V
V
Vova2022-04-13 20:14:22
Python
Vova, 2022-04-13 20:14:22

How to bypass the blocking for a lot of actions with a proxy?

Good day, I am writing a site parser, but I ran into the problem that I get a block for behaving like a bot, I decided to use a proxy like this:

https proxy (I go to https) I tried http proxy (I went to http link)

from selenium import webdriver
from selenium.webdriver.chrome.options import Options

PROXY = "1.0.0.0:8080" 
chrome_options = webdriver.ChromeOptions()
chrome_options.add_argument('--proxy-server=%s' % PROXY)
chrome = webdriver.Chrome(options=chrome_options)
chrome.get(mainUrl)


and
socks5 proxy
options = Options()
options.add_argument(f'--proxy-server=socks5://' + proxy)
chrome_options = webdriver.ChromeOptions()
chrome = webdriver.Chrome(options=chrome_options)
chrome .get(mainUrl)


but I get

failed to verify recaptcha - 116

Your activity is making our system think you're a bot.
Try to avoid opening this page in incognito mode or making repetitive actions.


Do I understand correctly that proxies are needed to avoid this?
Unfortunately due to js it is necessary to parse in an open browser window. Tried running incognito. Does not help. Proxies are paid.

Maybe I'm doing it wrong or I don't quite understand what proxies are for.

How to use a proxy correctly?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
A
AUser0, 2022-04-14
@AUser0

It is obvious that the site being scanned is protected from a large number of requests (that is, from scanning). And this protection with the help of ReCaptcha offers to confirm your "humanity".
So analyze the content of the page with an error (or the previous one),
somewhere there should be a ReCaptcha form that needs to be filled out correctly and sent to the right place.
And then access should appear.
PS And proxies were invented to speed up (not to drive data from a beautiful, far away) and control (allow-not allow) access to the Internet.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question