Answer the question
In order to leave comments, you need to log in
How to bypass the blocking for a lot of actions with a proxy?
Good day, I am writing a site parser, but I ran into the problem that I get a block for behaving like a bot, I decided to use a proxy like this:
https proxy (I go to https) I tried http proxy (I went to http link)
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
PROXY = "1.0.0.0:8080"
chrome_options = webdriver.ChromeOptions()
chrome_options.add_argument('--proxy-server=%s' % PROXY)
chrome = webdriver.Chrome(options=chrome_options)
chrome.get(mainUrl)
options = Options()
options.add_argument(f'--proxy-server=socks5://' + proxy)
chrome_options = webdriver.ChromeOptions()
chrome = webdriver.Chrome(options=chrome_options)
chrome .get(mainUrl)
failed to verify recaptcha - 116
Your activity is making our system think you're a bot.
Try to avoid opening this page in incognito mode or making repetitive actions.
Answer the question
In order to leave comments, you need to log in
It is obvious that the site being scanned is protected from a large number of requests (that is, from scanning). And this protection with the help of ReCaptcha offers to confirm your "humanity".
So analyze the content of the page with an error (or the previous one),
somewhere there should be a ReCaptcha form that needs to be filled out correctly and sent to the right place.
And then access should appear.
PS And proxies were invented to speed up (not to drive data from a beautiful, far away) and control (allow-not allow) access to the Internet.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question