Answer the question
In order to leave comments, you need to log in
Proxy problem?
Faced the following problem
There is a list of proxy
script that randomly takes a proxy from the list and parses the url I need
Very often I can’t parse the page I need through the proxy and an exception pops up
I catch the exception and re-patch the page through another proxy
There are 2 problems
1) Without a proxy everything happens very quickly, Everything slows down through a proxy once every 20
2) Only 1/3 of the pages are parsed, the rest are not for some reason (although I parse in the while loop until the page is successfully downloaded)
Am I doing the multiproxed parsing correctly at all? someone has examples of how to do it (I use python, but any other language is also suitable)
On the Internet, usually simple examples come across that clearly do not take into account my problems.
Answer the question
In order to leave comments, you need to log in
Hello, I also recently encountered a problem that through some proxies it is impossible to get anything at all, even if the site has no protection. The problem is not only with free services, but also with paid ones. Later I came across the same problem on a toaster and the answers are very interesting How to properly implement cURL with a proxy?
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question