How to parse a site through a proxy?

Question

PHP

Hello!
I wrote an ad site parsing through Selenium (python), but unfortunately, when I connect through a purchased proxy, it says: "We detected suspicious traffic coming from your network." What are the mechanisms to circumvent this situation? Essentially, I will need to implement a parser with > 5000 requests per day. How many proxies do I need, and what should I do?

Answer 1

Cron or any other scheduler available on the system.

Answer 2

I proxy requests through TOR, no hemorrhoids with buying a proxy and other things, I have parsed more than 2 million pages without any cuts at all. I'll put it on github a little later, you can take it for yourself as an example

Answer 3

mobile proxies
true proxies
are just another proxy
, for example, free and a lot
of it, secondly
, and anonymization methods, firstly

Answer 4

And what VPN don't want to try. For example, Windscribe is not so slow even in the free version (2 GB limit per month). For an annual subscription of $49, unlimited.