S
S
sergof2017-05-03 09:51:54
proxy
sergof, 2017-05-03 09:51:54

Where can I get a proxy pool for 5000+ addresses?

Good afternoon my friends!
There was a task to organize scraping for the SEO department. Necessarily anonymous (well, how could it be without it, right?).
It is necessary to make thousands of requests (or rather, hundreds of thousands per day), so the pool of adequate proxies needs to be at least 5000 (and preferably 10000) deep.
I will immediately define what "adequate proxy" means:
a. public
b. alive, i.e. The request passes to the target address without error and timeout
. anonymous (not necessarily elite), checked separately via ping.eu or a similar service
At the moment I take proxy lists from aggregators like:
proxyserverlist-24.blogspot.com
freeproxylists.net
free-proxy-list.net
The fact that you need to copy sheets daily with your hands is not a big problem compared to the total.
Much worse is that if I collect 30,000 - 40,000 proxy addresses per day, then after checking for adequacy (public-live-anonymous), only 300 - 500 of them remain.
This is not enough, proxies go to the ban after a few dozen scrolls.
I tried the same lists from paid subscriptions, but as expected, the same pool, only for 20 foreign money per month.
If you pull sheets from other aggregators (paid or free, it doesn’t matter), then even if there are at least half a million of them (checked), the same 300 - 500 still pass the test.
Who successfully solved a similar problem, please give advice or share links to useful resources. The goal is several thousand public live anonymous proxy addresses.
Thanks please!

Answer the question

In order to leave comments, you need to log in

7 answer(s)
D
Dimonchik, 2017-05-03
@dimonchik2013

you can’t get more than 1k public ones,
see gray forums, you can dial up to 2-3 there, and there are also sellers of live, but not public
proxies for Google have their own nuances

P
Philipp, 2017-05-03
@zoonman

Check out this shader.io service

Z
Zhandos M, 2017-05-03
@Zhandos

Good database coolproxies.com

M
mitaichik, 2017-05-04
@mitaichik

You can use tor. There, it needs to be slightly finished in the source code so that it changes the chains more often (you can put it out of the box at least once every 10 seconds).
Another interesting variant is to work through IPv6 - their addresses can be bought for 1 ruble, unless of course they can be used for your purpose.

Z
zorruch, 2017-05-22
@zorruch

awmproxy.com

P
Pythonisto, 2021-04-25
@Pythonisto

try this: https://proximy.io/

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question