G
G
guerrrka2019-11-02 14:35:25
Chromium
guerrrka, 2019-11-02 14:35:25

How to use different proxies for each puppeteer cluster page?

How to use different proxies (http/https) for each page (or task)?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
A
astronotius, 2020-04-06
@astronotius

Use proxy-chain
The essence is simple.
For puppeteer you use your local proxy server: '--proxy-server=localhost:8000'
And this local proxy server sends requests from each page to a random (or in turn) taken from the proxy array.
upstreamProxyUrl: 'http://'+random_proxy.
If you need to use several puppeteers in parallel, then the bundle has shown itself well: puppeteer-cluster and proxy-chain
On an average server, we process up to 200 pages simultaneously through different proxies.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question