D
D
dmitred2017-01-07 16:11:32
JavaScript
dmitred, 2017-01-07 16:11:32

Is it possible to do multithreading through a proxy in js phantom?

Good afternoon, tell me about a lot of threading in js phantom.
The task is this:

  1. Authorization on the site by login password
  2. Going to a page, scrolling and passing this page to a php script.
For one process, everything is clear, sort of figured it out.
It takes 4.5-5 seconds.
But the task is to receive information from 70-80 requests in these 5 seconds.
Authorization from about 50-150 accounts (randomly) and it would be possible to have a solution with the participation of a proxy.
Is this at least in theory real?))) And where to dig, what to read? didn't find anything. I've been google for a week now((
Any help would be appreciated!

Answer the question

In order to leave comments, you need to log in

3 answer(s)
A
Anton L, 2017-01-07
@dmitred

It is possible and there is no magic in it. It is not necessary to bind to the phantom in your case (it has some problems, for example, with closing alerts), use any other web driver for selenium. Working through a proxy and replacing headers, as well as filtering traffic passing through the web driver is possible via https://github.com/antonecma/browsermob-proxy-clie... , which I wrote for these purposes. That is, you need to dig towards Google with the following requests: Selenium, chromewebdrive, browsermob proxy, well, you can look at webdriverio.

A
Alexander Aksentiev, 2017-01-07
@Sanasol

In theory, yes.
In practice, to run 70-80 phantoms, you need to have a virtual machine for each.
Phantom does not work in several "windows"

A
Alexey Sundukov, 2017-01-12
@alekciy

Run multiple PhantomJS from the console with different proxy and webdriver settings.
Headless browser is fast and stable. Maybe?

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question