B
B
beginer1232016-09-03 18:47:30
Python
beginer123, 2016-09-03 18:47:30

Will Python scrapy work?

Hello, due to the lack of time to study the subtleties of scrapy, I would like to ask knowledgeable people
Is Scrapy suitable if
1) I need to simulate the browser, by analogy with phantomjs, is there the same?
2) You need to download hundreds of thousands of urls and do it in parallel with different ip and as quickly as possible

Answer the question

In order to leave comments, you need to log in

2 answer(s)
S
sim3x, 2016-09-03
@sim3x

1 Fully semimit fail
2 Yes

D
Dimonchik, 2016-09-03
@dimonchik2013

hundreds of thousands of cows Scrapy robs badly, in my opinion socks still does not support

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question