D
D
Dmitry2017-05-15 17:34:34
Python
Dmitry, 2017-05-15 17:34:34

Which is better for parsing Selenium(ChromeDriver) + BeautifulSoup or Scrappy?

I have a site that when using only BeautifulSoup produces one html-ku. If the same site is opened directly in the Chrome browser, then the page is already in the form of another html-ki.
In this situation, I want to understand what is better to use either:
1. Selenenium -> ChromeDriver -> BeautifulSoup and put up with the fact that the browser opens for a long time
2. Or Scrappy
?
UPD:
One of the pluses for Scrappy is the ability to use XPATH

Answer the question

In order to leave comments, you need to log in

3 answer(s)
Q
qlkvg, 2017-05-16
@qlkvg

Only requests, only hardcore.

D
Dimonchik, 2017-05-15
@dimonchik2013

Scrapy when without JS (although they have options with ), Selenium when everything else, Scrapy is better

E
Evgen, 2017-05-17
@Verz1Lka

Scrapy definitely, great speed, customization.
90% of JS requests can be emulated in Scrapy.
If absolutely severe protection - you can bind splash to it.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question