What libraries to use to collect data from sites?

Question

Python

There is an idea to create a script that collects data from sites (mainly statistical indicators) for further use in plotting.
What tools and libraries should I use for this? I plan to write in Python.
UPD: Project for personal development :)

Answer 1

1) The coolest scrapy
2) For lovers of css query https://lxml.de/cssselect.html
3) Still quite powerful beautifulsoup

Answer 2

Python + requests + beatysoup = in one thread can hack about 10,000 pages in 15-20 minutes.
If you directly need automation, flows, and so on, then already scrappy

Answer 3

In most cases urllib+lxml. Another grab is an interesting thing.