What is the point of the Scrapy framework?

Question

Python

Never used this framework. What is its meaning. I read several reviews, but did not understand what its advantage is and what it is for (there are no intelligible articles). There are requests and BS4 (for example). With the help of the first - we get the page, with the help of the second - we parse this page. What does Scrapy do?

Answer 1

Automation of the parsing process. Instead of writing the logic of multithreading, navigating through pages, processing / storing data, and so on, you can use Scrapy, which does it all out of the box.