Answer the question
In order to leave comments, you need to log in
How to write a parser for SPA?
Good evening.
How to write a web scraper for a dynamic site?
There are static sites in which a ready-made template is loaded in html. Of course, scraping such a site is quite simple.
But how do you sail the SPA site?
The problem is that the content from the server is loaded later, after the main template is loaded. When you try to sail such a site, the template will be Rustam, since the scripts did not start.
Thank you very much in advance!
Answer the question
In order to leave comments, you need to log in
if you watch and parse ajax requests from the site, you will get the Stanislav template, and you can forget about Rustam.
And if you just need to load the site as it is and process everything for you, then you will have to take some kind of headless chrome to load with scripts and other things.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question