Answer the question
In order to leave comments, you need to log in
How to parse a node js website?
Actually, I wanted to learn how to parse sites and tried simple sites with them, no problems arose.
As I understand it, the data is loaded there dynamically via websocket
How to parse?)
Answer the question
In order to leave comments, you need to log in
Connect to a websocket and collect data, for this you need any websocket client and dig the site a little to understand what requests to send.
No browsers are needed for this as they say.
For the complex, there is a special service apify.com, here you can find a million examples https://apify.com/store?type=acts in short, is it possible to use the built-in pupetter service or throw your dockerfile and collect data from sites in several streams .
In your case, most likely it’s enough just to open the dev tools from the browser, pull out the url and data for connecting to the sockets from there, play around with the data being sent, and you can pull what you need without a browser.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question