Answer the question
In order to leave comments, you need to log in
How to start parsing sites with authorization on nodejs?
Recently there was a task to parse a site with authorization. Tell me packages or guides for this case. I know that people somehow do it through request, but how exactly and whether it is suitable for all sites is not very clear.
Before that, I wrote parsers only on cherryio and without authorization. I would like to parse exactly on nodejs\ts-node
Answer the question
In order to leave comments, you need to log in
This lib supports browsers such as: Chrome, Firefox, IE, Edge, Opera, Safari
https://www.npmjs.com/package/selenium-webdriver
Facebook creators. I have a bunch of parsers on selenium
Как вариант через бразуер парсить:
https://github.com/puppeteer/puppeteer
Там можете кликать на кнопки, сохранять куки, залезать в DOM и тд..
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question