K
K
kyzinatra2021-01-27 02:42:40
Parsing
kyzinatra, 2021-01-27 02:42:40

How to start parsing sites with authorization on nodejs?

Recently there was a task to parse a site with authorization. Tell me packages or guides for this case. I know that people somehow do it through request, but how exactly and whether it is suitable for all sites is not very clear.
Before that, I wrote parsers only on cherryio and without authorization. I would like to parse exactly on nodejs\ts-node

Answer the question

In order to leave comments, you need to log in

2 answer(s)
V
Vladislav, 2021-01-27
@kyzinatra

This lib supports browsers such as: Chrome, Firefox, IE, Edge, Opera, Safari
https://www.npmjs.com/package/selenium-webdriver
Facebook creators. I have a bunch of parsers on selenium

D
Daniil Vasilyev, 2021-01-27
@hello_my_name_is_dany

Как вариант через бразуер парсить:
https://github.com/puppeteer/puppeteer
Там можете кликать на кнопки, сохранять куки, залезать в DOM и тд..

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question