A
A
Alexey2018-06-16 13:49:35
Parsing
Alexey, 2018-06-16 13:49:35

What tools to use to write a site parser with JS protection?

There is a site. the data on it is displayed in the form of a table after a simple GET or POST request.
But if I request this site via curl, instead of content, there is something like an encrypted / obfuscated function in JS .
In the browser, the code naturally executes, reloads the page, and the site works.
What tools are better to use for parsing such sites?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
E
Evgen, 2018-06-16
@Verz1Lka

Well, look where the request is sent, and emulate it.
if you want everything at once - use selenium c chrome headless or splash from scrapinghub

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question