D
D
Daniel2020-08-06 23:08:06
Parsing
Daniel, 2020-08-06 23:08:06

How to parse content loaded dynamically?

Hello!
There is one site. It has a button that calls a modal window and it loads some information into itself. When you click on a link with this event through the browser, the site opens and a modal window opens automatically.
But when parsing to php through simple_html_dom and nokogiri, I can get a page without this window. On python'e through requests the same story.
The question is whether there is a tool that would parse loading elements. Thanks

Answer the question

In order to leave comments, you need to log in

1 answer(s)
T
ThunderCat, 2020-08-06
@daniil46

Selenium or any other web driver that executes Javascript. Well, or track where the data is requested from and pull it out with a separate request.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question