Answer the question
In order to leave comments, you need to log in
How to parse content loaded dynamically?
Hello!
There is one site. It has a button that calls a modal window and it loads some information into itself. When you click on a link with this event through the browser, the site opens and a modal window opens automatically.
But when parsing to php through simple_html_dom and nokogiri, I can get a page without this window. On python'e through requests the same story.
The question is whether there is a tool that would parse loading elements. Thanks
Answer the question
In order to leave comments, you need to log in
Selenium or any other web driver that executes Javascript. Well, or track where the data is requested from and pull it out with a separate request.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question