How to deal with lazy loading when parsing a site?

S

Spoon in the brain2020-10-13 15:20:56

Parsing

Spoon in the brain, 2020-10-13 15:20:56

Hello!
The goal was to parse the product catalog , everything would be fine, but there is a lazy loading script, that is, it does not immediately display some products.
Tell me how to bypass this script and immediately parse the entire directory?

Reply

Answer the question

In order to leave comments, you need to log in

1 answer(s)

S

Sergey Karbivnichy, 2020-10-13
@vessels

F12. Next, we scroll and see that requests are sent to rn-sport.com.ua/category/tyazhelaya-atletika/?_=1602592184845&page=3
The page parameter is responsible for the page number. Total 25 pages: