F
F
Folsout2019-07-01 02:33:03
Android
Folsout, 2019-07-01 02:33:03

How to parse sites that load on scroll?

Hello, I'm trying to parse Yandex.Images for a specific request using JSOUP. Everything seems to be fine, but only the first 30 pictures are loaded, how to implement loading on scroll?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
D
Dmitry Baskakov, 2019-07-01
@followout

You can use the chrome inspector.
You need to open the inspector, go to the network tab, select xhr, scroll to download and see where and what request goes. Then you can copy the request, changing the data inside, to get this or that page with the same pictures

D
dollar, 2019-07-01
@dollar

I think it's better to switch from JSOUP to pure chrome.
Less chance of something breaking.
And it’s easier to implement, you don’t need to dig into (obfuscated?) code, but just work with the DOM.
That is, you just make an extension for chrome (personal) - and it already parses the Yandex output in the tab, while scrolling the page to load new images.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question