V
V
Vlad_beg2019-08-01 07:50:21
Python
Vlad_beg, 2019-08-01 07:50:21

How can I navigate to the next page when parsing JSON?

The site has 100 pages that need to be parsed. On the site itself, I can specify a specific page
https://shopee.sg/search?keyword=hdmi&page=0&sortB...
in the URL parameters &page=5. I can't view more than 100 products per page
https://shopee.sg/api/v2/search_items/?&keyword=hd...
Tell me how to parse all pages?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
D
Developer, 2019-08-01
@Vlad_beg

Are you passing cookies? Have you installed all the headers?
UPD:
This is how it returns different products:
https://shopee.sg/api/v2/search_items/?by=relevanc...
https://shopee.sg/api/v2/search_items/?by=relevanc...
https://shopee.sg/api/v2/search_items/?by=relevanc...
You must additionally pass the newest parameter, offset
newest = limit * page

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question