Discounted items parser in dns-shop?

F

Firsim2018-07-20 22:42:23

JSON

Firsim, 2018-07-20 22:42:23

I think I’m voicing my question in the right place ..
In general, I thought to parse the information a little from the page: https://www.dns-shop.ru/catalog/markdown/
But it turned out that initially there are only 20 products, and in order to load more products, you need to send a request to the page

https://www.dns-shop.ru/catalogMarkdown/category/update/

, and the answer is the next n items. But I just can’t figure out what request needs to be formed so that the page gives an answer? Can anyone suggest? Thank you.
PS the city is not important, it is transmitted with the help of a cookie ..

Reply

Answer the question

In order to leave comments, you need to log in

2 answer(s)

I

Ilya, 2018-07-21
@Firsim

What language do you write the parser in? If you need the stability of the result and the absence of further problems when changing fields and protections, then you can use Selenium. Load the page, collect the data, press the next button - and so on according to the schedule.
Otherwise, take the advice of Evgen 's advice and implement the reading and transmission of the CSRF token.

E

Evgen, 2018-07-21
@Verz1Lka

https://www.dns-shop.ru/catalogMarkdown/category/u...
using headers like X-CSRF-Token & X-Requested-With: XMLHttpRequest