How to get all the price data in steam?

Question

Python

I need to get the names and prices of all items in steam. Ideally, I would like to create my own database that I will update several times a day.
But, when I want to parse more than 2 pages, strange things happen. On different pages exactly the same items appear, although if you follow the link, the items will differ. I am programming in python. Tell me how this can be fixed?
Full code on github - https://github.com/rassadin11/steam/blob/main/index.py

Answer 1

Because the elements are loaded by an additional request. Making a request for

https://steamcommunity.com/market/search/render/?query=&start=10&count=10&search_descriptions=0&sort_column=popular&sort_dir=desc&appid=730&category_730_ItemSet%5B%5D=any&category_730_ProPlayer%5B%5D=any&category_730_StickerCapsule%5B%5D=any&category_730_TournamentTeam%5B%5D=any&category_730_Weapon%5B%5D=any&category_730_Exterior%5B%5D=tag_WearCategory0&category_730_Quality%5B%5D=tag_normal&norender=1

and get what you need. All get parameters are basically clear