How to record responses to many links?

Question

JSON

Good day!

There are many links like:
https://steamcommunity.com/market/search/render/?q...
https://steamcommunity.com/market/search/render/?q...
https://steamcommunity.com /market/search/render/?q...
etc.

Traversing a link returns a response,
{
success: true,
start: 0,
pagesize: 100,
total_count: 166595,
results_html: " <Long html code with a list of items>"
}

Is there a way to go through all these links and store the result in a single file (possible even without preliminary parsing)?

Answer 1

do you have a backend (node, ruby, php)? To write everything to a file, you need to give an answer there (on the backend), and there, depending on the language, write it to a file

Answer 2

Use HTA. Same as HTML, only allows you to save text files on the local machine. The sequence is as follows: make an HTML page with jquery / angular, On the page, launch all requests for your links via ajax, after assembling all the responses, summarize them and write them to a text file. Bonus - no need to write a back end.
It is possible even without HTA if done on Windows Scripting Host , but here you have to tinker with Ajax: stackoverflow.com/questions/13689871/how-do-i-use-...
You can experiment with nw.js: nwjs.io
You can also use C# + CefSharp (WebBrowser class is very weak with the old version of IE, I strongly DO NOT recommend it), but this is when you need to seriously process the result, for example, I loaded a set of pictures from a site where the pictures were like CSS background and stitched them automatically into PDFs, for which I connected iText via NuGet. If you recently asked the question of downloading data from the steam site, then you can very well write a good spider with this tool to process steam data in C # when viewing an online page.

Answer 3

Is there a way to go through all these links and save the result into a single file (even without parsing)?

An incoherent stream of consciousness.
What's so terrible about it? json and html? Take it and understand.
google -> "json\html + favorite programming language"