Answer the question
In order to leave comments, you need to log in
How to parse information on one site and save the file?
Hello everyone)
I actually work as a content manager in a fairly large company. Sometimes there is a lot of work for me alone, in order to improve my knowledge in programming, I want to somehow automate this process :)
I know HTML + CSS and have an average knowledge of JS, I am familiar with NodeJS and Python.
Answer the question
In order to leave comments, you need to log in
Python.
Where and how to write data is the third thing. You can always create a language structure with the data you need (a class, or just a dictionary), and then save it in one format or another, even in csv, even in the database.
I don't care what language. Almost any language that is used on the web has a set of libraries for downloading and parsing a page. Grab whatever you like and go.
You ask strange questions
- some sites can be parsed with a single-line perl script, others need heavy phantom or nightmare because of scripts and ajax.
- in one case, for example, the name and prices are parsed, which can be put in csv, in another there is so much data that it is easier to immediately in the database, and in the third huge articles with pictures for which csv is not particularly suitable
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question