How to copy a piece of content from a website using nodejs?

Question

Node.js

There is an online store in which you need to copy the description of the goods and some attributes (not all!). What is the name of such a process? And where should I dig further to implement my plan on nodejs?

Answer 1

This content tybzing is called, but culturally, in a bourgeois style, krawling . This can be done using HTTP requests with the native node library http , or using the npm library request . The resulting pages need to be parsed and saved in the required format in the database. For parsing, either regular expressions or a library like cheerio are suitable. If these are products with a clear structure, then it is more logical to use PostgreSQL , and if the products are very different, then you can write them to the document base with an arbitrary set of fields, for example, in MongoDB .

Answer 2

It's called " parsing "
Google for "nodejs site scraper", "nodejs site scraper", "nodejs site scraper"

Answer 3

Also good is CasperJS