K
K
koskanalya2020-11-28 23:25:26
Parsing
koskanalya, 2020-11-28 23:25:26

How to copy certain pages of a site?

Hello, I need to download a list of specific site pages by id. For example site.ru/?id=1 - site.ru/?id=4000, but downloading the entire site is not an option there are more than a million pages .... How can you save only certain pages by mask? In software like HTTrack Website Copier, there is no separate download function ... Maybe there is something else?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
S
SagePtr, 2020-11-29
@SagePtr

In bash or zsh:wget https://example.com/?id={1..4000}

M
Maxim, 2020-11-29
@max_shane

Read about web scraping with Node.js + Puppeteer

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question