A
A
Andrew92052019-07-10 00:23:48
linux
Andrew9205, 2019-07-10 00:23:48

[wget] How to fully download a site?

Hello everyone,
I'm trying to use wget to download one site that downloads all resources (img, css, js) from its CDN domain.
Used a lot of keys, but in the end it downloads only index or thousands of junk files
Ps I use wget on Linux

Answer the question

In order to leave comments, you need to log in

2 answer(s)
C
CityCat4, 2019-07-10
@CityCat4

Perhaps not. Today's websites are not just a dozen pages of html and a couple of CSS files :)

U
uvelichitel, 2019-07-10
@uvelichitel

For wget keys --recursive --level=3 --referer=http//:Your.Target.Index --save-headers tried?
There are specialized bugs besides wget - google 'web crawler', 'web spider', lots of them.
As correctly noted in the comment to the question, parsing a modern, obfuscated site is a whole science.))

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question