Answer the question
In order to leave comments, you need to log in
[wget] How to fully download a site?
Hello everyone,
I'm trying to use wget to download one site that downloads all resources (img, css, js) from its CDN domain.
Used a lot of keys, but in the end it downloads only index or thousands of junk files
Ps I use wget on Linux
Answer the question
In order to leave comments, you need to log in
Perhaps not. Today's websites are not just a dozen pages of html and a couple of CSS files :)
For wget keys --recursive --level=3 --referer=http//:Your.Target.Index --save-headers tried?
There are specialized bugs besides wget - google 'web crawler', 'web spider', lots of them.
As correctly noted in the comment to the question, parsing a modern, obfuscated site is a whole science.))
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question