How to make a sitemap using wget?

Question

linux

I know that it seems like you can download sites (he can extract links from downloaded files). I would like to know how to do it. Or at least get a list of all the files and directories there. Do you know how find works? Stupidly displays a list of all files with full paths to them (this is if without arguments). Something like this I would like

Answer 1

We look at recursive queries and insert the necessary options

Answer 2

There is a special parameter '-r' for this. Here is a simple example of how it works:

ph@laptop ~ $ cd /tmp/

ph@laptop /tmp $ wget -r malyg.in

ph@laptop /tmp $ find malyg.in/
malyg.in/
malyg.in/tag
malyg.in/tag/uefi
malyg.in/tag/bluetooth
malyg.in/tag/manual
malyg.in/tag/linux
malyg.in/novus-exertus
malyg.in/perekhod-na-ispolzovanie-uefi-v-gnu-linux
malyg.in/bluetooth-i-blokirovka-ekrana-v-gnu-linux
malyg.in/feed.xml
malyg.in/robots.txt
malyg.in/index.html

To limit the "depth" of walking on links, you must use the '-l' parameter.
A complete list of parameters can be found here - opennet.ru/man.shtml?topic=wget&category=1&russian=0