Scanning directories and site files

Question

Scanning

Hello. I need to crawl the site, i.e. its structure of files and folders, are there any similar utilities? Thank you.

Answer 1

Of course have. From what you can run yourself with your own hands: dirb , DirBuster , Sublist3r , dirsearch . There are not so many differences between them, the main thing is which dictionary to use for enumeration.
Of the online options, I can advise URL Fuzzer or METASCAN , they already have built-in dictionaries.

Answer 2

if you do not have access to the server - 99% no (or rather, only brute force)

Answer 3

Within the links on this site, you can get a good copy using the Teleport program or similar.

Answer 4

www.owasp.org/index.php/Category :OWASP_DirBuster_Project

Answer 5

physical folders and files on the server? in general, no. Because it's easy to close access to existing folders and files and make them virtual.
Virtual ones that make up the url structure - wget and the like.