Web scraping - need advice?

S

sstquartz2015-10-15 08:41:43

Parsing

sstquartz, 2015-10-15 08:41:43

Does web scraping involve saving web links for offline viewing?
you want to upload pictures from the site, preserving the structure of the hierarchy of links converted into folders"
what do you need to do for this?
programs such as:
Offline Explorer
teleport vlx
winhtTrack
NeoDonloader
WebCopier
either save all pictures in one folder
or create a folder structure, but instead of pictures, it saves links for offline viewing
-
the volume of the site
is about 300 thousand links

Reply

Answer the question

In order to leave comments, you need to log in

1 answer(s)

D

Dimonchik, 2015-10-15
@dimonchik2013

wget will save a novice scraper, although not quickly - run several with different starting