Answer the question
In order to leave comments, you need to log in
How to download a large number of files from different URLs?
Hello,
There are about 100,000 image links (separate URLs on different domains) to download.
I tried to throw a list of URLs in Flashget, Download Master - they hang.
The option to split the list into several parts is not suitable, since then there will be more URLs.
Also:
- some URLs are not valid
- download files have the same name (image.jpg)
- Need to know which image was downloaded from which URL, keep some kind of log
Available Window 7/ CentOS
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question