M
M
Mouvdy2015-01-10 18:04:30
Software and Internet Services
Mouvdy, 2015-01-10 18:04:30

How to download a large number of files from different URLs?

Hello,
There are about 100,000 image links (separate URLs on different domains) to download.
I tried to throw a list of URLs in Flashget, Download Master - they hang.
The option to split the list into several parts is not suitable, since then there will be more URLs.
Also:
- some URLs are not valid
- download files have the same name (image.jpg)
- Need to know which image was downloaded from which URL, keep some kind of log
Available Window 7/ CentOS

Answer the question

In order to leave comments, you need to log in

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question