V
V
Vitaly Pukhov2015-04-17 08:02:58
linux
Vitaly Pukhov, 2015-04-17 08:02:58

Is the WGet command correct?

When I asked a question about the boot manager in linux, every second one said that wget drives and everything else is not needed, I decided to try to solve my problem using wget, but I'm not sure that I correctly composed the command:

wget -i I -P 8 --force-directories --continue -nc -t inf --waitretry=1 --progress=bar

The URL in the list will look like
blablabla.com/blabla/Folder1/01.zip
https://blablabla.com/blabla/Folder1/02.zip
https://blablabla.com/blabla/Folder2/01.zip
blablabla.com/blabla/Folder2/01 .zip

The requirements for the script were such that it passed the following requirements:
  • the download list is 10-20 files in a separate folder,
  • there can be more than 10 such folders,
  • in wget you need to somehow feed the list of files, with all the folders
  • Some of the files may have already been uploaded, they do not need to be uploaded again.
  • at the same time, so that he can download, say, 5 files at the same time,
  • but with 8 threads per file,
  • at the same time, such a script can be executed, say, for a week
  • and during this time a power outage can stop him a couple of times
  • and a dozen more times I myself have to suspend it when I need the entire Internet channel.

The question is, does the team I have compiled meet all these requirements?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
A
AVKor, 2015-04-17
@Neuroware

In short, it's wrong.
For more details, see man wget.
There is a suspicion that instead of reading the documentation there was a googling raid, moreover, misunderstood (the -P option does not at all what you think).

M
monah_tuk, 2015-04-17
@monah_tuk

I robbed websites with httrack

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question