Download 30 GB files from VPS, as fast as possible, please. multithreaded

H

hostovik2020-09-22 09:24:08

linux

hostovik, 2020-09-22 09:24:08

Download 30 GB files from VPS, as fast as possible, please. multithreaded - what is possible?

On vps there are 10 files of 3 GB.
The data is such that it is extremely poorly compressed.
The data is not of particular value - you can download it "without encryption".
The channels of vps and mine are fast, but the data will be updated frequently, they will often have to be downloaded and quickly analyzed - therefore, every minute won is important

. What is the best way to do this?

Reply

Answer the question

In order to leave comments, you need to log in

5 answer(s)

#

# ., 2020-09-22
@hostovik

rclone

P

pfg21, 2020-09-22
@pfg21

syncthing is already answered.

C

CityCat4, 2020-09-22
@CityCat4

If the update time of one file is less than the time of its download, it makes no sense to download it, it has already changed during the download process and it will turn out to be a mess.
(well, that is, if the file changes faster than you have time to download it)

V

Volodymyr Palamar, 2020-09-22
@GORNOSTAY25

axel -a -n 9 url:// -o file.zip

V

Viktor T2, 2020-09-22
@Viktor_T2

rclone