Multi-threaded File transfer ~200Gb between 2 servers?

Question

linux

Have a good day everyone, I ran into trouble ... there are 2 servers physically distant from each other.
there is a backup file of the site weighing ~ 200 GB, I
download via wget the speed is at the level of 800 kilobytes per second, this is about 3 days of transferring
another 140 GB on the server where it is now free, that is, I can’t divide the file with the same 7z into parts and download as a bunch of files .
if I start downloading another file between these servers, the speed does not drop.
I tried aria2c -j 10 /
doesn't help much, the download speed is also displayed at the level of 800-900kb...
I was thinking about torrents, install 2 console torrent clients, create a torrent file on one, take it on the second...
but without a tracker, as I understand it, it will not work? - or I'm wrong. and uploading a site dump to a torrent is not very reasonable
, in general, options are needed, otherwise I will be hellishly long for 2.5-3 days,
thanks in advance

Answer 1

And what is the protocol? For http/ftp in aria2, a separate option (-x) is the number of connections to one server.

Answer 2

For multi-threaded downloads, you can try Axel . Another option is rsync.

Answer 3

It’s easiest to upload a torrent, put it on distribution on one server, don’t register trackers. On the other, add via magnet. The download starts, your backup will not float away.

Answer 4

What OS do you have on your PC? Linux too? Then feel free to set this on both computers in /etc/sysctl.conf:

net.ipv4.tcp_slow_start_after_idle = 0

net.core.rmem_max = 4096 87380 4194304
net.core.rmem_max = 4194304
net.ipv4.tcp_wmem = 4096 65536 4194304
net.core.wmem_max = 4194304

net.ipv4.tcp_keepalive_time = 300
net.ipv4.tcp_keepalive_intvl = 30
net.ipv4.tcp_keepalive_probes = 3

net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_retries2 = 5

net.ipv4.tcp_congestion_control = illinois

and then sudo sysctl -p
And bring up the http server like you seem to have done before and download through aria2 with these options:
aria2c --max-connection-per-server=12 --min-split-size=10M - s 12
You can also use some software with UDP, but I won't tell you much here.

Answer 5

Budget?
There is a system specifically designed for high-speed transfer of large files, used, for example, by filmmakers. Multi-threaded or not, I don’t know, it copes with its task. But it's not cheap.
asperasoft.com/

Answer 6

Try uploading via ssh

Answer 7

IMHO sometimes it's faster with a hard run