How to quickly transfer 100 GB between two PCs in different countries?

Question

Data transfer

It is necessary to transfer more than 100GB of information from the server (Debian) to the client (MacBook) at the highest possible speed
.
The download is about 600kb/s - 1.7MB/s
SpeedTest from my ISP to the server provider (OVH) and also from OVH to my ISP in the aisles of 87-95Mb/s.
I also took measurements using iperf3 , here the picture is sad , using TCP , the average speed is 8 Mbps, the ceiling is 14 Mbps
But when using the -u (UDP) key, the speed is from 88 to 101 Mbps
On the deluge server, on the uTorrent client -> Is it possible to make them work on the UDP protocol?
And are there any other options to transfer such a large volume without damage via UDP?

Answer 1

https://www.resilio.com/
Totally surpassed 6TB
Survives the entire 200mb / s channel between a computer in Russia and a server in the USA
Uses UDP

Answer 2

syncthing

Answer 3

Suggestions:
use uTorrent on both sides;
check if there are any speed limits in the settings of torrent clients.

uTorrent -> Is it possible to make them work on UDP protocol?

µTorrent is moving to UDP protocol .

Answer 4

I use NFS on the server because it's convenient and fast enough. If you need faster and incremental, then rsync -z ( -z compression flag). So you will already run into the speed of the disks. If you need even faster (for example, you have an SSD in a raid), then netcat ( nc ) with compression is faster, in my opinion there is nothing
On the macbook in the target directory
$ nс -l 4444 | tar xzvf -
(4444 is a port, can be anything. Ports less than 1000, root directories and nc in general may require sudo )
On a Debian server in the source directory
$ tar -czf - * | netcat -N address.macbook.domainname.orIP 4444
If you really like UDP, add the -u flag to the nc commands Why I don’t understand the protocol in a point-to-point bittorrent connection. In my experience, even with traditional rsync , you'll hit the disk subsystem sooner. But with rsync you get a lot of options, fast incremental synchronization of small changes for example, and the accumulated experience of tutorials, guides and manuals.

Answer 5

www.rejetto.com/hfs

Answer 6

In the order of delirium, you can put nginx on the docker, which will give the necessary files, and in front of it QUIC reverse proxy , download on Mac via Chrome. If interested, I can throw a config.

Answer 7

If the keyword is "quickly", then with your MacBook on an airplane, fly to the data center and copy everything over a direct connection there. You can also google "Amazon Snowmobile".
If the keyword is "simple", then use the usual console sftp client.

Answer 8

use an open tracker server and everything will not be so sad