How to transfer a lot (a lot) of data between two machines on the internet?

AlexanderG2012-08-07 02:49:09

Computer networks

AlexanderG, 2012-08-07 02:49:09

Inspired by a question .

Recently there was a need to transfer a large amount of data (115GB, but this is not the limit) between two machines. Both have gray addresses and go through PPPoE. We tried several different methods, but nothing sane happened and, most likely, you will have to carry the disk personally.

What we tried:
-Torrents (magnet and the file itself). Didn't take off, obviously, because of gray addresses and PPP.
-Hamachi. NetBios, FTP in virtual network. Very low speed (<200kB/s).
-Opera Unite. Also low speed.

At the same time, the channels on both machines are acceptable, with a return of ~ 10 Mbit / s. There is no way to upload to any free hosting, there is too much data, and it makes no sense to rent for the sake of a single transfer).

Are there any ways to solve the problem?

Answer the question

In order to leave comments, you need to log in

20 answer(s)

Evgeny Bezymyannikov, 2012-08-07
@psman

I can allocate space on the server and issue ftp acc. if still relevant.

SerDIDG, 2012-08-07
@SerDIDG

Is there a way to split the data? You can transfer parts using dropbox and similar services.
In general, rent a white IP on the wheelbarrow from which you need to download data, it's not expensive, then it will be possible, as mentioned above, to raise a web server.

andreysmind, 2012-08-07
@andreysmind

hard disk with data, send by courier.

Semyon Dubina, 2012-08-07
@sam002

Exactly, take VDS! Almost everywhere there are a couple of days of testing ... You will have time to transfer 115 GB. With an external ip, there are already quite a few options.

agmt, 2012-08-07
@agmt

Torrents (magnet and the file itself). Didn't take off, obviously, because of gray addresses and PPP.

Did you use the latest uTorrent? Was uTP allowed (bt.transp_disposition=31)? He is rumored to be able to UDP Hole Punching. However, if Hamachi failed to make a fast connection, then things are bad.
PS It's a pity that my favorite article on this topic was removed from Habr. You can find it like this: gliffer.ru/articles/setevie-tehnologii--iz-pesochnitsi-prostoy-nat-traversal-na-osnove-openvpn-i-koe-chto-eshchyo-chast-1/ , and habrahabr used to sit here . en/post/131873/ .

Mikhail Lyalin, 2012-08-07
@mr_jok

host02.pipebytes.com/
livebusiness.ru/news/4522
pando.com/

Nazar Mokrinsky, 2012-08-07
@nazarpc

And if you raise a web server on one machine and pull it off via wget on another?

Ilya Plotnikov, 2012-08-07
@ilyaplot

I wanted to suggest a remote file system, but here you can’t do without a third one, and this will slow down quite well.
Try some hosting that allows you to create a VPN server, and then connect from two machines. I think it will be faster than Hamachi at times.

bad_guy, 2012-08-07
@bad_guy

Transfer "directly", without downloading to the server itself - jetbytes.com/
Well, or for example - selectel.ru/services/cloud-storage/

Seekeer, 2012-08-07
@Seekeer

I would do this: I would score 4.8 gigs per archive, and upload it through Ya.Disk. While the first archive is being downloaded by one machine, the second is already uploading the next one. There will be some delay compared to direct transmission, but I don't think it's critical.

a3x, 2012-08-07
@a3x

crashplan - allows you to synchronize data between machines, bypassing their cloud

AlexTest, 2012-08-08
@AlexTest

1. Archive the data in some quick way and break it into parts of about a gigabyte.
2. Take a cheap one for 1-2 bucks, or a free test VPN like this hideme.ru/vpn/ for one day, connect the computer from which you need to collect data to this VPN.
3. On this computer, run any suitable file-sharing service (http, ftp, etc., etc.).
4. Map the port of this service to your real external VPN IP address.
5. Connect to this "address: port" with the corresponding "give" client from the second computer.
6. Take half of the files.
7. Repeat steps 2-6 again, because. with 10 megabits for upload minus control traffic, it will take you about two days to transfer 115 gigabytes.

Sergey Lerg, 2012-08-07
@Lerg

That is, no torrents work at all on machines for distribution?
And so without a third party can not do. If you transfer via Skype, what speed is obtained?

Antelle, 2012-08-07
@Antelle

I would use either TeamViewer File Transfer mode or CC File Transfer .
Well, or you can use Dropbox, 100 gigs is not enough.

Valery Osipov, 2012-08-07
@Namolem

1gb.ru
hosting with a week to "try". Should be enough

atreen, 2012-08-07
@atreen

If you are afraid of hosting, and ftp / web is not an option, then you can do it via icq / skype.

betony, 2012-08-07
@betony

Maybe via Skype?

agmt, 2012-08-07
@agmt

Something led me even deeper into the theory, but still. And if you use some analogue of torrents, only with additional encryption, so that the file is transferred to a certain list of people (in this particular task, 1 person), and for all the others involved in the transfer (peers with a white IP), the data would not even be saved to disk ( received - sent to all those who were thirsty and deleted from RAM).
In short, the transfer of an encrypted archive via torrents, only with a small consumption of ROM, both from the transmitters (no need for an encrypted copy) and intermediaries (nothing needed at all).

Zharskiy, 2012-08-08
@Zharskiy

I recommend iFolder via torrent the fastest - they are now rusfolder.com - there you can download the torrent client
on some other file hosting services (Yandex.People.Disk for example) the link to the file lives up to 3 days, i.e. it can also be added to the torrent client
, etc.
those. download and upload in portions, torrent with 2..3 (at least) sources
there is also such an extravagant method as usenet (binary newsgroups) - there the speed can be unlimited, use newspost

Alexander Tugov, 2012-08-11
@fortyseven

If both PCs are under Windows, then try synchronizing files via Windows Live Mesh. You can create a bunch of 20GB folders for synchronization, the data itself is transferred directly between PCs, without intermediate servers, i.e. as quickly as possible.