How to build a local network with a bandwidth of more than 1Gbps?

Question

Iron

Is it possible to create a local network for 3 computers with a bandwidth of more than 1Gbps? If so, how and how much money should be spent on it?

Answer 1

Here they referred to my blog, I saw the statistics - and came.
The cheapest 10G network is 3 2-port infiniband cards and two cables. It cost me about $150 (cards for $23 + shipping, cables - something for $30, all from ebay). The most ambush is cables, they are good, but sometimes they are not.
Then we combine 3 machines, start up IP on this case (it's easy and simple) and the network works.
But your problem will most likely not be in the network, but in providing fast simultaneous access to the server's HDD (if there is an HDD with round plates, not an SSD). Those. personally, with the described scheme of work, I would do “download tasks to the local disk of the workstation” and work with the local (SSD?) disk.
Those. here, in my personal experience, two parallel backups, one over a 10G network (samba), the second over gigabit - a design of 5 slow HDDs (in ZFS) easily saturates and interferes with each other.

Answer 2

8-port managed switch. Two network cards per computer with aggregation. Formally, it will be “more than 1Gbit / s”, i.e. with a favorable arrangement of stars and multi-threaded transmission - as much as 2 GB / s.

Answer 3

Under Windows it is a dream. For Linux, there is a patch in the bonding mechanism, which allows you to use full-fledged bonding interfaces (that is, squeeze out 3 gbps per file via NFS, for example).
In general, under Windows there is bonding (there it is called teaming), but you will still download one file against one physical interface.
It makes sense to try to transfer files with torrents or aerofs. Torrents certainly easily hit any number of interfaces, aerofs should do the same on large files. On small ones, you just run into logic.
With storage — a dream. Samba generally doesn’t really know how to work with bonding, FTP almost doesn’t know how ... NFS - several files on different physical interfaces, perhaps. Well, and so on.

Answer 4

In your case, you need to decide head-on, 10GB (single-port) cards to all computers and a “server”, one 10Gb switch for 8 ports.
This will definitely increase your speed (unlike teaming with 1Gbit cards).
Expensive, but does not require any additional gestures at all to set up, stuck it in - it works.

Answer 5

A quick google suggests that Infinyband is not that expensive:
blog.lexa.ru/2012/02/10/10g_doma_pervye_uspekhi.html
Here are eBay cards:
www.ebay.com/itm/Mellanox-InfiniHost-MHET2X-1TC-2- Port-10Gb-s-InfiniBand-HCA-PCI-X-Card-45-/140876672901?pt=US_Internal_Network_Cards&hash=item20cce76f85
And another article on Habré:
habrahabr.ru/post/120393/

Answer 6

The Intel x520-da2 is a 10G dual port card with direct connection capability. You connect such a card on one machine, on the rest you can use single-port cards (but they all cost around $500). The cable can be used copper, category 7.

Answer 7

If not a secret for what needs?

Answer 8

And how much do you imagine how many spindles will have to be used to load such a strip? There seems to be no point in SSD, because. if such speed is needed, then the data volumes are not small.

Answer 9

You can buy three of these: www.amazon.com/Intel-Gigabit-Dual-Server-Adapter/dp/B001AGFXTQ/ref=sr_1_1?ie=UTF8&qid=1352147437&sr=8-1&keywords=10Gbit+nic and connect them with these cables (http: //www.amazon.com/Cable-Matters-Screened-Shielded-Snagless/dp/B004NPL4YE/ref=sr_1_3?s=electronics&ie=UTF8&qid=1352147706&sr=1-3&keywords=cat6a) in pairs of three.
Something in the region of three thousand dollars, all this pleasure will come out. I can’t say what will be soft with these cards under Windows (possible places for problems to arise are driver capabilities, the possibility of correct ring topology routing, general network stack brakes for such a speed, Samba brakes / what will you fumble files with).