How to implement distributed reliable storage of large files?

A

abir_valg2016-04-07 10:00:45

Database

abir_valg, 2016-04-07 10:00:45

I would like to find an open source solution that will allow organizing a distributed reserved storage of large files ~ 10GB.
Functionality is needed for downloading files, searching, uploading on demand and automatically mirroring to backup servers to ensure reliability.
Is it worth bothering with Hadoop for such a task, or are there simpler solutions?
Thanks in advance.

Reply

Answer the question

In order to leave comments, you need to log in

2 answer(s)

L

ldv, 2016-04-07
@ldvldv

LizardFS, MooseFS
CephFS , GlusterFS - but there are negative reviews for these two

A

Anton Aplemakh, 2016-04-08
@aplemakh

you can still consider openstack swift, but it is very capricious. It must be set up carefully.
why do you want to make your own? Ready-made solutions are not considered?
For example, there are no restrictions on the volume of uploaded files and it is backed up in 3 DCs at once.