What distributed file systems or storages are popular now?

Question

System administration

I asked a question about the image site. Everyone was sent in unison to S3 - but this is a service. And if you do everything yourself. What administration tools are popular now? Ceph?.. Maybe something else?

What are the options for reserving and administering an array of files (pictures / memes)?

Answer 1

Well, here the question is first about the budget and only then about technology.
I will give a real example - there are 100TB of emails (mail hosting) - billions of small files, there is a zoo of hundreds that give it over NFS to containers and virtual machines. No objects of storage and cef (or other distributed FS).
the storages themselves - from just 2U servers with a bunch of disks to dell unity storage systems of various models.
there is no hot backup (because it is expensive), there are backups.
Therefore, you need to carefully consider - perhaps redundancy and distributed storage is something you cannot afford, but just 2U servers from, for example, supermicro for 24 or 50 disks, which will give NFS shares to neighboring servers with containers, this is what you can afford.
Separately, you need to consider how much a minute or an hour of downtime of your service costs.

Answer 2

mogilefs
minio

Answer 3

And they answered you correctly - do not use distributed file systems, use S3, even if on top of the same ceph.
The file system must provide a huge number of very strict guarantees, which results in extremely low performance in the distributed case.
Theoretical justification:
https://ru.wikipedia.org/wiki/%D0%A2%D0%B5%D0%BE%D...

Answer 4

What distributed file systems or storages are popular now?

Many are popular, but which ones are suitable for a specific task is unknown, since the requirements are unknown.
Quickly and without worries - S3
If you can use ready-made solutions like Ceph on your own.
If you are not satisfied with the functionality of ready-made solutions, you can do it from scratch.
The one that is most convenient and suitable for the task is chosen.

Answer 5

Here

Answer 6

Here is some overview of fs: https://itelon.ru/blog/raspredelennye-faylovye-sis...
More information: https://fb.ru/article/447249/raspredelennaya-faylo... Something
from scratch It can be very costly and time consuming to do.