What solutions are used to create multi-host distributed memory for storing data from Docker containers?

Question

linux

What solutions are used to create multi-host distributed memory for storing data from Docker containers? What is the most robust, production-ready approach? GlusterFS? Minio+S3? We need to store images uploaded by users. You can, of course, connect some S3 or other cloud to Rails, but I would like a Docker solution with replication between hosts. GlusterFS looks good, but you need to create a separate partition for each host, and, say, if you need to add 10 new servers, this solution will not be very elegant, since you have to do it manually.
PS We are talking about a system of 2 hosts with the same web application containers.

Answer 1

Experience in building and operating a large file ...
Binary (file) storage, a scary tale with m...

Answer 2

You can write an ansible playbook if you don't want to by hand. We currently have 3 servers configured with GlusterFS with NFS enabled. On all servers, folders are mounted via NFS, since it has a higher speed than the native fuse driver. There was OCFS2 before it, but after 2TB of data (mostly images), the write speed dropped sharply. I had to switch to GlusterFS. At the moment we are considering the option with CephFS...