D
D
DdarkX2017-05-03 21:01:05
Computer networks
DdarkX, 2017-05-03 21:01:05

Moosefs, glusterfs, how to be?

Good to all, something there.
Well, I was also touched by technologies for creating large file "garbage dumps". Walking on the Internet showed a lot of interesting and wonderful things, but the fact is that everything should be quite simple, since all this kitchen will fall on the shoulders of another admin. This means heavy things, like LustreFS will not work, and you yourself can forget what you did. It's time to choose, moosefs or glusterfs, both systems are quite simple, both in installation and configuration. Of course there is, BUT, glusterfs must be scaled in pairs, one takes the hit on itself, the second insures, that is, put 3 north and wait for the increase in space will not work, of course there is a striped volume, but when one falls off, everything will fall apart.
Time passed, I began to think in a different direction and an interesting description of moosefs fell into my hands. Of course, I took up the tests, and I can also say that it doesn’t matter how many and what kind of servers you have, it will work well. When one server falls off, there are pauses, but this is not visible to the average user, and if the network is well built, it will not even be noticeable.
Later I will write detailed instructions on how to install, add servers and what to look for in case the "master" falls. Of the minuses, probably the biggest one is RAM, it eats it mercilessly. Encryption and geolocation can be organized using vpn, there will be nothing to worry about. I advise you to use 2 network cards, then it will be possible to increase the responses to the requested files. Of course, build a raid for reliability, because everything cannot die at once.
So here's a question for experts and those who have come across. Is it really impossible to free up RAM on ssd drives and let them toss and turn there?
Sorry for the many letters, and also THANK YOU to everyone who responds!

Answer the question

In order to leave comments, you need to log in

1 answer(s)
A
Alexey Cheremisin, 2017-05-03
@leahch

I didn’t look at moosefs, but with the glaster they just got burned on the expansion.
We were also looking for a simple solution to replace GPFS for a long time. And as a result of the search, they settled on the "complex" CEPH. Well, CephFS is suitable for the trash. Try it, it's practically the market leader now. We did not regret, for more than three years - the flight is normal. And this is not only a file system, but also disks for virtual machines and cloud storage for files, all in one. It expands very simply, it unfolds in an hour, from this hour, 50 minutes - reading the documentation, which is a must read.
Yes, separately about performance, it's great! You can add both SSD and SAS, and all this is very flexible to configure, both caching and fast pools for critical data.
Yes, the documentation is very good.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question