Which file system to choose for a large volume?

A

a0xff2015-12-23 16:17:41

linux

a0xff, 2015-12-23 16:17:41

there is a large disk array (several volumes of 50T), with large files (from 200 MB)
What file system to choose for it for maximum reading speed?

Reply

Answer the question

In order to leave comments, you need to log in

2 answer(s)

A

Alexey Cheremisin, 2015-12-23
@leahch

XFS, very even nothing. It is possible and EXT4. The difference is small. We use both. Well, the reading speed mainly depends on the speed of the array.
Issued: Well, in general, I recommend doing everything in a storage like Ceph, we just have it deployed on 5 servers with a capacity of 100tb. Interconnects via infiband, external 1/10Gb. In Ceph, you can pour it like S3 - the speed will be crazy, we have a peak of about 7-8GB / s (gigabytes per second!) Per client.

S

Sly_tom_cat ., 2015-12-25
@Sly_tom_cat

xfs. And forget about XFS's dislike for power cuts - all these glitches have been fixed long ago, but the label of a not very reliable FS stuck to poor XFS like that bath sheet to the priest.
If EXT4 is still selected, then at least turn off the root reserve on it ( http://help.ubuntu.ru/wiki/ext4#disk_optimization... But for 200 MB of EXT2-4 files - not too good - there will be a lot of fragmentation ( internal system, which no one will tell you about).