The task is to organize the storage of 30 TB of photo and video materials with a guarantee that not a single bit of stored data will be distorted. How to implement it?

Question

NAS

Data: 20 TB of videos and 10 TB of photos.
Requirements: guaranteeing the immutability and safety of data. For each video clip and photo, when writing to the storage, a hash sum will be calculated, which will be stored in a database located on the same storage.
Storage load: frequent sequential reads and rare writes.
High performance is not required.
How to implement it? Which raid array to choose? And if not a raid array, then what?

Answer 1

ECC memory + ZFS (Linux, FreeBSD) in the desired RAIDZ configuration (not to be confused with RAID!) + the required number of disks. A RAID controller is optional and even harmful.

Answer 2

Plus for the option proposed by sanrega
ZFS raidz solves this problem. If you are very afraid - you can even raidz2 (conditional analog of RAID6). If it's really, really scary - well, there's also raidz3 :-)
On disks and controllers, by and large, it doesn't care. ZFS regularly tests data blocks for consistency, and if a block is damaged, it restores it using data from other disks in the array and writes a corrected copy in place. Set it in the settings so that scrub runs once every few days.
This is about the guarantee of immutability. As for availability guarantees, it all depends on what specific guarantees you need, and how much money you can spend on it.

Answer 3

Build CEPH storage with a bluestore backend on at least five servers with a replication factor of 3. You will need 100Tb of raw disk space. Control checks are verified both on the network and when stored on disks.

Answer 4

Take an 8-drive NAS, fill it with 8-terabyte or 10-terabyte SATA drives.
Organize them in a raid with mirroring. Change in time if the disk is out of order. It may make sense to immediately buy one spare disk so that it is at hand.
Cheaper - only if the motherboard allows you to connect so many drives.

Answer 5

Only an insurance policy gives a full guarantee.
You can even shove it into zip, even check SHA, even use ZFS.
But only 3 independent copies placed in different buildings give a full guarantee.
I would use either ZIP or ZFS

Answer 6

- RAID 10
- AWS S3

Answer 7

FreeNAS

FreeNAS with ZFS to protect, store, backup, all of your data. FreeNAS is used everywhere, for the home, small business, and the enterprise.

Answer 8

https://www.backblaze.com/b2/cloud-storage-pricing.html
30 TB of storage = $150 per month
Uptime: 99.9% SLA.
Reliability: 99.999999% durability.