S
S
sanchower2019-06-06 17:17:32
Data synchronization
sanchower, 2019-06-06 17:17:32

The most efficient way to back up a bunch of small files?

There are directories with files: 910 thousand files, about 30 GB in total, most of the files are small in a couple of KB.
Changes are periodically made to one or another part of it (files change transactionally).
There is a need to store archive versions of files for some time and have access to them as of a particular moment to a set of files or to a slice of the entire file tree at a point in time.
How to solve this problem in the most efficient way?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
F
forspamonly2, 2019-06-06
@sanchower

fold in some file system thread with copy on write (btrfs, zfs, etc.) and make snapshots after "transactional file changes"

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question