A
A
Alexey Sundukov2020-04-06 12:08:44
linux
Alexey Sundukov, 2020-04-06 12:08:44

What is the optimal utility for archiving append only with increments and a cluster?

Context: a directory with photo and video files (media archive) in which only new ones are added and old ones are not edited. Interested in a ready-made system for linux with control from the console that can itself:

  1. Incrementally creates daily archives that include only new files.
  2. Able to create encrypted archives.
  3. It can work in cluster mode and automatically copies X copies (let's say 2) to random nodes of the cluster (of course controlling the correctness of the transfer and data integrity), if some archive did not reach the node correctly (the node fell off), then it will find another node and copy there.
  4. It has a terminal interface (or writes data to the RDBMS database) that allows you to answer on which nodes which archives are located.
  5. When a node falls out (with the ability to set the time - more than a day) or its removal and the cluster, automatically copy data from other nodes that were on the remote one so that the copy factor within the cluster remains at the specified level (i.e. 2) .
  6. Ideally, I had integration with a monitoring system in the spirit of Zabbix out of the box.


It is clear that there is rsync. But I don't want to ride a bike. I also googled bacula, Backupninja and so on, but from the description on all of them it can be built, they are all kind of convenient. I do not want to waste time testing each of these systems.

I ask you to recommend a ready-made backup system for the media library so that it contains the maximum of the specified items out of the box.

Answer the question

In order to leave comments, you need to log in

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question