Answer the question
In order to leave comments, you need to log in
What software can perform a quick backup of directories with a large number of files (several millions)?
The task sounds so:
There is a directory with files. It is internally divided into subdirectories by dates \YYYY\MM\DD\.
Every day 20-40 thousand JPG files of 250kb are added to it.
The files are stored for several years.
The file system is NTFS, 8dot3name is disabled (otherwise everything is very bad and slow).
Disk array - two dozen 1.8TB 10K HDD, RAID10, 512MB controller cache, DELL PERC H700.
You must back up this directory every day.
Cobian Backup is currently used for backup (in WS2012R2).
Full every 60 days + incremental backups every day with logic on the archive attribute of files.
Storage in 7zip without compression, otherwise there are a lot of files in the file system on the backup server, and it is difficult to determine in which directory the space is occupied (using WinDirStat or TreeSize).
The problems with Cobian Backup are as follows (no work has been done on it since at least 2014):
1. A full backup task every 60 days lasts for days.
2. In the middle of the task, the service may stop responding and needs to be killed.
3. Sometimes the service may crash.
4. There are several such directories, and tasks, respectively.
There are ~50-70 more small jobs in Cobian Backup, but there were no problems with them before the advent of these big ones.
It is clear that software that makes copies using VSS and images of the entire partition will be more productive and less problematic in terms of backup, BUT:
1. There are other directories on this partition that do not need to be included in the backup.
2. The copy should retain simple file access (like files or archives).
As a result of all of the above, to solve the problem, a modern analogue of Cobian Backup is being sought , which can:
1. Incremental / differential copying of a directory with files on a schedule.
2. Stores backups as files or archives that are easy to access. (so using powerful backup solutions is difficult (such as SCDPM, Acronis, Symantec/Veritas, Bacula, etc.)
The closest analogue found recently is APBackup, this is an extreme fallback.
But it is impossible to set up full + incremental backups in one task, and taking into account the number of tasks, maintaining this list becomes a problem.
Answer the question
In order to leave comments, you need to log in
https://www.veeam.com/en/windows-endpoint-server-b...
Can do everything you need. There are utilities for file-by-file access to archived copies.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question