How to back up data to a remote server?

Question

System administration

Hello everyone, another 1001 question about data backup.
Conditions:
1) there are a couple of folders +/- 50 GB in size and the number of files is 150K
2) about 500 files are changed and new ones are added per day
3) backup must be done daily and stored remotely
Now this is implemented using 7z and the u parameter ( incremental archive), but driving every night 50 GB is not an option, the channel is 100, and it’s busy with others ... The whole thing is spinning under Windows
. Any ideas?

Answer 1

SyncThing
https://habrahabr.ru/post/225655/
A hybrid of regular file synchronization and torrent technologies.
Just knows how to work with large files.

Answer 2

Now this is implemented using 7z and the u parameter (incremental archive), but driving 50 GB every night is not an option

Change 7z to zpaq and you're good to go.
Especially pay attention to the key -index indexfile
And in the case of using 7z, I don’t understand why drive every time 50GB if you can make incremental archives, and drive the archive with your modified 500 files over the network.

Answer 3

Since you can set the file attribute to "compressed", the use of an archiver is optional. It remains only to copy the new and updated files (the deleted ones will also be removed from the archive):

-------------------------------------------------------------------------------
   ROBOCOPY     ::     Robust File Copy for Windows
-------------------------------------------------------------------------------

              Применение :: ROBOCOPY источник назначение [файл [файл]...] 
                            [Параметры]

                 Источник:: Исходная папка (диск:\путь или
                            \\сервер\общий ресурс\путь).
              Назначение :: Конечная папка (диск:\путь или 
                            \\сервер\общий ресурс\путь).
                    Файл :: Копировать файлы   (имена и подстановочные знаки:
                            по умолчанию "*.*").

Answer 4

Duplicati 2.0
https://www.duplicati.com/download
to any cloud or FTP, SSH, WebDAV
encryption, scheduler, incremental backups, VSS, remote web management, email reporting
... everything is there and it's free)

Answer 5

Are you gaining 50GB every day? It seems that it should be less, since the archive is incremental.

Answer 6

Paid program ACRONIS TRUE IMAGE,
free FBACKUP
Look this way