How to make a backup with a minimum of disk usage?

Question

linux

Mysqldump is done every day (300 databases), each database in its file, ~ 20GB in total, is compressed into one 1GB bz2 file, then the archive flies to amazon glacer.
The problem is that the server does not have 20GB for files, and bz2 requires * a whole tar file when compressed, how to get out?

Answer 1

Now you do not have enough 20 GB for backup, tomorrow you will not have enough free space to store new data. And that tomorrow will come sooner than you think.
Add disk space.
As a temporary option - make a backup of 1 database, archive it, send it to Amazon, then another, etc. The required disk space will be reduced to the amount of the maximum database * 2.

Answer 2

There is a large list of software that supports deduplication (search for "dedup")
https://github.com/restic/others
ZBackup is not bad.

Answer 3

What's the problem with backing up directly to the archive?

# mysqldump -uUSER -pPASSWORD BASE | gzip > base.sql.gz
# mysqldump -uUSER -pPASSWORD BASE > base.sql
# du -sh ./base.sql*
26M	./base.sql
4,0M	./base.sql.gz

Norm)))