A
A
Anton Kuznetsov2015-05-03 03:31:25
Backup
Anton Kuznetsov, 2015-05-03 03:31:25

How and where to back up 50TB?

Now there is a video archive (many large files) about 10TB. This is already more than any existing HDD and in the near future the archive will grow rapidly. You can backup all this on Amazon Glacier, it will cost $ 10 per ter per month, it will end up being $ 500 per month, which is somehow quite a lot.
I am ready to buy the current maximum 6-8TB HDD and backup it at home, but not to make separate storage at home with a RAID array. I want something like a serial backup, I connected the screw via USB once a week, turned on the backup and it pulls everything from the last backup point. The screw ran out, I bought a new one, we back up to it, only incremental addition, you can not return to full HDDs, rarely something is deleted in the archive, this can be neglected. Windows home, unix server. Is there something ready for such a task? It seems that software is needed that would keep a list of already backed up files and that would not need to check what is on the previous inaccessible HDD.
Current solution. Not ideal, but the amount of worries is kept to a minimum. On the server, the storage directory has subfolders
/data/01
/data/02, etc.
they transferred the current files of 6-8TB to the size of the backup screws.
In the script that sorts out everything incoming, the target folder is replaced by / data / 03 - it adds files to it after processing and makes a symlink in / realdata / for future needs.
Bittorent Sync is installed on the server - each folder is added to it in a separate line and is completely backed up in one screw. After which it can be removed.
Once a quarter, we change the directory in the script, add a new sync to BS and put a new hard drive into the crandle at home, which is in the picture below. If surplus has accumulated in the previous folder - we transfer it to the next one on the server, BS will recalculate everything very quickly.

Answer the question

In order to leave comments, you need to log in

3 answer(s)
S
sim3x, 2015-05-03
@sim3x

51LEQiQ-zEL.jpg
https://www.google.com/search?q=hard+drive+docking...

A
Andrey Ermachenok, 2015-05-03
@eapeap

Specify the task:
1. Do you have a video storage of up to 50T, and this storage needs to be backed up periodically?
2. Or is there a "small" storage - 2-4T - from which you periodically need to move or copy fresh films to the archive?
APBackUp - I use it in the Archiving mode (zips files), but it can also just copy / move files. Your option - either differential or incremental mode - will reset only the new one.
Probably, there are other file archivers - this one suited me, I did not look for another.

P
Puma Thailand, 2015-05-03
@opium

It is not difficult to write a script that will do this and remember the last saved point.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question