T
T
Twelfth Doctor2018-02-09 16:22:54
linux
Twelfth Doctor, 2018-02-09 16:22:54

How to quickly create an archive?

Hello. Tell me, how can I quickly pack a ~2.2 GB directory into an archive?
tar archive was created in 1 min 52 sec( tar -czf), zip archive - in 2 min and 12 sec
There can be 150-200 such archives, and it is important that their creation takes a minimum amount of time.

Answer the question

In order to leave comments, you need to log in

4 answer(s)
K
ky0, 2018-02-09
@ky0

how can I quickly pack a ~2.2 GB directory into an archive?

Don't use compression, obviously - just tar.

I
ivankomolin, 2018-02-09
@ivankomolin

If the processor is multi-threaded, run in multiple threads.
The task of archiving is very well parallelized.
And if you also have a video card with cuda support, then bzip2-cuda will help you.

P
pfg21, 2018-02-09
@pfg21

If I understand correctly, it is better to store this stuff on a file system with btrfs, zfs, etc. snapshots.
instead of an archive, take a snapshot, it happens instantly.
and then from the snapshot it is no longer in a hurry to bury the files.
then delete the snapshot.
or store as snapshots, but with an increase in the number of snapshots, the fs starts to slow down.
Plus, there is the possibility of differential archives with only changed files (but this is already in the direction of backups).

X
xibir, 2018-02-09
@xibir

pigz

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question