H
H
HamsterGamer2021-10-26 13:44:27
Algorithms
HamsterGamer, 2021-10-26 13:44:27

What are the ways to store parts of several files in one common?

Hello everyone, I was solving the problem of finding the largest common subarray among N arrays and wondered if it was possible to store the total file data in this way. What if we take identical subarrays of bits from files (let's say 10 bits, 100, 1000, 10000, etc.) and cut them out of the originals, create some kind of mask / table / hash function for each of the files and restore any original using them . It is clear that this is not compression, but it can be a way to store a bunch of data in one piece.
So, I would like to get acquainted with algorithms or some similar ideas, articles and so on. Please advise them! Thank you in advance!

Answer the question

In order to leave comments, you need to log in

4 answer(s)
A
Adamos, 2021-10-26
@HamsterGamer

Google term: deduplication.

A
AndromedaStar, 2021-10-26
@AndromedaStar

Congratulations, you have invented the archiver!

D
Dmitry Shitskov, 2021-10-26
@Zarom

The operation of tar is described almost exactly. You can read more about it here
www.mkssoftware.com/docs/man4/tar.4.asp

P
Puma Thailand, 2021-10-27
@opium

You opened the file system

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question