T
T
Twelfth Doctor2017-11-11 13:47:31
MySQL
Twelfth Doctor, 2017-11-11 13:47:31

What kind of storage should be used to store one table with a large number of records?

Hello. Please tell me, I have a table with 5 columns
path|name|type|user|date
The table can contain millions of records (it stores the file structure of backup copies of all users for a certain time). Q: Where is the best place to store it all?
Why did I even come to the conclusion that it is necessary to store the file structure of backups in the storage (database)?
Because now every backup that belongs to the user has a *.txt.gz file that stores the same information. If I need to get a list of files and directories in a directory, I need to read the file and parse each line of it. This takes a lot of time (especially if the file has a large number of lines).
Why do I keep the file structure in a backup?
I want to give the user of my script the ability to restore a single file or folder from a backup and show him a list of files and folders in an arbitrary directory (the one he chooses).
Why don't I use standard command line utilities like tar --list
The archive is located on a remote server, and I will need to connect to it, execute this command and parse the output of the commandtar --list

Answer the question

In order to leave comments, you need to log in

1 answer(s)
L
longclaps, 2017-11-11
@verdex

Of course, writing your own bike is more interesting than learning how to use one of the existing ones.
Since this is your choice - make it from what you know: from water pipes if you are a plumber, or from shit and sticks if you are more into this topic.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question