What is the best database for storing large amounts of information?

Question

SQL

It is necessary to store several tens (or even hundreds) of millions of records in a database table, pieces of 5-8 fields, types such as bigint, string, bool, integer, float. For a quick search, you need indexing by the id and title fields. This requires that the database on disk take up as little space as possible. Perhaps there are some DBMS benchmarks that test the size of the database with the same content?

Answer 1

1. Millions of records is NOT a big database at all. For a modern DBMS, this is nonsense. Today, even billions of records are not a big problem, but you are talking about some millions.
2. Indexes take up a lot of space in the database. If you do not do them (and do not use a DBMS that creates indexes by itself), you can save 2 times. As an option - index every time you start the application.
3. Applies only to a constantly changing database. The transaction log takes up a lot of space in the database. If you use a DBMS without a transaction log - save the size, but lose in reliability. If changes occur rarely and in small volumes, there is no problem with this.
4. There is an append only DBMS. There is no fragmentation. There is no transaction log (or it is greatly simplified).
5. You don't have that much volume. Let's even say you have 8 string fields of 120 characters each. This is about a kilobyte without indexes. Let's say there are 1 million. This is about 1 gigabyte without indexes.
6. Can be perfectly placed in RAM.
If you really need to save hard on disk space, for example, I would take an in-memory DBMS (1 gigabyte of data + indexes per half gigabyte, even if this is not much for a modern computer). And the data would be compressed.

Answer 2

For a small volume - only work with the nodes of the "tree" will save you (and the creation of the initial tree).
And for the rest of the criteria - you can take any.

Answer 3

What is quick search for you?
Need a full-fledged full-text search by title ?
https://ru.wikipedia.org/wiki/%D0%9F%D0%BE%D0%BB%D...
If yes, then without a search engine, nowhere.
If you have a catalog search, then options like
unsuitable.