How to store large amount of data?

A

Alexander2021-09-20 15:54:34

Data storage

Alexander, 2021-09-20 15:54:34

daily there is a fairly large amount of data containing users and some of their characteristics (numerical, textual, etc.). Characteristics change daily, users themselves also have the property of changing their first or last name. The essence of the task is to analyze all the changes in order to develop various kinds of reports. Since all these data and changes need to be recorded daily, the question arises how to store this data?
It is desirable that data storage be without third-party programs, but I will listen to various options.

Reply

Answer the question

In order to leave comments, you need to log in

2 answer(s)

S

Sergey Gornostaev, 2021-09-20
@sergey-gornostaev

Well, if this is big data, then you need to build or rent a data center.

M

Maxim, 2021-09-20
@Tomio

To store a large amount of archive data that you need to build analytics on, use ClickHouse . This database allows you to process huge amounts of data (more than 1 billion) quickly enough. But you need an appropriate server, with at least 8-16GB of RAM and a reasonably large hard drive.