K
K
Kirill2020-09-07 19:07:12
Data storage
Kirill, 2020-09-07 19:07:12

Where is the best place to store a large amount of frequently accessed data?

There is a large amount of data ~ 100 GB.
They are constantly updated and growing, while the site user must receive the requested part of this data in a short time so that the site does not hang for 2-3 seconds.
Now they are on disk in the form of directories.

Where better to move/download them for quick access to them.
DB - PostgreSQL. I'm going to connect Redis soon
PS Only GET requests, these are images

Answer the question

In order to leave comments, you need to log in

2 answer(s)
V
Vladimir Korotenko, 2020-09-07
@firedragon

GET only, these are images

Store them in the file system. Suddenly!
Nginx is just fine for this.

R
Roman Mirilaczvili, 2020-09-08
@2ord

You need to move data (images and other files) outside the website. For example, AWS S3, Azure Blob storage, GCP Cloud Storage, or compatible services. Also on their capacities, if you really need it.
Thus, when downloading ~100 GB from an external resource, your server will serve clients without any additional load.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question