Answer the question
In order to leave comments, you need to log in
Where is the best place to store a large amount of frequently accessed data?
There is a large amount of data ~ 100 GB.
They are constantly updated and growing, while the site user must receive the requested part of this data in a short time so that the site does not hang for 2-3 seconds.
Now they are on disk in the form of directories.
Where better to move/download them for quick access to them.
DB - PostgreSQL. I'm going to connect Redis soon
PS Only GET requests, these are images
Answer the question
In order to leave comments, you need to log in
GET only, these are images
You need to move data (images and other files) outside the website. For example, AWS S3, Azure Blob storage, GCP Cloud Storage, or compatible services. Also on their capacities, if you really need it.
Thus, when downloading ~100 GB from an external resource, your server will serve clients without any additional load.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question