M
M
musuk2018-03-05 19:22:51
Data storage
musuk, 2018-03-05 19:22:51

What cloud storage should I use for a service with millions of small files?

I make a large catalog of devices. I have several terabytes of images for 40-60kb products, I think it's easier and cheaper to download. Amazon S3 says billable object size of 128KB, which makes storage expensive, I couldn't find how they would charge a small image from Azure. Azure has a lot of options, like all those Page Blobs and Block Blob. So far I'm counting on somewhere around 100 files per second. It's 5Mb/s, but random access.
Your own server is not an option, because you want a CDN.
What option would you recommend?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
R
rPman, 2018-03-05
@rPman

Download a simple cloud application on the same amazon using their own storage, I haven’t studied it for your task, but usually there are a lot of concessions in tariff plans for requests inside their 'local' cloud.
In general, amazon has very expensive network traffic, and it is very difficult to use it for such tasks profitably (the ratio of monthly traffic to the total volume should be very small for you to use their systems more profitable than "ours", i.e. rarely give away a lot) .
If money is dear to you and your volumes are not more than hundreds of gigabytes (we are talking about an active data window), rent a couple of ssd vps-ok (in different data centers), put one backup (with replication) and use any key-value database.

A
Andrew, 2018-03-06
@byte916

I use a domestic solution, although there are cdn servers all over the world - selectel.ru (referral link). There is cdn, caching, backups and everything you might need. Storage of a terabyte of files - 1300 rubles per month, traffic - about 10 thousand per terabyte

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question