Answer the question
In order to leave comments, you need to log in
Which database to choose for frequent data updates?
Task:
There is a certain document that is written to the database once and then properties are added to it by different sources. For example document - file name, properties - size, creation date, hash, type. etc.
Some properties may or may not be. Those. some files may not have size or creation date information.
Properties for the same file can update different sources and they can do it at the same time, but different properties update different sources, i.e. one source will update only the size, the other only the creation date, and so on. Therefore, I would like to be able to update properties without blocking the entire document.
Documents will not be kept forever and will be deleted as soon as all properties are filled.
It should also withstand about 500 records/updates per second.
Answer the question
In order to leave comments, you need to log in
Ну Redis вы вполне правильно указали, 500rps он спокойно выдержит, даже с локами на весь весь ключ.
Ещё sophia.systems посмотрите, её вроде как tarantool использует внутри.
500 обновлений в секунду - совсем не большая нагрузка.
Но если прям-таки специализированное решение хочется, то на такие вещи заточены InfluxDB и Tarantool (с включенным движком vinyl)
На среднем железе лично получал до 5000 в секунду.
Больше не требовалось по тех.заданию, возможно можно и больше.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question