Answer the question
In order to leave comments, you need to log in
Best key/value storage for bigdata?
Hello!
Prompt cool key/value storage.
The most important thing for my task is the speed with random reading , in second place is the speed with random writing . Also, keys of different lengths.
The storage will be primary, so you can't store data in RAM.
It is desirable to have support for java.
Of the most suitable ones, I found:
1) Leveldb (for 300M records, search for 1000 records in 7 seconds, a bit long in 1 thread)
2) Bangdb (Ehash)
3) Kyoto (HashDB)
Those with a hash, their hash tables are stored in a file and then loaded into RAM and are permanently there, but their size is many times smaller than the size of the data.
Benchmarks:
leveldb - https://leveldb.googlecode.com/svn/trunk/doc/bench...
bangdb - 300GB and 4KKK still working =) bangdb.com/bangdb_embedded_one_billion.php
kyoto - fallabs.com/kyotocabinet/kyotoproducts.pdf
This the top three, according to the charts. Who worked with them, what do you think?
Answer the question
In order to leave comments, you need to log in
Riak? It may not be fast, but it is very reliable due to data replication across different nodes.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question