R
R
ruboss2015-11-13 02:22:43
Java
ruboss, 2015-11-13 02:22:43

Best key/value storage for bigdata?

Hello!
Prompt cool key/value storage.
The most important thing for my task is the speed with random reading , in second place is the speed with random writing . Also, keys of different lengths.
The storage will be primary, so you can't store data in RAM.
It is desirable to have support for java.
Of the most suitable ones, I found:
1) Leveldb (for 300M records, search for 1000 records in 7 seconds, a bit long in 1 thread)
2) Bangdb (Ehash)
3) Kyoto (HashDB)
Those with a hash, their hash tables are stored in a file and then loaded into RAM and are permanently there, but their size is many times smaller than the size of the data.
Benchmarks:
leveldb - https://leveldb.googlecode.com/svn/trunk/doc/bench...
bangdb - 300GB and 4KKK still working =) bangdb.com/bangdb_embedded_one_billion.php
kyoto - fallabs.com/kyotocabinet/kyotoproducts.pdf
This the top three, according to the charts. Who worked with them, what do you think?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
S
Sergey, 2015-11-13
@begemot_sun

Riak? It may not be fast, but it is very reliable due to data replication across different nodes.

P
polyhedron, 2015-11-13
@polyhedron

Well, if it's for "bigdata", then you can look at Apache HBase.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question