A
A
Andrew2014-10-21 11:52:14
SQL
Andrew, 2014-10-21 11:52:14

Which database to choose to store 10 billion rows?

Dear BigData experts,
I have a data array of two fields of the Integer type, one with 200 million unique values, the other with 100 million. In total, there are about 10 billion values ​​in the array.
It is required to implement only two types of request:
1. Selection by the value of one of the fields.
select id1, id2 from bigtab where id1 = 123;
2. Selection by the list of values ​​with grouping
select id1, count(id2)
from bigtab
where id1 in (<list of values>)
group by id1;
What is the easiest way to do this?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
M
Melkij, 2014-10-21
@melkij

74 gigabytes of data? Is this big data? I thought there speech begins with a terabyte.
postgresql, plus partitioning by id1

P
Puma Thailand, 2014-10-21
@opium

yes, you can simply do it on mysql last

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question