L
L
lamerboy2018-02-18 03:34:10
Database
lamerboy, 2018-02-18 03:34:10

Which database to choose for a trillion+ rows?

Advise, please, who had experience with huge databases, which one to choose for a trillion+ rows, so that selection, insertion, update and deletion work relatively quickly.
A relatively powerful server is idle, I have long wanted to write a bot that scans the entire network so as not to depend on any services, search engines, etc. to check backlinks, I plan to start with one table and 5 columns in the database, id, hash, acceptor url, donor url, anchor.
And is 2 TB enough?
A trillion is, of course, with a margin just in case, so far only Runet is interested, so it will probably be less.

Answer the question

In order to leave comments, you need to log in

2 answer(s)
K
kidar2, 2018-02-18
@lamerboy

https://clickhouse.yandex/ is highly praised. But there seems to be some difficulty with deleting lines.

D
Dimonchik, 2018-02-18
@dimonchik2013

There are 5 million sites in Runet, a trillion per eye

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question