P
P
PendalF892020-05-10 20:06:32
MySQL
PendalF89, 2020-05-10 20:06:32

What is the best way to host a large table in MySQL?

Hello!
I want to parse ~ 5,000,000 pages and upload data from them to the MySQL database, the estimated size of the database is ~ 150GB.
Most of the data will be in one table
. I am a little confused by the volume of the table and I don’t know how best to proceed, until the following options came to mind:

1. Take 1 powerful VPS and use one table without doing anything with it
2. Take 1 powerful VPS and partition the table
3. Take a few weak VPS and distribute the table between them (horizontal sharding)
4. Or maybe abandon MySQL in favor of some NoSQL solution?

What would you suggest?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
R
Roman Mirilaczvili, 2020-05-10
@PendalF89

150GB of data is fine, even for a single table. It all depends on what kind of data it is and what kind of queries will go to the database. We don't know anything yet.
No need to rush into NoSQL, it's premature.
If you need to get data by id or another key, there is no problem with this. Mysql works with JSON, the main thing is to add the correct indexes.
To take a server powerful or weak - depends on the load that needs to be measured.

D
Dr. Bacon, 2020-05-10
@bacon

Take the simplest implementation from all this, apply the required / planned load, then identify problem areas and, regarding them, make optimization decisions.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question