L
L
LobsterJoe2019-03-30 01:01:28
MySQL
LobsterJoe, 2019-03-30 01:01:28

Writing to the database - why does the speed of operations drop?

The situation is as follows - I have an excel file with 600k lines, parsed by a PHP script (symfony console command).
I use Doctrine, I write to the database in batches of 200.
The environment is aws eb, mysql SSD.
The UUID is used as the primary key.
I observe a gradual decrease in the speed of operations (for the first hour - 24k were exported, for the second - already 19k, etc.).
Where to dig?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
S
Stalker_RED, 2019-03-30
@LobsterJoe

I propose to stop torturing all sorts of ORMs, save the excel in csv and use LOAD DATA INFILE

LOAD DATA INFILE 'data.txt' INTO TABLE db2.my_table;

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question