How to organize logging for polling a large number of unit devices?

Question

Database

Logging architecture question.
There are, say, 1000 devices (modems, for example).
Every minute each device is interrogated and the parameters returned by the device are stored for a) history and b) for fast interactive plotting, analytical reports, statistical studies, etc. The
question is how to save.
As long as I see it.
First, the logs are written to a file. A separate file for each day.
Then the logs are transferred to some kind of columnar DBMS, say at 00:00 - the whole file at a time.
Question 1: How good is this architecture? What can be improved?
Question 2: What is the best DBMS for these purposes?

Answer 1

Question 1: How good is this architecture? What can be improved?

Beautiful architecture, as it is usually done, just throw off more often, but less.
With such volumes of MySQL for the eyes.

Answer 2

For logging and monitoring, there is an EKL solution . You can try it.
Also, instead of files, you can try kafka .