How to "stream" data from monitoring?

Question

PHP

Hello everyone, it is necessary to somehow process the data from monitoring, the essence is this:
Monitoring writes data to the table once a minute, respectively, the table is quite voluminous over time.
I would like to somehow "stretch" these data, so that the data for the previous week were not for every minute, but for an hour, and a year later, already daily by average. What are the implementation options?

Answer 1

In general, deleting data is certainly not good.
Therefore, a good option when choosing to group data with the desired interval.
Then there will not be much to process, and at the same time, detailed historical data will cool down in case of important negotiations.
All this is dynamically possible. Open the chart for a year -> the backend
groups by days
Open for a month -> 12 hours a
week Week/Day -> time points

Answer 2

You can learn how this is done in time series databases: RRDtool and Whisper (Graphite)
Both of them are for monitoring services.

Answer 3

From my own experience, I can say that it is precisely non-aggregated so-called raw data that is needed to analyze cases.
At one time, I implemented operational monitoring of key business service quality indicators (KPI / BSQI) for IT using Oracle procedures and jobs. I had to invent a procedure that once an hour is engaged in shifting raw data into the so-called archive table.
BUT in today's realities, this problem is already being solved by regular methods of DBMS (Oracle / MySQL) partitioning.