How to collect and analyze statistics of 5k people?

Question

MySQL

There is a VK bot in python, mysql base
There are > 5k people on the bot
In the arsenal of Python
You need to somehow save statistics about users
Statistics for the user will be something like this

{
voronka:{
stage1:1
stage2:ignore
stage3:no
stage4:1
}
cikl1:{
stage1:1
stage2:1
stage3:1
stage4:1
}
webinar:{
reg:1
prishol:1
freeze:0
}
}

The fields can be different for different users and vary a lot
. How to store such data? How to handle such amount of data?
Will 8 operas survive if you open a list of 5k dicts

Answer 1

Well, 5k is not enough, so everything is ok, but it’s better to process it with a generator or by unloading a specific parameter. Store statistics wherever you want, even in the form of files for each user. =)
But since you know what mysql is, use it or sqlite, any database makes it easier to work with data.