Answer the question
In order to leave comments, you need to log in
How well do these technologies fit the problem?
You need to write a service for collecting analytical data for a web application. The main part of the backend is written in python. The main load on analytics is the counter of views, while the user ID is saved if he is authorized, if not, then his IP. This is necessary for recommendations and partial getting rid of cheating views.
About the planned implementation: when a GET request is made to python, the server sends msg via kafka to the golang server, which caches the data in redis, and once every few seconds massively transfers them to ClickHouse excluding repetitions (if the user has already watched this post, we do not transfer it to ClickHouse) .
All of this should be easy to scale.
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question