D
D
Deleting Account2021-07-01 13:15:51
Software and Internet Services
Deleting Account, 2021-07-01 13:15:51

How well do these technologies fit the problem?

You need to write a service for collecting analytical data for a web application. The main part of the backend is written in python. The main load on analytics is the counter of views, while the user ID is saved if he is authorized, if not, then his IP. This is necessary for recommendations and partial getting rid of cheating views.
About the planned implementation: when a GET request is made to python, the server sends msg via kafka to the golang server, which caches the data in redis, and once every few seconds massively transfers them to ClickHouse excluding repetitions (if the user has already watched this post, we do not transfer it to ClickHouse) .
All of this should be easy to scale.

Answer the question

In order to leave comments, you need to log in

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question