A
A
Animag12017-08-09 12:55:52
Python
Animag1, 2017-08-09 12:55:52

Is the architecture appropriate?

Hello! I am new to python, I have a project which is divided into modules running in different threads. The project works like a pipeline, i.e. the first module takes jobs from the database, puts them in a queue, the second module takes jobs from the queue, processes them and puts them in another queue, the third module takes the results from the last queue and saves them to the database. Moreover, in each module, several threads can work. Now it was required to introduce the collection of statistics on the operation of each module with its subsequent saving to the database. At first, I decided to follow the same principle, to create a separate module to collect statistics, which will be connected with the rest of the modules through a queue. The latter will add certain statistical data in this turn, which the statistics module will receive and save in the database.

Answer the question

In order to leave comments, you need to log in

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question