K
K
Konstantin Rudenkov2015-03-03 23:35:14
Python
Konstantin Rudenkov, 2015-03-03 23:35:14

How to organize file sharing in a distributed application?

Good health dear community.
There is an application head where users upload files, and there are N-workers for processing. Files can be of any type. Question: how to organize file exchange between the head and the workers (two-way)? Are there any (relatively) off-the-shelf solutions?
django+celery application head
celery workers. RabbitMQ messaging.
Files are on average up to 100MB, but the option for several gigs of 1 file (in any direction) is real. For simplicity - the file is binary.

Answer the question

In order to leave comments, you need to log in

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question