Where can I find information about parallel computing in python?

Question

Python

Good day
I would like to practice parallelizing heavy calculations in python.
Recommend an interesting project / good example or blog where this topic is covered.
Is it possible to use greenlets for these purposes?

Answer 1

Greenlets are for the web (io), not for computing.

Answer 2

Recommend an interesting project / good example or blog where this topic is covered.

IPython , MPI

Is it possible to use greenlets for these purposes?

It is possible, but not necessary. Greenlets are, to my knowledge, more efficient at concurrent handling of IO tasks.

Answer 3

For parallelization of computations - multiprocessing , tk. Gil.

Answer 4

Heavy calculations on pure python + multiprocessing in my opinion do not make sense - it will be slow.
Options:
1. Theano - habrahabr.ru/post/173819
2. Write critical calculations in Cython
3. If there is a lot of data, you can try Spark through the Pyspark API.