What is the relationship between back-end and parallel programming?

Question

Books

What is worth reading about parallel programming for the back-end?
What recent literature, resources, articles can you recommend?

Answer 1

There are 4 types of parallelism:
1) threads. Although this is multitasking, tk. pieces of threads are run sequentially through the processor.
2) several cores (let's say 4). It happens that the compiler helps you and passes the threads through different processor cores.
3) network machines: run pieces of the program (pieces of data) on several computers at the same time.
4) GPU (several hundred cores). Here the bottleneck is the data exchange between the CPU and GPU.
Read about these possibilities here.
Plus, each programming language has its own methods of parallel calculations.