How to process and store binary data?

Question

linux

Actually, you need to read a binary file with a given block size and save it approximately in the following format:
1={binary block 1}
2={binary block 2}
....
n={binary block n}
Then you will need to work with this file. The volume of the opened file is up to several terabytes, so it should work quickly (limited only by the speed of the disk). Linux OS.
Only here I do not know in which direction to dig. If someone shares a couple of links, I would be very grateful. Preferably in python, but you can use any other.
Thank you.

Answer 1

Although read petabytes, you will still be limited by the speed of access to the hard disk, the delays of which are dozens of times greater than the computation time. You just need to read a piece of data and write it down, which will work equally slowly in c++ as in python. In any case, it will not take more than a couple of minutes of work time.
Actually ... you read in pieces (if the block size is relatively small, then you can take it as the size of a piece, if it is large, then you should read in pieces smaller than the block size) into memory, and write it in a different format.