Why is the second data packet not being deserialized?

Question

C++ / C#

What I want to do: send an image over TCP sockets.
Algorithm:

1. The client converts the image to a byte array.
   
2. Splits this array into fragments (packets).
   
3. Sequentially sends packets to the server.
   
4. The server reads the packets, extracts byte arrays from them and glues them together.
   
5. The resulting byte array is deserialized into an image.
   

What I send (a separate .dll file that I connect to the client and server):

[Serializable]
    public struct DataPacket
    {
        public byte[] Bytes;
        public bool IsEnclosing;
    }

How do I send:

public static void SendByPackets(NetworkStream netStream, byte[] data)
        {
            MemoryStream memoryStream = null;
            var formatter = new BinaryFormatter();

            try
            {
                for (int i = 0; i * DATA_PACKET_BYTES_MAX_LENGTH <= data.Length; i++)
                {
                    bool isLastPackage = ((i + 1) * DATA_PACKET_BYTES_MAX_LENGTH >= data.Length);

                    var packet = new DataPacket()
                    {
                        Bytes = SubArray<byte>(data, i * DATA_PACKET_BYTES_MAX_LENGTH, (isLastPackage) ? data.Length - i * DATA_PACKET_BYTES_MAX_LENGTH : DATA_PACKET_BYTES_MAX_LENGTH),
                        IsEnclosing = isLastPackage
                    };

                    memoryStream = new MemoryStream();
                    formatter.Serialize(memoryStream, packet);

                    byte[] arr = memoryStream.ToArray();

                    netStream.Write(arr, 0, arr.Length);
                }
            }
            catch(Exception ex)
            {
                throw ex;
            }
            finally
            {
                memoryStream?.Close();
            }
        }

How I take it:

private BitmapImage ReceiveImageByPackets(TcpClient client)
        {
            NetworkStream netStream = client.GetStream();
            BinaryFormatter formatter = new BinaryFormatter();
            MemoryStream memoryStream = null;

            byte[] serializedImage = new byte[0];

            do
            {
                var bytes = new byte[client.ReceiveBufferSize];
                int countOfReadBytes = netStream.Read(bytes, 0, client.ReceiveBufferSize);

                if (countOfReadBytes > 0)
                {
                    memoryStream = new MemoryStream(bytes);
                    memoryStream.Seek(0, SeekOrigin.Begin);
                    var packet = (DataPacket) formatter.Deserialize(memoryStream);
                    memoryStream.Close();

                    serializedImage = Concatenate<byte>(serializedImage, packet.Bytes);

                    if (packet.IsEnclosing)
                        break;
                }
                else
                    throw new Exception("Received 0 bytes!");
            } while (true);

            var stream = new MemoryStream(serializedImage);

            return (BitmapImage) formatter.Deserialize(stream);
        }

Problem: Deserialization of the second packet always gives the error "Invalid binary format of the input stream. Start of content (in bytes): (hex code here)". What prevents to deserialize the second package? It turns out it is incorrectly serialized? If yes, what is the error?