How to choose a library for working with video?

Question

C++ / C#

There was a need to work with audio / video under Windows and Linux. Basically, you need to receive a video stream via RTP or from a specific device via USB and display / compress / transmit via RTP.
And I would like to more or less understand what is happening, and not just connect something like libvlc and pray.
But what is the best library to use for this? I would like:
- Good documentation. Well, or that she was at all.
- Cross-platform.
- A large number of formats and codecs (and codecs are generally part of the library?).
- Preferably bindings to C#.
I've used gstreamer a bit so far (via gst-launch), but I'm not sure if bringing it to Windows is a good idea. With DirectShow it seems to be the same song, just the other way around. I looked at the SDL with interest, but decided it was better to ask.
Advice on what to read on the topic is welcome, because so far I have very little idea how, for example, to display video in a qt window.

Answer 1

There are ffmpeg , opencv . Bindings to C# can be found.
I won't say anything about the latter, I haven't used it. But ffmpeg has proven itself well.
For video output, you can use OpenGL, SDL. Basically, you get video frames in YUV420P format , you need to convert to RGB . SDL has native support for .
There is a good tutorial on Habré .