How to make a filter program for a video stream?

Question

Video processing

There is a video stream. That is, endless.
There may be places in the video that need to be blurred. well, for example, the inscription "go all to ..." on the fence.
A self-written program should actually analyze the video stream that it receives at the input,
and if there is a fence and such an inscription, blur the inscription. And to issue the same video with a blurry inscription.
Or just a video without changes, if it's not there.
That is, like a filter.
How approximately can this be done? where to dig?

Answer 1

Dig towards computer vision. For C ++ there is an openCV library, which allows you to process different images and videos.
Neural networks may be needed.

Answer 2

Plugin for AviSynth make. The .avs script will specify the incoming video stream, and your plugin as its handler. In the plugin itself, it will already be necessary to detect a fence on the frame and blur it, and this will require temporal stability and many other difficulties. For a couple of years I sawed a plug-in to fix a crooked stereo camera (correction of geometric artifacts in 3D films), all this had to be solved.
OpenCV is rightly advised to you

Answer 3

Most likely, you have seen enough of Hollywood blockbusters) Alas, but a live stream, process and change on the fly, advanced Google-level neural networks are needed here, and the technical support will result in a very considerable penny ..
Realistically, it’s still not working with the stream on the fly, but again neural networks are long and expensive to process content on local resources.
Of course, IMHO, since I'm not a pro in this, but any processing of video streams is the most expensive in every sense