Responding to events on the screen.?

Question

Python

Friends, the bottom line is this. A utility is needed that will scan the phone screen and, when an object appears on it, emit a sound notification. For example: a red circle appears on the screen and the program starts beeping.
First you need to configure the utility to react to this particular color (enter the color code into it). Are there such programs and, if not, how can this be done? is it possible to write such a script in bash and python?

Answer 1

In theory, it can be implemented, but there are many nuances. Starting from how to get an image from the screen, ending with how to understand whether it is a circle or a square.
You can use ADB, VNC, webcam - to get the image. To recognize it, you can train a neural network or write a primitive script to detect color at a point (several points) of an image.