Character recognition in active window?

Question

Python

Good time.
Got inspired by the idea of ​​creating a bot for games in python, inspired by the bot for playing Go from Google.
There was a misunderstanding in the following.
Let's say a client of some kind of card game is running on my PC. How can you get cards in your hand? As far as I understand, if in our window the maps are guaranteed to be signed with text, then we can get the window handle and organize a text search. But what if there are images? Will I have to take a screenshot of this window and use character recognition algorithms?

Answer 1

If you work directly with the window, and not with the interception of process data or network traffic, a screenshot is perhaps the only option. There is already either a search for a subimage in an image, or a recognition algorithm.