Is it possible to scan an image in a browser and compare it with another?

Question

JavaScript

So it goes.
I don't even know what tags to put on this.
There are applications (for example, with Egorka Creed and Garnier), where an object is filmed with the phone’s camera (for example, a bottle of acne cream), compared with an image (I assume that the png of this very bottle), an answer is obtained, based on which either nothing does not happen, or Creed starts dancing and singing right on the phone screen in the camera mode.
And the question is: is it possible to do this using the browser?

Answer 1

Compare two different images? That is, to determine that the reference (studio) picture shows the same jar of cream that the user photographed with his crooked smartphone? This can only be done with the help of neural networks, the same Google is just starting timid steps in this direction - and this is with its own budgets. We do not yet have a 100% ability to compare only 2 identical images on the subject of whether it is the same photo or not.

Answer 2

I don't know about Garnier - but what you described - you don't need a photo for this. there is probably a code on the cream. similar to qr code. he can be anything. and the application sees this code. and when he sees - the song begins.

Answer 3

It is possible, because the browser implements neural networks and the basic functionality of computer vision. Eg. ConvNetJS , tracking.js .
Probably, it is possible to train the network in advance to determine the presence of the desired jar in the frame, and in the application quickly determine yes / no by the network with ready-made weights.