How to track objects quickly?

Question

C++ / C#

Hello.
The problem is the following, the task will achieve 30 fps with tracking 12 objects. Mat size 512*420, grayscale. Used cv::MultiTracke and Tracker, 12-15 fps and it's just update and imshow. The camera itself gives up to 100 fps, checked
What are the alternatives or solutions?
Thank you for your attention

Answer 1

At one time I was engaged in tracking moving objects (I highlighted the fact of the presence of movement and then tracked it).
For tracking I used the Hungarian algorithm.
There was something like this:
https://github.com/Smorodov/Multitarget-tracker
Article:
https://habrahabr.ru/post/267651/