Automated testing system?

Question

Automation

I am slowly starting a project and I want to be able to automatically test it and make all sorts of benchmarks with different parameters. Project under Windows, will be done in MSVS 2010 (maybe 2008), c++ language possibly +sharp, associated with GPGPU, OpenCL, rendering of all sorts of perversions, CAM, geometry and the like. Actually, the task is this: there is a program that renders pictures, it has 20 performance-related parameters with 10 values ​​each at the input, I worked on it, ran benchmarks at night and in the morning got a beautiful graph about what combinations of parameters it turns out faster than it differs from yesterday's version and where it is painted.
On the Nvidia website, there was a mention of such a standard as OpenAutomate, but somehow there has not been much activity there for a long time.
I also know that there are unit tests in the studio, but I have never used them and I don’t know how wide the capabilities of the built-in tools are in terms of collecting statistics and benchmarks.
Prompt, who than uses for a similar kind of tasks. It is desirable that it be free (free for academic use is also good).

Answer 1

Working project in C#. We make it in VS2010. CruiseControl on the server automatically updates the project from SVN every half hour, builds it, and then runs all the tests. If something has fallen, then the developer displays this sad news in the tray.