With what tool is it reasonable to combine monitoring and whitebox testing?

Question

Software testing

Hello!
There was a need to supplement the functionality of Prometheus (complete with Grafana and AlertManager) to solve the problem of monitoring resources/services with parallel testing of the functionality: for example, to validate the data returned by the DBMS during test queries; check the fact that the correct content was returned by the web server (and not just its up/down status); call API methods to check the response. And in case of failure, also generate alerts, use automation, and so on.
So far, three ways are seen: create a new plugin, expand the capabilities of existing ones, or use some external tool that is more suitable initially for solving the described task, and then integrate (or not integrate) it with monitoring.
Has anyone solved a similar problem and, in fact, with the help of which tool (a set of tools or methodology, preferably open source) is it reasonable to combine monitoring and synthetic / whitebox testing?
Thank you!

Answer 1

I haven't worked much with , usually there is an HTTP plugin for monitoring systems, etc.
Look at Zabbix, Zenoss. Or cloud NewRelic, AppDynamic, ...