Monitoring in Java. How to implement?

Question

Java

Dear experts, I ask for advice in solving the problem.
It is necessary to implement a monitoring system. The tasks of the system include periodic launch of tasks (search for errors in log files, obtaining data from the database, etc.), analysis of the received information and visualization of the results on the web page. Keep a log of the history of results - not required. It is planned to simultaneously perform about 10 tasks. Programming language: Java
While I look towards Spring Batch as a scheduler and Ehcache or Berkeley DB as a module for intermediate storage of collection / analysis results.
Can you please tell me the technologies / technology stacks on which such a system can be implemented?
What is the best way to implement output to a web page? Periodically poll the staging module or are there other options?

Answer 1

If you just need to solve the problem of aggregating logs, then it’s better not to invent a wheel, but to look towards applications like Graylog, LogStash + Kibana, etc. Google "log aggregation java".
If the task is programming, then I advise you Quartz as a scheduler. For an intermediate data storage module (or just for an inmemory database), I recommend you H2 or Hsqldb. Ehcache is not quite suitable for these purposes, because. it is mainly used as an object cache for caching the results of queries to the DB / web services, mainly for caching JPA entities.

Answer 2

If there is a desire to get confused on your own, then in java create a scheduler that would work with a list of tasks (a list of tasks in any database), and the result of the execution of tasks would also be put in the database. This application is implemented as a windows or unix service. For yourself and users to make the simplest WEB dashboard.
Or look towards Zabix, Zenoss or Nagios...