Algorithms for analyzing logs

Question

Algorithms

Good afternoon.

Interested in algorithms for analyzing program logs, and not statistical ones (which simply count the number of certain words / events), but intellectual ones. For example, our program works, prints some data to the log. At this time, the analyzer performs some calculations, finds possible patterns. At some point in time, an event occurs in the program that violates the identified patterns, and the analyzer points this out to us.

Has anyone come across similar algorithms?

Answer 1

In any case, the writing of the log parsing algorithm will have to be fixed.
If you use AI, then this is a rather cumbersome and long way.
If a fixed algorithm is not suitable, create an analytical algorithm that, based on a fixed base of features (questions), will issue recommendations (answers). For Google - expert systems.

Answer 2

Use the Bayes probability test. Collect statistics, train statistically “normal” data as 1, completely abnormal as 0.
Then use the data in the analysis.