How to analyze server log files?

Question

Apache HTTP Server

Periodically, there is a significant load on the server at night, when traffic, on the contrary, drops. Looks like they are bots.
But how can you just look at which site and who / what is the source of the load?
those. no need for detailed data (at least on the 1st step), but just the simplest way to get an answer.
Those. some simple solution that will point to the main source of traffic for a certain period of time.

Answer 1

In fact, if it’s one-time, it’s easier and cheaper than just your eyes, you open the log and see what happened during the load.
You can deploy logstash elastic search and kibana quite powerfully there, you can do analytics

Answer 2

Hello,
The easiest way is awk.

Answer 3

Try goaccess in combination with log grep by date.