V
V
Vladimir Merk2019-09-02 09:15:26
linux
Vladimir Merk, 2019-09-02 09:15:26

At night, the server stops responding, in kvm you can see Unit systemd-journald.service entered failed state, how to find the reason?

Greetings!
At night, after 12 hours, the server stops responding to requests, packets do not reach it by ping, and you can’t connect to the shell either.
There is kvm, connecting through it, you can see the endless output of such lines:

Unit systemd-journald.service entered failed state.
systemd-journald.service has no holdoff time, schelduling restart.
Stopping Journal Service...
Starting Journal Service...
Started Journal Service.
systemd-journald.service watchdog timeout (limit 1min)!

It is treated only by rebooting through the same kvm. Didn't find anything clear on google.
The server is running a medium-load site (LAMP), several docker containers.
What could be the problem? What logs to look at to understand what the trouble is?
UPD:
This output in /var/log/messages is clear during a crash:
/var/log/messages (yadisk)
Syslog output from crash to reboot
/var/log/syslog (yadisk)
ATOP continues to work even during crash
atop output 10 minutes before crash
5d6cf4c14f2e8138643347.png

atop output 1 minute after crash
5d6cf4e376289162836608.png

atop output 10 minutes after crash
5d6cf4ff16f40736814278.png

Answer the question

In order to leave comments, you need to log in

1 answer(s)
A
Armenian Radio, 2019-09-02
@gbg

For some reason, the magazine got stuck. Do you have disk space?

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question