QA » openQA Project » openQA Infrastructure

[alert] Failed systemd services - qamaster - logrotate fails on /var/log/messages with "/usr/bin/xz: (stdin): Read error: Input/output error"

Observation¶

From https://stats.openqa-monitor.qa.suse.de/d/KToPYLEWz/failed-systemd-services?orgId=1

2023-10-07 14:08:20

qamaster

logrotate

okurz@qamaster:~> sudo systemctl status logrotate
x logrotate.service - Rotate log files
     Loaded: loaded (/usr/lib/systemd/system/logrotate.service; static)
     Active: failed (Result: exit-code) since Sat 2023-10-07 00:00:09 CEST; 14h ago
TriggeredBy: . logrotate.timer
       Docs: man:logrotate(8)
             man:logrotate.conf(5)
   Main PID: 2037 (code=exited, status=1/FAILURE)

Oct 07 00:00:00 qamaster systemd[1]: Starting Rotate log files...
Oct 07 00:00:04 qamaster logrotate[2037]: error: Compressing program wrote following message to stderr when compressing log /var/log/messages-20231007:
Oct 07 00:00:04 qamaster logrotate[2037]: /usr/bin/xz: (stdin): Read error: Input/output error
Oct 07 00:00:04 qamaster logrotate[2037]: error: failed to compress log /var/log/messages-20231007
Oct 07 00:00:09 qamaster systemd[1]: logrotate.service: Main process exited, code=exited, status=1/FAILURE
Oct 07 00:00:09 qamaster systemd[1]: logrotate.service: Failed with result 'exit-code'.
Oct 07 00:00:09 qamaster systemd[1]: Failed to start Rotate log files.

/var/log/messages sounds like syslog, possibly from rsyslog. I suggest we just make sure this is not used at all anymore as systemd journald should suffice.

Suggestions¶

• can we just fully switch to systemd journal? what isn't in the journal yet? Likely we can. This is just an effect of the system being an old installation migrated over multiple versions. Just remove "rsyslog" and whatever and ensure everything writes into the system journal

Workaround¶

• systemctl restart logrotate