Project

General

Profile

action #136370

Updated by okurz 8 months ago

## Observation 

 From https://stats.openqa-monitor.qa.suse.de/d/KToPYLEWz/failed-systemd-services?orgId=1&from=now-6h&to=now 
 2023-09-23 08:22:00 	
 backup-vm 	
 rsnapshot@beta 	

 From `ssh backup-vm.qe.nue2.suse.org "sudo systemctl status rsnapshot@beta"` 

 ``` 
 Sep 23 03:30:00 backup-vm systemd[1]: Starting rsnapshot (beta) backup... 
 Sep 23 03:30:00 backup-vm rsnapshot[21512]: ---------------------------------------------------------------------------- 
 Sep 23 03:30:00 backup-vm rsnapshot[21512]: rsnapshot encountered an error! The program was invoked with these options: 
 Sep 23 03:30:00 backup-vm rsnapshot[21512]: /usr/bin/rsnapshot beta 
 Sep 23 03:30:00 backup-vm rsnapshot[21512]: ---------------------------------------------------------------------------- 
 Sep 23 03:30:00 backup-vm rsnapshot[21512]: ERROR: Lockfile /var/run/rsnapshot.pid exists and so does its process, can not continue 
 Sep 23 03:30:00 backup-vm rsnapshot[21532]: /usr/bin/rsnapshot beta: ERROR: Lockfile /var/run/rsnapshot.pid exists and so does its process, can not continue 
 Sep 23 03:30:00 backup-vm systemd[1]: rsnapshot@beta.service: Main process exited, code=exited, status=1/FAILURE 
 Sep 23 03:30:00 backup-vm systemd[1]: rsnapshot@beta.service: Failed with result 'exit-code'. 
 Sep 23 03:30:00 backup-vm systemd[1]: Failed to start rsnapshot (beta) backup. 
 ``` 

 ## Suggestions 
 * Look which other jobs ran at the time, likely another level conflicting with this one (alpha, gamma, etc.) 

 ## Rollback actions 
 * Remove silence for failed systemd services

Back