Project

General

Profile

Actions

action #136370

closed

systemd service rsnapshot@beta on backup-vm.qe.nue2.suse.org failed due to process conflict

Added by okurz about 1 year ago. Updated about 1 year ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
-
Start date:
2023-09-23
Due date:
% Done:

0%

Estimated time:
Tags:

Description

Observation

From https://stats.openqa-monitor.qa.suse.de/d/KToPYLEWz/failed-systemd-services?orgId=1&from=now-6h&to=now
2023-09-23 08:22:00
backup-vm

rsnapshot@beta

From ssh backup-vm.qe.nue2.suse.org "sudo systemctl status rsnapshot@beta"

Sep 23 03:30:00 backup-vm systemd[1]: Starting rsnapshot (beta) backup...
Sep 23 03:30:00 backup-vm rsnapshot[21512]: ----------------------------------------------------------------------------
Sep 23 03:30:00 backup-vm rsnapshot[21512]: rsnapshot encountered an error! The program was invoked with these options:
Sep 23 03:30:00 backup-vm rsnapshot[21512]: /usr/bin/rsnapshot beta
Sep 23 03:30:00 backup-vm rsnapshot[21512]: ----------------------------------------------------------------------------
Sep 23 03:30:00 backup-vm rsnapshot[21512]: ERROR: Lockfile /var/run/rsnapshot.pid exists and so does its process, can not continue
Sep 23 03:30:00 backup-vm rsnapshot[21532]: /usr/bin/rsnapshot beta: ERROR: Lockfile /var/run/rsnapshot.pid exists and so does its process, can not continue
Sep 23 03:30:00 backup-vm systemd[1]: rsnapshot@beta.service: Main process exited, code=exited, status=1/FAILURE
Sep 23 03:30:00 backup-vm systemd[1]: rsnapshot@beta.service: Failed with result 'exit-code'.
Sep 23 03:30:00 backup-vm systemd[1]: Failed to start rsnapshot (beta) backup.

Suggestions

  • Look which other jobs ran at the time, likely another level conflicting with this one (alpha, gamma, etc.)

Rollback actions

  • Remove silence for failed systemd services

Related issues 1 (0 open1 closed)

Related to openQA Infrastructure (public) - action #134519: We were not notified that backup.qa.suse.de did not create backups size:MResolvedlivdywan2023-08-23

Actions
Actions

Also available in: Atom PDF