Project

General

Profile

Actions

action #132893

closed

[alert] failed systemd services on jenkins: jenkins-plugins-update, snapper-cleanup

Added by okurz 10 months ago. Updated 10 months ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
-
Target version:
Start date:
2023-07-17
Due date:
% Done:

0%

Estimated time:
Tags:


Related issues 1 (0 open1 closed)

Related to openQA Infrastructure - action #158505: Failed systemd services alert for jenkins-plugins-update size:SResolvedokurz2024-03-18

Actions
Actions #1

Updated by okurz 10 months ago

  • Status changed from In Progress to Feedback

journalctl -u snapper-cleanup says

Jul 17 03:45:40 jenkins systemd[1]: Started Daily Cleanup of Snapper Snapshots.
Jul 17 03:45:40 jenkins systemd-helper[4418]: running cleanup for 'root'.
Jul 17 03:45:40 jenkins systemd-helper[4418]: running number cleanup for 'root'.
Jul 17 03:45:40 jenkins systemd-helper[4418]: IO Error (.snapshots is not a btrfs subvolume).
Jul 17 03:45:40 jenkins systemd-helper[4418]: number cleanup for 'root' failed.
Jul 17 03:45:40 jenkins systemd-helper[4418]: running timeline cleanup for 'root'.
Jul 17 03:45:40 jenkins systemd-helper[4418]: running empty-pre-post cleanup for 'root'.
Jul 17 03:45:40 jenkins systemd[1]: snapper-cleanup.service: Main process exited, code=exited, status=1/FAILURE
Jul 17 03:45:40 jenkins systemd[1]: snapper-cleanup.service: Failed with result 'exit-code'.

For this I found a report https://www.spinics.net/lists/linux-btrfs/msg74706.html from a user on Tumbleweed but nothing conclusive there. I called systemctl snapper-cleanup && journalctl -f -u snapper-cleanup but no problem there. Problem can not be reproduced.

jenkins-plugins-update failed with

Jul 17 03:00:00 jenkins systemd[1]: Started Automatically update jenkins plugins..
Jul 17 03:00:00 jenkins (-plugins)[25014]: jenkins-plugins-update.service: Failed to locate executable /usr/local/bin/update-jenkins-plugins: No such file or directory
Jul 17 03:00:00 jenkins (-plugins)[25014]: jenkins-plugins-update.service: Failed at step EXEC spawning /usr/local/bin/update-jenkins-plugins: No such file or directory
Jul 17 03:00:00 jenkins systemd[1]: jenkins-plugins-update.service: Main process exited, code=exited, status=203/EXEC
Jul 17 03:00:00 jenkins systemd[1]: jenkins-plugins-update.service: Failed with result 'exit-code'.

That should be fixed by https://gitlab.suse.de/openqa/salt-states-openqa/-/merge_requests/919

Actions #2

Updated by livdywan 10 months ago

Actions #3

Updated by okurz 10 months ago

  • Status changed from Feedback to Resolved

Deployed on jenkins.qa.suse.de and seems to work fine.

Actions #4

Updated by jbaier_cz about 1 month ago

  • Related to action #158505: Failed systemd services alert for jenkins-plugins-update size:S added
Actions

Also available in: Atom PDF