Actions
action #180707
closedo3 worker openqaworker20 has outdated os-autoinst package, possibly inoperative auto-update service size:S
Start date:
2025-04-10
Due date:
% Done:
0%
Estimated time:
Tags:
Description
Observation¶
Trying to do a rollback for #180695 I found that openqaworker20 is outdated:
okurz@ariel:~> hosts="openqaworker20 openqaworker21 openqaworker22 openqaworker23 openqaworker24 openqaworker25 openqaworker26 openqaworker27 openqaworker28 openqaworker-arm21 openqaworker-arm22 qa-power8-3"; for i in $hosts; do echo "### $i" && ssh root@$i "rpm -q os-autoinst" ; done
### openqaworker20
os-autoinst-4.6.1739536098.bc54195-lp156.2047.1.x86_64
### openqaworker21
os-autoinst-5.1744220409.84f2b44-lp156.2074.1.x86_64
### openqaworker22
os-autoinst-5.1744220409.84f2b44-lp156.2074.1.x86_64
…
os-autoinst-5.1744220409.84f2b44-lp156.2074.1.x86_64
### openqaworker28
os-autoinst-5.1744220409.84f2b44-lp156.2074.1.x86_64
### openqaworker-arm21
os-autoinst-5.1744220409.84f2b44-lp156.2074.1.aarch64
### openqaworker-arm22
os-autoinst-5.1744220409.84f2b44-lp156.2074.1.aarch64
…
From journalctl -u openqa-auto-update
since 2025-02-18 (!)
Feb 18 03:00:19 openqaworker20 systemd[1]: Started Automatically patch system packages. See https://progress.opensuse.org/issues/18006 and https://progress.opensuse.org/issues/70978.
Feb 18 03:00:19 openqaworker20 openqa-auto-update[45450]: devel:openQA looks good for Leap 15.6 (x86_64)
Feb 18 03:00:19 openqaworker20 openqa-auto-update[45464]: Repository 'Update repository of openSUSE Backports' is up to date.
Feb 18 03:00:19 openqaworker20 openqa-auto-update[45464]: Repository 'Update repository with updates from SUSE Linux Enterprise 15' is up to date.
Feb 18 03:00:19 openqaworker20 openqa-auto-update[45464]: Repository 'devel_openQA' is up to date.
Feb 18 03:00:19 openqaworker20 openqa-auto-update[45464]: Retrieving repository 'devel_openQA_Leap' metadata [.error]
Feb 18 03:00:19 openqaworker20 openqa-auto-update[45464]: Repository 'devel_openQA_Leap' is invalid.
Feb 18 03:00:19 openqaworker20 openqa-auto-update[45464]: [devel_openQA_Leap|http://download.opensuse.org/repositories/devel:openQA:Leap:15.4/15.4] Failed to retrieve new repository metadata.
Feb 18 03:00:19 openqaworker20 openqa-auto-update[45464]: History:
Feb 18 03:00:19 openqaworker20 openqa-auto-update[45464]: - [devel_openQA_Leap|http://download.opensuse.org/repositories/devel:openQA:Leap:15.4/15.4] Repository type can't be determined.
Feb 18 03:00:19 openqaworker20 openqa-auto-update[45464]: Please check if the URIs defined for this repository are pointing to a valid repository.
Feb 18 03:00:19 openqaworker20 openqa-auto-update[45464]: Skipping repository 'devel_openQA_Leap' because of the above error.
Feb 18 03:00:19 openqaworker20 openqa-auto-update[45464]: Repository 'repo-oss' is up to date.
Feb 18 03:00:20 openqaworker20 openqa-auto-update[45464]: Some of the repositories have not been refreshed because of an error.
Feb 18 03:00:20 openqaworker20 systemd[1]: openqa-auto-update.service: Main process exited, code=exited, status=4/NOPERMISSION
Feb 18 03:00:20 openqaworker20 systemd[1]: openqa-auto-update.service: Failed with result 'exit-code'.
Acceptance criteria¶
- AC1: All o3 workers have a consistent os-autoinst version
- AC2: It is understood why w20 is outdated
Suggestions¶
- Understand what brought us into the situation
- The
openqa-auto-update.service
is failing (at the time we are estimating this ticket). - Ensure that all o3 workers have at least the previously installed version of os-autoinst and all relevant openQA packages
Updated by okurz 6 days ago
- Copied from action #180701: Package cache on o3 workers does not include any os-autoinst packages size:S added
Updated by gpuliti 6 days ago
- Subject changed from o3 worker openqaworker20 has outdated os-autoinst package, possibly inoperative auto-update service to o3 worker openqaworker20 has outdated os-autoinst package, possibly inoperative auto-update service size:S
- Description updated (diff)
- Status changed from New to Workable
- Parent task deleted (
#162146)
Updated by dheidler 6 days ago
openqaworker20:/etc/zypp/repos.d # cat devel_openQA_Leap.repo
[devel_openQA_Leap]
enabled=1
autorefresh=1
baseurl=http://download.opensuse.org/repositories/devel:openQA:Leap:15.4/15.4
type=rpm-md
priority=90
The $releasever
var wasn't used when adding the devel:openQA:Leap:$releasever repo.
Updated by okurz 6 days ago
- Copied to action #180767: Alerts/notifications from o3 workers on failed systemd services added
Updated by dheidler 6 days ago
- Status changed from In Progress to Resolved
ariel:~ # salt-ssh '*' cmd.run 'rpm -q os-autoinst'
openqaworker22:
os-autoinst-5.1744270001.5d9f36e-lp156.2078.1.x86_64
openqaworker21:
os-autoinst-5.1744270001.5d9f36e-lp156.2078.1.x86_64
openqaworker20:
os-autoinst-5.1744270001.5d9f36e-lp156.2078.1.x86_64
openqaworker28:
os-autoinst-5.1744270001.5d9f36e-lp156.2078.1.x86_64
openqaworker25:
os-autoinst-5.1744270001.5d9f36e-lp156.2078.1.x86_64
openqaworker26:
os-autoinst-5.1744270001.5d9f36e-lp156.2078.1.x86_64
openqaworker27:
os-autoinst-5.1744270001.5d9f36e-lp156.2078.1.x86_64
openqaworker23:
os-autoinst-5.1744270001.5d9f36e-lp156.2078.1.x86_64
openqaworker24:
os-autoinst-5.1744270001.5d9f36e-lp156.2078.1.x86_64
openqaworker-arm21:
os-autoinst-5.1744270001.5d9f36e-lp156.2078.1.aarch64
openqaworker-arm22:
os-autoinst-5.1744270001.5d9f36e-lp156.2078.1.aarch64
Also made sure that all other workers use $releasever
in every applicable repo.
Actions