action #157996
Updated by okurz 7 months ago
## Motivation
* Need to upgrade machines before EOL of Leap 15.5 and have a consistent environment
## Acceptance criteria
* **AC1:** all LSG QE salt controlled machines run a clean upgraded openSUSE Leap 15.6 (no failed systemd services, no left over .rpm-new files, etc.) except for OSD workers
## Acceptance tests
* **AT1-1:** `sudo salt -C 'not G@roles:worker and not G@roles:webui' grains.get oscodename | grep -B1 'Leap 15.5'` is empty
## Suggestions
* read https://progress.opensuse.org/projects/openqav3/wiki#Distribution-upgrades
* Reserve some time when the related services are not heavily relied upon
* Keep IPMI interface ready and test that Serial-over-LAN works for potential recovery or for virtual machines virt-manager access
* After upgrade reboot and check everything working as expected, if not rollback, e.g. with `snapper rollback`
## Rollback actions
* Remove silence `alertname=jenkins: host up alert` from https://monitor.qa.suse.de/alerting/silences `alertname=Failed systemd services`
## Further details
* Don't worry, everything can be repaired :) If by any chance the machines gets misconfigured in many cases there are btrfs snapshots to recover, the IPMI Serial-over-LAN, etc.
Back