Project

General

Profile

Actions

action #180698

closed

"Rollback of updates" wiki section outdated size:S

Added by okurz about 2 months ago. Updated about 1 month ago.

Status:
Resolved
Priority:
High
Category:
Regressions/Crashes
Start date:
2025-04-10
Due date:
% Done:

0%

Estimated time:

Description

Observation

https://progress.opensuse.org/projects/openqav3/wiki/#Rollback-of-updates says "transactional-update" which isn't true anymore since long. This needs to be updated.

Acceptance criteria

  • AC1: Wiki section is up-to-date

Suggestions

  • Check current o3 workers for their state, e.g. do we have now consistently btrfs with snapshots? I guess not so we need to write it down accordingly.
  • Keep the section about just rolling back package updates from /var/cache/zypp/ which should still be relevant

Out of scope

  • Fix the empty package cache #180701

Related issues 2 (0 open2 closed)

Related to openQA Project (public) - action #180695: tests fail due to removal of '%cmd' from testapi size:SResolvedokurz2025-04-10

Actions
Related to openQA Infrastructure (public) - action #180710: Upgrade Power8 o3 workers to openSUSE Leap 15.6 - qa-power8-3 size:SResolvedgpathak2024-11-14

Actions
Actions #1

Updated by okurz about 2 months ago

  • Related to action #180695: tests fail due to removal of '%cmd' from testapi size:S added
Actions #2

Updated by gpuliti about 2 months ago

  • Subject changed from "Rollback of updates" wiki section outdated to "Rollback of updates" wiki section outdated size:S
  • Description updated (diff)
  • Status changed from New to Workable
Actions #3

Updated by okurz about 2 months ago

  • Parent task set to #162146
Actions #4

Updated by robert.richardson about 2 months ago

  • Status changed from Workable to In Progress
  • Assignee set to robert.richardson
Actions #5

Updated by openqa_review about 2 months ago

  • Due date set to 2025-04-25

Setting due date based on mean cycle time of SUSE QE Tools

Actions #6

Updated by robert.richardson about 2 months ago · Edited

After some auth issues, i was finally able to check workers. Started with openqaworker20 – openqaworker28, arm21/22, and qa-power8-3.
Most use a consistent layout with btrfs as root filesystem and a seperate (~5TB) ext4 partition for /var/lib/openqa, which is of course not covered by btfrs snapshots/rollbacks.

Some workers stand out so far:

  • openqaworker23 has multiple container storage overlays, each 476 GB in size, are they covered ?
  • arm21/22 and aarch64-o3 store everything—including /var/lib/openqa—on a large single btrfs volume.
  • qa-power8-3 uses an "older" layout without RAID, with a smaller /var/lib/openqa, also its latest snapshot is over a month old while all other workers had current snapshots (Fri 07 Mar 2025 04:53:02 AM GMT)
Actions #7

Updated by robert.richardson about 2 months ago · Edited

  • Status changed from In Progress to Feedback

qa-power8-o3 is not yet upgraded to Leap 15.6 and has active zypper locks, so i guess the missing zypper snapshots will be therefore be resolved in the future.

@mkittler brought to my attention that there where multiple sections covering commands specific to transactional-update servers, not just the rollback section.
I have adjusted all wiki sections, removed and replaced commands with equivalents where applicable. DIFF.

As there are now several changes to the wiki, maybe someone can review my changes before we resolve this ?

Actions #8

Updated by tinita about 2 months ago

  • Status changed from Feedback to Workable
Actions #9

Updated by livdywan about 1 month ago

  • Related to action #180710: Upgrade Power8 o3 workers to openSUSE Leap 15.6 - qa-power8-3 size:S added
Actions #10

Updated by livdywan about 1 month ago

robert.richardson wrote in #note-7:

qa-power8-o3 is not yet upgraded to Leap 15.6 and has active zypper locks, so i guess the missing zypper snapshots will be therefore be resolved in the future.

I assume this is covered by #180710.

Actions #11

Updated by livdywan about 1 month ago

I have adjusted all wiki sections, removed and replaced commands with equivalents where applicable. DIFF.

As there are now several changes to the wiki, maybe someone can review my changes before we resolve this ?

Updates look fine to me. Not sure if others have seen them. Maybe we're good here then?

Actions #12

Updated by robert.richardson about 1 month ago

livdywan wrote in #note-11:

I have adjusted all wiki sections, removed and replaced commands with equivalents where applicable. DIFF.

As there are now several changes to the wiki, maybe someone can review my changes before we resolve this ?

Updates look fine to me. Not sure if others have seen them. Maybe we're good here then?

I think @tinita also had a look already, as she removed my previous feedback tag. Though maybe that was just due to my vacation days, not sure. Resolving tomorrow, if there are no objections until then.

Actions #13

Updated by nicksinger about 1 month ago · Edited

  • Monitor if nightly update works, e.g. look at the for journal entries of and openqa-continuous-update.service and rebootmgr.service entry:

I think there is something missing here or an "and" to much at the beginning. Otherwise the changes look reasonable (I used https://progress.opensuse.org/projects/openqav3/wiki/Wiki/diff?utf8=%E2%9C%93&commit=View+differences&version=315&version_from=313 btw to review them)

Actions #14

Updated by robert.richardson about 1 month ago

nicksinger wrote in #note-13:

  • Monitor if nightly update works, e.g. look at the for journal entries of and openqa-continuous-update.service and rebootmgr.service entry:

I think there is something missing here or an "and" to much at the beginning. Otherwise the changes look reasonable (I used https://progress.opensuse.org/projects/openqav3/wiki/Wiki/diff?utf8=%E2%9C%93&commit=View+differences&version=315&version_from=313 btw to review them)

thanks, i've just updated that, the current diff link is now: https://progress.opensuse.org/projects/openqav3/wiki/Wiki/diff?utf8=%E2%9C%93&commit=View+differences&version=316&version_from=313

Actions #15

Updated by robert.richardson about 1 month ago

  • Status changed from Workable to Resolved

at least two more people had a look since yesterday so i am resolving this now, as discussed.

Actions #16

Updated by okurz about 1 month ago

  • Due date deleted (2025-04-25)
Actions

Also available in: Atom PDF