QA » openQA Project » openQA Tests

The assets are gone. Recreating them using openQA clone_job should be feasible if necessary. However, the problem I see is that you as RM for openSUSE Leap defined a custom testing scope (uefi upgrade scenarios) which certainly make sense but they are for Leap only, hence the last successful jobs marking the openQA assets as used are 15.0 GM. Since then – 3 months ago – the assets have been unused and therefore deleted as such. I suggest to primarily extend the test scope on openSUSE Tumbleweed first as this will mark the assets as always used and only define a sub-set for openSUSE Leap. Back to lnussel, WDYT?

feel free to put the same test cases also on TW. It should be possible to recreate the assets by restarting the jobs that originally created them

lnussel wrote:

It should be possible to recreate the assets by restarting the jobs that originally created them

True but I doubt we still have these jobs on o3, most likely pruned already.

lnussel wrote:

note there's also the hdd/fixed directory which contains some images. not sure what the rule is to put stuff there

I am fully aware of the fixed assets. IMHO the "rule" is: Just do it or run into problems like the one described in this ticket ;)

So for a start I removed the following test scenarios from the Leap job group as they are incomplete and have the missing assets assigned as well as are for now unsupported Leap versions but also we still have the non-uefi, non-cryptlvm upgrade scenarios still as well as the uefi,cryptlvm scenario doing upgrade from 42.1 to current:

• DVD-x86_64-update_Leap_42.1_cryptlvm@uefi
• DVD-x86_64-update_Leap_42.2_cryptlvm@uefi
• NET-x86_64-update_Leap_42.1_cryptlvm@uefi
• NET-x86_64-update_Leap_42.2_cryptlvm@uefi

This should remove the urgency.

Next steps:

• Ensure TW is a superset of Leap, i.e. add missing upgrade tests only on Leap to TW
• If necessary according to lnussel add 42.1 upgrade tests by creating the assets somehow, manually or automatically

try to reproduce on o3 directly by e.g. a jobs post or fallback to manual verification

failed because the ISO is not there anymore: https://openqa.opensuse.org/tests/752499/file/autoinst-log.txt shows "Download of /var/lib/openqa/cache/openSUSE-Leap-42.1-DVD-x86_64-Build0265-Media.iso failed with: 404 - Not Found" . You could try to reference the ISO from download.o.o . As this becomes more effort now and with limited value I suggest to drop the work on it and revisit the situation later. We have a good coverage spanning different versions, desktops, flavors, etc., still and no currently incomplete or failing tests linked with this ticket here.

@sergio unassign ok?

@SLindoMansilla is fine with unassigning

Since it was copied to the ticket I am working on, and my ticket is called "part 2", I consider this an epic ticket

@SLindoMansilla please update after #40052 is resolved

Blocker resolved.

I asked lnussel and DimStar in #opensuse-factory @freenode if the test coverage for each upgrade test should have uefi and legacy scenarios. Waiting for their answer. If the answer is yes, I would resolve this epic. If not, I would transform it into a normal task to complete the missing scenarios.

Blocked by #48725

@SLindoMansilla it seems like something went wrong here. You set the ticket to "Blocked" by #48725 which in turn is blockey by this one :D
Considering that Leap 15.1 is about to be released like … today that is a bit unfortunate in case we we missed some serious issue, let's just cross fingers that we not ;)

we should revisit for leap 15.2
@Sergio wdyt?

mgriessmeier wrote:

we should revisit for leap 15.2
@Sergio wdyt?

Sure. This needs more love.
Let's take this to be properly refined today.

To be tracked

due to changes in a related task

due to changes in a related task

needs to be discussed offline

No time to work on this :(