Project

General

Profile

action #89263

[leap 15.3][qe-core] Please add migration testing from 15.2 to 15.3 and remove migration tests from 42.X

Added by lkocman 8 months ago. Updated 5 months ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
New test
Target version:
Start date:
2021-03-01
Due date:
% Done:

100%

Estimated time:
Difficulty:

Description

Hello team

could you please remove migration tests from 42.X to Leap 15.3 and add migration test for Leap 15.2 -> 15.3 to Leap 15.3
Somehow we've forgot to request the most common scenario.

Thank you


Related issues

Related to openQA Tests - action #91554: [qem][leap][opensuse][qe-core][needs-refining] Consider updating GM images before running migration testsWorkable

Related to openQA Tests - action #91545: [opensuse][qe-core] Upgrade tests: stall detected (consoletest_finish)Resolved

History

#1 Updated by okurz 8 months ago

  • Subject changed from [leap 15.3] - Please add migration testing from 15.2 to 15.3 and remove migration tests from 42.X to [leap 15.3][qe-core][migration] Please add migration testing from 15.2 to 15.3 and remove migration tests from 42.X

#2 Updated by okurz 7 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: zdup-Leap-42.1-gnome@64bit_cirrus
https://openqa.opensuse.org/tests/1667130

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#3 Updated by okurz 7 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: upgrade_Leap_42.1_kde
https://openqa.opensuse.org/tests/1685860

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#4 Updated by tjyrinki_suse 7 months ago

  • Status changed from New to Workable

#5 Updated by mgrifalconi 7 months ago

  • Assignee set to mgrifalconi

#6 Updated by lkocman 7 months ago

Any progress on this one? Thank you

#7 Updated by mgrifalconi 7 months ago

Hello, as we talked over Rocket Chat, I scheduled the migration test for gnome and kde on the development section of o3 for testing:
https://openqa.opensuse.org/admin/job_templates/39

On the next leap build it will be executed and we can check how it goes!

#8 Updated by tjyrinki_suse 7 months ago

  • Subject changed from [leap 15.3][qe-core][migration] Please add migration testing from 15.2 to 15.3 and remove migration tests from 42.X to [leap 15.3][qe-core] Please add migration testing from 15.2 to 15.3 and remove migration tests from 42.X

Removing migration team from the tags as QE Core is doing this.

#9 Updated by mgrifalconi 6 months ago

Small update:

Tests added to the Development section of Leap 15 in o3

    opensuse-Leap-15.3-DVD-x86_64:
    - upgrade_Leap_15.2_gnome
    - upgrade_Leap_15.2_kde
    - upgrade_Leap_15.2_cryptlvm:
        machine: uefi

Still waiting for a Leap build to trigger the execution of the tests.

About removing old tests: there was some discussion in Rocket Chat and IRC opensuse-factory and Oliver is still suggesting to keep them.

#10 Updated by mgrifalconi 6 months ago

Runs of

    - upgrade_Leap_15.2_gnome
    - upgrade_Leap_15.2_kde
    - upgrade_Leap_15.2_cryptlvm:
        machine: uefi

are now moved to the official Leap 15 job group. On the following build they will appear.

Cryptlvm took some time since the base image to use for upgrade test was not available and needed to be created and uploaded but now should be fine.

#11 Updated by mgrifalconi 6 months ago

We also found a discussion point: we may want to test update versions of the system before upgrade and not its old GM. Relative issue here https://progress.opensuse.org/issues/91554

#12 Updated by okurz 6 months ago

  • Related to action #91554: [qem][leap][opensuse][qe-core][needs-refining] Consider updating GM images before running migration tests added

#13 Updated by mgrifalconi 6 months ago

  • Status changed from Workable to Resolved
  • % Done changed from 0 to 100

Hello,

    - upgrade_Leap_15.2_gnome
    - upgrade_Leap_15.2_kde
    - upgrade_Leap_15.2_cryptlvm:

Are being scheduled on the Leap 15 job group in o3 so I will close this issue.

Not touching old tests because of the conversation with Oliver on IRC,please reopen (or open a new one) if you want the old tests being unscheduled.
Thanks!

#14 Updated by okurz 6 months ago

  • Status changed from Resolved to Feedback
  • % Done changed from 100 to 0

Thank you for adding these scenarios. But https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=141.2&groupid=50&test=upgrade_Leap_15.2_gnome&test=upgrade_Leap_15.2_kde&test=upgrade_Leap_15.2_cryptlvm shows only the upgrade tests for "DVD". What about upgrade tests based on "NET" media? As I see upgrade tests for other versions I assume we should especially have them for the base 15.2 :) Sorry, if I interfered too early before your PO or something :)

Oh, regarding the "% Done" field I suggest to simply ignore that. Estimations in software development are very unlikely to get right to be able to say how far one has progressed anywhere between 0 and 100% :)

#15 Updated by mgrifalconi 6 months ago

Hey Oliver, thanks for pointing this out! I believe it's important to find any issue as soon as possible, no matter who finds it first!

Makes totally sense, I added the three runs on NET directly in the Leap 15 group this time, to not wait one more build to run in the development job group.

Thanks!

#16 Updated by mgrifalconi 6 months ago

  • Status changed from Feedback to Resolved
  • % Done changed from 0 to 100

Tests are now scheduled for both DVD and NET

#17 Updated by szarate 6 months ago

  • Target version set to QE-Core: Ready

#18 Updated by szarate 6 months ago

  • Target version changed from QE-Core: Ready to Ready

#19 Updated by szarate 6 months ago

  • Target version changed from Ready to QE-Core: Ready

#20 Updated by szarate 6 months ago

  • Related to action #91545: [opensuse][qe-core] Upgrade tests: stall detected (consoletest_finish) added

#21 Updated by openqa_review 5 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: zdup-Leap-42.1-gnome@64bit_cirrus
https://openqa.opensuse.org/tests/1739027

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#22 Updated by favogt 5 months ago

I removed the failing tests which attempt zdup from 42.x.

#23 Updated by lkocman 5 months ago

Thank you Fabian

Also available in: Atom PDF