Project

General

Profile

Actions
Copy link

action #89263

closed

[leap 15.3][qe-core] Please add migration testing from 15.2 to 15.3 and remove migration tests from 42.X

Added by lkocman over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
High
Assignee:
mgrifalconi
Category:
New test
Target version:
QA - QE-Core: Ready
Start date:
2021-03-01
Due date:
% Done:

100%

Estimated time:
Difficulty:

Description

Hello team

could you please remove migration tests from 42.X to Leap 15.3 and add migration test for Leap 15.2 -> 15.3 to Leap 15.3
Somehow we've forgot to request the most common scenario.

Thank you

Related issues 2 (1 open — 1 closed)

Related to openQA Tests - action #91554: [qem][leap][opensuse][qe-core] Update GM images before running upgrade testsFeedbackapappas

Actions
Related to openQA Tests - action #91545: [opensuse][qe-core] Upgrade tests: stall detected (consoletest_finish)Resolved

Actions
Actions
Copy link
 #1

Updated by okurz over 3 years ago

  • Subject changed from [leap 15.3] - Please add migration testing from 15.2 to 15.3 and remove migration tests from 42.X to [leap 15.3][qe-core][migration] Please add migration testing from 15.2 to 15.3 and remove migration tests from 42.X
Actions
Copy link
 #2

Updated by okurz over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: zdup-Leap-42.1-gnome@64bit_cirrus
https://openqa.opensuse.org/tests/1667130

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed
Actions
Copy link
 #3

Updated by okurz over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: upgrade_Leap_42.1_kde
https://openqa.opensuse.org/tests/1685860

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed
Actions
Copy link
 #4

Updated by tjyrinki_suse over 3 years ago

  • Status changed from New to Workable
Actions
Copy link
 #5

Updated by mgrifalconi over 3 years ago

  • Assignee set to mgrifalconi
Actions
Copy link
 #6

Updated by lkocman over 3 years ago

Any progress on this one? Thank you

Actions
Copy link
 #7

Updated by mgrifalconi over 3 years ago

Hello, as we talked over Rocket Chat, I scheduled the migration test for gnome and kde on the development section of o3 for testing:
https://openqa.opensuse.org/admin/job_templates/39

On the next leap build it will be executed and we can check how it goes!

Actions
Copy link
 #8

Updated by tjyrinki_suse over 3 years ago

  • Subject changed from [leap 15.3][qe-core][migration] Please add migration testing from 15.2 to 15.3 and remove migration tests from 42.X to [leap 15.3][qe-core] Please add migration testing from 15.2 to 15.3 and remove migration tests from 42.X

Removing migration team from the tags as QE Core is doing this.

Actions
Copy link
 #9

Updated by mgrifalconi over 3 years ago

Small update:

Tests added to the Development section of Leap 15 in o3

    opensuse-Leap-15.3-DVD-x86_64:
    - upgrade_Leap_15.2_gnome
    - upgrade_Leap_15.2_kde
    - upgrade_Leap_15.2_cryptlvm:
        machine: uefi

Still waiting for a Leap build to trigger the execution of the tests.

About removing old tests: there was some discussion in Rocket Chat and IRC opensuse-factory and Oliver is still suggesting to keep them.

Actions
Copy link
 #10

Updated by mgrifalconi over 3 years ago

Runs of 

    - upgrade_Leap_15.2_gnome
    - upgrade_Leap_15.2_kde
    - upgrade_Leap_15.2_cryptlvm:
        machine: uefi

are now moved to the official Leap 15 job group. On the following build they will appear.

Cryptlvm took some time since the base image to use for upgrade test was not available and needed to be created and uploaded but now should be fine.

Actions
Copy link
 #11

Updated by mgrifalconi over 3 years ago

We also found a discussion point: we may want to test update versions of the system before upgrade and not its old GM. Relative issue here https://progress.opensuse.org/issues/91554

Actions
Copy link
 #12

Updated by okurz over 3 years ago

  • Related to action #91554: [qem][leap][opensuse][qe-core] Update GM images before running upgrade tests added
Actions
Copy link
 #13

Updated by mgrifalconi over 3 years ago

  • Status changed from Workable to Resolved
  • % Done changed from 0 to 100

Hello,

    - upgrade_Leap_15.2_gnome
    - upgrade_Leap_15.2_kde
    - upgrade_Leap_15.2_cryptlvm:

Are being scheduled on the Leap 15 job group in o3 so I will close this issue.

Not touching old tests because of the conversation with Oliver on IRC,please reopen (or open a new one) if you want the old tests being unscheduled.
Thanks!

Actions
Copy link
 #14

Updated by okurz over 3 years ago

  • Status changed from Resolved to Feedback
  • % Done changed from 100 to 0

Thank you for adding these scenarios. But https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=141.2&groupid=50&test=upgrade_Leap_15.2_gnome&test=upgrade_Leap_15.2_kde&test=upgrade_Leap_15.2_cryptlvm shows only the upgrade tests for "DVD". What about upgrade tests based on "NET" media? As I see upgrade tests for other versions I assume we should especially have them for the base 15.2 :) Sorry, if I interfered too early before your PO or something :)

Oh, regarding the "% Done" field I suggest to simply ignore that. Estimations in software development are very unlikely to get right to be able to say how far one has progressed anywhere between 0 and 100% :)

Actions
Copy link
 #15

Updated by mgrifalconi over 3 years ago

Hey Oliver, thanks for pointing this out! I believe it's important to find any issue as soon as possible, no matter who finds it first!

Makes totally sense, I added the three runs on NET directly in the Leap 15 group this time, to not wait one more build to run in the development job group.

Thanks!

Actions
Copy link
 #16

Updated by mgrifalconi over 3 years ago

  • Status changed from Feedback to Resolved
  • % Done changed from 0 to 100

Tests are now scheduled for both DVD and NET

Actions
Copy link
 #17

Updated by szarate over 3 years ago

  • Target version set to QE-Core: Ready
Actions
Copy link
 #18

Updated by szarate over 3 years ago

  • Target version changed from QE-Core: Ready to Ready
Actions
Copy link
 #19

Updated by szarate over 3 years ago

  • Target version changed from Ready to QE-Core: Ready
Actions
Copy link
 #20

Updated by szarate over 3 years ago

  • Related to action #91545: [opensuse][qe-core] Upgrade tests: stall detected (consoletest_finish) added
Actions
Copy link
 #21

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: zdup-Leap-42.1-gnome@64bit_cirrus
https://openqa.opensuse.org/tests/1739027

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed
Actions
Copy link
 #22

Updated by favogt over 3 years ago

I removed the failing tests which attempt zdup from 42.x.

Actions
Copy link
 #23

Updated by lkocman over 3 years ago

Thank you Fabian

Actions
Copy link

Also available in: Atom PDF