Project

General

Profile

Actions

action #117520

closed

[qe-core][opensuse] set up 15.4 to 15.5 upgrade tests

Added by mlin7442 about 2 years ago. Updated almost 2 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
New test
Target version:
Start date:
2022-10-04
Due date:
% Done:

0%

Estimated time:
Difficulty:
Sprint:
QE-Core: December Sprint (Dec 07 - Jan 11)

Description

Please to set up tests for Leap 15.4 upgrade to Leap 15.5, including upgrading via zypper and installer.

Actions #1

Updated by maritawerner about 2 years ago

  • Subject changed from set up 15.4 to 15.5 upgrade tests to [opensuse] set up 15.4 to 15.5 upgrade tests
Actions #2

Updated by okurz about 2 years ago

  • Category set to New test
Actions #3

Updated by szarate about 2 years ago

  • Subject changed from [opensuse] set up 15.4 to 15.5 upgrade tests to [qe-core][opensuse] set up 15.4 to 15.5 upgrade tests

Max, do you have a timeframe when this should be done? mostly... are the update repos already there?

Actions #4

Updated by mlin7442 about 2 years ago

szarate wrote:

Max, do you have a timeframe when this should be done? mostly... are the update repos already there?

15.4 was released a while, the update repos is all set at http://download.opensuse.org/update/leap/15.4/ . Do you need the 15.5 update repos for the 15.4->15.5 migration setup? we do have it already http://download.opensuse.org/update/leap/15.5/ , just not so much updates exist since 15.5 is still under development.

Actions #5

Updated by szarate almost 2 years ago

  • Sprint set to QE-Core: December Sprint (Dec 07 - Jan 04)
  • Tags set to qe-core-december-sprint
  • Status changed from New to Workable
  • Target version set to QE-Core: Ready
Actions #6

Updated by dimstar almost 2 years ago

co-incidentally I started working on 15.4-> TW upgrade tests. For this I already copied some auto-generated HDD (from maintenance update) to hdd/fixed:

opensuse-15.4-x86_64-GM-gnome@64bit.qcow2
opensuse-15.4-x86_64-GM-kde@64bit.qcow2

I also created the test suite zdup-Leap-15-{gnome,kde} (initial tests in the TW devel group; and first bug already filed :) )

some of that work should at least be re-usable for Leap 15.4->15.5 testing

Actions #7

Updated by rfan1 almost 2 years ago

  • Assignee set to rfan1

Let me try to take this task

Actions #8

Updated by rfan1 almost 2 years ago

dimstar wrote:

co-incidentally I started working on 15.4-> TW upgrade tests. For this I already copied some auto-generated HDD (from maintenance update) to hdd/fixed:

opensuse-15.4-x86_64-GM-gnome@64bit.qcow2
opensuse-15.4-x86_64-GM-kde@64bit.qcow2
dimstar
I also created the test suite zdup-Leap-15-{gnome,kde} (initial tests in the TW devel group; and first bug already filed :) )

some of that work should at least be re-usable for Leap 15.4->15.5 testing

@dimstar

Could you please point me the opensuse-15.4-x86_64-GM-kde@64bit.qcow2 download link if any? seems I fail to find it.

I can find the one gnome one, I can build a new one if no available one is there. thanks much!

Actions #9

Updated by rfan1 almost 2 years ago

Start to build some qcow2 images

Actions #10

Updated by rfan1 almost 2 years ago

  • Status changed from Workable to In Progress

rfan1 wrote:

Start to build some qcow2 images

hdd/fixed> ls |grep opensuse-15.4-x86_64-GM
opensuse-15.4-x86_64-GM-gnome@64bit.qcow2
opensuse-15.4-x86_64-GM-kde@64bit.qcow2
opensuse-15.4-x86_64-GM-cryptlvm@uefi.qcow2
Actions #11

Updated by rfan1 almost 2 years ago

https://openqa.opensuse.org/admin/job_templates/39
Some scenarios are added to job group

Actions #12

Updated by rfan1 almost 2 years ago

rfan1 wrote:

rfan1 wrote:

Start to build some qcow2 images

hdd/fixed> ls |grep opensuse-15.4-x86_64-GM
opensuse-15.4-x86_64-GM-gnome@64bit.qcow2
opensuse-15.4-x86_64-GM-kde@64bit.qcow2
opensuse-15.4-x86_64-GM-cryptlvm@uefi.qcow2

I re-built the qcow2 image via leap15.4 iso image https://openqa.opensuse.org/tests/2980139/asset/iso/openSUSE-Leap-15.4-DVD-x86_64.iso
this should be the GM one

Actions #13

Updated by rfan1 almost 2 years ago

https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.5&build=366.2&groupid=39
The tests are running well, the failed cases are known issues which can be seen on other leap versions as well.

Actions #14

Updated by rfan1 almost 2 years ago

Added flavor 'NET' and new job 'upgrade_Leap_15.4_cryptlvm'

Actions #15

Updated by dimstar almost 2 years ago

I know. it's a bit of hijacking - but the base images are shared for TW upgrade tests:

https://openqa.opensuse.org/tests/2987619#step/zdup/450

Is that the GM kernel being installed there? An upgrade from the GM kernel to TW is not possible. We need a base image with the kernel from -Update installed (and the old kernel must be uninstalled prior). This due to a bug fix in the kernel regarding script execution which was not in 15.4 GA

Actions #16

Updated by rfan1 almost 2 years ago

dimstar wrote:

I know. it's a bit of hijacking - but the base images are shared for TW upgrade tests:

https://openqa.opensuse.org/tests/2987619#step/zdup/450

Is that the GM kernel being installed there? An upgrade from the GM kernel to TW is not possible. We need a base image with the kernel from -Update installed (and the old kernel must be uninstalled prior). This due to a bug fix in the kernel regarding script execution which was not in 15.4 GA

Thanks @dimstar for the update!

Currently, the 3 qcow2 images I built are based on GM ISO image. I will try to upgrade them to new kernel version and then upload them. btw, can I know which minimum kernel version is required?

Actions #17

Updated by rfan1 almost 2 years ago

Now,
I will try to build 3 new images with updated kernel [version should be updated to 5.14.21-150400.24.38-default],at the same time, I will try to remove the old kernel packages via code changes below:

diff --git a/tests/console/force_scheduled_tasks.pm b/tests/console/force_scheduled_tasks.pm
index 9b7bfb261..ebb31bbee 100644
--- a/tests/console/force_scheduled_tasks.pm
+++ b/tests/console/force_scheduled_tasks.pm
@@ -18,7 +18,7 @@ use base "consoletest";
 use strict;
 use warnings;
 use testapi;
-use utils 'assert_screen_with_soft_timeout';
+use utils qw(zypper_call assert_screen_with_soft_timeout);
 use version_utils 'is_jeos';

 sub settle_load {
@@ -68,6 +68,10 @@ sub run {

     # return dmesg output to normal
     assert_script_run "dmesg -n 1";
+
+    # Remove leap 15.4 kernel as tests only
+    record_info('Remove the old kernel');
+    zypper_call('rm kernel-default-5.14.21-150400.22.1.x86_64');
 }

https://openqa.opensuse.org/tests/2997201
https://openqa.opensuse.org/tests/2997202
https://openqa.opensuse.org/tests/2997203

Actions #18

Updated by dimstar almost 2 years ago

rfan1 wrote:

dimstar wrote:

I know. it's a bit of hijacking - but the base images are shared for TW upgrade tests:

https://openqa.opensuse.org/tests/2987619#step/zdup/450

Is that the GM kernel being installed there? An upgrade from the GM kernel to TW is not possible. We need a base image with the kernel from -Update installed (and the old kernel must be uninstalled prior). This due to a bug fix in the kernel regarding script execution which was not in 15.4 GA

Thanks @dimstar for the update!

Currently, the 3 qcow2 images I built are based on GM ISO image. I will try to upgrade them to new kernel version and then upload them. btw, can I know which minimum kernel version is required?

I think the first update kernel had the scripts protected, so the minimal version should be
5.14.21-150400.24.11.1 (any newer is fine too)

(GA version is 5.14.21-150400.22.1)

Actions #19

Updated by rfan1 almost 2 years ago

dimstar wrote:

rfan1 wrote:

dimstar wrote:

I know. it's a bit of hijacking - but the base images are shared for TW upgrade tests:

https://openqa.opensuse.org/tests/2987619#step/zdup/450

Is that the GM kernel being installed there? An upgrade from the GM kernel to TW is not possible. We need a base image with the kernel from -Update installed (and the old kernel must be uninstalled prior). This due to a bug fix in the kernel regarding script execution which was not in 15.4 GA

Thanks @dimstar for the update!

Currently, the 3 qcow2 images I built are based on GM ISO image. I will try to upgrade them to new kernel version and then upload them. btw, can I know which minimum kernel version is required?

I think the first update kernel had the scripts protected, so the minimal version should be
5.14.21-150400.24.11.1 (any newer is fine too)

(GA version is 5.14.21-150400.22.1)

Thanks, it helps much!

Actions #20

Updated by rfan1 almost 2 years ago

Now, the zdup test to tw seems work fine:

https://openqa.opensuse.org/tests/2997283# [not completed yet, but zdump test module is green], let me re-run all the leap 15.4-15.5 test again.

https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.5&build=366.4&groupid=39

Actions #21

Updated by dimstar almost 2 years ago

rfan1 wrote:

Now, the zdup test to tw seems work fine:

https://openqa.opensuse.org/tests/2997283# [not completed yet, but zdup test module is green], let me re-run all the leap 15.4-15.5 test again.

Awesome work!

Actions #22

Updated by rfan1 almost 2 years ago

dimstar wrote:

rfan1 wrote:

Now, the zdup test to tw seems work fine:

https://openqa.opensuse.org/tests/2997283# [not completed yet, but zdup test module is green], let me re-run all the leap 15.4-15.5 test again.

Awesome work!

Hello @dimstar,

Can you please do me a favor? I want to move the following qcow2 images to o3 /var/lib/openqa/factory/hdd/fixed directory.
Now they are under /var/lib/openqa/factory/hdd/fixed/transfer. you can overwrite the images with the same name if any.

~> ll /var/lib/openqa/factory/hdd/fixed/transfer/
total 20972100
-rw-r--r-- 1 rfan users 11558387712 Jan  3 01:46 opensuse-15.4-x86_64-GM-cryptlvm@uefi.qcow2
-rw-r--r-- 1 rfan users  4904452096 Jan  3 02:19 opensuse-15.4-x86_64-GM-gnome@64bit.qcow2
-rw-r--r-- 1 rfan users  5012586496 Jan  3 02:23 opensuse-15.4-x86_64-GM-kde@64bit.qcow2

BTW, we may hit issue https://bugzilla.suse.com/show_bug.cgi?id=1203012 with test module disable_grub_timeout and yast2_bootloader in zdup test [ e.g. https://openqa.opensuse.org/tests/3007454], I can pass the test with workaround setting QEMU_VIRTIO_RNG=0
, I used the same setting when I tried to build the images as well.

Actions #23

Updated by dimstar almost 2 years ago

rfan1 wrote:

Hello @dimstar,

Can you please do me a favor? I want to move the following qcow2 images to o3 /var/lib/openqa/factory/hdd/fixed directory.
Now they are under /var/lib/openqa/factory/hdd/fixed/transfer. you can overwrite the images with the same name if any.

qcow2 files have been moved up to …/fixed

Actions #25

Updated by rfan1 almost 2 years ago

  • Status changed from In Progress to Feedback

PR is merged, let me wait for next openQA run result.

Actions

Also available in: Atom PDF