action #117520
closed[qe-core][opensuse] set up 15.4 to 15.5 upgrade tests
0%
Description
Please to set up tests for Leap 15.4 upgrade to Leap 15.5, including upgrading via zypper and installer.
Updated by maritawerner about 2 years ago
- Subject changed from set up 15.4 to 15.5 upgrade tests to [opensuse] set up 15.4 to 15.5 upgrade tests
Updated by szarate about 2 years ago
- Subject changed from [opensuse] set up 15.4 to 15.5 upgrade tests to [qe-core][opensuse] set up 15.4 to 15.5 upgrade tests
Max, do you have a timeframe when this should be done? mostly... are the update repos already there?
Updated by mlin7442 about 2 years ago
szarate wrote:
Max, do you have a timeframe when this should be done? mostly... are the update repos already there?
15.4 was released a while, the update repos is all set at http://download.opensuse.org/update/leap/15.4/ . Do you need the 15.5 update repos for the 15.4->15.5 migration setup? we do have it already http://download.opensuse.org/update/leap/15.5/ , just not so much updates exist since 15.5 is still under development.
Updated by szarate about 2 years ago
- Sprint set to QE-Core: December Sprint (Dec 07 - Jan 04)
- Tags set to qe-core-december-sprint
- Status changed from New to Workable
- Target version set to QE-Core: Ready
Updated by dimstar about 2 years ago
co-incidentally I started working on 15.4-> TW upgrade tests. For this I already copied some auto-generated HDD (from maintenance update) to hdd/fixed:
opensuse-15.4-x86_64-GM-gnome@64bit.qcow2
opensuse-15.4-x86_64-GM-kde@64bit.qcow2
I also created the test suite zdup-Leap-15-{gnome,kde} (initial tests in the TW devel group; and first bug already filed :) )
some of that work should at least be re-usable for Leap 15.4->15.5 testing
Updated by rfan1 about 2 years ago
dimstar wrote:
co-incidentally I started working on 15.4-> TW upgrade tests. For this I already copied some auto-generated HDD (from maintenance update) to hdd/fixed:
opensuse-15.4-x86_64-GM-gnome@64bit.qcow2
opensuse-15.4-x86_64-GM-kde@64bit.qcow2
dimstar
I also created the test suite zdup-Leap-15-{gnome,kde} (initial tests in the TW devel group; and first bug already filed :) )some of that work should at least be re-usable for Leap 15.4->15.5 testing
Could you please point me the opensuse-15.4-x86_64-GM-kde@64bit.qcow2
download link if any? seems I fail to find it.
I can find the one gnome one, I can build a new one if no available one is there. thanks much!
Updated by rfan1 about 2 years ago
- Status changed from Workable to In Progress
rfan1 wrote:
Start to build some qcow2 images
hdd/fixed> ls |grep opensuse-15.4-x86_64-GM
opensuse-15.4-x86_64-GM-gnome@64bit.qcow2
opensuse-15.4-x86_64-GM-kde@64bit.qcow2
opensuse-15.4-x86_64-GM-cryptlvm@uefi.qcow2
Updated by rfan1 almost 2 years ago
https://openqa.opensuse.org/admin/job_templates/39
Some scenarios are added to job group
Updated by rfan1 almost 2 years ago
rfan1 wrote:
rfan1 wrote:
Start to build some qcow2 images
hdd/fixed> ls |grep opensuse-15.4-x86_64-GM opensuse-15.4-x86_64-GM-gnome@64bit.qcow2 opensuse-15.4-x86_64-GM-kde@64bit.qcow2 opensuse-15.4-x86_64-GM-cryptlvm@uefi.qcow2
I re-built the qcow2 image via leap15.4 iso image https://openqa.opensuse.org/tests/2980139/asset/iso/openSUSE-Leap-15.4-DVD-x86_64.iso
this should be the GM one
Updated by rfan1 almost 2 years ago
https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.5&build=366.2&groupid=39
The tests are running well, the failed cases are known issues which can be seen on other leap versions as well.
Updated by rfan1 almost 2 years ago
Added flavor 'NET' and new job 'upgrade_Leap_15.4_cryptlvm'
Updated by dimstar almost 2 years ago
I know. it's a bit of hijacking - but the base images are shared for TW upgrade tests:
https://openqa.opensuse.org/tests/2987619#step/zdup/450
Is that the GM kernel being installed there? An upgrade from the GM kernel to TW is not possible. We need a base image with the kernel from -Update installed (and the old kernel must be uninstalled prior). This due to a bug fix in the kernel regarding script execution which was not in 15.4 GA
Updated by rfan1 almost 2 years ago
dimstar wrote:
I know. it's a bit of hijacking - but the base images are shared for TW upgrade tests:
https://openqa.opensuse.org/tests/2987619#step/zdup/450
Is that the GM kernel being installed there? An upgrade from the GM kernel to TW is not possible. We need a base image with the kernel from -Update installed (and the old kernel must be uninstalled prior). This due to a bug fix in the kernel regarding script execution which was not in 15.4 GA
Thanks @dimstar for the update!
Currently, the 3 qcow2 images I built are based on GM ISO image. I will try to upgrade them to new kernel version and then upload them. btw, can I know which minimum kernel version is required?
Updated by rfan1 almost 2 years ago
Now,
I will try to build 3 new images with updated kernel [version should be updated to 5.14.21-150400.24.38-default],at the same time, I will try to remove the old kernel packages via code changes below:
diff --git a/tests/console/force_scheduled_tasks.pm b/tests/console/force_scheduled_tasks.pm
index 9b7bfb261..ebb31bbee 100644
--- a/tests/console/force_scheduled_tasks.pm
+++ b/tests/console/force_scheduled_tasks.pm
@@ -18,7 +18,7 @@ use base "consoletest";
use strict;
use warnings;
use testapi;
-use utils 'assert_screen_with_soft_timeout';
+use utils qw(zypper_call assert_screen_with_soft_timeout);
use version_utils 'is_jeos';
sub settle_load {
@@ -68,6 +68,10 @@ sub run {
# return dmesg output to normal
assert_script_run "dmesg -n 1";
+
+ # Remove leap 15.4 kernel as tests only
+ record_info('Remove the old kernel');
+ zypper_call('rm kernel-default-5.14.21-150400.22.1.x86_64');
}
https://openqa.opensuse.org/tests/2997201
https://openqa.opensuse.org/tests/2997202
https://openqa.opensuse.org/tests/2997203
Updated by dimstar almost 2 years ago
rfan1 wrote:
dimstar wrote:
I know. it's a bit of hijacking - but the base images are shared for TW upgrade tests:
https://openqa.opensuse.org/tests/2987619#step/zdup/450
Is that the GM kernel being installed there? An upgrade from the GM kernel to TW is not possible. We need a base image with the kernel from -Update installed (and the old kernel must be uninstalled prior). This due to a bug fix in the kernel regarding script execution which was not in 15.4 GA
Thanks @dimstar for the update!
Currently, the 3 qcow2 images I built are based on GM ISO image. I will try to upgrade them to new kernel version and then upload them. btw, can I know which minimum kernel version is required?
I think the first update kernel had the scripts protected, so the minimal version should be
5.14.21-150400.24.11.1 (any newer is fine too)
(GA version is 5.14.21-150400.22.1)
Updated by rfan1 almost 2 years ago
dimstar wrote:
rfan1 wrote:
dimstar wrote:
I know. it's a bit of hijacking - but the base images are shared for TW upgrade tests:
https://openqa.opensuse.org/tests/2987619#step/zdup/450
Is that the GM kernel being installed there? An upgrade from the GM kernel to TW is not possible. We need a base image with the kernel from -Update installed (and the old kernel must be uninstalled prior). This due to a bug fix in the kernel regarding script execution which was not in 15.4 GA
Thanks @dimstar for the update!
Currently, the 3 qcow2 images I built are based on GM ISO image. I will try to upgrade them to new kernel version and then upload them. btw, can I know which minimum kernel version is required?
I think the first update kernel had the scripts protected, so the minimal version should be
5.14.21-150400.24.11.1 (any newer is fine too)(GA version is 5.14.21-150400.22.1)
Thanks, it helps much!
Updated by rfan1 almost 2 years ago
Now, the zdup test to tw seems work fine:
https://openqa.opensuse.org/tests/2997283# [not completed yet, but zdump test module is green], let me re-run all the leap 15.4-15.5 test again.
https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.5&build=366.4&groupid=39
Updated by dimstar almost 2 years ago
rfan1 wrote:
Now, the zdup test to tw seems work fine:
https://openqa.opensuse.org/tests/2997283# [not completed yet, but zdup test module is green], let me re-run all the leap 15.4-15.5 test again.
Awesome work!
Updated by rfan1 almost 2 years ago
dimstar wrote:
rfan1 wrote:
Now, the zdup test to tw seems work fine:
https://openqa.opensuse.org/tests/2997283# [not completed yet, but zdup test module is green], let me re-run all the leap 15.4-15.5 test again.
Awesome work!
Hello @dimstar,
Can you please do me a favor? I want to move the following qcow2 images to o3 /var/lib/openqa/factory/hdd/fixed
directory.
Now they are under /var/lib/openqa/factory/hdd/fixed/transfer
. you can overwrite the images with the same name if any.
~> ll /var/lib/openqa/factory/hdd/fixed/transfer/
total 20972100
-rw-r--r-- 1 rfan users 11558387712 Jan 3 01:46 opensuse-15.4-x86_64-GM-cryptlvm@uefi.qcow2
-rw-r--r-- 1 rfan users 4904452096 Jan 3 02:19 opensuse-15.4-x86_64-GM-gnome@64bit.qcow2
-rw-r--r-- 1 rfan users 5012586496 Jan 3 02:23 opensuse-15.4-x86_64-GM-kde@64bit.qcow2
BTW, we may hit issue https://bugzilla.suse.com/show_bug.cgi?id=1203012 with test module disable_grub_timeout
and yast2_bootloader
in zdup test [ e.g. https://openqa.opensuse.org/tests/3007454], I can pass the test with workaround setting QEMU_VIRTIO_RNG=0
, I used the same setting when I tried to build the images as well.
Updated by dimstar almost 2 years ago
rfan1 wrote:
Hello @dimstar,
Can you please do me a favor? I want to move the following qcow2 images to o3
/var/lib/openqa/factory/hdd/fixed
directory.
Now they are under/var/lib/openqa/factory/hdd/fixed/transfer
. you can overwrite the images with the same name if any.
qcow2 files have been moved up to …/fixed
Updated by rfan1 almost 2 years ago
Updated by rfan1 almost 2 years ago
- Status changed from In Progress to Feedback
PR is merged, let me wait for next openQA run result.
Updated by rfan1 almost 2 years ago
- Status changed from Feedback to Resolved
All tests show up in production job group:
https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.5&build=368.1&groupid=50
I have filed bugs against the failed test modules:
https://bugzilla.opensuse.org/show_bug.cgi?id=1206865
https://bugzilla.opensuse.org/show_bug.cgi?id=1206879
https://bugzilla.opensuse.org/show_bug.cgi?id=1206814