action #132842
closed
coordination #130216: [epic] Adapt migration test coverage and its migration matrix for SLE 15 SP6
Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3 - part 1
Added by leli 10 months ago.
Updated 5 months ago.
Estimated time:
(Total: 0.00 h)
Description
Motivation¶
Following the new test matrix, we need add large-sized module combination test suites to Migration daily and milestone job group, or do the movement from Migration milestone job group to daily job group.
The test need to be added as below:
migration daily job group(https://openqa.nue.suse.com/group_overview/265)
offline:
- offline_sles15sp3_pscc_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full@ppc64le (textmode)
- offline_sles15sp3_pscc_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full@x86_64 (textmode)
- offline_sles15sp3_media_basesys-srv-ltss-desk-dev_all_full@aarch64
- offline_sles15sp3_media_basesys-srv-ltss-desk-python2_all_full@aarch64
- offline_sles15sp3_pscc_basesys-srv-ltss-desk-dev_all_full@s390x-kvm
online:
- online_sles15sp3_pscc_basesys-srv-ltss-desk-dev_all_full_y@ppc64le
Note: check the existing test suites to decide to add/modify test suites or move from milestone job group.
Acceptance criteria¶
AC1: Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3
AC2: The new test suites need to be triggered and file bug if new issue found.
- Status changed from New to Workable
- Target version set to Current
- Parent task set to #130216
- Description updated (diff)
- Description updated (diff)
- Priority changed from Normal to High
- Description updated (diff)
Updated this online_sles15sp3_pscc_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full_zypp@x86_64 (textmode) to online_sles15sp3_pscc_basesys-srv-ltss-contm-lgm-tsm-pcm-wsm_all_full_zypp@aarch64
- Description updated (diff)
- Status changed from Workable to In Progress
- Assignee set to JRivrain
- Subject changed from Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3 to Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3 - part 1
- Description updated (diff)
- Description updated (diff)
I have difficulties with s390x:
- problems with sle12 workers last week
- qcow images are deleted each night, so I have to re-run the 2 parent jobs before doing any VR, after several hours.
- still some failure that might be a bug, I don't know https://openqa.suse.de/tests/12682478#step/upgrade_select/5. I tried different qcows and variable combinations, it still happens.
JRivrain wrote in #note-13:
I have difficulties with s390x:
- problems with sle12 workers last week
- qcow images are deleted each night, so I have to re-run the 2 parent jobs before doing any VR, after several hours.
I will move these support images to fixed folder to avoid such unstable qcow generation issue.
- still some failure that might be a bug, I don't know https://openqa.suse.de/tests/12682478#step/upgrade_select/5. I tried different qcows and variable combinations, it still happens.
You have wrong setting for REPO_0, it should be 'SLE-15-SP6-Online-s390x-Build26.1-Media1' while not for 15SP3.
I excluded the s390x test from the MR so we can merge it. We will can add it after. I cannot figure out why this test fails in that way at the moment.
I re-added the s390 part, the issue seemed to be a bug in the build I was using. I managed to use the build 28.1 and manually work around the known issue for that build. In last VR, the test failed in reconnect_mgmt_console, but I think the MR is ready to merge.
MR merged, waiting for next build.
- Status changed from In Progress to Blocked
there has not been any build since last update, I'll unblock and resolve this when there's a build.
- Status changed from Blocked to Resolved
All passed, thanks @leli for helping with that one.
Also available in: Atom
PDF