action #132842
closedcoordination #130216: [epic] Adapt migration test coverage and its migration matrix for SLE 15 SP6
Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3 - part 1
Description
Motivation¶
Following the new test matrix, we need add large-sized module combination test suites to Migration daily and milestone job group, or do the movement from Migration milestone job group to daily job group.
The test need to be added as below:
migration daily job group(https://openqa.nue.suse.com/group_overview/265)
offline:
- offline_sles15sp3_pscc_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full@ppc64le (textmode)
- offline_sles15sp3_pscc_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full@x86_64 (textmode)
- offline_sles15sp3_media_basesys-srv-ltss-desk-dev_all_full@aarch64
- offline_sles15sp3_media_basesys-srv-ltss-desk-python2_all_full@aarch64
- offline_sles15sp3_pscc_basesys-srv-ltss-desk-dev_all_full@s390x-kvm
online:
- online_sles15sp3_pscc_basesys-srv-ltss-desk-dev_all_full_y@ppc64le
Note: check the existing test suites to decide to add/modify test suites or move from milestone job group.
Acceptance criteria¶
AC1: Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3
AC2: The new test suites need to be triggered and file bug if new issue found.
Updated by JERiveraMoya over 1 year ago
- Status changed from New to Workable
- Target version set to Current
- Parent task set to #130216
Updated by leli about 1 year ago
Updated this online_sles15sp3_pscc_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full_zypp@x86_64 (textmode) to online_sles15sp3_pscc_basesys-srv-ltss-contm-lgm-tsm-pcm-wsm_all_full_zypp@aarch64
Updated by JRivrain about 1 year ago
- Status changed from Workable to In Progress
- Assignee set to JRivrain
Updated by JRivrain about 1 year ago
- Subject changed from Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3 to Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3 - part 1
- Description updated (diff)
Updated by JRivrain about 1 year ago
Updated by JRivrain about 1 year ago
I have difficulties with s390x:
- problems with sle12 workers last week
- qcow images are deleted each night, so I have to re-run the 2 parent jobs before doing any VR, after several hours.
- still some failure that might be a bug, I don't know https://openqa.suse.de/tests/12682478#step/upgrade_select/5. I tried different qcows and variable combinations, it still happens.
Updated by leli about 1 year ago
JRivrain wrote in #note-13:
I have difficulties with s390x:
- problems with sle12 workers last week
- qcow images are deleted each night, so I have to re-run the 2 parent jobs before doing any VR, after several hours. I will move these support images to fixed folder to avoid such unstable qcow generation issue.
- still some failure that might be a bug, I don't know https://openqa.suse.de/tests/12682478#step/upgrade_select/5. I tried different qcows and variable combinations, it still happens. You have wrong setting for REPO_0, it should be 'SLE-15-SP6-Online-s390x-Build26.1-Media1' while not for 15SP3.
Updated by JRivrain about 1 year ago
I excluded the s390x test from the MR so we can merge it. We will can add it after. I cannot figure out why this test fails in that way at the moment.
Updated by JRivrain about 1 year ago
I re-added the s390 part, the issue seemed to be a bug in the build I was using. I managed to use the build 28.1 and manually work around the known issue for that build. In last VR, the test failed in reconnect_mgmt_console, but I think the MR is ready to merge.