action #132842
closedcoordination #130216: [epic] Adapt migration test coverage and its migration matrix for SLE 15 SP6
Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3 - part 1
Description
Motivation¶
Following the new test matrix, we need add large-sized module combination test suites to Migration daily and milestone job group, or do the movement from Migration milestone job group to daily job group.
The test need to be added as below:
migration daily job group(https://openqa.nue.suse.com/group_overview/265)
offline:
- offline_sles15sp3_pscc_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full@ppc64le (textmode)
- offline_sles15sp3_pscc_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full@x86_64 (textmode)
- offline_sles15sp3_media_basesys-srv-ltss-desk-dev_all_full@aarch64
- offline_sles15sp3_media_basesys-srv-ltss-desk-python2_all_full@aarch64
- offline_sles15sp3_pscc_basesys-srv-ltss-desk-dev_all_full@s390x-kvm
online:
- online_sles15sp3_pscc_basesys-srv-ltss-desk-dev_all_full_y@ppc64le
Note: check the existing test suites to decide to add/modify test suites or move from milestone job group.
Acceptance criteria¶
AC1: Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3
AC2: The new test suites need to be triggered and file bug if new issue found.
Updated by JERiveraMoya 10 months ago
- Status changed from New to Workable
- Target version set to Current
- Parent task set to #130216
Updated by JRivrain 6 months ago
I have difficulties with s390x:
- problems with sle12 workers last week
- qcow images are deleted each night, so I have to re-run the 2 parent jobs before doing any VR, after several hours.
- still some failure that might be a bug, I don't know https://openqa.suse.de/tests/12682478#step/upgrade_select/5. I tried different qcows and variable combinations, it still happens.
Updated by leli 6 months ago
JRivrain wrote in #note-13:
I have difficulties with s390x:
- problems with sle12 workers last week
- qcow images are deleted each night, so I have to re-run the 2 parent jobs before doing any VR, after several hours. I will move these support images to fixed folder to avoid such unstable qcow generation issue.
- still some failure that might be a bug, I don't know https://openqa.suse.de/tests/12682478#step/upgrade_select/5. I tried different qcows and variable combinations, it still happens. You have wrong setting for REPO_0, it should be 'SLE-15-SP6-Online-s390x-Build26.1-Media1' while not for 15SP3.
Updated by JRivrain 6 months ago
I re-added the s390 part, the issue seemed to be a bug in the build I was using. I managed to use the build 28.1 and manually work around the known issue for that build. In last VR, the test failed in reconnect_mgmt_console, but I think the MR is ready to merge.