action #115607
closedcoordination #115322: [Epic] Update test coverage based on PRD for migration paths in SLE 15 SP5
Revert addition of module pcm in Migration and adapt in its own combination
Description
Motivation¶
Product module pcm was randomly added for other combinations in Migration matrix by mistake, but this action changed the test case. Instead we should cover pcm in its existing test case for combination with that module. So basically this ticket revert the problem that was introduced previously.
The following cases should remove 'pcm' from the test suite name and its openQA setting 'addon':
offline_sles12sp5_pscc_base-pcm_all_full_GM@ppc64le
offline_ltss_sles15sp2_media_basesys-srv-desk-pcm_all_full
online_sles15sp3_pscc_basesys-srv-live-tsm-pcm_all_full_zdup
Adapt the following test cases to cover pcm with all patterns plus some specific changes (if any specified below):
- Modify offline_sles12sp5_rmt_pcm-contm_def_full
- We need to add similar test suite to offline_sles15sp2_ltss_rmt_basesys-srv-lgm-pcm_def_full but in 'Migration' job group and connecting scc for registration and migration (p1/c/c)
- Add similar test suite to online_sles15sp3_pscc_basesys-srv-lgm-pcm_def_full_y but migrating with zypper instead of YaST.
Acceptance criteria¶
AC1: Remove "pcm" from scenarios listed above
AC2: Add pcm to its corresponding combination in the test coverage.
Suggestions¶
Locate in the Migration matrix spreadsheet the changes described as starting point.
Updated by JERiveraMoya almost 2 years ago
- Tracker changed from coordination to action
Updated by JERiveraMoya almost 2 years ago
- Subject changed from Drop Online migration scenarios to SLE 15 SP5 to Revert addition of module pcm in Migration and adapt in its own combination
- Description updated (diff)
Updated by JERiveraMoya almost 2 years ago
- Tags deleted (
qe-yast-refinement) - Status changed from New to Workable
Updated by maritawerner almost 2 years ago
For pcm the scenario with "all patterns" is not a valid scenario, only default patterns are meaningful, please see this bug: https://bugzilla.suse.com/show_bug.cgi?id=989687#c19
For some documentation see also: https://confluence.suse.com/pages/viewpage.action?pageId=373096459#SLE15SP2/SP3/SP4MigrationWiki-Addons&Modules'changesaftermigration(FromSLE12toSLE15)
Updated by leli almost 2 years ago
maritawerner wrote:
For pcm the scenario with "all patterns" is not a valid scenario, only default patterns are meaningful, please see this bug: https://bugzilla.suse.com/show_bug.cgi?id=989687#c19
For some documentation see also: https://confluence.suse.com/pages/viewpage.action?pageId=373096459#SLE15SP2/SP3/SP4MigrationWiki-Addons&Modules'changesaftermigration(FromSLE12toSLE15)
Hi Marita, about the pcm with 'all patterns', we have a long discussion with HPC and Public cloud team, then got the conclusion we should test SLES for pcm with 'all patterns' with clear pattern combinations (Exclude "Instance-Init" and "Instance-Tools"). Corresponding ticket https://progress.opensuse.org/issues/105094
The e-mail titled as 'About HPC test scenario with Public cloud module on Aarch64' is for the discussion of pcm.
Updated by leli almost 2 years ago
- Assignee set to leli
From my point of view, this is not a mistake, just at the end of SLES15SP4 I don't want to update too much testcases and only select several cases to test pcm + 'all patterns', we plan to update test matrix after GM of SLES15SP4. So this ticket is to update testcases following the new test matrix.
Updated by leli almost 2 years ago
New cases name:
offline_sles12sp5_pscc_base_all_full_GM
offline_sles15sp2_ltss_media_basesys-srv-desk_all_full
online_sles15sp3_pscc_basesys-srv-live-tsm_all_full_zdup
offline_sles12sp5_rmt_pcm-contm_all_full
offline_sles15sp2_ltss_pscc_basesys-srv-lgm-pcm_all_full
online_sles15sp3_pscc_basesys-srv-lgm-pcm_all_full_zypp
Updated by leli almost 2 years ago
MR submitted. https://gitlab.suse.de/coolgw/wegao-test/-/merge_requests/132
VRs:
https://openqa.nue.suse.com/tests/9455443#
https://openqa.nue.suse.com/tests/9455444#
https://openqa.nue.suse.com/tests/9455469#details
https://openqa.nue.suse.com/tests/9455441#live
https://openqa.nue.suse.com/tests/9455494#live
Updated by leli almost 2 years ago
- Status changed from In Progress to Resolved
- % Done changed from 0 to 100
MR merged.
Updated by zoecao almost 2 years ago
@leli: There's an error in the case setting:
offline_sles15sp2_ltss_pscc_basesys-srv-lgm-pcm_all_full
Need to remove the setting of SMT_URL, please fix it.
Updated by leli almost 2 years ago
zoecao wrote:
@leli: There's an error in the case setting:
offline_sles15sp2_ltss_pscc_basesys-srv-lgm-pcm_all_full
Need to remove the setting of SMT_URL, please fix it.
Create a MR to fix this, https://gitlab.suse.de/coolgw/wegao-test/-/merge_requests/135