action #116509
closedcoordination #115322: [Epic] Update test coverage based on PRD for migration paths in SLE 15 SP5
Adapt existing SLE-15-SP{3,4} Standalone offline migration + AutoYaST installation
Description
Motivation¶
After discussion with SAP and HA squad about the migration update here are the results:
https://confluence.suse.com/display/qasle/2022-09-12+SAP+and+HA+migration+update
General idea is that QE YaST will own equivalent standalone migrations to the ones that exists for non-standalone (with modification via clusters), consisting on:
- AutoYaST installation (selecting the extension and corresponding role and publishing image)
- Migration (without any more validation)
and SAP/HA squad will connect the standalone system migrated above to its existing procedure:
- Boot image that has already modified by cluster
- Migration
- Validation with clusters
In that regard each team will review its own group, and migration with cluster will not start until standalone migration has succeed, making the team independent, but collaborating in case of any potential issue. In theory failures not seen in the standalone migration will be probably caused by cluster modification, so QE SAP/HA will open bugs for that and they will have to figure out what is different.
Additional mapping of standalone migration test suite names and cluster migration test suites should provided by our side to make the connection.
Scope¶
This is is the full list to tackle in the future (notice that we don't have to do it for both nodes, only one, so it is the half of it).
But in this ticket will will tackle this procedure only covering what the following existing test suite are covering:
- migration_offline_dvd_sle15sp3_ha_alpha_node0{1,2}_atmg
- migration_offline_dvd_sle15sp4_ha_alpha_node0{1,2}_atmg
It should corresponds which what Lemon did, so we just need to convert to AutoYaST (see additional info).
It should cover all architectures even ppc64le with PowerVM.
Acceptance criteria¶
AC1: Create new AutoYaST HA textmode image creation in "YaST Maintenance Updates - Development" job group
AC2: Use different name than existing when publishing AutoYaST image and change name of test suite to ha_autoyast_*
AC3: Tackle migration listed in the scope (above) for this ticket and setup as well in 'Migration' job group with name starting with ha_*
Additional information¶
PoC by Lemon: https://openqa.suse.de/tests/overview?distri=sle&version=15-SP5&build=19.1&groupid=319
- create_hdd_ha_textmode_15SP3
- offline_sles15sp3_pscc_basesys_all_full-standalone-test
- create_hdd_ha_textmode_15SP4
- offline_sles15sp4_pscc_basesys_all_full-standalone-test
Notice that we cannot replace yet the test suites in Migration: HA due to we need to still file bugs for new builds for existing configuration (which is replicated for both squad at the moment)
Please, do not chain image creation with migration test suites.
Updated by JERiveraMoya over 2 years ago
- Subject changed from Create AutoYasT standalone installation for HA to Adapt offline standalone migration using AutoYaST for SLE-15-SP{3,4}
Updated by JERiveraMoya over 2 years ago
- Subject changed from Adapt offline standalone migration using AutoYaST for SLE-15-SP{3,4} to Adapt existing offline standalone migration in dev group with AutoYaST for SLE-15-SP{3,4}
Updated by JERiveraMoya over 2 years ago
- Tags deleted (
qe-yast-refinement) - Status changed from New to Workable
Updated by JERiveraMoya over 2 years ago
- Subject changed from Adapt existing offline standalone migration in dev group with AutoYaST for SLE-15-SP{3,4} to Adapt existing HA offline standalone migration in dev group with AutoYaST for SLE-15-SP{3,4}
Updated by zoecao over 2 years ago
- Status changed from Workable to In Progress
- Assignee set to zoecao
Updated by zoecao about 2 years ago
Summit a MR for adding Migration HA yaml file to gitlab:
https://gitlab.suse.de/coolgw/wegao-test/-/merge_requests/142
Updated by zoecao about 2 years ago
Add the ha standalone cases of 15sp2/15sp3/15sp4 for all arches, checking the cases whether any setting issues. Will move the cases to migration daily group and submit MR after the cases are correct.
https://openqa.suse.de/tests/overview?distri=sle&version=15-SP5&build=24.1&groupid=319
Updated by zoecao about 2 years ago
Add the cases of create_hdd_ha_textmode_15SP3 & create_hdd_ha_textmode_15SP4 to migration development group to create qcows:
SLES-15-SP3-aarch64-HA-GM.qcow2
SLES-15-SP4-aarch64-HA-GM.qcow2
SLES-15-SP3-x86_64-HA-GM.qcow2
SLES-15-SP4-x86_64-HA-GM.qcow2
SLES-15-SP3-s390x-HA-GM.qcow2
SLES-15-SP4-s390x-HA-GM.qcow2
Wei Gao had helped to move these qcows to openqa fixed folder;
Add the offline ha standalone cases:
ha_migration_offline_dvd_sles15sp3
ha_migration_offline_dvd_sles15sp4
ha_migration_offline_pscc_sles15sp3
ha_migration_offline_pscc_sles15sp4
for x86_64, s390x and aarch64;
Add the offline ha standalone cases for power:
ha_migration_offline_dvd_sle15sp3_pre
ha_migration_offline_dvd_sle15sp3
ha_migration_offline_dvd_sle15sp4_pre
ha_migration_offline_dvd_sle15sp4
VR: https://openqa.suse.de/tests/overview?distri=sle&version=15-SP5&build=24.1&groupid=319
Updated by zoecao about 2 years ago
Submit MR for this ticket:
https://gitlab.suse.de/coolgw/wegao-test/-/merge_requests/146
Updated by zoecao about 2 years ago
Still need to convert the installation case to AutoYaST.
Updated by JERiveraMoya about 2 years ago
- Description updated (diff)
Notice change in AC1, that group is triggered everyday by the bot, avoiding for us to have to do it manually.
Also we need some naming convention to distinguish by product what we test, I updated AC2 and AC3.
Updated by JERiveraMoya about 2 years ago
- Subject changed from Adapt existing HA offline standalone migration in dev group with AutoYaST for SLE-15-SP{3,4} to Adapt existing SLE-15-SP{3,4} Standalone offline migration + AutoYaST installation
- Description updated (diff)
Updated by JERiveraMoya about 2 years ago
- Description updated (diff)
Updated in the description your suggestion to cover all the architectures.
Updated by JERiveraMoya about 2 years ago
This ticket is for adapting what lemon did to use AutoYaST, but seems that he only did some subset, the jobs for sle-15-sp3 with pscc.
Please, just focus on those, I will be creating separate tickets for the remaining offline cases.
#117637 #117640
Updated by JERiveraMoya about 2 years ago
- Related to action #116179: Create PoC for migration of standalone HA installation from SLE-15-SP4 added
Updated by zoecao about 2 years ago
Started to convert installation and creating qcow cases to autoyast, so far created 15SP2/SP3/SP4 installation and creating qcows cases on x86_64, will check the test result later.
https://10.160.0.207/tests/overview?distri=sle&version=15-SP5&build=25.1&groupid=251
Updated by zoecao about 2 years ago
Done with converting installation case to autoyast installation for 15SP3 and 15SP4:
https://openqa.suse.de/tests/overview?distri=sle&version=15-SP4&build=25.1&groupid=251
https://openqa.suse.de/tests/overview?distri=sle&version=15-SP3&build=25.1&groupid=251
Only for x86_64, s390x and aarch64.
And migration cases VR:
https://openqa.suse.de/tests/overview?distri=sle&version=15-SP5&build=25.1&groupid=251
ppc64le cases are not ready, need to resolve the failure:
https://openqa.suse.de/tests/9749498#step/login/1
Updated by JERiveraMoya about 2 years ago
good progress! let's add the MR for https://openqa.suse.de/group_overview/446 to have there all this autoyast creation jobs, as soon as we merge it, we can have more realistic results on a daily bases.
Updated by zoecao about 2 years ago
Submit the MR for the autoyast installation cases to YaST MUs Dev group:
MR: https://gitlab.suse.de/qa-maintenance/qam-openqa-yml/-/merge_requests/406
For the power cases, the issues on the installation case are resolved, but there's a failure on the migration case, will fix it and then submit the MR to add the ha standalone cases to migration group.
https://openqa.suse.de/tests/9756681#step/welcome/2
Updated by zoecao about 2 years ago
Submit PR for the autoyast profiles, and will submit MR for the migration cases to migration daily group after no more problems with the autoyast installation mr.
PR link: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/15751
autoyast case MR: https://gitlab.suse.de/qa-maintenance/qam-openqa-yml/-/merge_requests/406
Updated by zoecao about 2 years ago
I resubmit the MR for the ha standalone migration cases:
https://gitlab.suse.de/coolgw/wegao-test/-/merge_requests/158
Updated by zoecao about 2 years ago
The MRs and PR are merged, and I checked the latest test results of ha autoyast installation cases in YaST MUs Dev group, no issues found. So close here.
Updated by zoecao about 2 years ago
- Status changed from In Progress to Resolved