Project

General

Profile

Actions

action #116509

closed

coordination #115322: [Epic] Update test coverage based on PRD for migration paths in SLE 15 SP5

Adapt existing SLE-15-SP{3,4} Standalone offline migration + AutoYaST installation

Added by JERiveraMoya over 1 year ago. Updated over 1 year ago.

Status:
Resolved
Priority:
Normal
Assignee:
Target version:
Start date:
2022-09-13
Due date:
% Done:

0%

Estimated time:

Description

Motivation

After discussion with SAP and HA squad about the migration update here are the results:
https://confluence.suse.com/display/qasle/2022-09-12+SAP+and+HA+migration+update

General idea is that QE YaST will own equivalent standalone migrations to the ones that exists for non-standalone (with modification via clusters), consisting on:

  • AutoYaST installation (selecting the extension and corresponding role and publishing image)
  • Migration (without any more validation)

and SAP/HA squad will connect the standalone system migrated above to its existing procedure:

  • Boot image that has already modified by cluster
  • Migration
  • Validation with clusters

In that regard each team will review its own group, and migration with cluster will not start until standalone migration has succeed, making the team independent, but collaborating in case of any potential issue. In theory failures not seen in the standalone migration will be probably caused by cluster modification, so QE SAP/HA will open bugs for that and they will have to figure out what is different.

Additional mapping of standalone migration test suite names and cluster migration test suites should provided by our side to make the connection.

Scope

This is is the full list to tackle in the future (notice that we don't have to do it for both nodes, only one, so it is the half of it).

But in this ticket will will tackle this procedure only covering what the following existing test suite are covering:

  • migration_offline_dvd_sle15sp3_ha_alpha_node0{1,2}_atmg
  • migration_offline_dvd_sle15sp4_ha_alpha_node0{1,2}_atmg

It should corresponds which what Lemon did, so we just need to convert to AutoYaST (see additional info).
It should cover all architectures even ppc64le with PowerVM.

Acceptance criteria

AC1: Create new AutoYaST HA textmode image creation in "YaST Maintenance Updates - Development" job group
AC2: Use different name than existing when publishing AutoYaST image and change name of test suite to ha_autoyast_*
AC3: Tackle migration listed in the scope (above) for this ticket and setup as well in 'Migration' job group with name starting with ha_*

Additional information

PoC by Lemon: https://openqa.suse.de/tests/overview?distri=sle&version=15-SP5&build=19.1&groupid=319

  • create_hdd_ha_textmode_15SP3
  • offline_sles15sp3_pscc_basesys_all_full-standalone-test
  • create_hdd_ha_textmode_15SP4
  • offline_sles15sp4_pscc_basesys_all_full-standalone-test

Notice that we cannot replace yet the test suites in Migration: HA due to we need to still file bugs for new builds for existing configuration (which is replicated for both squad at the moment)

Please, do not chain image creation with migration test suites.


Related issues 1 (0 open1 closed)

Related to qe-yam - action #116179: Create PoC for migration of standalone HA installation from SLE-15-SP4Resolvedleli2022-09-02

Actions
Actions #1

Updated by JERiveraMoya over 1 year ago

  • Description updated (diff)
Actions #2

Updated by JERiveraMoya over 1 year ago

  • Description updated (diff)
Actions #3

Updated by JERiveraMoya over 1 year ago

  • Description updated (diff)
Actions #4

Updated by JERiveraMoya over 1 year ago

  • Subject changed from Create AutoYasT standalone installation for HA to Adapt offline standalone migration using AutoYaST for SLE-15-SP{3,4}
Actions #5

Updated by JERiveraMoya over 1 year ago

  • Description updated (diff)
Actions #6

Updated by JERiveraMoya over 1 year ago

  • Description updated (diff)
Actions #7

Updated by JERiveraMoya over 1 year ago

  • Subject changed from Adapt offline standalone migration using AutoYaST for SLE-15-SP{3,4} to Adapt existing offline standalone migration in dev group with AutoYaST for SLE-15-SP{3,4}
Actions #8

Updated by JERiveraMoya over 1 year ago

  • Description updated (diff)
Actions #9

Updated by JERiveraMoya over 1 year ago

  • Description updated (diff)
Actions #10

Updated by JERiveraMoya over 1 year ago

  • Tags deleted (qe-yast-refinement)
  • Status changed from New to Workable
Actions #11

Updated by JERiveraMoya over 1 year ago

  • Subject changed from Adapt existing offline standalone migration in dev group with AutoYaST for SLE-15-SP{3,4} to Adapt existing HA offline standalone migration in dev group with AutoYaST for SLE-15-SP{3,4}
Actions #12

Updated by zoecao over 1 year ago

  • Status changed from Workable to In Progress
  • Assignee set to zoecao
Actions #13

Updated by JERiveraMoya over 1 year ago

  • Description updated (diff)
Actions #14

Updated by zoecao over 1 year ago

Summit a MR for adding Migration HA yaml file to gitlab:
https://gitlab.suse.de/coolgw/wegao-test/-/merge_requests/142

Actions #15

Updated by zoecao over 1 year ago

Add the ha standalone cases of 15sp2/15sp3/15sp4 for all arches, checking the cases whether any setting issues. Will move the cases to migration daily group and submit MR after the cases are correct.
https://openqa.suse.de/tests/overview?distri=sle&version=15-SP5&build=24.1&groupid=319

Actions #16

Updated by zoecao over 1 year ago

Add the cases of create_hdd_ha_textmode_15SP3 & create_hdd_ha_textmode_15SP4 to migration development group to create qcows:
SLES-15-SP3-aarch64-HA-GM.qcow2
SLES-15-SP4-aarch64-HA-GM.qcow2
SLES-15-SP3-x86_64-HA-GM.qcow2
SLES-15-SP4-x86_64-HA-GM.qcow2
SLES-15-SP3-s390x-HA-GM.qcow2
SLES-15-SP4-s390x-HA-GM.qcow2
Wei Gao had helped to move these qcows to openqa fixed folder;
Add the offline ha standalone cases:
ha_migration_offline_dvd_sles15sp3
ha_migration_offline_dvd_sles15sp4
ha_migration_offline_pscc_sles15sp3
ha_migration_offline_pscc_sles15sp4
for x86_64, s390x and aarch64;
Add the offline ha standalone cases for power:
ha_migration_offline_dvd_sle15sp3_pre
ha_migration_offline_dvd_sle15sp3
ha_migration_offline_dvd_sle15sp4_pre
ha_migration_offline_dvd_sle15sp4
VR: https://openqa.suse.de/tests/overview?distri=sle&version=15-SP5&build=24.1&groupid=319

Actions #18

Updated by zoecao over 1 year ago

Still need to convert the installation case to AutoYaST.

Actions #19

Updated by JERiveraMoya over 1 year ago

  • Description updated (diff)

Notice change in AC1, that group is triggered everyday by the bot, avoiding for us to have to do it manually.
Also we need some naming convention to distinguish by product what we test, I updated AC2 and AC3.

Actions #20

Updated by JERiveraMoya over 1 year ago

  • Subject changed from Adapt existing HA offline standalone migration in dev group with AutoYaST for SLE-15-SP{3,4} to Adapt existing SLE-15-SP{3,4} Standalone offline migration + AutoYaST installation
  • Description updated (diff)
Actions #21

Updated by JERiveraMoya over 1 year ago

  • Description updated (diff)

Updated in the description your suggestion to cover all the architectures.

Actions #22

Updated by JERiveraMoya over 1 year ago

This ticket is for adapting what lemon did to use AutoYaST, but seems that he only did some subset, the jobs for sle-15-sp3 with pscc.
Please, just focus on those, I will be creating separate tickets for the remaining offline cases.
#117637 #117640

Actions #23

Updated by JERiveraMoya over 1 year ago

  • Related to action #116179: Create PoC for migration of standalone HA installation from SLE-15-SP4 added
Actions #24

Updated by zoecao over 1 year ago

Started to convert installation and creating qcow cases to autoyast, so far created 15SP2/SP3/SP4 installation and creating qcows cases on x86_64, will check the test result later.
https://10.160.0.207/tests/overview?distri=sle&version=15-SP5&build=25.1&groupid=251

Actions #25

Updated by zoecao over 1 year ago

Done with converting installation case to autoyast installation for 15SP3 and 15SP4:
https://openqa.suse.de/tests/overview?distri=sle&version=15-SP4&build=25.1&groupid=251
https://openqa.suse.de/tests/overview?distri=sle&version=15-SP3&build=25.1&groupid=251
Only for x86_64, s390x and aarch64.
And migration cases VR:
https://openqa.suse.de/tests/overview?distri=sle&version=15-SP5&build=25.1&groupid=251
ppc64le cases are not ready, need to resolve the failure:
https://openqa.suse.de/tests/9749498#step/login/1

Actions #26

Updated by JERiveraMoya over 1 year ago

good progress! let's add the MR for https://openqa.suse.de/group_overview/446 to have there all this autoyast creation jobs, as soon as we merge it, we can have more realistic results on a daily bases.

Actions #27

Updated by zoecao over 1 year ago

Submit the MR for the autoyast installation cases to YaST MUs Dev group:
MR: https://gitlab.suse.de/qa-maintenance/qam-openqa-yml/-/merge_requests/406
For the power cases, the issues on the installation case are resolved, but there's a failure on the migration case, will fix it and then submit the MR to add the ha standalone cases to migration group.
https://openqa.suse.de/tests/9756681#step/welcome/2

Actions #28

Updated by zoecao over 1 year ago

Submit PR for the autoyast profiles, and will submit MR for the migration cases to migration daily group after no more problems with the autoyast installation mr.
PR link: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/15751
autoyast case MR: https://gitlab.suse.de/qa-maintenance/qam-openqa-yml/-/merge_requests/406

Actions #29

Updated by zoecao over 1 year ago

I resubmit the MR for the ha standalone migration cases:
https://gitlab.suse.de/coolgw/wegao-test/-/merge_requests/158

Actions #30

Updated by zoecao over 1 year ago

The MRs and PR are merged, and I checked the latest test results of ha autoyast installation cases in YaST MUs Dev group, no issues found. So close here.

Actions #31

Updated by zoecao over 1 year ago

  • Status changed from In Progress to Resolved
Actions

Also available in: Atom PDF