Project

General

Profile

Actions
Copy link

action #135899

closed

coordination #120534: [epic] Provide auto-installation test suites for supporting testing

Optimize test coverage for recommended module, lp-contm-lgm-tsm-pcm-wsm module combination with all patterns from SLE 15 SP5

Added by leli 8 months ago. Updated 6 months ago.

Status:
Resolved
Priority:
High
Assignee:
zoecao
Target version:
Current
Start date:
2023-09-18
Due date:
% Done:

0%

Estimated time:

Description

Motivation

Following the new test matrix, we need add
recommended module, lp-contm-lgm-tsm-pcm-wsm module combination test suites to Migration daily and milestone job group, or do the movement from Migration milestone job group to daily job group.

The test need to be added as below:
migration daily job group(https://openqa.nue.suse.com/group_overview/265)
offline:
* offline_sles15sp5_media_basesys-srv-python3_all_full@spvm (textmode)
* autoupgrade_sles15sp5_pscc_basesys-srv-python3_all_full@x86_64 (textmode)
* offline_sles15sp5_pscc_basesys-srv-python3-lp-contm-lgm-tsm-pcm-wsm_all_full@spvm (textmode) (DROPPED_MODULES: 'tsm')
* offline_sles15sp5_pscc_basesys-srv-python3-lp-contm-lgm-tsm-pcm-wsm_all_full@x86_64 (textmode) (DROPPED_MODULES: 'tsm')

online:
* online_sles15sp5_pscc_basesys-srv-python3_all_full_y@aarch64 (textmode)
* online_sles15sp5_pscc_basesys-srv-python3_all_full_zdup@s390-kvm (textmode)
* online_sles15sp5_pscc_basesys-srv-python3-lp-contm-lgm-tsm-pcm-wsm_all_full_zypp@aarch64 (textmode) (DROPPED_MODULES: 'tsm')
* online_sles15sp5_pscc_basesys-srv-python3-lp-contm-lgm-tsm-pcm-wsm_all_full_y@s390x-kvm (textmode) (DROPPED_MODULES: 'tsm')

Migration milestone job group(https://openqa.nue.suse.com/group_overview/266):
* offline_sles15sp5_rmt_basesys-srv-python3_all_full@spvm (textmode)
* online_sles15sp5_rmt_basesys-srv-python3-lp-contm-lgm-tsm-pcm-wsm_all_full_y@aarch64 (textmode) (DROPPED_MODULES: 'tsm')
* online_sles15sp5_smt_basesys-srv-python3-lp-contm-lgm-tsm-pcm-wsm_all_full_y@s390x-kvm (textmode) (DROPPED_MODULES: 'tsm')

Note:
check the existing test suites to decide to add/modify test suites or move from milestone job group.
tested registration but not migration for tsm.

Acceptance criteria

AC1: Optimize test coverage for recommended module, lp-contm-lgm-tsm-pcm-wsm module combination with all patterns from SLE 15 SP5.
AC2: The new test suites need to be triggered and file bug if new issue found.

Actions
Copy link
 #1

Updated by leli 7 months ago

  • Status changed from New to Workable
  • Target version set to Current
  • Parent task set to #120534
Actions
Copy link
 #2

Updated by leli 7 months ago

  • Priority changed from Normal to High
Actions
Copy link
 #3

Updated by zoecao 7 months ago

  • Status changed from Workable to In Progress
  • Assignee set to zoecao
Actions
Copy link
 #4

Updated by zoecao 7 months ago

Added the testsuites and running VRs: (cases names start with c- are for this ticket)
https://openqa.suse.de/tests/overview?distri=sle&version=15-SP6&build=26.1&groupid=251

I will check the results later.

Actions
Copy link
 #5

Updated by zoecao 6 months ago

Submit MR to add the testsuites:
https://gitlab.suse.de/coolgw/wegao-test/-/merge_requests/357
(ppc64le is not included, will add ppc64le testsuite via a new MR)

And only the ppc64le testsuites need to DROPPED_MODULES: 'tsm'.

offline:

  • offline_sles15sp5_media_basesys-srv-python3_all_full@spvm (textmode)
  • autoupgrade_sles15sp5_pscc_basesys-srv-python3_all_full@x86_64 (textmode) (Added via [MR#357])
  • offline_sles15sp5_pscc_basesys-srv-python3-lp-contm-lgm-tsm-pcm-wsm_all_full@spvm (textmode) (DROPPED_MODULES: 'tsm')
  • offline_sles15sp5_pscc_basesys-srv-python3-lp-contm-lgm-tsm-pcm-wsm_all_full@x86_64 (textmode) (Added via [MR#357])

online:

  • online_sles15sp5_pscc_basesys-srv-python3_all_full_y@aarch64 (textmode) (Added via [MR#357])
  • online_sles15sp5_pscc_basesys-srv-python3_all_full_zdup@s390-kvm (textmode) (Added via [MR#357])
  • online_sles15sp5_pscc_basesys-srv-python3-lp-contm-lgm-tsm-pcm-wsm_all_full_zypp@aarch64 (textmode) (Added via [MR#357])
  • online_sles15sp5_pscc_basesys-srv-python3-lp-contm-lgm-tsm-pcm-wsm_all_full_y@s390x-kvm (textmode) (Added via [MR#357])

Migration milestone job group(https://openqa.nue.suse.com/group_overview/266):

  • offline_sles15sp5_rmt_basesys-srv-python3_all_full@spvm (textmode)
  • online_sles15sp5_rmt_basesys-srv-python3-lp-contm-lgm-tsm-pcm-wsm_all_full_y@aarch64 (textmode) (Added via [MR#357])
  • online_sles15sp5_smt_basesys-srv-python3-lp-contm-lgm-tsm-pcm-wsm_all_full_y@s390x-kvm (textmode) (Added via [MR#357])
Actions
Copy link
 #6

Updated by zoecao 6 months ago

Submit mr for the remained testsuites:

  • offline_sles15sp5_media_basesys-srv-python3_all_full@spvm (textmode)
  • offline_sles15sp5_pscc_basesys-srv-python3-lp-contm-lgm-pcm-wsm_all_full@spvm (textmode)
  • offline_sles15sp5_rmt_basesys-srv-python3_all_full@spvm (textmode)

MR: https://gitlab.suse.de/coolgw/wegao-test/-/merge_requests/368

Actions
Copy link
 #7

Updated by zoecao 6 months ago

  • Status changed from In Progress to Resolved
Actions
Copy link

Also available in: Atom PDF