action #136010: Optimize test coverage for recommended module, lp module combination and minimal role with default patterns from SLE 15 SP4 - qe-yam - openSUSE Project Management Tool

Actions

Copy link

action #136010

closed

coordination #120534: [epic] Provide auto-installation test suites for supporting testing

Optimize test coverage for recommended module, lp module combination and minimal role with default patterns from SLE 15 SP4

Added by leli 11 months ago. Updated 10 months ago.

Status:

Resolved

Priority:

High

Assignee:

tinawang123

Target version:

Current

Start date:

2023-09-19

Due date:

% Done:

Estimated time:

Description

Motivation¶

Following the new test matrix, we need add
recommended module, lp module combination test suites to Migration daily and milestone job group, or do the movement from Migration milestone job group to daily job group.

The test need to be added as below:
migration daily job group(https://openqa.nue.suse.com/group_overview/265)
offline:
* offline_sles15sp4_pscc_basesys-srv_def_minimal@s390x-kvm (text mode)
* offline_sles15sp4_pscc_basesys-srv_def_minimal@aarch64 (text mode)
* offline_sles15sp4_pscc_basesys-srv_def_full@spvm (text mode)

* offline_sles15sp4_media_basesys-srv_def_full@s390x-zvm (text mode)
* offline_sles15sp4_pscc_basesys-srv-lp_def_full@s390x-kvm (text mode)
* offline_sles15sp4_pscc_basesys-srv-lp_def_full@x86_64 (text mode)
* offline_sles15sp4_media_basesys-srv_def_full@aarch64 (minimal mode)
* offline_sles15sp4_pscc_basesys-srv_def_full@spvm (minimal mode)

online:
* online_sles15sp4_pscc_basesys-srv_def_minimal_y@aarch64 (text mode)
* online_sles15sp4_pscc_basesys-srv_def_full_zypp@aarch64 (text mode)
* online_sles15sp4_pscc_basesys-srv_def_full_zypp_lock@s390x-kvm (text mode)
* online_sles15sp4_pscc_basesys-srv-lp_def_full_y@spvm (text mode)

Migration milestone job group(https://openqa.nue.suse.com/group_overview/266):
* online_sles15sp4_smt_basesys-srv_def_full_y@aarch64 (text mode)
* online_sles15sp4_smt_basesys-srv-lp_def_full_y@spvm (text mode)
* online_sles15sp4_smt_basesys-srv-lp_def_full_y@x86_64 (text mode)

Note: check the existing test suites to decide to add/modify test suites or move from milestone job group.

Acceptance criteria¶

AC1: Optimize test coverage for recommended module, lp module combination from SLE 15 SP4.
AC2: The new test suites need to be triggered and file bug if new issue found.

Actions

Copy link

Updated by leli 11 months ago

Description updated (diff)

Actions

Copy link

Updated by leli 10 months ago

Status changed from New to Workable

Actions

Copy link

Updated by leli 10 months ago

Priority changed from Normal to High

Actions

Copy link

Updated by zoecao 10 months ago

Hi ticket owner, I already added some of the testsuites listed above, you can skip them when you work on this ticket, I mark "already added via [MR#350]" after the testsuite name:

offline:

offline_sles15sp4_pscc_basesys-srv_def_minimal@s390x-kvm (text mode)
offline_sles15sp4_pscc_basesys-srv_def_minimal@aarch64 (text mode)
offline_sles15sp4_pscc_basesys-srv_def_full@spvm (text mode)
~~offline_sles15sp4_media_basesys-srv_def_full@s390x-zvm (text mode)~~ (already added via [MR#350])
offline_sles15sp4_pscc_basesys-srv-lp_def_full@s390x-kvm (text mode)
offline_sles15sp4_pscc_basesys-srv-lp_def_full@x86_64 (text mode)
offline_sles15sp4_media_basesys-srv_def_full@aarch64 (minimal mode)
offline_sles15sp4_pscc_basesys-srv_def_full@spvm (minimal mode)

online:

online_sles15sp4_pscc_basesys-srv_def_minimal_y@aarch64 (text mode)
~~online_sles15sp4_pscc_basesys-srv_def_full_zypp@aarch64 (text mode)~~ (already added via [MR#350])
~~online_sles15sp4_pscc_basesys-srv_def_full_zypp_lock@s390x-kvm (text mode)~~ (already added via [MR#350])
online_sles15sp4_pscc_basesys-srv-lp_def_full_y@spvm (text mode)

Migration milestone job group(https://openqa.nue.suse.com/group_overview/266):

~~online_sles15sp4_smt_basesys-srv_def_full_y@aarch64 (text mode)~~ (already added via [MR#350])
online_sles15sp4_smt_basesys-srv-lp_def_full_y@spvm (text mode)
online_sles15sp4_smt_basesys-srv-lp_def_full_y@x86_64 (text mode)

Actions

Copy link