Project

General

Profile

Actions

action #136016

closed

coordination #120534: [epic] Provide auto-installation test suites for supporting testing

Optimize test coverage for recommended module, phub, nvidia module combination with default patterns gnome test from SLE 15 SP4

Added by leli 8 months ago. Updated 6 months ago.

Status:
Resolved
Priority:
High
Assignee:
Target version:
Start date:
2023-09-19
Due date:
% Done:

0%

Estimated time:

Description

Motivation

Following the new test matrix, we need add
recommended module, phub, nvidia module combination test suites to Migration daily and milestone job group, or do the movement from Migration milestone job group to daily job group.

The test need to be added as below:
migration daily job group(https://openqa.nue.suse.com/group_overview/265)
offline:
* offline_sles15sp4_pscc_basesys-srv-desk_def_full@aarch64 (gnome)
* offline_sles15sp4_media_basesys-srv-desk_def_full@x86_64 (gnome)
* offline_sles15sp4_media_basesys-srv-desk-phub_def_full@s390x-kvm (gnome)

online:
* offline_sles15sp4_pscc_basesys-srv-desk_def_full_y@s390x-kvm (gnome)

Migration milestone job group(https://openqa.nue.suse.com/group_overview/266):
* offline_sles15sp4_rmt_basesys-srv-desk_def_full@aarch64 (gnome)
* offline_sles15sp4_rmt_basesys-srv-desk-nvidia_def_full@x86_64 (gnome)
* online_sles15sp4_scc_basesys-srv-desk-nvidia_def_full_y@aarch64 (gnome)

Note: check the existing test suites to decide to add/modify test suites or move from milestone job group.

Acceptance criteria

AC1: Optimize test coverage for recommended module, phub, nvidia module combination from SLE 15 SP4.
AC2: The new test suites need to be triggered and file bug if new issue found.

Actions #1

Updated by leli 7 months ago

  • Status changed from New to Workable
  • Target version set to Current
  • Parent task set to #120534
Actions #2

Updated by leli 7 months ago

  • Priority changed from Normal to High
Actions #3

Updated by zoecao 7 months ago

Hi ticket owner, I already added some of the testsuites listed above, you can skip them when you work on this ticket, I mark "already added via [MR#350]" after the testsuite name:

offline:

  • offline_sles15sp4_pscc_basesys-srv-desk_def_full@aarch64 (gnome) (already added via [MR#350])
  • offline_sles15sp4_media_basesys-srv-desk_def_full@x86_64 (gnome) (already added via [MR#350])
  • offline_sles15sp4_media_basesys-srv-desk-phub_def_full@s390x-kvm (gnome)

online:

  • online_sles15sp4_pscc_basesys-srv-desk_def_full_y@s390x-kvm (gnome) (already added via [MR#350]

Migration milestone job group(https://openqa.nue.suse.com/group_overview/266):

  • offline_sles15sp4_rmt_basesys-srv-desk_def_full@aarch64 (gnome) (already added via [MR#350]
  • offline_sles15sp4_rmt_basesys-srv-desk-nvidia_def_full@x86_64 (gnome)
  • online_sles15sp4_scc_basesys-srv-desk-nvidia_def_full_y@aarch64 (gnome)
Actions #4

Updated by zoecao 7 months ago

  • Status changed from Workable to In Progress
  • Assignee set to zoecao
Actions #5

Updated by zoecao 7 months ago

Added the remaining testsuites and running VRs: (cases names start with b- are for this ticket)
https://openqa.suse.de/tests/overview?distri=sle&version=15-SP6&build=26.1&groupid=251

Will check the results later.

Actions #6

Updated by zoecao 6 months ago

The VR are failed with no qcow2, the support images are not ready yet, so pending.

Actions #7

Updated by zoecao 6 months ago

Submit MR for the remained testsuites:

  • offline_sles15sp4_media_basesys-srv-desk-phub_def_full@s390x-kvm (gnome)
  • offline_sles15sp4_rmt_basesys-srv-desk-nvidia_def_full@x86_64 (gnome)
  • online_sles15sp4_scc_basesys-srv-desk-nvidia_def_full_y@aarch64 (gnome)

MR: https://gitlab.suse.de/coolgw/wegao-test/-/merge_requests/363

Actions #8

Updated by zoecao 6 months ago

  • Status changed from In Progress to Resolved
Actions

Also available in: Atom PDF