Project

General

Profile

Actions

action #66541

closed

coordination #29733: [epic][functional][u] Test suites that use "all patterns" boot from created qcow2 image

[functional][u] Add allmodules+allpatterns test suite to SLE15-SP2

Added by SLindoMansilla almost 4 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
New test
Target version:
SUSE QA - Milestone 30
Start date:
5000-01-01
Due date:
% Done:

0%

Estimated time:
42.00 h
Difficulty:

Description

Motivation

This will cover all conflicts between modules and patterns.

Acceptance criteria

  • AC1: The test suite allmodules+allpatterns-gnome performs an installation without post-installation test modules and doesn't publish the QCOW2.

Tasks

  1. Adapt/fix test suite allmodules+allpatterns
  2. Schedule it on "SLE15-SP2: Functional" job group.

Further information

Using test suite setting ENABLE_ALL_SCC_MODULES=1, the following modules would be selected in scc_registration:

  • basesystem
  • server app
  • desktop app
  • container
  • dev tools
  • Web Scripting
  • legacy
  • Package Hub

Modules not designed to work with all other modules together:

  • Public cloud
  • python2
  • HA
  • Live patching
  • Workstation extension
  • Transactional server

Using test suite setting PATTERNS=all, all patterns will be selected in select_patterns

Actions #1

Updated by SLindoMansilla almost 4 years ago

  • Start date set to 5000-01-01

due to changes in a related task: #29733

Actions #2

Updated by SLindoMansilla almost 4 years ago

  • Description updated (diff)
Actions #3

Updated by SLindoMansilla almost 4 years ago

  • Start date set to 5000-01-01

due to changes in a related task: #66541

Actions #4

Updated by SLindoMansilla almost 4 years ago

  • Start date deleted (5000-01-01)
Actions #5

Updated by SLindoMansilla almost 4 years ago

  • Description updated (diff)
Actions #6

Updated by SLindoMansilla almost 4 years ago

  • Description updated (diff)
Actions #7

Updated by SLindoMansilla almost 4 years ago

  • Description updated (diff)
  • Status changed from New to Workable
  • Target version set to Milestone 30
  • Estimated time set to 42.00 h
Actions #8

Updated by zluo almost 4 years ago

  • Status changed from Workable to In Progress
  • Assignee set to zluo

take over

Actions #9

Updated by zluo almost 4 years ago

we have at moment:

  1. https://openqa.suse.de/tests/4327317 allpatterns@64bit
  2. https://openqa.suse.de/tests/4327350 we-module@64bit

adapt allpattern.yaml for 1. and set yaml schedule on OSD, rename it to allpatterns-gnome
add sdk part to 2. and set yaml schedule on OSD, rename it to allpatterns-gnome+sdk+we

remove 1. and 2. from OSD when these new test suites got scheduled and worked without issue.

Actions #10

Updated by SLindoMansilla almost 4 years ago

zluo wrote:

we have at moment:

  1. https://openqa.suse.de/tests/4327317 allpatterns@64bit
  2. https://openqa.suse.de/tests/4327350 we-module@64bit

adapt allpattern.yaml for 1. and set yaml schedule on OSD, rename it to allpatterns-gnome
add sdk part to 2. and set yaml schedule on OSD, rename it to allpatterns-gnome+sdk+we

remove 1. and 2. from OSD when these new test suites got scheduled and worked without issue.

That is wrong. Please, see the epic, ACs and Tasks of this ticket.

Actions #11

Updated by SLindoMansilla almost 4 years ago

allpatterns, we+allpatterns and sdk+allpatterns must be handled in the other tickets.

If they are removed in favor of allmodules+allpatterns, coverage will be lost.

Actions #12

Updated by SLindoMansilla almost 4 years ago

  • Description updated (diff)

Removed AC2.
I just realized that post-installation tests would just duplicate the coverage of extra_tests_(textmode|gnome)_$module_label_name

Added explicit without post-installation test modules to AC1

Agreed with zluo

Actions #14

Updated by SLindoMansilla almost 4 years ago

  • Description updated (diff)

Sorry, updating description, I realize more information was needed.

Actions #15

Updated by zluo almost 4 years ago

PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/10524

create test suite on osd when it got merged.

Actions #16

Updated by zluo almost 4 years ago

allmodules+allpatterns-gnome on osd updated:

DEPENDENCY_RESOLVER_FLAG=1
DESKTOP=gnome
ENABLE_ALL_SCC_MODULES=1
HDDSIZEGB=40
MAX_JOB_TIME=14400
PATTERNS=all
VNC_TYPING_LIMIT=18
YAML_SCHEDULE=schedule/functional/allmodules+allpatterns-gnome.yaml

Actions #17

Updated by zluo over 3 years ago

  • Status changed from In Progress to Resolved

PR got merged and the required changes in test suite on osd is already in place.

Actions

Also available in: Atom PDF