action #66541
closedcoordination #29733: [epic][functional][u] Test suites that use "all patterns" boot from created qcow2 image
[functional][u] Add allmodules+allpatterns test suite to SLE15-SP2
0%
Description
Motivation¶
This will cover all conflicts between modules and patterns.
Acceptance criteria¶
- AC1: The test suite allmodules+allpatterns-gnome performs an installation without post-installation test modules and doesn't publish the QCOW2.
Tasks¶
- Adapt/fix test suite allmodules+allpatterns
- Schedule it on "SLE15-SP2: Functional" job group.
Further information¶
Using test suite setting ENABLE_ALL_SCC_MODULES=1, the following modules would be selected in scc_registration:
- basesystem
- server app
- desktop app
- container
- dev tools
- Web Scripting
- legacy
- Package Hub
Modules not designed to work with all other modules together:
- Public cloud
- python2
- HA
- Live patching
- Workstation extension
- Transactional server
Using test suite setting PATTERNS=all, all patterns will be selected in select_patterns
Updated by SLindoMansilla over 4 years ago
- Start date set to 5000-01-01
due to changes in a related task: #29733
Updated by SLindoMansilla over 4 years ago
- Start date set to 5000-01-01
due to changes in a related task: #66541
Updated by SLindoMansilla over 4 years ago
- Description updated (diff)
- Status changed from New to Workable
- Target version set to Milestone 30
- Estimated time set to 42.00 h
Updated by zluo over 4 years ago
- Status changed from Workable to In Progress
- Assignee set to zluo
take over
Updated by zluo over 4 years ago
we have at moment:
- https://openqa.suse.de/tests/4327317 allpatterns@64bit
- https://openqa.suse.de/tests/4327350 we-module@64bit
adapt allpattern.yaml for 1. and set yaml schedule on OSD, rename it to allpatterns-gnome
add sdk part to 2. and set yaml schedule on OSD, rename it to allpatterns-gnome+sdk+we
remove 1. and 2. from OSD when these new test suites got scheduled and worked without issue.
Updated by SLindoMansilla over 4 years ago
zluo wrote:
we have at moment:
- https://openqa.suse.de/tests/4327317 allpatterns@64bit
- https://openqa.suse.de/tests/4327350 we-module@64bit
adapt allpattern.yaml for 1. and set yaml schedule on OSD, rename it to allpatterns-gnome
add sdk part to 2. and set yaml schedule on OSD, rename it to allpatterns-gnome+sdk+weremove 1. and 2. from OSD when these new test suites got scheduled and worked without issue.
That is wrong. Please, see the epic, ACs and Tasks of this ticket.
Updated by SLindoMansilla over 4 years ago
allpatterns, we+allpatterns and sdk+allpatterns must be handled in the other tickets.
If they are removed in favor of allmodules+allpatterns, coverage will be lost.
Updated by SLindoMansilla over 4 years ago
- Description updated (diff)
Removed AC2.
I just realized that post-installation tests would just duplicate the coverage of extra_tests_(textmode|gnome)_$module_label_name
Added explicit without post-installation test modules to AC1
Agreed with zluo
Updated by SLindoMansilla over 4 years ago
- Description updated (diff)
Sorry, updating description, I realize more information was needed.
Updated by zluo over 4 years ago
PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/10524
create test suite on osd when it got merged.
Updated by zluo over 4 years ago
allmodules+allpatterns-gnome on osd updated:
DEPENDENCY_RESOLVER_FLAG=1
DESKTOP=gnome
ENABLE_ALL_SCC_MODULES=1
HDDSIZEGB=40
MAX_JOB_TIME=14400
PATTERNS=all
VNC_TYPING_LIMIT=18
YAML_SCHEDULE=schedule/functional/allmodules+allpatterns-gnome.yaml
Updated by zluo over 4 years ago
- Status changed from In Progress to Resolved
PR got merged and the required changes in test suite on osd is already in place.