action #66541
closed
coordination #29733: [epic][functional][u] Test suites that use "all patterns" boot from created qcow2 image
[functional][u] Add allmodules+allpatterns test suite to SLE15-SP2
Added by SLindoMansilla almost 4 years ago.
Updated over 3 years ago.
Target version:
SUSE QA - Milestone 30
Description
Motivation¶
This will cover all conflicts between modules and patterns.
Acceptance criteria¶
- AC1: The test suite allmodules+allpatterns-gnome performs an installation without post-installation test modules and doesn't publish the QCOW2.
Tasks¶
- Adapt/fix test suite allmodules+allpatterns
- Schedule it on "SLE15-SP2: Functional" job group.
Further information¶
Using test suite setting ENABLE_ALL_SCC_MODULES=1, the following modules would be selected in scc_registration:
- basesystem
- server app
- desktop app
- container
- dev tools
- Web Scripting
- legacy
- Package Hub
Modules not designed to work with all other modules together:
- Public cloud
- python2
- HA
- Live patching
- Workstation extension
- Transactional server
Using test suite setting PATTERNS=all, all patterns will be selected in select_patterns
- Start date set to 5000-01-01
due to changes in a related task: #29733
- Description updated (diff)
- Start date set to 5000-01-01
due to changes in a related task: #66541
- Start date deleted (
5000-01-01)
- Description updated (diff)
- Description updated (diff)
- Description updated (diff)
- Status changed from New to Workable
- Target version set to Milestone 30
- Estimated time set to 42.00 h
- Status changed from Workable to In Progress
- Assignee set to zluo
we have at moment:
- https://openqa.suse.de/tests/4327317 allpatterns@64bit
- https://openqa.suse.de/tests/4327350 we-module@64bit
adapt allpattern.yaml for 1. and set yaml schedule on OSD, rename it to allpatterns-gnome
add sdk part to 2. and set yaml schedule on OSD, rename it to allpatterns-gnome+sdk+we
remove 1. and 2. from OSD when these new test suites got scheduled and worked without issue.
zluo wrote:
we have at moment:
- https://openqa.suse.de/tests/4327317 allpatterns@64bit
- https://openqa.suse.de/tests/4327350 we-module@64bit
adapt allpattern.yaml for 1. and set yaml schedule on OSD, rename it to allpatterns-gnome
add sdk part to 2. and set yaml schedule on OSD, rename it to allpatterns-gnome+sdk+we
remove 1. and 2. from OSD when these new test suites got scheduled and worked without issue.
That is wrong. Please, see the epic, ACs and Tasks of this ticket.
allpatterns, we+allpatterns and sdk+allpatterns must be handled in the other tickets.
If they are removed in favor of allmodules+allpatterns, coverage will be lost.
- Description updated (diff)
Removed AC2.
I just realized that post-installation tests would just duplicate the coverage of extra_tests_(textmode|gnome)_$module_label_name
Added explicit without post-installation test modules to AC1
Agreed with zluo
- Description updated (diff)
Sorry, updating description, I realize more information was needed.
allmodules+allpatterns-gnome on osd updated:
DEPENDENCY_RESOLVER_FLAG=1
DESKTOP=gnome
ENABLE_ALL_SCC_MODULES=1
HDDSIZEGB=40
MAX_JOB_TIME=14400
PATTERNS=all
VNC_TYPING_LIMIT=18
YAML_SCHEDULE=schedule/functional/allmodules+allpatterns-gnome.yaml
- Status changed from In Progress to Resolved
PR got merged and the required changes in test suite on osd is already in place.
Also available in: Atom
PDF