action #43856
closed
coordination #40484: [qe-core][functional][epic] Move different checks to separate test suites not to affect other functional tests
[functional][y] Verify release notes only in relevant scenarios
Added by riafarov over 5 years ago.
Updated over 2 years ago.
Category:
Enhancement to existing tests
Target version:
SUSE QA - Milestone 22
Description
Motivation¶
See motivation in the parent ticket.
We validate release notes in each installation, which is a bit too much. Relevant cases are following:
1) Different architectures (to see that package is available)
2) Online vs offline (as we might get release notes from DVD)
3) Addons (source doesn't matter, either all-packages DVD, or ftp url, or as module)
Acceptance criteria¶
- Coverage remains same for relevant scenarios
- Release notes are not tested in every installation
- Change in behavior is communicated to other teams, so release notes are also tested for the products QSF is not responsible for (e.g. SLED, SLES4SAP, etc.)
Suggestion¶
Simplest implementation would be to introduce variable and validate Release Notes in relevant test suites only.
Please, check https://openqa.suse.de/tests/2260719 as we test release note origin there.
Let's address this for SLE only for the start, considering applying same approach for openSUSE.
- Description updated (diff)
- Due date set to 2018-12-18
- Category set to Enhancement to existing tests
- Target version set to Milestone 21
- Description updated (diff)
- Description updated (diff)
- Estimated time set to 5.00 h
- Due date changed from 2018-12-18 to 2019-01-29
- Target version changed from Milestone 21 to Milestone 22
- Due date changed from 2019-01-29 to 2019-01-15
- Assignee set to JERiveraMoya
- Status changed from Workable to In Progress
- Status changed from In Progress to Feedback
PR: Schedule release notes when relevant
I got a little confuse by release_note origin here, we are referring only to release note, right? not the checking of the package or a combination of both? Answered that it is only about the test module testing the dialog.
For example, we can introduce the variable for the following groups:
Functional & YaST:create_hdd_gnome
create_hdd_textmode
HPC: create_hdd_hpc_textmode
HA: create_hdd_ha_textmode
SLES for SAP Applications:create_hdd_sles4sap_gnome
create_hdd_sles4sap_textmode
For openSUSE is not currently implemented to check the dialog, so the new variable is not taken into account.
- Status changed from Feedback to In Progress
Added CHECK_RELEASENOTES=1 to test suites mentioned above plus: create_hdd_minimal_base+sdk and create_hdd_gnome+we.
- Blocks action #14774: [sle][functional][yast][y] Disconnected installation: grab release notes while a system is not plugged into network takes too long added
- Status changed from In Progress to Feedback
Waiting for next build to verify the change.
- Status changed from Feedback to Resolved
- Due date deleted (
2019-01-15)
Also available in: Atom
PDF