action #43856
closedcoordination #40484: [qe-core][functional][epic] Move different checks to separate test suites not to affect other functional tests
[functional][y] Verify release notes only in relevant scenarios
0%
Description
Motivation¶
See motivation in the parent ticket.
We validate release notes in each installation, which is a bit too much. Relevant cases are following:
1) Different architectures (to see that package is available)
2) Online vs offline (as we might get release notes from DVD)
3) Addons (source doesn't matter, either all-packages DVD, or ftp url, or as module)
Acceptance criteria¶
- Coverage remains same for relevant scenarios
- Release notes are not tested in every installation
- Change in behavior is communicated to other teams, so release notes are also tested for the products QSF is not responsible for (e.g. SLED, SLES4SAP, etc.)
Suggestion¶
Simplest implementation would be to introduce variable and validate Release Notes in relevant test suites only.
Please, check https://openqa.suse.de/tests/2260719 as we test release note origin there.
Let's address this for SLE only for the start, considering applying same approach for openSUSE.
Updated by okurz about 5 years ago
- Due date set to 2018-12-18
- Category set to Enhancement to existing tests
- Target version set to Milestone 21
Updated by riafarov about 5 years ago
- Description updated (diff)
- Estimated time set to 5.00 h
Updated by riafarov almost 5 years ago
- Due date changed from 2018-12-18 to 2019-01-29
- Target version changed from Milestone 21 to Milestone 22
No capacity.
Updated by riafarov almost 5 years ago
- Due date changed from 2019-01-29 to 2019-01-15
Updated by JERiveraMoya almost 5 years ago
- Status changed from Workable to In Progress
Updated by JERiveraMoya almost 5 years ago
- Status changed from In Progress to Feedback
PR: Schedule release notes when relevant
I got a little confuse by release_note origin here, we are referring only to release note, right? not the checking of the package or a combination of both? Answered that it is only about the test module testing the dialog.
Updated by JERiveraMoya almost 5 years ago
For example, we can introduce the variable for the following groups:
Functional & YaST:create_hdd_gnome
create_hdd_textmode
HPC: create_hdd_hpc_textmode
HA: create_hdd_ha_textmode
SLES for SAP Applications:create_hdd_sles4sap_gnome
create_hdd_sles4sap_textmode
For openSUSE is not currently implemented to check the dialog, so the new variable is not taken into account.
Updated by JERiveraMoya almost 5 years ago
- Status changed from Feedback to In Progress
Added CHECK_RELEASENOTES=1 to test suites mentioned above plus: create_hdd_minimal_base+sdk and create_hdd_gnome+we.
Updated by okurz almost 5 years ago
- Blocks action #14774: [sle][functional][yast][y] Disconnected installation: grab release notes while a system is not plugged into network takes too long added
Updated by JERiveraMoya almost 5 years ago
- Status changed from In Progress to Feedback
Waiting for next build to verify the change.
Updated by JERiveraMoya almost 5 years ago
- Status changed from Feedback to Resolved