Project

General

Profile

Actions

action #43856

closed

coordination #40484: [qe-core][functional][epic] Move different checks to separate test suites not to affect other functional tests

[functional][y] Verify release notes only in relevant scenarios

Added by riafarov over 5 years ago. Updated over 2 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Enhancement to existing tests
Target version:
SUSE QA - Milestone 22
Start date:
2018-11-15
Due date:
% Done:

0%

Estimated time:
5.00 h
Difficulty:

Description

Motivation

See motivation in the parent ticket.

We validate release notes in each installation, which is a bit too much. Relevant cases are following:
1) Different architectures (to see that package is available)
2) Online vs offline (as we might get release notes from DVD)
3) Addons (source doesn't matter, either all-packages DVD, or ftp url, or as module)

Acceptance criteria

  1. Coverage remains same for relevant scenarios
  2. Release notes are not tested in every installation
  3. Change in behavior is communicated to other teams, so release notes are also tested for the products QSF is not responsible for (e.g. SLED, SLES4SAP, etc.)

Suggestion

Simplest implementation would be to introduce variable and validate Release Notes in relevant test suites only.
Please, check https://openqa.suse.de/tests/2260719 as we test release note origin there.

Let's address this for SLE only for the start, considering applying same approach for openSUSE.


Related issues 1 (0 open1 closed)

Blocks openQA Tests - action #14774: [sle][functional][yast][y] Disconnected installation: grab release notes while a system is not plugged into network takes too long Resolvedriafarov2016-11-14

Actions
Actions #1

Updated by riafarov over 5 years ago

  • Description updated (diff)
Actions #2

Updated by okurz over 5 years ago

  • Due date set to 2018-12-18
  • Category set to Enhancement to existing tests
  • Target version set to Milestone 21
Actions #3

Updated by riafarov over 5 years ago

  • Description updated (diff)
Actions #4

Updated by riafarov over 5 years ago

  • Description updated (diff)
  • Estimated time set to 5.00 h
Actions #5

Updated by riafarov about 5 years ago

  • Due date changed from 2018-12-18 to 2019-01-29
  • Target version changed from Milestone 21 to Milestone 22

No capacity.

Actions #6

Updated by riafarov about 5 years ago

  • Due date changed from 2019-01-29 to 2019-01-15
Actions #7

Updated by JERiveraMoya about 5 years ago

  • Assignee set to JERiveraMoya
Actions #8

Updated by JERiveraMoya about 5 years ago

  • Status changed from Workable to In Progress
Actions #9

Updated by JERiveraMoya about 5 years ago

  • Status changed from In Progress to Feedback

PR: Schedule release notes when relevant
I got a little confuse by release_note origin here, we are referring only to release note, right? not the checking of the package or a combination of both? Answered that it is only about the test module testing the dialog.

Actions #10

Updated by JERiveraMoya about 5 years ago

For example, we can introduce the variable for the following groups:
Functional & YaST:create_hdd_gnome
create_hdd_textmode

HPC: create_hdd_hpc_textmode
HA: create_hdd_ha_textmode
SLES for SAP Applications:create_hdd_sles4sap_gnome
create_hdd_sles4sap_textmode
For openSUSE is not currently implemented to check the dialog, so the new variable is not taken into account.

Actions #11

Updated by JERiveraMoya about 5 years ago

  • Status changed from Feedback to In Progress

Added CHECK_RELEASENOTES=1 to test suites mentioned above plus: create_hdd_minimal_base+sdk and create_hdd_gnome+we.

Actions #12

Updated by okurz about 5 years ago

  • Blocks action #14774: [sle][functional][yast][y] Disconnected installation: grab release notes while a system is not plugged into network takes too long added
Actions #13

Updated by JERiveraMoya about 5 years ago

  • Status changed from In Progress to Feedback

Waiting for next build to verify the change.

Actions #14

Updated by JERiveraMoya about 5 years ago

  • Status changed from Feedback to Resolved
Actions #15

Updated by okurz over 2 years ago

  • Due date deleted (2019-01-15)
Actions

Also available in: Atom PDF