action #41858: [functional][sle][y] test fails in system_role expecting a system role screen where there is non anymore, see https://fate.suse.com/324713 - openQA Tests - openSUSE Project Management Tool

Custom queries

All open Feature tests
openQA Infrastructure Project
openqa-review - Closed tickets last updated by openqa-review, last 30 days
QA roadmap long-term
QA SLE functional
QA SLE Functional - closed in last 14 days
QA SLE Functional - High, need to be refined
QA SLE Functional - over cycle time median
QA SLE u
QA SLE y
QA tools (tag not necessary in openQA and subprojects)
QA tools tag (tag not necessary in openQA and subprojects; excluding tickets in "Ready" version as they are already on the backlog)
QAC - Backlog
QAM
QE tools team - backlog (ready issues)
QE tools team - backlog (w/o infra)
QE tools team - backlog SLA high
QE tools team - backlog SLA immediate
QE tools team - backlog SLA no immediate/urgent in feedback/blocked
QE tools team - backlog SLA normal
QE tools team - backlog SLA urgent
QE tools team - backlog SLO high
QE tools team - backlog SLO normal
QE tools team - backlog SLO urgent
QE tools team - backlog, high-level view (epics and higher)
QE tools team - backlog, non-reactive work, needs parent
QE tools team - backlog, top-level view (all sagas)
QE tools team - closed within last 14 days
QE tools team - closed within last 60 days
QE tools team - closed yesterday
QE Tools Team - Collaborative Session
QE tools team - due date forecast
QE tools team - exceeding due-date
QE tools team - infrastructure backlog
QE tools team - next - sorted by update time
QE tools team - next issues
QE tools team - non-estimated (unblocked) issues (w/o infra)
QE tools team - ready issues - Workable
QE tools team - ready, not assigned/blocked/low
QE tools team - update forecast
QE tools team - updated by priority
QE tools team - what members of the team are working on - Feedback (not-low)
QE Tools Team Backlog By Assignee
SLE15 Migration Open Tickets
SLE15 SP1 Migration Open Tickets
SLE15SP3 Migration open ticket
SLE15SP3 Security open ticket
Tools Team Retrospective
Tools Team Retrospective (not estimated or assigned)

Actions

Copy link

action #41858

closed

[functional][sle][y] test fails in system_role expecting a system role screen where there is non anymore, see https://fate.suse.com/324713

Added by okurz over 5 years ago. Updated over 5 years ago.

Status:

Resolved

Priority:

High

Assignee:

riafarov

Category:

Bugs in existing tests

Target version:

SUSE QA - Milestone 20

Start date:

2018-10-01

Due date:

2018-11-06

% Done:

Estimated time:

3.00 h

Difficulty:

Description

Observation¶

openQA test in scenario sle-15-SP1-Installer-DVD-x86_64-skip_registration@64bit fails in
system_role assuming the system role screen which does not show up anymore.

Suggestions¶

We can set our expectations in the code to validate that system roles or we can simply detect if it's shown or not and act accordingly.

Reproducible¶

Fails since (at least) Build 52.3

Expected result¶

Last good: 50.1 (or more recent)

No system role screen should be expected when there is only a single system role available

Further details¶

Always latest result in this scenario: latest

http://xcdchk.suse.de/results/SLE-15-SP1-Packages-Test/52.3 shows the relevant changes, https://fate.suse.com/324713 is the cause of the failure

Related issues 1 (0 open — 1 closed)

Related to openQA Tests - action #42365: [sle][functional][s390x][y] test fails in partitioning - not scheduled system_role module

Rejected

okurz

2018-10-12

Actions

Issue # Delay: days Cancel

History
Notes
Property changes

Actions

Copy link

Updated by okurz over 5 years ago

Subject changed from [functional][sle][y] test fails in system_role to [functional][sle][y] test fails in system_role expecting a system role screen where there is non anymore, see https://fate.suse.com/324713

Actions

Copy link

Updated by riafarov over 5 years ago

Description updated (diff)
Estimated time set to 3.00 h

Actions

Copy link

Updated by riafarov over 5 years ago

Status changed from New to Workable

Actions

Copy link

Updated by riafarov over 5 years ago

Assignee set to riafarov

Actions

Copy link

Updated by riafarov over 5 years ago

Status changed from Workable to Feedback

https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/5906

Actions

Copy link

Updated by riafarov over 5 years ago

Status changed from Feedback to Resolved

https://openqa.suse.de/tests/2169339

Actions

Copy link

Updated by okurz over 5 years ago

Related to action #42365: [sle][functional][s390x][y] test fails in partitioning - not scheduled system_role module added

Actions

Copy link

Updated by okurz over 5 years ago

Status changed from Resolved to In Progress

seems we need to handle WORKAROUND_MODULES as well? -> #42365

Maybe we can link the system role expectation to what we did for the expectation of the default desktop somehow?

Actions

Copy link

Updated by riafarov over 5 years ago

Should get fixed, as we set ADDONURL there: https://openqa.suse.de/tests/2166881/file/vars.json retriggered to see if it works: https://openqa.suse.de/tests/2171374#

Actions

Copy link

#10

Updated by riafarov over 5 years ago

Status changed from In Progress to Feedback

Actions

Copy link

#11

Updated by riafarov over 5 years ago

Status changed from Feedback to Resolved

No remaining failures for build 71.2

Actions

Copy link

#12

Updated by okurz over 5 years ago

Due date changed from 2018-10-23 to 2018-11-06
Status changed from Resolved to In Progress

Hi @riafarov, it seems a corresponding test failure has been overlooked: https://openqa.suse.de/tests/2196966#step/releasenotes_origin/8 which also already failed in build 71.2 . Care to take a look?

Actions

Copy link

#13