action #23506: [sle][functional]test fails in addon_products_sle, trying to continue with empty regcode - openQA Tests - openSUSE Project Management Tool

Custom queries

All open Feature tests
openQA Infrastructure Project
openqa-review - Closed tickets last updated by openqa-review, last 30 days
QA roadmap long-term
QA SLE functional
QA SLE Functional - closed in last 14 days
QA SLE Functional - High, need to be refined
QA SLE Functional - over cycle time median
QA SLE u
QA SLE y
QA tools (tag not necessary in openQA and subprojects)
QA tools tag (tag not necessary in openQA and subprojects; excluding tickets in "Ready" version as they are already on the backlog)
QAC - Backlog
QAM
QE tools team - backlog (ready issues)
QE tools team - backlog (w/o infra)
QE tools team - backlog SLA high
QE tools team - backlog SLA immediate
QE tools team - backlog SLA no immediate/urgent in feedback/blocked
QE tools team - backlog SLA normal
QE tools team - backlog SLA urgent
QE tools team - backlog SLO high
QE tools team - backlog SLO normal
QE tools team - backlog SLO urgent
QE tools team - backlog, high-level view (epics and higher)
QE tools team - backlog, non-reactive work, needs parent
QE tools team - backlog, top-level view (all sagas)
QE tools team - closed within last 14 days
QE tools team - closed within last 60 days
QE tools team - closed yesterday
QE Tools Team - Collaborative Session
QE tools team - due date forecast
QE tools team - exceeding due-date
QE tools team - infrastructure backlog
QE tools team - next - sorted by update time
QE tools team - next issues
QE tools team - non-estimated (unblocked) issues (w/o infra)
QE tools team - ready issues - Workable
QE tools team - ready, not assigned/blocked/low
QE tools team - update forecast
QE tools team - updated by priority
QE tools team - what members of the team are working on - Feedback (not-low)
QE Tools Team Backlog By Assignee
SLE15 Migration Open Tickets
SLE15 SP1 Migration Open Tickets
SLE15SP3 Migration open ticket
SLE15SP3 Security open ticket
Tools Team Retrospective
Tools Team Retrospective (not estimated or assigned)

Actions

Copy link

action #23506

closed

[sle][functional]test fails in addon_products_sle, trying to continue with empty regcode

Added by okurz over 6 years ago. Updated over 6 years ago.

Status:

Resolved

Priority:

High

Assignee:

okurz

Category:

Bugs in existing tests

Target version:

Start date:

2017-08-25

Due date:

% Done:

100%

Estimated time:

(Total: 0.00 h)

Difficulty:

Description

Observation¶

openQA test in scenario sle-15-Leanos-DVD-x86_64-textmode+proxy_SCC@64bit fails in
addon_products_sle

Reproducible¶

Fails since (at least) Build 93.17

Suggestions¶

DONE: file product bug about "http token: access denied" instead of helpful error message that one tries with an empty regcode -> #23642
DONE: ensure empty regcode does not happen within tests unknowningly -> https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3466
DONE: add proper regcode to the tests currently failing -> #23506#note-10
DONE: optional: add explicit test suite checking handling of empty regcode -> #23506#note-12

Further details¶

Always latest result in this scenario: latest

Subtasks 1 (0 open — 1 closed)

action #23642: [sle][functional]file product bug about "http token: access denied" instead of helpful error message that one tries with an empty regcode

Resolved

riafarov

2017-08-25

Actions

Related issues 3 (0 open — 3 closed)

Related to openQA Tests - action #23438: [sle][functional][sle15] decide how and start using SCC using SUSEConnect

Resolved

riafarov

2017-08-17

Actions

Related to openQA Tests - action #23492: [sle][functional]test fails in scc_registration - openQA SLE media are missing SCC_URL

Resolved

riafarov

2017-08-20

2017-09-27

Actions

Copied to openQA Tests - action #23752: [sle][functional] refactor scc_allmodules in one test suite

Resolved

jorauch

2017-10-25

Actions

Issue # Delay: days Cancel

History
Notes
Property changes

Actions

Copy link

Updated by okurz over 6 years ago

Priority changed from Normal to Urgent

Actions

Copy link

Updated by nicksinger over 6 years ago

Some more examples of this happening:

https://openqa.suse.de/tests/1123671
https://openqa.suse.de/tests/1123744

Actions

Copy link

Updated by jorauch over 6 years ago

Created https://bugzilla.suse.com/show_bug.cgi?id=1055668

Actions

Copy link

Updated by riafarov over 6 years ago

Related to action #23438: [sle][functional][sle15] decide how and start using SCC using SUSEConnect added

Actions

Copy link

Updated by riafarov over 6 years ago

Related to action #23492: [sle][functional]test fails in scc_registration - openQA SLE media are missing SCC_URL added

Actions

Copy link

Updated by jorauch over 6 years ago

The critical code part is fill_in_registration_code in lib/registration.pm, it is called from the following modules

tests/installation/addon_products_via_SCC_yast2.pm
tests/installation/addon_products_yast2.pm
tests/installation/scc_registration.pm In my understanding we could check whether SCC_REGCODE is empty and softfail if true, this would have to be done in each module if we want to create a test for this scenario

Actions

Copy link

Updated by okurz over 6 years ago

Description updated (diff)
Status changed from New to In Progress

@jorauch: softfail would not be recommended as we should use it only when we have a product issue to track which is not the case here. Empty regcode means we did something wrong in the test setup. So https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3466 should address the empty regcode by hard-failing tests when this is used.

Actions

Copy link

Updated by okurz over 6 years ago

So one mandatory step left to do is to add a valid SCC_REGCODE to the media. I suggest to add the one from SLE 12 SP3 as this one works (did not check on all architectures but it should be still valid).

@jorauch: Do you want to do that?

Actions

Copy link

Updated by jorauch over 6 years ago

@okurz I will do it

Actions

Copy link

#10

Updated by jorauch over 6 years ago

Keys added from the SLE12 SP3 Media to the according SLE15 Leanos Media, additionally started the following test runs:
x86_64: https://openqa.suse.de/tests/1129994
aarch64: https://openqa.suse.de/tests/1129995
ppc64le: https://openqa.suse.de/tests/1129996
s390x: https://openqa.suse.de/tests/1129997

Actions

Copy link

#11

Updated by jorauch over 6 years ago

On aarch64 and ppc the code is written to the e-mail field, also on x86 a popup blocks the test.
Is an e-mail address needed for aarch64/ppc?

Actions

Copy link

#12

Updated by okurz over 6 years ago

Assignee set to okurz

I added a new test suite "empty_scc_regcode" and added this to the sle 15 test development job group. Also triggered a test manually:

$ openqa_clone_job_osd 1130717 SCC_REGCODE= EXTRABOOTPARAMS= SLE_PRODUCT=sles _GROUP=0 TEST=empty_scc_regcode

-> https://openqa.suse.de/t1132277

Sorry riafarov for being too impatient on your experiment with the yast team ;-)

Forgot to specify to actually register:

$ openqa_clone_job_osd 1130717 SCC_REGCODE= EXTRABOOTPARAMS= SLE_PRODUCT=sles _GROUP=0 TEST=empty_scc_regcode SCC_REGISTER=installation

-> https://openqa.suse.de/t1132356

Works as expected as it fails in https://openqa.suse.de/tests/1132356#step/scc_registration/4 which corresponds to https://bugzilla.suse.com/show_bug.cgi?id=1055696

enabled testsuite "empty_scc_regcode" in sle functional job group.

Actions

Copy link

#13

Updated by okurz over 6 years ago

Description updated (diff)

jobs continue further to the module selection -> https://openqa.suse.de/tests/1130770#step/scc_registration/30

We can also continue in another ticket if we like

Actions

Copy link

#14

Updated by jorauch over 6 years ago

Copied to action #23752: [sle][functional] refactor scc_allmodules in one test suite added

Actions

Copy link

#15

Updated by okurz over 6 years ago

Status changed from In Progress to Resolved

ok, rest to be continued in #23752

Actions

Copy link

Also available in: Atom PDF

Project

General

Profile

QA » openQA Project » openQA Tests

Tags

Custom queries

action #23506

[sle][functional]test fails in addon_products_sle, trying to continue with empty regcode

Observation¶

Reproducible¶

Suggestions¶

Further details¶

Updated by okurz over 6 years ago

Updated by nicksinger over 6 years ago

Updated by jorauch over 6 years ago

Updated by riafarov over 6 years ago

Updated by riafarov over 6 years ago

Updated by jorauch over 6 years ago

Updated by okurz over 6 years ago

Updated by okurz over 6 years ago

Updated by jorauch over 6 years ago

Updated by jorauch over 6 years ago

Updated by jorauch over 6 years ago

Updated by okurz over 6 years ago

Updated by okurz over 6 years ago

Updated by jorauch over 6 years ago

Updated by okurz over 6 years ago