action #23506
closed[sle][functional]test fails in addon_products_sle, trying to continue with empty regcode
100%
Description
Observation¶
openQA test in scenario sle-15-Leanos-DVD-x86_64-textmode+proxy_SCC@64bit fails in
addon_products_sle
Reproducible¶
Fails since (at least) Build 93.17
Suggestions¶
- DONE: file product bug about "http token: access denied" instead of helpful error message that one tries with an empty regcode -> #23642
- DONE: ensure empty regcode does not happen within tests unknowningly -> https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3466
- DONE: add proper regcode to the tests currently failing -> #23506#note-10
- DONE: optional: add explicit test suite checking handling of empty regcode -> #23506#note-12
Further details¶
Always latest result in this scenario: latest
Updated by nicksinger over 6 years ago
Some more examples of this happening:
https://openqa.suse.de/tests/1123671
https://openqa.suse.de/tests/1123744
Updated by jorauch over 6 years ago
Updated by riafarov over 6 years ago
- Related to action #23438: [sle][functional][sle15] decide how and start using SCC using SUSEConnect added
Updated by riafarov over 6 years ago
- Related to action #23492: [sle][functional]test fails in scc_registration - openQA SLE media are missing SCC_URL added
Updated by jorauch over 6 years ago
The critical code part is fill_in_registration_code in lib/registration.pm, it is called from the following modules
- tests/installation/addon_products_via_SCC_yast2.pm
- tests/installation/addon_products_yast2.pm
- tests/installation/scc_registration.pm In my understanding we could check whether SCC_REGCODE is empty and softfail if true, this would have to be done in each module if we want to create a test for this scenario
Updated by okurz over 6 years ago
- Description updated (diff)
- Status changed from New to In Progress
@jorauch: softfail would not be recommended as we should use it only when we have a product issue to track which is not the case here. Empty regcode means we did something wrong in the test setup. So https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3466 should address the empty regcode by hard-failing tests when this is used.
Updated by okurz over 6 years ago
So one mandatory step left to do is to add a valid SCC_REGCODE to the media. I suggest to add the one from SLE 12 SP3 as this one works (did not check on all architectures but it should be still valid).
@jorauch: Do you want to do that?
Updated by jorauch over 6 years ago
Keys added from the SLE12 SP3 Media to the according SLE15 Leanos Media, additionally started the following test runs:
x86_64: https://openqa.suse.de/tests/1129994
aarch64: https://openqa.suse.de/tests/1129995
ppc64le: https://openqa.suse.de/tests/1129996
s390x: https://openqa.suse.de/tests/1129997
Updated by jorauch over 6 years ago
On aarch64 and ppc the code is written to the e-mail field, also on x86 a popup blocks the test.
Is an e-mail address needed for aarch64/ppc?
Updated by okurz over 6 years ago
- Assignee set to okurz
I added a new test suite "empty_scc_regcode" and added this to the sle 15 test development job group. Also triggered a test manually:
$ openqa_clone_job_osd 1130717 SCC_REGCODE= EXTRABOOTPARAMS= SLE_PRODUCT=sles _GROUP=0 TEST=empty_scc_regcode
-> https://openqa.suse.de/t1132277
Sorry riafarov for being too impatient on your experiment with the yast team ;-)
Forgot to specify to actually register:
$ openqa_clone_job_osd 1130717 SCC_REGCODE= EXTRABOOTPARAMS= SLE_PRODUCT=sles _GROUP=0 TEST=empty_scc_regcode SCC_REGISTER=installation
-> https://openqa.suse.de/t1132356
Works as expected as it fails in https://openqa.suse.de/tests/1132356#step/scc_registration/4 which corresponds to https://bugzilla.suse.com/show_bug.cgi?id=1055696
enabled testsuite "empty_scc_regcode" in sle functional job group.
Updated by okurz over 6 years ago
- Description updated (diff)
jobs continue further to the module selection -> https://openqa.suse.de/tests/1130770#step/scc_registration/30
We can also continue in another ticket if we like
Updated by jorauch over 6 years ago
- Copied to action #23752: [sle][functional] refactor scc_allmodules in one test suite added
Updated by okurz over 6 years ago
- Status changed from In Progress to Resolved
ok, rest to be continued in #23752