Project

General

Profile

Actions
Copy link

action #25862

closed

[sle][functional]pressing alt+N too fast so we skip preselected modules step during scc_registration

Added by asmorodskyi over 6 years ago. Updated over 6 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
-
Category:
Bugs in existing tests
Target version:
-
Start date:
2017-10-09
Due date:
2017-10-25
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

openQA test in scenario sle-15-Installer-DVD-x86_64-yast_hostname@64bit fails in
scc_registration

after pressing Alt-N to close dialog suggesting update repositories
https://openqa.suse.de/tests/1198216#step/scc_registration/6
we are too fast on detecting it again so we press Alt+N second time
https://openqa.suse.de/tests/1198216#step/scc_registration/7

but installer catching this as press Next in preselected modules so from test perspective we skipping this step

Reproducible

Fails since (at least) Build 294.1 (current job)

Expected result

Last good: 288.8 (or more recent)

Further details

Always latest result in this scenario: latest

Actions
Copy link
 #1

Updated by okurz over 6 years ago

  • Subject changed from pressing alt+N too fast so we skip preselected modules step during scc_registration to [sle][functional]pressing alt+N too fast so we skip preselected modules step during scc_registration
  • Priority changed from Normal to Urgent

failing in many tests

Actions
Copy link
 #2

Updated by okurz over 6 years ago

  • Due date set to 2017-10-25

adding to sprint 3 backlog 'cause it's urgent. Approved by PO

Actions
Copy link
 #3

Updated by jorauch over 6 years ago

  • Status changed from New to In Progress
  • Assignee set to jorauch
Actions
Copy link
 #4

Updated by jorauch over 6 years ago

I could not reproduce it locally so far

Actions
Copy link
 #5

Updated by jorauch over 6 years ago

  • Status changed from In Progress to Feedback
Actions
Copy link
 #6

Updated by Anonymous over 6 years ago

  • Status changed from Feedback to In Progress

PR already merged.

Actions
Copy link
 #7

Updated by Anonymous over 6 years ago

  • Status changed from In Progress to Resolved

Since one week the issue described here didn't appear. Now scc_registration fails because of other reason.

Actions
Copy link
 #8

Updated by Anonymous over 6 years ago

  • Status changed from Resolved to In Progress
Actions
Copy link
 #9

Updated by Anonymous over 6 years ago

scc_registration still fails: the screen inst-addon didn't show up. Tried to reproduce it but the issue didn't appear: https://openqa.suse.de/tests/1216265

Actions
Copy link
 #10

Updated by Anonymous over 6 years ago

I started 10 times verification testrun, and all passed. Now I have started 50 runs and will wait for the results and then update here.

Actions
Copy link
 #11

Updated by Anonymous over 6 years ago

https://openqa.suse.de/tests/latest?version=15&test=yast_hostname&arch=x86_64&distri=sle&flavor=Installer-DVD&limit_previous=100&machine=64bit#previous

Here we can see approximately 10% of the testruns fail. The issue seem to be the same. Take https://openqa.suse.de/tests/1213050 for an example, the screen inst-addon didn't show up. The reason might still be "next" was pressed too fast, so that addon_products_sle was skipped somehow, and the test jumped to system_role.

Actions
Copy link
 #12

Updated by Anonymous over 6 years ago

  • Assignee changed from jorauch to Anonymous
Actions
Copy link
 #13

Updated by Anonymous over 6 years ago

On my local machine, the same issue appeared once out of 30 testruns. http://f146.suse.detests/1567
I did a fix on it, will test it multiple times before I submit it.

Actions
Copy link
 #14

Updated by Anonymous over 6 years ago

PR created: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3745
I have let it run 50 times locally, and the issue from comment#9 (comment#11) didn't appear any more.

Actions
Copy link
 #15

Updated by okurz over 6 years ago

  • Status changed from In Progress to Resolved

PR merged. Very diligent investigation and verification. Thank you. I guess a verification run on production is not helpful here as we would need to run another 50 jobs on production and you did that already locally and the change is not invasive -> resolved.

Actions
Copy link
 #16

Updated by Anonymous over 6 years ago

Thanks Olli. I restarted failed scc_registration test scenarios with build308.1 after PR was merged and scc_registration didn't fail again.
old failed: https://openqa.suse.de/tests/1224497
new finished: https://openqa.suse.de/tests/1225472

Actions
Copy link
 #17

Updated by Anonymous over 6 years ago

  • Status changed from Resolved to In Progress

On osd the issue appeared again: https://openqa.suse.de/tests/1233284

Actions
Copy link
 #18

Updated by SLindoMansilla over 6 years ago

yxu, the link you pasted is broken. I cannot find the same issue in the build 321.1

Actions
Copy link
 #19

Updated by okurz over 6 years ago

https://openqa.suse.de/tests/1236500#step/scc_registration/22 is what I think is the same problem on s390x zVM

Actions
Copy link
 #20

Updated by Anonymous over 6 years ago

Right Oliver, with build 321.5 the issue didn't appear, however I doubt to close the ticket now.

Actions
Copy link
 #21

Updated by Anonymous over 6 years ago

I'm verifying the testcase in comment#19 for 100 times now on osd: job #1238407 till job #1238506

Actions
Copy link
 #22

Updated by Anonymous over 6 years ago

  • Status changed from In Progress to Resolved

The problem observed in the description is actually resolved. Another issue that I observed and that appeared 1-10% of the time is different. If it appears again, we'll need to open a new ticket for it.

Actions
Copy link

Also available in: Atom PDF