action #128981
closedcoordination #121876: [epic] Handle openQA review failures in Yam squad - SLE 15 SP5
Run comparable test for the YaST glitch passing in O3 in OSD
0%
Description
Updated by JERiveraMoya over 1 year ago
- Related to action #124652: gtk glitch not showing dialog window decoration on openQA size:M added
Updated by syrianidou_sofia over 1 year ago
- Status changed from In Progress to Resolved
I created a tumbleweed hdd on osd using this customized test: https://openqa.suse.de/tests/11076564
and then proceeded to run 100 tests for yast2_gui security module:
https://openqa.suse.de/tests/overview?distri=opensuse&build=glitch_investigation_tw&version=Tumbleweed
I have ran another 100 tests for yast2 security for SLE 15 SP5 on osd:
https://openqa.suse.de/tests/overview?distri=sle&build=glitch_investigation_SP5&version=15-SP5
The failure rate for SP5 is 5% , for Tumbleweed there is a problem with identifying a new needle created but the successful runs don't exibit the glitch at all.
Updated by syrianidou_sofia over 1 year ago
- Status changed from Resolved to In Progress
will try to resolve the needle issue because the successful runs don't seem enough
Updated by JERiveraMoya over 1 year ago
what about the Leap equivalent? (point 1 in description)
How is that the failure is 5% for this case and 97% from previous investigation, could you please clarify it?
Updated by syrianidou_sofia over 1 year ago
JERiveraMoya wrote:
what about the Leap equivalent? (point 1 in description)
How is that the failure is 5% for this case and 97% from previous investigation, could you please clarify it?
The previous failure rate was collected by running the iscsi tests, now the new stats where collected by running yast2 security, because it is way simpler than customizing multimachine tests for the stats collection. If you happen to know another yast2 module that exhibited the failure more frequently, I can run tests for that as well. But seems unnecessary because I haven't seen a single failure due to the glitch on any of the opensuse distributions.
Images for Leap 15.4 created by this test: https://openqa.suse.de/tests/11096501#downloads
and Leap 15.5 by this: https://openqa.suse.de/tests/11096534#downloads
So far all tests ran on osd
5% failure for SLE15 SP5 : https://openqa.suse.de/tests/overview?distri=sle&build=glitch_investigation_SP5&version=15-SP5
0% failure for Tumbleweed : https://openqa.suse.de/tests/overview?distri=opensuse&build=glitch_investigation_tw&version=Tumbleweed
0% failure for Leap 15.4 : https://openqa.suse.de/tests/overview?distri=opensuse&build=glitch_investigation_leap_sp4&version=15.4
0% failure for Leap 15.5 : https://openqa.suse.de/tests/overview?distri=opensuse&version=Leap15.5&build=glitch_investigation_leap_sp5
Updated by syrianidou_sofia over 1 year ago
- Status changed from In Progress to Resolved
Stats posted on https://progress.opensuse.org/issues/124652#note-32