Actions
action #111920
closedcoordination #103962: [saga][epic] Easy multi-machine handling: MM-tests as first-class citizens
[sporadic] Flaky test t/ui/10-tests_overview.t size:S
Start date:
2022-06-01
Due date:
% Done:
0%
Estimated time:
Tags:
Description
Observation¶
[12:12:03] t/ui/10-tests_overview.t ................... 6/?
# Failed test 'job 99982 collapsed via collapse all button'
# at /home/squamata/project/t/ui/../lib/OpenQA/SeleniumTest.pm line 283.
# Looks like you failed 1 test of 46.
[12:12:03] t/ui/10-tests_overview.t ................... 10/?
# Failed test 'stacking of parallel children'
# at t/ui/10-tests_overview.t line 220.
[12:12:03] t/ui/10-tests_overview.t ................... 11/?
[12:12:03] t/ui/10-tests_overview.t ................... 13/?
[12:12:03] t/ui/10-tests_overview.t ................... 14/?
[12:12:03] t/ui/10-tests_overview.t ................... 16/?
[12:12:03] t/ui/10-tests_overview.t ................... 17/?
[12:12:03] t/ui/10-tests_overview.t ................... 18/?
[12:12:03] t/ui/10-tests_overview.t ................... 20/?
[12:12:03] t/ui/10-tests_overview.t ................... 22/?
[12:12:03] t/ui/10-tests_overview.t ................... 23/? # Looks like you failed 1 test of 23.
[12:12:03] t/ui/10-tests_overview.t ................... Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/23 subtests
So far I couldn't find another occurrence of this.
Acceptance criteria¶
- AC1: Test no longer fails sporadically
Suggestions¶
- Review the test code and try to identify where the recent code changes from https://github.com/os-autoinst/openQA/pull/4670 or https://github.com/os-autoinst/openQA/pull/4640/files could have introduced a sporadic test failure and fix it with proper synchronization means, e.g.
wait_for_element
Updated by livdywan almost 2 years ago
Maybe https://github.com/os-autoinst/openQA/pull/4670 since it contains no test changes? Or https://github.com/os-autoinst/openQA/pull/4640/files which made the bigger changes
Updated by okurz almost 2 years ago
- Tags set to reactive work
- Priority changed from Normal to Urgent
- Target version set to Ready
Updated by okurz almost 2 years ago
- Related to action #110719: Fold ok clusters by default, unfold if there is any non-ok result added
Updated by okurz almost 2 years ago
- Parent task set to #103962
yes, seems to be likely that it's one of the two.
Updated by livdywan almost 2 years ago
- Subject changed from [sporadic] Flaky test t/ui/10-tests_overview.t to [sporadic] Flaky test t/ui/10-tests_overview.t size:S
- Description updated (diff)
- Status changed from New to Workable
Updated by mkittler almost 2 years ago
Detailed test log:
# Subtest: stacking of parallel children
ok 1 - \#res-99963 present exactly once
ok 2 - \#res-99963 exists
ok 3 - parallel child not collapsed if parent not present (different group)
ok 4 - \#res-99963 present exactly once
ok 5 - \#res-99963 exists
ok 6 - parallel child not collapsed if in other table (different flavor)
ok 7 - parallel parent has not toggle icon
ok 8 - toggle button present
ok 9 - \#res-99963 present exactly once
ok 10 - \#res-99963 exists
ok 11 - parallel child expanded if parent in same table
ok 12 - \#res-99937 present exactly once
ok 13 - \#res-99937 exists
ok 14 - job from other architecture expanded as well
ok 15 - \#res-99963 present exactly once
ok 16 - parallel child collapsed after clicking stacking icon
ok 17 - \#res-99937 present exactly once
ok 18 - job from other architecture collapsed as well
ok 19 - \#res-99963 present exactly once
ok 20 - \#res-99963 exists
ok 21 - parallel child expanded again
ok 22 - \#res-99937 present exactly once
ok 23 - \#res-99937 exists
ok 24 - job from other architecture expanded again as well
ok 25 - collapse all button present
ok 26 - \#res-99963 present exactly once
ok 27 - parallel child collapsed after clicking "Collapse all" button
ok 28 - \#res-99963 present exactly once
ok 29 - parallel child collapse by default if one of OK_RESULTS
ok 30 - exactly one collapse button present
ok 31 - exactly one expand button present
ok 32 - \#res-99937 present exactly once
ok 33 - job 99937 hidden in the first place
ok 34 - \#res-99982 present exactly once
ok 35 - \#res-99982 exists
ok 36 - job 99982 shown in the first place
ok 37 - \#res-99937 present exactly once
ok 38 - \#res-99937 exists
ok 39 - job 99937 expanded via expand all button
ok 40 - \#res-99982 present exactly once
ok 41 - \#res-99982 exists
ok 42 - job 99982 stays expanded
ok 43 - \#res-99937 present exactly once
ok 44 - job 99937 collapsed via collapse all button
ok 45 - \#res-99982 present exactly once
not ok 46 - job 99982 collapsed via collapse all button
1..46
not ok 10 - stacking of parallel children
Updated by mkittler almost 2 years ago
- Status changed from Workable to Feedback
Updated by mkittler almost 2 years ago
- Status changed from Feedback to Resolved
The PR has been merged. If we see it again we can reopen this ticket but for now I'll consider it resolved.
Actions