action #111920
closed
coordination #103962: [saga][epic] Easy multi-machine handling: MM-tests as first-class citizens
[sporadic] Flaky test t/ui/10-tests_overview.t size:S
Added by tinita over 2 years ago.
Updated over 2 years ago.
Category:
Regressions/Crashes
Description
Observation¶
https://app.circleci.com/pipelines/github/os-autoinst/openQA/9695/workflows/44758edd-8a85-4c30-bc0a-4b525847d402/jobs/91518/steps
[12:12:03] t/ui/10-tests_overview.t ................... 6/?
# Failed test 'job 99982 collapsed via collapse all button'
# at /home/squamata/project/t/ui/../lib/OpenQA/SeleniumTest.pm line 283.
# Looks like you failed 1 test of 46.
[12:12:03] t/ui/10-tests_overview.t ................... 10/?
# Failed test 'stacking of parallel children'
# at t/ui/10-tests_overview.t line 220.
[12:12:03] t/ui/10-tests_overview.t ................... 11/?
[12:12:03] t/ui/10-tests_overview.t ................... 13/?
[12:12:03] t/ui/10-tests_overview.t ................... 14/?
[12:12:03] t/ui/10-tests_overview.t ................... 16/?
[12:12:03] t/ui/10-tests_overview.t ................... 17/?
[12:12:03] t/ui/10-tests_overview.t ................... 18/?
[12:12:03] t/ui/10-tests_overview.t ................... 20/?
[12:12:03] t/ui/10-tests_overview.t ................... 22/?
[12:12:03] t/ui/10-tests_overview.t ................... 23/? # Looks like you failed 1 test of 23.
[12:12:03] t/ui/10-tests_overview.t ................... Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/23 subtests
So far I couldn't find another occurrence of this.
Acceptance criteria¶
- AC1: Test no longer fails sporadically
Suggestions¶
- Tags set to reactive work
- Priority changed from Normal to Urgent
- Target version set to Ready
- Related to action #110719: Fold ok clusters by default, unfold if there is any non-ok result added
- Parent task set to #103962
yes, seems to be likely that it's one of the two.
- Subject changed from [sporadic] Flaky test t/ui/10-tests_overview.t to [sporadic] Flaky test t/ui/10-tests_overview.t size:S
- Description updated (diff)
- Status changed from New to Workable
Detailed test log:
# Subtest: stacking of parallel children
ok 1 - \#res-99963 present exactly once
ok 2 - \#res-99963 exists
ok 3 - parallel child not collapsed if parent not present (different group)
ok 4 - \#res-99963 present exactly once
ok 5 - \#res-99963 exists
ok 6 - parallel child not collapsed if in other table (different flavor)
ok 7 - parallel parent has not toggle icon
ok 8 - toggle button present
ok 9 - \#res-99963 present exactly once
ok 10 - \#res-99963 exists
ok 11 - parallel child expanded if parent in same table
ok 12 - \#res-99937 present exactly once
ok 13 - \#res-99937 exists
ok 14 - job from other architecture expanded as well
ok 15 - \#res-99963 present exactly once
ok 16 - parallel child collapsed after clicking stacking icon
ok 17 - \#res-99937 present exactly once
ok 18 - job from other architecture collapsed as well
ok 19 - \#res-99963 present exactly once
ok 20 - \#res-99963 exists
ok 21 - parallel child expanded again
ok 22 - \#res-99937 present exactly once
ok 23 - \#res-99937 exists
ok 24 - job from other architecture expanded again as well
ok 25 - collapse all button present
ok 26 - \#res-99963 present exactly once
ok 27 - parallel child collapsed after clicking "Collapse all" button
ok 28 - \#res-99963 present exactly once
ok 29 - parallel child collapse by default if one of OK_RESULTS
ok 30 - exactly one collapse button present
ok 31 - exactly one expand button present
ok 32 - \#res-99937 present exactly once
ok 33 - job 99937 hidden in the first place
ok 34 - \#res-99982 present exactly once
ok 35 - \#res-99982 exists
ok 36 - job 99982 shown in the first place
ok 37 - \#res-99937 present exactly once
ok 38 - \#res-99937 exists
ok 39 - job 99937 expanded via expand all button
ok 40 - \#res-99982 present exactly once
ok 41 - \#res-99982 exists
ok 42 - job 99982 stays expanded
ok 43 - \#res-99937 present exactly once
ok 44 - job 99937 collapsed via collapse all button
ok 45 - \#res-99982 present exactly once
not ok 46 - job 99982 collapsed via collapse all button
1..46
not ok 10 - stacking of parallel children
- Status changed from Workable to Feedback
- Status changed from Feedback to Resolved
The PR has been merged. If we see it again we can reopen this ticket but for now I'll consider it resolved.
Also available in: Atom
PDF