Project

General

Profile

action #111920

coordination #103962: [saga][epic] Easy multi-machine handling: MM-tests as first-class citizens

[sporadic] Flaky test t/ui/10-tests_overview.t size:S

Added by tinita 2 months ago. Updated 2 months ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
Concrete Bugs
Target version:
Start date:
2022-06-01
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

https://app.circleci.com/pipelines/github/os-autoinst/openQA/9695/workflows/44758edd-8a85-4c30-bc0a-4b525847d402/jobs/91518/steps

[12:12:03] t/ui/10-tests_overview.t ................... 6/? 
    #   Failed test 'job 99982 collapsed via collapse all button'
    #   at /home/squamata/project/t/ui/../lib/OpenQA/SeleniumTest.pm line 283.
    # Looks like you failed 1 test of 46.
[12:12:03] t/ui/10-tests_overview.t ................... 10/? 
#   Failed test 'stacking of parallel children'
#   at t/ui/10-tests_overview.t line 220.
[12:12:03] t/ui/10-tests_overview.t ................... 11/?
[12:12:03] t/ui/10-tests_overview.t ................... 13/?
[12:12:03] t/ui/10-tests_overview.t ................... 14/?
[12:12:03] t/ui/10-tests_overview.t ................... 16/?
[12:12:03] t/ui/10-tests_overview.t ................... 17/?
[12:12:03] t/ui/10-tests_overview.t ................... 18/?
[12:12:03] t/ui/10-tests_overview.t ................... 20/?
[12:12:03] t/ui/10-tests_overview.t ................... 22/?
[12:12:03] t/ui/10-tests_overview.t ................... 23/? # Looks like you failed 1 test of 23.
[12:12:03] t/ui/10-tests_overview.t ................... Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/23 subtests

So far I couldn't find another occurrence of this.

Acceptance criteria

  • AC1: Test no longer fails sporadically

Suggestions


Related issues

Related to openQA Project - action #110719: Fold ok clusters by default, unfold if there is any non-ok resultResolved2022-05-06

History

#1 Updated by cdywan 2 months ago

Maybe https://github.com/os-autoinst/openQA/pull/4670 since it contains no test changes? Or https://github.com/os-autoinst/openQA/pull/4640/files which made the bigger changes

#2 Updated by okurz 2 months ago

  • Tags set to reactive work
  • Priority changed from Normal to Urgent
  • Target version set to Ready

#3 Updated by okurz 2 months ago

  • Related to action #110719: Fold ok clusters by default, unfold if there is any non-ok result added

#4 Updated by okurz 2 months ago

  • Parent task set to #103962

yes, seems to be likely that it's one of the two.

#5 Updated by cdywan 2 months ago

  • Subject changed from [sporadic] Flaky test t/ui/10-tests_overview.t to [sporadic] Flaky test t/ui/10-tests_overview.t size:S
  • Description updated (diff)
  • Status changed from New to Workable

#6 Updated by mkittler 2 months ago

  • Assignee set to mkittler

#7 Updated by mkittler 2 months ago

Detailed test log:

# Subtest: stacking of parallel children
    ok 1 - \#res-99963 present exactly once
    ok 2 - \#res-99963 exists
    ok 3 - parallel child not collapsed if parent not present (different group)
    ok 4 - \#res-99963 present exactly once
    ok 5 - \#res-99963 exists
    ok 6 - parallel child not collapsed if in other table (different flavor)
    ok 7 - parallel parent has not toggle icon
    ok 8 - toggle button present
    ok 9 - \#res-99963 present exactly once
    ok 10 - \#res-99963 exists
    ok 11 - parallel child expanded if parent in same table
    ok 12 - \#res-99937 present exactly once
    ok 13 - \#res-99937 exists
    ok 14 - job from other architecture expanded as well
    ok 15 - \#res-99963 present exactly once
    ok 16 - parallel child collapsed after clicking stacking icon
    ok 17 - \#res-99937 present exactly once
    ok 18 - job from other architecture collapsed as well
    ok 19 - \#res-99963 present exactly once
    ok 20 - \#res-99963 exists
    ok 21 - parallel child expanded again
    ok 22 - \#res-99937 present exactly once
    ok 23 - \#res-99937 exists
    ok 24 - job from other architecture expanded again as well
    ok 25 - collapse all button present
    ok 26 - \#res-99963 present exactly once
    ok 27 - parallel child collapsed after clicking "Collapse all" button
    ok 28 - \#res-99963 present exactly once
    ok 29 - parallel child collapse by default if one of OK_RESULTS
    ok 30 - exactly one collapse button present
    ok 31 - exactly one expand button present
    ok 32 - \#res-99937 present exactly once
    ok 33 - job 99937 hidden in the first place
    ok 34 - \#res-99982 present exactly once
    ok 35 - \#res-99982 exists
    ok 36 - job 99982 shown in the first place
    ok 37 - \#res-99937 present exactly once
    ok 38 - \#res-99937 exists
    ok 39 - job 99937 expanded via expand all button
    ok 40 - \#res-99982 present exactly once
    ok 41 - \#res-99982 exists
    ok 42 - job 99982 stays expanded
    ok 43 - \#res-99937 present exactly once
    ok 44 - job 99937 collapsed via collapse all button
    ok 45 - \#res-99982 present exactly once
    not ok 46 - job 99982 collapsed via collapse all button
    1..46
not ok 10 - stacking of parallel children

#8 Updated by mkittler 2 months ago

  • Status changed from Workable to Feedback

#9 Updated by mkittler 2 months ago

  • Status changed from Feedback to Resolved

The PR has been merged. If we see it again we can reopen this ticket but for now I'll consider it resolved.

Also available in: Atom PDF