action #95839
closed
[sporadic] CircleCI: openQA t/ui/14-dashboard.t flaky size:M
Added by tinita about 3 years ago.
Updated about 3 years ago.
Category:
Regressions/Crashes
Description
Problem¶
t/ui/14-dashboard.t failed in this PR https://github.com/os-autoinst/openQA/pull/4064
https://app.circleci.com/pipelines/github/os-autoinst/openQA/7140/workflows/760cdf7c-01a6-4627-9dce-1f020e046a2f/jobs/67371/steps
[02:35:42] t/ui/14-dashboard.t ........................ 1/?
# Failed test 'button is not visible anymore after using it'
# at t/ui/14-dashboard.t line 53.
# Looks like you failed 1 test of 4.
# Failed test 'Back to top button'
# at t/ui/14-dashboard.t line 54.
[02:35:42] t/ui/14-dashboard.t ........................ 9/? [02:35:42] t/ui/14-dashboard.t ........................ 10/? [02:35:42] t/ui/14-dashboard.t ........................ 17/? [02:35:42] t/ui/14-dashboard.t ........................ 19/? [02:35:42] t/ui/14-dashboard.t ........................ 20/? [02:35:42] t/ui/14-dashboard.t ........................ 22/? [02:35:42] t/ui/14-dashboard.t ........................ 28/? [02:35:42] t/ui/14-dashboard.t ........................ 38/? [02:35:42] t/ui/14-dashboard.t ........................ 40/? [02:35:42] t/ui/14-dashboard.t ........................ 42/? # Looks like you failed 1 test of 42.
[02:35:42] t/ui/14-dashboard.t ........................ Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/42 subtests
Retriggering it fixed it.
Acceptance Criteria¶
AC 1: t/ui/14-dashboard.t is not flaky anymore
Suggestion¶
- Could be related with selenium running in not headless mode
- Copied from action #95836: [sporadic] CircleCI: openQA t/full-stack.t flaky size:M added
- Copied to action #95848: [sporadic] CircleCI: openQA t/05-scheduler-full.t flaky size:M added
- Priority changed from Normal to Urgent
- Subject changed from CircleCI: openQA t/ui/14-dashboard.t flaky to CircleCI: openQA t/ui/14-dashboard.t flaky size:M
- Description updated (diff)
- Status changed from New to Workable
- Subject changed from CircleCI: openQA t/ui/14-dashboard.t flaky size:M to [sporadic] CircleCI: openQA t/ui/14-dashboard.t flaky size:M
- Copied to deleted (action #95848: [sporadic] CircleCI: openQA t/05-scheduler-full.t flaky size:M)
This is always reproducible in non-headless mode - at least on my screen which is high enough for not having a scrollbar here altogether so the button is always absent. In headless mode the "window" might be smaller but it is possibly on the edge so in rare cases we see this test failure.
- Status changed from Workable to In Progress
- Due date set to 2021-08-07
Setting due date based on mean cycle time of SUSE QE Tools
Unfortunately it didn't help. The instability must be caused by something else than just the viewport height.
Rerun 53 of 200 …
[14:24:14] t/ui/14-dashboard.t .. 1/?
# Failed test 'button is visible after scrolling down'
# at t/ui/14-dashboard.t line 55.
# Looks like you failed 1 test of 4.
# Failed test 'Back to top button'
# at t/ui/14-dashboard.t line 58.
[14:24:14] t/ui/14-dashboard.t .. 4/?
I assume Selenium is simply not blocking until all JavaScript events have been processed so I changed the check to use wait_until
. I'm currently testing whether it is now stable locally and on CirceCI.
- Status changed from In Progress to Feedback
- Status changed from Feedback to Resolved
PR has been merged after 200 consecutive successful runs (locally and on CircleCI).
Also available in: Atom
PDF