action #95839
closed[sporadic] CircleCI: openQA t/ui/14-dashboard.t flaky size:M
Description
Problem¶
t/ui/14-dashboard.t failed in this PR https://github.com/os-autoinst/openQA/pull/4064
https://app.circleci.com/pipelines/github/os-autoinst/openQA/7140/workflows/760cdf7c-01a6-4627-9dce-1f020e046a2f/jobs/67371/steps
[02:35:42] t/ui/14-dashboard.t ........................ 1/?
# Failed test 'button is not visible anymore after using it'
# at t/ui/14-dashboard.t line 53.
# Looks like you failed 1 test of 4.
# Failed test 'Back to top button'
# at t/ui/14-dashboard.t line 54.
[02:35:42] t/ui/14-dashboard.t ........................ 9/? [02:35:42] t/ui/14-dashboard.t ........................ 10/? [02:35:42] t/ui/14-dashboard.t ........................ 17/? [02:35:42] t/ui/14-dashboard.t ........................ 19/? [02:35:42] t/ui/14-dashboard.t ........................ 20/? [02:35:42] t/ui/14-dashboard.t ........................ 22/? [02:35:42] t/ui/14-dashboard.t ........................ 28/? [02:35:42] t/ui/14-dashboard.t ........................ 38/? [02:35:42] t/ui/14-dashboard.t ........................ 40/? [02:35:42] t/ui/14-dashboard.t ........................ 42/? # Looks like you failed 1 test of 42.
[02:35:42] t/ui/14-dashboard.t ........................ Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/42 subtests
Retriggering it fixed it.
Acceptance Criteria¶
AC 1: t/ui/14-dashboard.t is not flaky anymore
Suggestion¶
- Could be related with selenium running in not headless mode
Updated by tinita over 3 years ago
- Copied from action #95836: [sporadic] CircleCI: openQA t/full-stack.t flaky size:M added
Updated by tinita over 3 years ago
- Copied to action #95848: [sporadic] CircleCI: openQA t/05-scheduler-full.t flaky size:M added
Updated by ilausuch over 3 years ago
- Subject changed from CircleCI: openQA t/ui/14-dashboard.t flaky to CircleCI: openQA t/ui/14-dashboard.t flaky size:M
- Description updated (diff)
- Status changed from New to Workable
Updated by okurz over 3 years ago
- Subject changed from CircleCI: openQA t/ui/14-dashboard.t flaky size:M to [sporadic] CircleCI: openQA t/ui/14-dashboard.t flaky size:M
Updated by tinita over 3 years ago
- Copied to deleted (action #95848: [sporadic] CircleCI: openQA t/05-scheduler-full.t flaky size:M)
Updated by mkittler over 3 years ago
- Assignee set to mkittler
This is always reproducible in non-headless mode - at least on my screen which is high enough for not having a scrollbar here altogether so the button is always absent. In headless mode the "window" might be smaller but it is possibly on the edge so in rare cases we see this test failure.
Updated by mkittler over 3 years ago
- Status changed from Workable to In Progress
Updated by openqa_review over 3 years ago
- Due date set to 2021-08-07
Setting due date based on mean cycle time of SUSE QE Tools
Updated by okurz over 3 years ago
PR merged but only a single circleCI run in master had been done since the merge as visible in https://app.circleci.com/pipelines/github/os-autoinst/openQA?branch=master so not enough to prove stability.
Updated by mkittler over 3 years ago
PR to test stability: https://github.com/os-autoinst/openQA/pull/4079
Updated by mkittler over 3 years ago
Unfortunately it didn't help. The instability must be caused by something else than just the viewport height.
Rerun 53 of 200 …
[14:24:14] t/ui/14-dashboard.t .. 1/?
# Failed test 'button is visible after scrolling down'
# at t/ui/14-dashboard.t line 55.
# Looks like you failed 1 test of 4.
# Failed test 'Back to top button'
# at t/ui/14-dashboard.t line 58.
[14:24:14] t/ui/14-dashboard.t .. 4/?
Updated by mkittler over 3 years ago
I assume Selenium is simply not blocking until all JavaScript events have been processed so I changed the check to use wait_until. I'm currently testing whether it is now stable locally and on CirceCI.
Updated by okurz over 3 years ago
https://github.com/os-autoinst/openQA/pull/4090 looks good now, "Feedback"?
Updated by mkittler over 3 years ago
- Status changed from In Progress to Feedback
Updated by mkittler over 3 years ago
- Status changed from Feedback to Resolved
PR has been merged after 200 consecutive successful runs (locally and on CircleCI).