Project

General

Profile

Actions

action #95839

closed

[sporadic] CircleCI: openQA t/ui/14-dashboard.t flaky size:M

Added by tinita about 3 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
Regressions/Crashes
Target version:
Start date:
2021-07-22
Due date:
2021-08-07
% Done:

0%

Estimated time:

Description

Problem

t/ui/14-dashboard.t failed in this PR https://github.com/os-autoinst/openQA/pull/4064
https://app.circleci.com/pipelines/github/os-autoinst/openQA/7140/workflows/760cdf7c-01a6-4627-9dce-1f020e046a2f/jobs/67371/steps

[02:35:42] t/ui/14-dashboard.t ........................ 1/? 
    #   Failed test 'button is not visible anymore after using it'
    #   at t/ui/14-dashboard.t line 53.
    # Looks like you failed 1 test of 4.

#   Failed test 'Back to top button'
#   at t/ui/14-dashboard.t line 54.
[02:35:42] t/ui/14-dashboard.t ........................ 9/? [02:35:42] t/ui/14-dashboard.t ........................ 10/? [02:35:42] t/ui/14-dashboard.t ........................ 17/? [02:35:42] t/ui/14-dashboard.t ........................ 19/? [02:35:42] t/ui/14-dashboard.t ........................ 20/? [02:35:42] t/ui/14-dashboard.t ........................ 22/? [02:35:42] t/ui/14-dashboard.t ........................ 28/? [02:35:42] t/ui/14-dashboard.t ........................ 38/? [02:35:42] t/ui/14-dashboard.t ........................ 40/? [02:35:42] t/ui/14-dashboard.t ........................ 42/? # Looks like you failed 1 test of 42.
                                                              [02:35:42] t/ui/14-dashboard.t ........................ Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/42 subtests 

Retriggering it fixed it.

Acceptance Criteria

AC 1: t/ui/14-dashboard.t is not flaky anymore

Suggestion

  • Could be related with selenium running in not headless mode

Related issues 1 (0 open1 closed)

Copied from openQA Project - action #95836: [sporadic] CircleCI: openQA t/full-stack.t flaky size:MResolvedlivdywan2021-07-222021-09-02

Actions
Actions #1

Updated by tinita about 3 years ago

  • Copied from action #95836: [sporadic] CircleCI: openQA t/full-stack.t flaky size:M added
Actions #2

Updated by tinita about 3 years ago

  • Copied to action #95848: [sporadic] CircleCI: openQA t/05-scheduler-full.t flaky size:M added
Actions #3

Updated by okurz about 3 years ago

  • Priority changed from Normal to Urgent
Actions #4

Updated by ilausuch about 3 years ago

  • Subject changed from CircleCI: openQA t/ui/14-dashboard.t flaky to CircleCI: openQA t/ui/14-dashboard.t flaky size:M
  • Description updated (diff)
  • Status changed from New to Workable
Actions #5

Updated by okurz about 3 years ago

  • Subject changed from CircleCI: openQA t/ui/14-dashboard.t flaky size:M to [sporadic] CircleCI: openQA t/ui/14-dashboard.t flaky size:M
Actions #6

Updated by tinita about 3 years ago

  • Copied to deleted (action #95848: [sporadic] CircleCI: openQA t/05-scheduler-full.t flaky size:M)
Actions #7

Updated by mkittler about 3 years ago

  • Assignee set to mkittler

This is always reproducible in non-headless mode - at least on my screen which is high enough for not having a scrollbar here altogether so the button is always absent. In headless mode the "window" might be smaller but it is possibly on the edge so in rare cases we see this test failure.

Actions #8

Updated by mkittler about 3 years ago

  • Status changed from Workable to In Progress
Actions #9

Updated by openqa_review about 3 years ago

  • Due date set to 2021-08-07

Setting due date based on mean cycle time of SUSE QE Tools

Actions #10

Updated by okurz about 3 years ago

PR merged but only a single circleCI run in master had been done since the merge as visible in https://app.circleci.com/pipelines/github/os-autoinst/openQA?branch=master so not enough to prove stability.

Actions #12

Updated by mkittler about 3 years ago

Unfortunately it didn't help. The instability must be caused by something else than just the viewport height.

Rerun 53 of 200 …
[14:24:14] t/ui/14-dashboard.t .. 1/? 
    #   Failed test 'button is visible after scrolling down'
    #   at t/ui/14-dashboard.t line 55.
    # Looks like you failed 1 test of 4.

#   Failed test 'Back to top button'
#   at t/ui/14-dashboard.t line 58.
[14:24:14] t/ui/14-dashboard.t .. 4/?
Actions #13

Updated by mkittler about 3 years ago

I assume Selenium is simply not blocking until all JavaScript events have been processed so I changed the check to use wait_until. I'm currently testing whether it is now stable locally and on CirceCI.

Actions #14

Updated by okurz about 3 years ago

Actions #15

Updated by mkittler about 3 years ago

  • Status changed from In Progress to Feedback
Actions #16

Updated by mkittler about 3 years ago

  • Status changed from Feedback to Resolved

PR has been merged after 200 consecutive successful runs (locally and on CircleCI).

Actions

Also available in: Atom PDF