Project

General

Profile

action #80374

unstable/flaky/sporadic test t/ui/25-developer_mode.t

Added by okurz 5 months ago.

Status:
Workable
Priority:
Normal
Assignee:
-
Category:
Concrete Bugs
Target version:
Start date:
2020-11-25
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

https://app.circleci.com/pipelines/github/os-autoinst/openQA/5067/workflows/10cbcdac-cd57-4c67-8cb6-0483c8a98ba4/jobs/48181/steps shows that t/ui/25-developer_mode.t failed:

[16:58:27] t/ui/25-developer_mode.t ............... 8/? 
        #   Failed test 'foo selected'
        #   at t/ui/25-developer_mode.t line 447.
        #          got: '1'
        #     expected: '0'

        #   Failed test 'option #4 present'
        #   at t/ui/25-developer_mode.t line 449.
        # Looks like you failed 2 tests of 2.

    #   Failed test 'select module to pause at'
    #   at t/ui/25-developer_mode.t line 475.
    # Looks like you failed 1 test of 19.
[16:58:27] t/ui/25-developer_mode.t ............... 12/? 
#   Failed test 'start developer session'
#   at t/ui/25-developer_mode.t line 572.
[16:58:27] t/ui/25-developer_mode.t ............... 13/? [16:58:27] t/ui/25-developer_mode.t ............... 14/? # Looks like you failed 1 test of 14.
                                                          [16:58:27] t/ui/25-developer_mode.t ............... Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/14 subtests 

I am not aware of seeing this problem in before. Has anyone else seen it yet?

Acceptance criteria

  • AC1: t/ui/25-developer_mode.t should be stable

Suggestions

  • Try to reproduce locally or within CI
  • If reproducible add to .circleci/unstable_tests.txt
  • Consider starting with improving the error output in case of failure
  • Fix the instability in the test

Also available in: Atom PDF