action #80374
Updated by okurz over 3 years ago
## Observation
https://app.circleci.com/pipelines/github/os-autoinst/openQA/5067/workflows/10cbcdac-cd57-4c67-8cb6-0483c8a98ba4/jobs/48181/steps shows that t/ui/25-developer_mode.t failed:
```
[16:58:27] t/ui/25-developer_mode.t ............... 8/?
# Failed test 'foo selected'
# at t/ui/25-developer_mode.t line 447.
# got: '1'
# expected: '0'
# Failed test 'option #4 present'
# at t/ui/25-developer_mode.t line 449.
# Looks like you failed 2 tests of 2.
# Failed test 'select module to pause at'
# at t/ui/25-developer_mode.t line 475.
# Looks like you failed 1 test of 19.
[16:58:27] t/ui/25-developer_mode.t ............... 12/?
# Failed test 'start developer session'
# at t/ui/25-developer_mode.t line 572.
[16:58:27] t/ui/25-developer_mode.t ............... 13/? [16:58:27] t/ui/25-developer_mode.t ............... 14/? # Looks like you failed 1 test of 14.
[16:58:27] t/ui/25-developer_mode.t ............... Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/14 subtests
```
I am not aware of seeing this problem in before. Has anyone else seen it yet?
## Acceptance criteria
* **AC1:** t/ui/25-developer_mode.t is should be stable
## Acceptance tests
* **AT1-1:** `make test STABILITY_TEST=1 RETRIES=50 KEEP_DB=1 TESTS=1 t/ui/25-developer_mode.t`
* **AT1-2:** Same as *AT1-1* but in circleCI
## Suggestions
* DONE: Try to reproduce locally or within CI -> happened multiple times in circleCI
* DONE: If reproducible add to .circleci/unstable_tests.txt -> https://github.com/os-autoinst/openQA/pull/3884
* Consider starting with improving the error output in case of failure
* Fix the instability in the test