action #96545
Updated by livdywan over 3 years ago
## Observation
Right now in OBS checks I see a failure in https://build.opensuse.org/package/live_build_log/devel:openQA:TestGithub:PR-4007/openQA/openSUSE_Factory/x86_64 in
```
[ 1081s] # Failed test 'all jobs done'
[ 1081s] # at ./t/43-scheduling-and-worker-scalability.t line 216.
[ 1081s] # got: '4'
[ 1081s] # expected: '5'
[ 1081s]
[ 1081s] # Failed test 'all jobs passed'
[ 1081s] # at ./t/43-scheduling-and-worker-scalability.t line 217.
[ 1081s] # got: '4'
[ 1081s] # expected: '5'
[ 1081s] # All jobs:
[ 1081s] # - id: 1, state: done, result: passed, reason: none
[ 1081s] # - id: 2, state: done, result: passed, reason: none
[ 1081s] # - id: 3, state: assigned, result: none, reason: none
[ 1081s] # - id: 4, state: done, result: passed, reason: none
[ 1081s] # - id: 5, state: done, result: passed, reason: none
[ 1081s] # Looks like you failed 2 tests of 3.
[ 1081s]
[ 1081s] # Failed test 'assign and run jobs'
[ 1081s] # at ./t/43-scheduling-and-worker-scalability.t line 219.
[ 1081s] # Looks like you failed 1 test of 4.
[ 1081s] ./t/43-scheduling-and-worker-scalability.t ..................
[ 1081s] # Running scalability test with 2 worker(s) and 5 job(s).
[ 1081s] # Set SCALABILITY_TEST_WORKER_COUNT/SCALABILITY_TEST_JOB_COUNT to adjust this.
```
and I think I saw this in other OBS runs as well.
## Suggestion
- Stop running the test in OBS
- Consider if https://github.com/os-autoinst/openQA/pull/4084 erroneously enabled tests that weren't run before
- Consider #95851 - although likely the test was never run on OBS at the time (hypothesis during the daily)