openQA Project (public)

Observation¶

Right now in OBS checks I see a failure in https://build.opensuse.org/package/live_build_log/devel:openQA:TestGithub:PR-4007/openQA/openSUSE_Factory/x86_64 in

[ 1081s]     #   Failed test 'all jobs done'
[ 1081s]     #   at ./t/43-scheduling-and-worker-scalability.t line 216.
[ 1081s]     #          got: '4'
[ 1081s]     #     expected: '5'
[ 1081s] 
[ 1081s]     #   Failed test 'all jobs passed'
[ 1081s]     #   at ./t/43-scheduling-and-worker-scalability.t line 217.
[ 1081s]     #          got: '4'
[ 1081s]     #     expected: '5'
[ 1081s]     # All jobs:
[ 1081s]     #  - id: 1, state: done, result: passed, reason: none
[ 1081s]     #  - id: 2, state: done, result: passed, reason: none
[ 1081s]     #  - id: 3, state: assigned, result: none, reason: none
[ 1081s]     #  - id: 4, state: done, result: passed, reason: none
[ 1081s]     #  - id: 5, state: done, result: passed, reason: none
[ 1081s]     # Looks like you failed 2 tests of 3.
[ 1081s] 
[ 1081s] #   Failed test 'assign and run jobs'
[ 1081s] #   at ./t/43-scheduling-and-worker-scalability.t line 219.
[ 1081s] # Looks like you failed 1 test of 4.
[ 1081s] ./t/43-scheduling-and-worker-scalability.t .................. 
[ 1081s] # Running scalability test with 2 worker(s) and 5 job(s).
[ 1081s] # Set SCALABILITY_TEST_WORKER_COUNT/SCALABILITY_TEST_JOB_COUNT to adjust this.

and I think I saw this in other OBS runs as well.

Suggestion¶

• Stop running the test in OBS
• Consider if https://github.com/os-autoinst/openQA/pull/4084 erroneously enabled tests that weren't run before
• Consider #95851 - although likely the test was never run on OBS at the time (hypothesis during the daily)