action #65082
Updated by livdywan almost 4 years ago
## Observation
Seen in https://circleci.com/api/v1.1/project/github/os-autoinst/openQA/19175/output/111/0?file=true&allocation-id=5e83023bf2a75b19962e1646-0-build%2F6148E966 but also in at least one other case:
```
[08:55:42] t/43-scheduling-and-worker-scalability.t .. 1/?
# Failed test 'all jobs done'
# at t/43-scheduling-and-worker-scalability.t line 196.
# got: '4'
# expected: '5'
# Failed test 'all jobs passed'
# at t/43-scheduling-and-worker-scalability.t line 197.
# got: '4'
# expected: '5'
# Looks like you failed 2 tests of 3.
[08:55:42] t/43-scheduling-and-worker-scalability.t .. 2/?
# Failed test 'assign and run jobs'
# at t/43-scheduling-and-worker-scalability.t line 199.
[08:55:42] t/43-scheduling-and-worker-scalability.t .. 3/? # Looks like you failed 1 test of 4.
[08:55:42] t/43-scheduling-and-worker-scalability.t .. Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/4 subtests
[08:56:13]
Test Summary Report
-------------------
t/43-scheduling-and-worker-scalability.t (Wstat: 256 Tests: 4 Failed: 1)
Failed test: 2
Non-zero exit status: 1
Files=2, Tests=9, 88.8589 wallclock secs ( 0.59 usr 0.04 sys + 183.69 cusr 28.88 csys = 213.20 CPU)
Result: FAIL
Retrying...
[08:56:13] t/05-scheduler-full.t .....................
[08:56:13] t/05-scheduler-full.t ..................... 1/?
[08:56:13] t/05-scheduler-full.t ..................... 2/?
[08:56:13] t/05-scheduler-full.t ..................... 3/?
[08:56:13] t/05-scheduler-full.t ..................... 4/?
[08:56:13] t/05-scheduler-full.t ..................... 5/?
[08:56:13] t/05-scheduler-full.t ..................... ok 53057 ms ( 0.43 usr 0.03 sys + 146.90 cusr 12.32 csys = 159.68 CPU)
[08:57:06] t/43-scheduling-and-worker-scalability.t ..
[08:57:06] t/43-scheduling-and-worker-scalability.t .. 1/?
# Failed test 'all jobs done'
# at t/43-scheduling-and-worker-scalability.t line 196.
# got: '4'
# expected: '5'
# Failed test 'all jobs passed'
# at t/43-scheduling-and-worker-scalability.t line 197.
# got: '4'
# expected: '5'
# Looks like you failed 2 tests of 3.
[08:57:06] t/43-scheduling-and-worker-scalability.t .. 2/?
# Failed test 'assign and run jobs'
# at t/43-scheduling-and-worker-scalability.t line 199.
[08:57:06] t/43-scheduling-and-worker-scalability.t .. 3/? # Looks like you failed 1 test of 4.
[08:57:06] t/43-scheduling-and-worker-scalability.t .. Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/4 subtests
[08:57:39]
Test Summary Report
-------------------
t/43-scheduling-and-worker-scalability.t (Wstat: 256 Tests: 4 Failed: 1)
Failed test: 2
Non-zero exit status: 1
Files=2, Tests=9, 85.2037 wallclock secs ( 0.57 usr 0.04 sys + 177.56 cusr 16.58 csys = 194.75 CPU)
Result: FAIL
Retrying...
[08:57:39] t/05-scheduler-full.t .....................
[08:57:39] t/05-scheduler-full.t ..................... 1/?
[08:57:39] t/05-scheduler-full.t ..................... 2/?
[08:57:39] t/05-scheduler-full.t ..................... 3/?
[08:57:39] t/05-scheduler-full.t ..................... 4/?
[08:57:39] t/05-scheduler-full.t ..................... 5/?
[08:57:39] t/05-scheduler-full.t ..................... ok 55655 ms ( 0.45 usr 0.03 sys + 119.12 cusr 12.33 csys = 131.93 CPU)
[08:58:35] t/43-scheduling-and-worker-scalability.t ..
[08:58:35] t/43-scheduling-and-worker-scalability.t .. 1/?
# Failed test 'all jobs done'
# at t/43-scheduling-and-worker-scalability.t line 196.
# got: '4'
# expected: '5'
# Failed test 'all jobs passed'
# at t/43-scheduling-and-worker-scalability.t line 197.
# got: '4'
# expected: '5'
# Looks like you failed 2 tests of 3.
[08:58:35] t/43-scheduling-and-worker-scalability.t .. 2/?
```
that is failing after 3 retries with always the same failure.
## Acceptance criteria
* **AC1:** t/43-scheduling-and-worker-scalability.t is stable, e.g. 100/100 runs on circleCI as well as local
## Suggestions
* Run `make test TESTS=t/43-scheduling-and-worker-scalability.t SCALABILITY_TEST=1 STABILITY_TEST=1 RETRY=100`