action #65082
Updated by livdywan over 4 years ago
## Observation Seen in https://circleci.com/api/v1.1/project/github/os-autoinst/openQA/19175/output/111/0?file=true&allocation-id=5e83023bf2a75b19962e1646-0-build%2F6148E966 but also in at least one other case: ``` [08:55:42] t/43-scheduling-and-worker-scalability.t .. 1/? # Failed test 'all jobs done' # at t/43-scheduling-and-worker-scalability.t line 196. # got: '4' # expected: '5' # Failed test 'all jobs passed' # at t/43-scheduling-and-worker-scalability.t line 197. # got: '4' # expected: '5' # Looks like you failed 2 tests of 3. [08:55:42] t/43-scheduling-and-worker-scalability.t .. 2/? # Failed test 'assign and run jobs' # at t/43-scheduling-and-worker-scalability.t line 199. [08:55:42] t/43-scheduling-and-worker-scalability.t .. 3/? # Looks like you failed 1 test of 4. [08:55:42] t/43-scheduling-and-worker-scalability.t .. Dubious, test returned 1 (wstat 256, 0x100) Failed 1/4 subtests [08:56:13] Test Summary Report ------------------- t/43-scheduling-and-worker-scalability.t (Wstat: 256 Tests: 4 Failed: 1) Failed test: 2 Non-zero exit status: 1 Files=2, Tests=9, 88.8589 wallclock secs ( 0.59 usr 0.04 sys + 183.69 cusr 28.88 csys = 213.20 CPU) Result: FAIL Retrying... [08:56:13] t/05-scheduler-full.t ..................... [08:56:13] t/05-scheduler-full.t ..................... 1/? [08:56:13] t/05-scheduler-full.t ..................... 2/? [08:56:13] t/05-scheduler-full.t ..................... 3/? [08:56:13] t/05-scheduler-full.t ..................... 4/? [08:56:13] t/05-scheduler-full.t ..................... 5/? [08:56:13] t/05-scheduler-full.t ..................... ok 53057 ms ( 0.43 usr 0.03 sys + 146.90 cusr 12.32 csys = 159.68 CPU) [08:57:06] t/43-scheduling-and-worker-scalability.t .. [08:57:06] t/43-scheduling-and-worker-scalability.t .. 1/? # Failed test 'all jobs done' # at t/43-scheduling-and-worker-scalability.t line 196. # got: '4' # expected: '5' # Failed test 'all jobs passed' # at t/43-scheduling-and-worker-scalability.t line 197. # got: '4' # expected: '5' # Looks like you failed 2 tests of 3. [08:57:06] t/43-scheduling-and-worker-scalability.t .. 2/? # Failed test 'assign and run jobs' # at t/43-scheduling-and-worker-scalability.t line 199. [08:57:06] t/43-scheduling-and-worker-scalability.t .. 3/? # Looks like you failed 1 test of 4. [08:57:06] t/43-scheduling-and-worker-scalability.t .. Dubious, test returned 1 (wstat 256, 0x100) Failed 1/4 subtests [08:57:39] Test Summary Report ------------------- t/43-scheduling-and-worker-scalability.t (Wstat: 256 Tests: 4 Failed: 1) Failed test: 2 Non-zero exit status: 1 Files=2, Tests=9, 85.2037 wallclock secs ( 0.57 usr 0.04 sys + 177.56 cusr 16.58 csys = 194.75 CPU) Result: FAIL Retrying... [08:57:39] t/05-scheduler-full.t ..................... [08:57:39] t/05-scheduler-full.t ..................... 1/? [08:57:39] t/05-scheduler-full.t ..................... 2/? [08:57:39] t/05-scheduler-full.t ..................... 3/? [08:57:39] t/05-scheduler-full.t ..................... 4/? [08:57:39] t/05-scheduler-full.t ..................... 5/? [08:57:39] t/05-scheduler-full.t ..................... ok 55655 ms ( 0.45 usr 0.03 sys + 119.12 cusr 12.33 csys = 131.93 CPU) [08:58:35] t/43-scheduling-and-worker-scalability.t .. [08:58:35] t/43-scheduling-and-worker-scalability.t .. 1/? # Failed test 'all jobs done' # at t/43-scheduling-and-worker-scalability.t line 196. # got: '4' # expected: '5' # Failed test 'all jobs passed' # at t/43-scheduling-and-worker-scalability.t line 197. # got: '4' # expected: '5' # Looks like you failed 2 tests of 3. [08:58:35] t/43-scheduling-and-worker-scalability.t .. 2/? ``` that is failing after 3 retries with always the same failure. ## Acceptance criteria * **AC1:** t/43-scheduling-and-worker-scalability.t is stable, e.g. 100/100 runs on circleCI as well as local ## Suggestions * Run `make test TESTS=t/43-scheduling-and-worker-scalability.t SCALABILITY_TEST=1 STABILITY_TEST=1 RETRY=100`