Actions
action #103485
closed[sporadic] os-autoinst: flaky test t/13-osutils.t
Description
Observation¶
Observed in GHA and
locally
## Run 18
t/13-osutils.t .. 1/?
# Failed test 'Exit code appear in log'
# at t/13-osutils.t line 167.
# STDERR:
# [2021-12-05T11:03:37.186582+01:00] [debug] running `echo foo`
# [2021-12-05T11:03:37.194499+01:00] [debug] Command `echo foo` terminated with 1
# foo
#
# doesn't match:
# (?^u:terminated with 0)
# as expected
# Looks like you failed 1 test of 10.
# Failed test 'run_diag'
# at t/13-osutils.t line 190.
# Looks like you failed 1 test of 9.
t/13-osutils.t .. Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/9 subtests
Reproducible¶
Locally I could only reproduce it in 1/500 (!) runs with runs=500 count_fail_ratio prove -I. t/13-osutils.t
runs=500 count_fail_ratio make test-perl-testsuite WITH_COVER_OPTIONS=1 TESTS=t/13-osutils.t
yields
## count_fail_ratio: Run: 500. Fails: 5. Fail ratio 1%
Actions