QA » openQA Project

Observation¶

25-cache-service.t regularly finishes with a false negative:

# Looks like your test exited with -1 just after [...].
Dubious, test returned 255 [...]
All [...] subtests passed

On CircleCI this looks like so:

[06:18:54] t/25-cache-service.t ..       Dubious, test returned 255 (wstat 65280, 0xff00)
All 23 subtests passed 
[06:22:13]

Test Summary Report
-------------------
t/25-cache-service.t (Wstat: 65280 Tests: 23 Failed: 0)
  Non-zero exit status: 255
Files=1, Tests=23, 199.141 wallclock secs ( 0.08 usr  0.01 sys + 99.89 cusr  
4.69 csys = 104.67 CPU)
Result: FAIL

Steps to reproduce¶

make test TESTS=t/25-cache-service.t

Problem¶

All tests pass, but something is not being cleaned up and caused the entire test run to fail despite that.

Suggestion¶

• Investigate the services started and stopped in t/25-cache-service.t
• Track down what parts of clean-up are not done correctly

Workaround¶

• This is not effectively failing CI because it's already considered unstable. Although the false negative is very consistent now.