Project

General

Profile

Actions

action #71368

closed

25-cache-service.t fails after passing all tests

Added by livdywan over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Regressions/Crashes
Target version:
Start date:
2020-09-15
Due date:
% Done:

0%

Estimated time:

Description

Observation

25-cache-service.t regularly finishes with a false negative:

# Looks like your test exited with -1 just after [...].
Dubious, test returned 255 [...]
All [...] subtests passed

On CircleCI this looks like so:

[06:18:54] t/25-cache-service.t ..       Dubious, test returned 255 (wstat 65280, 0xff00)
All 23 subtests passed 
[06:22:13]

Test Summary Report
-------------------
t/25-cache-service.t (Wstat: 65280 Tests: 23 Failed: 0)
  Non-zero exit status: 255
Files=1, Tests=23, 199.141 wallclock secs ( 0.08 usr  0.01 sys + 99.89 cusr  
4.69 csys = 104.67 CPU)
Result: FAIL

Steps to reproduce

make test TESTS=t/25-cache-service.t

Problem

All tests pass, but something is not being cleaned up and caused the entire test run to fail despite that.

Suggestion

  • Investigate the services started and stopped in t/25-cache-service.t
  • Track down what parts of clean-up are not done correctly

Workaround

  • This is not effectively failing CI because it's already considered unstable. Although the false negative is very consistent now.
Actions #1

Updated by okurz over 3 years ago

  • Category set to Regressions/Crashes
  • Target version set to Ready

Is that maybe a consequence of the time limit you introduced? Please fill the ticket description from https://progress.opensuse.org/projects/openqav3/wiki/#Defects

Actions #2

Updated by livdywan over 3 years ago

  • Status changed from New to In Progress
  • Assignee set to livdywan

okurz wrote:

Is that maybe a consequence of the time limit you introduced? Please fill the ticket description from https://progress.opensuse.org/projects/openqav3/wiki/#Defects

No, that was only just merged ;-) This is the error you would usually see before CircleCI ended up killing the job (see #66664). I only filed it now after being certain it's a completely distinct issue.

https://github.com/os-autoinst/openQA/pull/3391

Actions #3

Updated by livdywan over 3 years ago

  • Description updated (diff)
Actions #4

Updated by okurz over 3 years ago

  • Status changed from In Progress to Resolved

merged and in combination with https://github.com/os-autoinst/openQA/pull/3400 this should not be ignored by CI anymore :)

Actions

Also available in: Atom PDF