Project

General

Profile

action #73273

coordination #39719: [saga][epic] Detection of "known failures" for stable tests, easy test results review and easy tracking of known issues

coordination #62420: [epic] Distinguish all types of incompletes

job incompletes with auto_review:"setup failure: Cache service status error from API.* file is not a database .*":retry

Added by Xiaojing_liu 10 months ago. Updated 8 months ago.

Status:
Workable
Priority:
Low
Assignee:
-
Category:
Feature requests
Target version:
Start date:
2020-10-13
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

job https://openqa.suse.de/tests/4812517 is incomplete, the log shows:

[2020-10-13T04:14:16.0500 CEST] [debug] [pid:36910] Updating status so job 4812517 is not considered dead.
[2020-10-13T04:14:16.0501 CEST] [debug] [pid:36910] REST-API call: POST http://openqa.suse.de/api/v1/jobs/4812517/status
[2020-10-13T04:14:21.0568 CEST] [debug] [pid:36910] Updating status so job 4812517 is not considered dead.
[2020-10-13T04:14:21.0569 CEST] [debug] [pid:36910] REST-API call: POST http://openqa.suse.de/api/v1/jobs/4812517/status
[2020-10-13T04:14:21.0630 CEST] [error] [pid:36910] Unable to setup job 4812517: Cache service status error from API: Minion job #43206 failed: DBD::SQLite::db do failed: file is not a database at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/SQLite.pm line 85.

please see more details in https://openqa.suse.de/tests/4812517/file/worker-log.txt

Acceptance criteria

  • AC1: The issue is automatically handled or the test maintainer is informed what he or she did wrong

Suggestions

  • Try to handle this problem with an automatic recovery within openQA if this is not a problem introduced by test maintainers (unlikely)

Workaround

Delete cache database on the affected worker and retry


Related issues

Related to openQA Project - action #67000: Job incompletes due to malformed worker cache database disk image with auto_review:"Cache service status error.*(database disk image is malformed|Specified job ID is invalid).*":retryResolved2020-05-18

History

#1 Updated by okurz 10 months ago

  • Description updated (diff)
  • Category set to Feature requests
  • Status changed from New to Workable
  • Priority changed from Normal to Low
  • Target version set to Ready

#2 Updated by Xiaojing_liu 9 months ago

  • Subject changed from job incompletes with auto_review:"setup failure: Cache service status error from API: Minion job #43206 failed: DBD::SQLite::db do failed: file is not a database at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/SQLite.pm line 85." to job incompletes with auto_review:"setup failure: Cache service status error from API: Minion job.* failed: DBD::SQLite::db do failed: file is not a database .*"

#3 Updated by Xiaojing_liu 9 months ago

  • Subject changed from job incompletes with auto_review:"setup failure: Cache service status error from API: Minion job.* failed: DBD::SQLite::db do failed: file is not a database .*" to job incompletes with auto_review:"setup failure: Cache service status error from API.* file is not a database .*"

#4 Updated by okurz 9 months ago

  • Related to action #67000: Job incompletes due to malformed worker cache database disk image with auto_review:"Cache service status error.*(database disk image is malformed|Specified job ID is invalid).*":retry added

#5 Updated by okurz 9 months ago

  • Subject changed from job incompletes with auto_review:"setup failure: Cache service status error from API.* file is not a database .*" to job incompletes with auto_review:"setup failure: Cache service status error from API.* file is not a database .*":retry
  • Description updated (diff)
  • Target version changed from Ready to future

#6 Updated by okurz 9 months ago

  • Parent task set to #62420

#7 Updated by okurz 8 months ago

The underlying problem was introduced by #67000 which we consider solved. We should still have this feature request in mind to improve the situation if the worker cache fails in a similar condition, e.g. automatically retrigger or "un-assign" the job from the worker before it incompletes

Also available in: Atom PDF