Project

General

Profile

Actions
Copy link

action #108980

open

coordination #80142: [saga][epic] Scale out: Redundant/load-balancing deployments of openQA, easy containers, containers on kubernetes

coordination #96263: [epic] Exclude certain Minion tasks from "Too many Minion job failures alert" alert

coordination #99831: [epic] Better handle minion tasks failing with "Job terminated unexpectedly"

Better handle minion tasks failing with "Job terminated unexpectedly" - OpenQA::Task::Asset::Download size:S

Added by mkittler about 3 years ago. Updated 8 days ago.

Status:
Workable
Priority:
Normal
Assignee:
-
Category:
Feature requests
Target version:
QA (public) - Tools - Next
Start date:
2022-03-25
Due date:
% Done:

0%

Estimated time:

Description

Acceptance criteria

  • AC1: minion job "download_asset" has a sigterm handler to decide how to shut down in a clean way in a reasonable time
  • AC2: Our minion job list on OSD and O3 do not show any "Job terminated unexpectedly" over multiple deployments for "download_asset"

Suggestions

  • Implement sigterm handler for "download_asset" like it has already been done for other jobs (e.g. #103416)
  • Test on o3 and osd either by manually restarting openqa-gru multiple times or awaiting the result from multiple deployments and checking the minion dashboard, e.g. openqa.suse.de/minion/jobs?state=failed

Related issues 2 (1 open — 1 closed)

Related to openQA Project (public) - action #167797: scripts-ci multimachine test CI job fails due to job incompleting with "minion failed" size:MResolvedmkittler2024-10-04

Actions
Copied to openQA Project (public) - action #169144: Link to minion job from openQA job with waiting task size:SWorkable

Actions
Actions
Copy link
 #1

Updated by mkittler about 3 years ago

  • Category set to Feature requests
Actions
Copy link
 #2

Updated by okurz about 3 years ago

  • Target version set to future
Actions
Copy link
 #3

Updated by tinita 6 months ago

  • Related to action #167797: scripts-ci multimachine test CI job fails due to job incompleting with "minion failed" size:M added
Actions
Copy link
 #4

Updated by tinita 5 months ago

  • Copied to action #169144: Link to minion job from openQA job with waiting task size:S added
Actions
Copy link
 #5

Updated by okurz 9 days ago

  • Target version changed from future to Tools - Next
Actions
Copy link
 #6

Updated by okurz 8 days ago

  • Subject changed from Better handle minion tasks failing with "Job terminated unexpectedly" - OpenQA::Task::Asset::Download to Better handle minion tasks failing with "Job terminated unexpectedly" - OpenQA::Task::Asset::Download size:S
  • Status changed from New to Workable
Actions
Copy link

Also available in: Atom PDF