Project

General

Profile

Actions
Copy link

action #179497

closed

[FIRING:1] worker-arm1 (worker-arm1: System load alert openQA worker-arm1 salt system_load_alert_worker-arm1 worker)

Added by nicksinger 8 days ago. Updated 7 days ago.

Status:
Resolved
Priority:
Normal
Assignee:
nicksinger
Category:
Regressions/Crashes
Target version:
openQA Project (public) - Ready
Start date:
Due date:
% Done:

0%

Estimated time:
Tags:
alert, osd, infra, reactive work, worker-arm-1

Description

Observation

The load was exceeding our expected limits for 15 minutes, and triggered an according alert. It started around ~20:30 UTC, peaked at 21:00 and seems to normalize around 21:30 again

Acceptance Criteria

  • AC1: No alerts about high load for normal openQA workloads on worker-arm1

Suggestions

Files

clipboard-202503271035-h2fvr.png (64 KB) clipboard-202503271035-h2fvr.png nicksinger, 2025-03-27 09:35

Related issues 1 (0 open — 1 closed)

Copied from openQA Infrastructure (public) - action #164284: [FIRING:1] worker-arm1 (worker-arm1: System load alert openQA worker-arm1 salt system_load_alert_worker-arm1 worker) size:SResolvedlivdywan

Actions
Actions
Copy link
 #1

Updated by nicksinger 8 days ago

  • Copied from action #164284: [FIRING:1] worker-arm1 (worker-arm1: System load alert openQA worker-arm1 salt system_load_alert_worker-arm1 worker) size:S added
Actions
Copy link
 #2

Updated by nicksinger 8 days ago

  • Status changed from New to Feedback
  • Assignee set to nicksinger
Actions
Copy link
 #3

Updated by nicksinger 7 days ago

Changes are effective and several slots are currently paused with a message telling me that the configured threshold of 14 is in place. Load still peaks but not as high as previously:

I removed the alert silence for that host again.

Actions
Copy link

Also available in: Atom PDF