Project

General

Profile

Actions
Copy link

action #137603

closed

[alert] Queue: State (SUSE) - too few jobs executed alert size:S

Added by jbaier_cz 7 months ago. Updated 7 months ago.

Status:
Resolved
Priority:
High
Assignee:
okurz
Category:
-
Target version:
openQA Project - Ready
Start date:
2023-10-09
Due date:
% Done:

0%

Estimated time:
Tags:
infra

Description

Observation

Queue: State (SUSE) - too few jobs executed alert

View alert
http://stats.openqa-monitor.qa.suse.de/alerting/grafana/ad8b5de6-d5ca-43e0-b734-6289739bc2d8/view?orgId=1

Summary
Too few openQA jobs are executed
Description
Not enough openQA jobs are assigned to workers and executed while many
scheduled jobs exist in the scheduled state.

see https://progress.opensuse.org/issues/135122 for details

Values

E0=17 E1=273

Labels
alertname Queue: State (SUSE) - too few jobs executed alert
grafana_folder Salt

Silence
http://stats.openqa-monitor.qa.suse.de/alerting/silence/new?alertmanager=grafana&matcher=alertname%3DQueue%3A+State+%28SUSE%29+-+too+few+jobs+executed+alert&matcher=grafana_folder%3DSalt&orgId=1

View dashboard http://stats.openqa-monitor.qa.suse.de/d/nRDab3Jiz?orgId=1

View panel
http://stats.openqa-monitor.qa.suse.de/d/nRDab3Jiz?orgId=1&viewPanel=9

Observed 38s before this notification was delivered, at 2023-10-09
04:30:00 +0200 CEST

Might be related to #137600, might be just a normal behavior over weekend. The alert is currently in a resolved state.

Suggestions

  • "too few jobs" means < 20 running, > 100 scheduled - are these numbers sensible? Reduce/increase?

Related issues 1 (0 open — 1 closed)

Related to openQA Tests - action #136130: test fails in iscsi_client due to salt 'host'/'nodename' confusion size:MResolvedmkittler2023-09-20

Actions
Actions
Copy link

Also available in: Atom PDF