Project

General

Profile

Actions
Copy link

action #159666

open

Lack of alerts about error messages related to InfluxDB and SSL expiration panel

Added by livdywan 8 months ago. Updated 8 months ago.

Status:
Blocked
Priority:
Normal
Assignee:
okurz
Category:
Feature requests
Target version:
QA (public) - future
Start date:
Due date:
% Done:

0%

Estimated time:
Tags:
infra, reactive work

Description

Motivation

We found out about at least one case where a panel was looking "health" which is indicated by a green heart 💚 despite error messages from InfluxDB indicating that something is not working (see #159402 for the concrete issue).

Acceptance criteria

  • AC1: Alerts are raised when there's error messages related to an existing panel

Suggestions

  • Research if there is a trivial way to configure this behavior in Grafana e.g. ignore, alert, or otherwise reveal such errors
  • Consider alerts based on log messages related to InfluxDB

Related issues 1 (0 open — 1 closed)

Copied from openQA Infrastructure (public) - action #159402: "SSL expiration" panel on https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary shows problems size:SResolvednicksinger2024-04-22

Actions
Actions
Copy link

Also available in: Atom PDF