Project

General

Profile

Actions

action #92176

closed

[alert] openqaworker-arm-3 offline and CI pipeline unable to send email but stating "passed"

Added by okurz over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Start date:
2021-05-05
Due date:
2021-05-21
% Done:

0%

Estimated time:

Description

Observation

https://stats.openqa-monitor.qa.suse.de/d/1bNU0StZz/automatic-actions?orgId=1&editPanel=7&tab=alert shows that the machine openqaworker-arm-3 is offline and https://gitlab.suse.de/openqa/grafana-webhook-actions/-/jobs/415264 is green but shows:

Attempting to reboot openqaworker-arm-3
Error: Unable to establish IPMI v2 / RMCP+ session
/usr/sbin/sendmail: No such file or directory
. . . message not sent.

so two problems: email could not be sent but also that did not fail the pipeline

Acceptance criteria

  • AC1: pipeline fails in case email sending does not work
  • AC2: email sending does work again for now for the above observed case

Related issues 2 (0 open2 closed)

Related to openQA Infrastructure (public) - action #89815: osd-deployment blocked by openqaworker-arm-3 offline and not recovered automaticallyResolvedmkittler2021-03-102021-04-22

Actions
Related to openQA Infrastructure (public) - action #76876: Find a better (automated) way to inform infra about hanging (arm) workersResolvedlivdywan2020-11-02

Actions
Actions

Also available in: Atom PDF