Project

General

Profile

Actions

action #75016

closed

[osd-admins][alert] Failed systemd services alert (workers): os-autoinst-openvswitch.service (and var-lib-openqa-share.mount) on openqaworker-arm-2 and others

Added by okurz about 4 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
-
Start date:
2020-10-21
Due date:
% Done:

0%

Estimated time:
Tags:

Description

Observation

```From: Grafana osd-admins@suse.de
To: osd-admins@suse.de
Sender: osd-admins
List-Id:
Date: 21/10/2020 09.06

/[OK] Failed systemd services alert (workers)/


http://stats.openqa-monitor.qa.suse.de/d/KToPYLEWz/failed-systemd-services?fullscreen&edit&tab=alert&panelId=6&orgId=1

## Problem

I found that this is on openqaworker-arm-2, the service failed is "os-autoinst-openvswitch.service":

● os-autoinst-openvswitch.service - os-autoinst openvswitch helper
Loaded: loaded (/usr/lib/systemd/system/os-autoinst-openvswitch.service; enabled; vendor preset: disabled)
Drop-In: /etc/systemd/system/os-autoinst-openvswitch.service.d
└─override.conf
Active: failed (Result: timeout) since Wed 2020-10-21 07:41:11 UTC; 1h 56min ago

Oct 21 07:39:41 openqaworker-arm-2 systemd[1]: Starting os-autoinst openvswitch helper...
Oct 21 07:40:42 openqaworker-arm-2 wicked[3318]: device br1: unable to apply configuration to nanny
Oct 21 07:41:11 openqaworker-arm-2 systemd[1]: os-autoinst-openvswitch.service: Start-pre operation timed out. Terminating.
Oct 21 07:41:11 openqaworker-arm-2 systemd[1]: Failed to start os-autoinst openvswitch helper.
Oct 21 07:41:11 openqaworker-arm-2 systemd[1]: os-autoinst-openvswitch.service: Unit entered failed state.
Oct 21 07:41:11 openqaworker-arm-2 systemd[1]: os-autoinst-openvswitch.service: Failed with result 'timeout'.


Related issues 6 (0 open6 closed)

Related to openQA Infrastructure (public) - action #73633: OSD partially unresponsive, triggering 500 responses, spotty response visible in monitoring panels but no alert triggered (yet)Resolvednicksinger2020-10-202020-11-17

Actions
Related to openQA Infrastructure (public) - action #75238: Upgrade osd workers and openqa-monitor to openSUSE Leap 15.2Resolvedlivdywan

Actions
Related to openQA Infrastructure (public) - action #89551: NFS mount fails after boot (reproducible on some OSD workers)Resolvedmkittler2021-03-052021-03-31

Actions
Related to openQA Infrastructure (public) - action #158041: grenache needs upgrade to 15.5Resolvedokurz2024-03-262024-04-09

Actions
Copied to openQA Infrastructure (public) - action #75274: [osd-admins][alert][learning] Failed systemd services alert (workers): os-autoinst-openvswitch.service aborts retries after 60s and is not easily configurableResolvedlivdywan2020-12-04

Actions
Copied to openQA Infrastructure (public) - action #75277: enable "postfix" service again after #73633 resolvedResolvedokurz

Actions
Actions

Also available in: Atom PDF