Project

General

Profile

Actions
Copy link

action #159840

closed

Munin - minion hook failed - see openqa-gru service logs for details - opensuse.org :: openqa.opensuse.org size:M

Added by livdywan 8 months ago. Updated 7 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
dheidler
Category:
Feature requests
Target version:
openQA Project (public) - Ready
Start date:
Due date:
% Done:

0%

Estimated time:
Tags:
minion, infra, reactive work

Description

Observation

Email from 2024-05-02 02.25 CEST

opensuse.org :: openqa.opensuse.org :: hook failed - see openqa-gru service logs for details
    CRITICALs: rc_failed_per_5min is 17.00 (outside range [:10]).

sudo journalctl -u openqa-gru --since '2024-05-02 0:25' --until '2024-05-02 0:30'                                                              
May 02 00:25:21 new-ariel openqa-gru[5979]:                                                                                                                           
May 02 00:25:21 new-ariel openqa-gru[5844]: Connect timeout                                                                                                           
May 02 00:25:21 new-ariel openqa-gru[5844]:                                                                                                                           
May 02 00:25:21 new-ariel openqa-gru[5843]: /opt/os-autoinst-scripts/openqa-label-known-issues: ERROR: line 129                                                       
May 02 00:25:21 new-ariel openqa-gru[5817]: /opt/os-autoinst-scripts/openqa-label-known-issues: ERROR: line 129

Suggestions

  • Check the journal e.g. sudo journalctl -u openqa-gru
  • Review the code at openqa-label-known-issues:129
  • Consider improving the scripting, error reporting, etc. e.g. reveal the URL/ API route
  • Check impact of a high timeout (and thus possibly jobs queuing up) on other time critical jobs (like saving needles)
Actions
Copy link

Also available in: Atom PDF