Project

General

Profile

Actions
Copy link

action #55154

closed

osd reporting monitoring alerts about "CRITICAL - Socket timeout after 16 seconds Service: HTTP access openqa" and "CRITICAL - I/O stats tps=2108.80 KB_read/s=322876.80 KB_written/s=100.80 iowait=0.88 Service: iostat openqa"

Added by okurz over 5 years ago. Updated over 5 years ago.

Status:
Resolved
Priority:
High
Assignee:
okurz
Category:
-
Target version:
openQA Project (public) - Current Sprint
Start date:
2019-07-31
Due date:
% Done:

0%

Estimated time:

Description

See https://thruk.suse.de/thruk/cgi-bin/extinfo.cgi?type=2&host=openqa.suse.de&service=iostat%20openqa#pnp_th2/1565016960/1565106960/0 and https://thruk.suse.de/thruk/cgi-bin/extinfo.cgi?type=2&host=openqa.suse.de&service=HTTP%20access%20openqa#pnp_th2/1565016958/1565106958/0

Related issues 1 (0 open — 1 closed)

Copied from openQA Project (public) - action #54902: openQA on osd fails at "incomplete" status when uploading, "502 response: Proxy Error"Resolvedokurz2019-07-31

Actions
Actions
Copy link
 #1

Updated by okurz over 5 years ago

  • Copied from action #54902: openQA on osd fails at "incomplete" status when uploading, "502 response: Proxy Error" added
Actions
Copy link
 #2

Updated by okurz over 5 years ago

  • Status changed from Feedback to Resolved

both alerts have been handled and levels are back to normal. We asked Infra to move the HTTP access check to "/tests" and the i/o load has been handled by multiple means, biggest impact seems to have been disabling the obs sync plugin until it's async.

Actions
Copy link

Also available in: Atom PDF