Project

General

Profile

Actions

action #96242

closed

[alert] Disk I/O time for /dev/vde (/space-slow) alert 2021-07-28 size:M

Added by okurz over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
-
Target version:
Start date:
2021-07-29
Due date:
% Done:

0%

Estimated time:

Description

Observation

From alert email 2021-07-28 20:18
[Alerting] Disk I/O time for /dev/vde (/space-slow) alert
Threshold set to 20s for cheap+slow storage (rotating disk).

vde: read, 33911.380

View your Alert rule
http://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=57&orgId=1


Related issues 2 (0 open2 closed)

Related to openQA Infrastructure - action #110269: [alert] QA-Power8-4-kvm + QA-Power8-5-kvm: Disk I/O time alert size:MResolvedkraih

Actions
Copied to openQA Infrastructure - action #110266: [alert] Disk I/O time for sr0 size:SResolvedjbaier_cz

Actions
Actions #1

Updated by ilausuch over 3 years ago

  • Subject changed from [alert] Disk I/O time for /dev/vde (/space-slow) alert 2021-07-28 to [alert] Disk I/O time for /dev/vde (/space-slow) alert 2021-07-28 size:M
  • Description updated (diff)
  • Status changed from New to Workable
Actions #2

Updated by mkittler over 3 years ago

  • Status changed from Workable to Resolved
  • Assignee set to mkittler

This is the first occurrence of the alert (in Grafanas history for the alert's state) and the problem did not persist. The OSD journal and dmesg output misses entries from 2021-07-28 so there's not much to do about it at this point:

-- Logs begin at Sun 2021-07-18 03:30:00 CEST, end at Thu 2021-07-29 17:59:29 CEST. --
Jul 18 03:30:00 openqa sudo[25770]: pam_unix(sudo:session): session closed for user root
Jul 18 03:30:02 openqa systemd[25237]: Stopped target Default.
Jul 18 03:30:02 openqa systemd[25237]: Stopped target Basic System.
Jul 18 03:30:02 openqa systemd[25237]: Stopped target Timers.
Jul 18 03:30:02 openqa systemd[25237]: Stopped target Sockets.
Jul 18 03:30:02 openqa systemd[25237]: Stopped target Paths.
Jul 18 03:30:02 openqa systemd[25237]: Closed D-Bus User Message Bus Socket.
Jul 18 03:30:02 openqa systemd[25237]: Reached target Shutdown.
Jul 18 03:30:02 openqa systemd[25237]: Starting Exit the Session...
Jul 18 03:30:02 openqa systemd[25237]: Received SIGRTMIN+24 from PID 2783 (kill).
Jul 18 03:30:02 openqa systemd[25238]: pam_unix(systemd-user:session): session closed for user asmorodskyi
-- Reboot --
Jul 29 14:15:15 openqa openqa[24296]: [debug] API auth by user: openqaworker3, operator: 1
Jul 29 14:15:15 openqa openqa[24296]: [debug] [ZFkr2esCKivu] Routing to controller "OpenQA::WebAPI::Controller::API::V1::Job" and action "update_status"
Jul 29 14:15:15 openqa openqa[24296]: [debug] Key is for user "openqaworker4"
…

I would mark this issue as resolved for now. If it happens again we can reopen it and investigate it further.

Actions #3

Updated by tinita over 2 years ago

  • Copied to action #110266: [alert] Disk I/O time for sr0 size:S added
Actions #4

Updated by okurz over 2 years ago

  • Related to action #110269: [alert] QA-Power8-4-kvm + QA-Power8-5-kvm: Disk I/O time alert size:M added
Actions

Also available in: Atom PDF