Project

General

Profile

coordination #113674

Updated by livdywan over 1 year ago

# Summary 
 With https://progress.opensuse.org/issues/112733 we got new I/O panels for the webui. Due to the nature of repeating panels we cannot add an alert for the IO time with the current alerting backend we use. This should be possible with unified alerting: https://grafana.com/blog/2021/06/14/the-new-unified-alerting-system-for-grafana-everything-you-need-to-know/ 

 ## Acceptance criteria 
 * **AC1:** Create alerts for each disk on the webui with according thresholds 

 ## Suggestions 
 * Take a look at our previous alerting rule: https://gitlab.suse.de/openqa/salt-states-openqa/-/blob/1c505df5e92420d0f266e7ea4b3a049aae892dd5/monitoring/grafana/webui.dashboard.json#L3757-3842 
 * Find out how to migrate to the new system, automatically/ manually 
 * Try out with an official test instance of Grafana available from their website 
 * Test with a container 
 * Confirm what we end up with e.g. new JSON or different layout

Back