https://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842021-04-15T08:49:08ZopenSUSE Project Management ToolopenQA Project - action #91157: [Alerting] web UI: Too many Minion job failures alert: limit_results_and_logs failedhttps://progress.opensuse.org/issues/91157?journal_id=3977212021-04-15T08:49:08Zmkittlermarius.kittler@suse.com
<ul><li><strong>Tags</strong> set to <i>alert</i></li><li><strong>Category</strong> set to <i>Regressions/Crashes</i></li></ul> openQA Project - action #91157: [Alerting] web UI: Too many Minion job failures alert: limit_results_and_logs failedhttps://progress.opensuse.org/issues/91157?journal_id=3977422021-04-15T09:01:35Zmkittlermarius.kittler@suse.com
<ul><li><strong>Assignee</strong> set to <i>mkittler</i></li></ul> openQA Project - action #91157: [Alerting] web UI: Too many Minion job failures alert: limit_results_and_logs failedhttps://progress.opensuse.org/issues/91157?journal_id=3977842021-04-15T09:44:11Zmkittlermarius.kittler@suse.com
<ul></ul><p>PR: <a href="https://github.com/os-autoinst/openQA/pull/3845" class="external">https://github.com/os-autoinst/openQA/pull/3845</a></p>
openQA Project - action #91157: [Alerting] web UI: Too many Minion job failures alert: limit_results_and_logs failedhttps://progress.opensuse.org/issues/91157?journal_id=3977872021-04-15T09:44:18Zmkittlermarius.kittler@suse.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li></ul> openQA Project - action #91157: [Alerting] web UI: Too many Minion job failures alert: limit_results_and_logs failedhttps://progress.opensuse.org/issues/91157?journal_id=3978442021-04-15T11:41:06Zokurzokurz@suse.com
<ul><li><strong>Target version</strong> set to <i>Ready</i></li></ul><p>PR merged.</p>
openQA Project - action #91157: [Alerting] web UI: Too many Minion job failures alert: limit_results_and_logs failedhttps://progress.opensuse.org/issues/91157?journal_id=3979952021-04-16T04:15:59Zopenqa_reviewopenqa-review@suse.de
<ul><li><strong>Due date</strong> set to <i>2021-04-30</i></li></ul><p>Setting due date based on mean cycle time of SUSE QE Tools</p>
openQA Project - action #91157: [Alerting] web UI: Too many Minion job failures alert: limit_results_and_logs failedhttps://progress.opensuse.org/issues/91157?journal_id=3980912021-04-16T09:53:41Zmkittlermarius.kittler@suse.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Feedback</i></li></ul> openQA Project - action #91157: [Alerting] web UI: Too many Minion job failures alert: limit_results_and_logs failedhttps://progress.opensuse.org/issues/91157?journal_id=3981122021-04-16T10:42:33Zmkittlermarius.kittler@suse.com
<ul><li><strong>Status</strong> changed from <i>Feedback</i> to <i>In Progress</i></li></ul><p>My fix only landed on OSD with today's deployment so I'm re-triggering the last <code>limit_results_and_logs</code> job now. It is currently still active. I hope it'll work because we've already received the filesystem alert as results have been piling up.</p>
<p>I'll also check which group has been configured with a retention period of infinity. Having such a configuration triggered the bug but regardless of the bug being fixed now it might be questionable to have such a configuration.</p>
openQA Project - action #91157: [Alerting] web UI: Too many Minion job failures alert: limit_results_and_logs failedhttps://progress.opensuse.org/issues/91157?journal_id=3981362021-04-16T11:47:13Zmkittlermarius.kittler@suse.com
<ul></ul><p>The job group <a href="https://openqa.suse.de/admin/job_templates/276" class="external">https://openqa.suse.de/admin/job_templates/276</a> had no/infinite retention periods for results configured. I've just set it to match its parent group (see <a href="https://openqa.suse.de/admin/job_templates/276" class="external">https://openqa.suse.de/admin/job_templates/276</a>) as we can not keep the results around forever.</p>
<p>The cleanup is meanwhile still running but could already bring the results under the alert threshold.</p>
openQA Project - action #91157: [Alerting] web UI: Too many Minion job failures alert: limit_results_and_logs failedhttps://progress.opensuse.org/issues/91157?journal_id=3981932021-04-16T15:27:29Zmkittlermarius.kittler@suse.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li></ul><p>The cleanup task succeeded again and we're still below the alert threshold.</p>