https://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842018-12-13T15:56:41ZopenSUSE Project Management ToolopenQA Project - action #45062: Better visualization of incompletes - show module in which incomplete happenshttps://progress.opensuse.org/issues/45062?journal_id=1738552018-12-13T15:56:41Zokurzokurz@suse.com
<ul></ul><p>"failed modules" for "incompletes" actually already works, see <a href="https://openqa.suse.de/tests/2330525#next_previous" class="external">https://openqa.suse.de/tests/2330525#next_previous</a></p>
<p>Funny thing is: A carryover "to" incompletes with failed modules does work as well, only "from" does not work. In <a href="https://openqa.suse.de/tests/2330525#next_previous" class="external">https://openqa.suse.de/tests/2330525#next_previous</a> any label on incompletes is disregarded for a carry-over but instead the label from the last "failing" job in the same module, <a href="https://openqa.suse.de/tests/2261045" class="external">https://openqa.suse.de/tests/2261045</a>, is carried over.</p>
<p>So to me it looks like: How can we ensure every incomplete to happen within a module so that a failed module would show up?</p>
openQA Project - action #45062: Better visualization of incompletes - show module in which incomplete happenshttps://progress.opensuse.org/issues/45062?journal_id=2640682019-12-12T06:18:30Zokurzokurz@suse.com
<ul><li><strong>Subject</strong> changed from <i>[feature][tools] Better visualization of incompletes</i> to <i>[feature][tools] Better visualization of incompletes - show module in which incomplete happens</i></li><li><strong>Description</strong> updated (<a title="View differences" href="/journals/264068/diff?detail_id=260279">diff</a>)</li><li><strong>Status</strong> changed from <i>New</i> to <i>Workable</i></li></ul><p>As a workaround with <a href="https://gitlab.suse.de/openqa/auto-review/" class="external">https://gitlab.suse.de/openqa/auto-review/</a> using <a href="https://github.com/os-autoinst/scripts/blob/master/openqa-label-known-issues" class="external">https://github.com/os-autoinst/scripts/blob/master/openqa-label-known-issues</a> which labels incomplete jobs better. With <a href="https://github.com/os-autoinst/openQA/pull/2554" class="external">https://github.com/os-autoinst/openQA/pull/2554</a> we also show the log content when there are no module results at all. What I see for this ticket is the task to provide proper test module results in more cases, especially when tests fail due to incorrect test API usage, not "random crashes".</p>
openQA Project - action #45062: Better visualization of incompletes - show module in which incomplete happenshttps://progress.opensuse.org/issues/45062?journal_id=2735332020-01-22T12:35:05Zokurzokurz@suse.com
<ul><li><strong>Parent task</strong> set to <i>#62420</i></li></ul> openQA Project - action #45062: Better visualization of incompletes - show module in which incomplete happenshttps://progress.opensuse.org/issues/45062?journal_id=2955732020-04-23T11:42:36Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-3 priority-lowest closed" href="/issues/59273">action #59273</a>: module result missing for incompleting job</i> added</li></ul> openQA Project - action #45062: Better visualization of incompletes - show module in which incomplete happenshttps://progress.opensuse.org/issues/45062?journal_id=3135132020-07-16T12:57:52Zokurzokurz@suse.com
<ul><li><strong>Subject</strong> changed from <i>[feature][tools] Better visualization of incompletes - show module in which incomplete happens</i> to <i>Better visualization of incompletes - show module in which incomplete happens</i></li><li><strong>Priority</strong> changed from <i>Normal</i> to <i>Low</i></li><li><strong>Target version</strong> set to <i>future</i></li></ul><p>Likely better to wait for <a class="issue tracker-4 status-3 priority-3 priority-lowest closed" title="action: module result missing for incompleting job (Resolved)" href="https://progress.opensuse.org/issues/59273">#59273</a> first</p>
openQA Project - action #45062: Better visualization of incompletes - show module in which incomplete happenshttps://progress.opensuse.org/issues/45062?journal_id=3425202020-10-23T16:05:34Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-1 priority-3 priority-lowest child" href="/issues/73525">action #73525</a>: Job incompletes with auto_review:"backend died: unexpected end of data at /usr/lib/os-autoinst/consoles/VNC.pm.*":retry</i> added</li></ul> openQA Project - action #45062: Better visualization of incompletes - show module in which incomplete happenshttps://progress.opensuse.org/issues/45062?journal_id=3425322020-10-23T16:05:48Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> deleted (<i><a class="issue tracker-4 status-1 priority-3 priority-lowest child" href="/issues/73525">action #73525</a>: Job incompletes with auto_review:"backend died: unexpected end of data at /usr/lib/os-autoinst/consoles/VNC.pm.*":retry</i>)</li></ul> openQA Project - action #45062: Better visualization of incompletes - show module in which incomplete happenshttps://progress.opensuse.org/issues/45062?journal_id=3566142020-12-07T09:40:08Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-4 priority-default closed" href="/issues/80746">action #80746</a>: test fails in await_install - openQA hasn't inherit the comments for incomplete job</i> added</li></ul> openQA Project - action #45062: Better visualization of incompletes - show module in which incomplete happenshttps://progress.opensuse.org/issues/45062?journal_id=3570522020-12-09T05:55:07Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>Workable</i> to <i>Resolved</i></li><li><strong>Assignee</strong> set to <i>okurz</i></li><li><strong>Target version</strong> changed from <i>future</i> to <i>Ready</i></li></ul><p><a href="https://openqa.suse.de/tests/5148360#next_previous" class="external">https://openqa.suse.de/tests/5148360#next_previous</a> shows that we do have support for failed modules in incomplete jobs. So it could be that this only works seldomly or in limited cases, e.g. when first the test module fails and then an incomplete happens in the same module. However I think this is good enough.</p>
<p>For an approach to have automatic labels on incomplete jobs regardless of the failed module I recommend the approach of job hooks with "auto-review" as described on <a href="http://open.qa/docs/#_enable_custom_hook_scripts_on_job_done_based_on_result" class="external">http://open.qa/docs/#_enable_custom_hook_scripts_on_job_done_based_on_result</a></p>