openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842024-01-18T13:58:20ZopenSUSE Project Management Tool
Redmine QA - action #153886 (New): SMELT incidents and Release Requests IDs are not unique and may interf...https://progress.opensuse.org/issues/1538862024-01-18T13:58:20Zmgrifalconi
<p>I would like to raise 2 issues (to be verified) about the current approval process of maintenance updates:</p>
<ul>
<li><p>SMELT Incidents ID can be reused for multiple Release Requests and what the process uses right now is the incident ID to tag a test that is crucial for the RR approval. Now the bot/dashboard combo uses a workaround of deleting some openqa results (from dashboard DB) to prevent issues (see <a href="https://github.com/openSUSE/qem-dashboard/pull/78/files" class="external">https://github.com/openSUSE/qem-dashboard/pull/78/files</a> ) but this makes the bot approval logic complex and shared between bot and dashboard code. Would be nice to switch from SMELT ID to IBS RR ID (or just add the RR on top) to resolve the issue at the origin.</p></li>
<li><p>RR are not unique either, but in a different way: RR can be revoked and then reopen (maybe with different content to test? to be checked). I know the bot recognize (some) changes and re-triggers incident tests, but what about aggregates? Is there a chance they could be wrongly considered for approval decision? Also incident channels could be changed while the incident/RR combo is being tested causing some confusion on bot side. If this proves to be a real issue, a solution idea would be to make sure test results related to older 'version' of a RR are not considered and the bot waits for new ones. Maybe add to SMELT-ID/RR combo, also a timestamp of smelt-incident/ibs-rr latest change?</p></li>
</ul>
<p>I can expect the valid argument that these are rare corner cases, but we should also consider that we are here to catch corner cases. Complex updates that gets modified while being tested should get enhanced attention and not reduced IMO.</p>
openQA Infrastructure - action #151570 (New): [qe-core] Cleanup openQA jobgroupshttps://progress.opensuse.org/issues/1515702023-11-28T07:41:52Zmgrifalconi
<p>On both openqa.suse.de and openqa.opensuse.org we have many old job groups that are unused but were never deleted, likely due to the missing option in the web-ui (see <a href="https://progress.opensuse.org/issues/57170" class="external">https://progress.opensuse.org/issues/57170</a>).</p>
<p>I understand there might be little performance impact on leaving them be, but if there is no business reason to keep them I think is time to do some cleanup.</p>
<p>AC1: Find out if old job groups can be deleted or there is some reason to keep them<br>
AC2: Check how difficult would be to implement the delete button in the ui<br>
AC3: Clean up what is possible</p>
openQA Tests - action #121210 (Resolved): [qe-core] test fails in clean_pidginhttps://progress.opensuse.org/issues/1212102022-12-01T08:10:09Zmgrifalconi
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP3-Desktop-DVD-Updates-x86_64-qam-regression-message@64bit fails in<br>
<a href="https://openqa.suse.de/tests/10060033/modules/clean_pidgin/steps/7" class="external">clean_pidgin</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Testsuite maintained at <a href="https://gitlab.suse.de/qa-maintenance/qam-openqa-yml" class="external">https://gitlab.suse.de/qa-maintenance/qam-openqa-yml</a>.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/10045284" class="external">20221128-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/10033636" class="external">20221124-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Desktop-DVD-Updates&machine=64bit&test=qam-regression-message&version=15-SP3" class="external">latest</a></p>
openQA Tests - action #121153 (New): [qe-core] remove qe_run testshttps://progress.opensuse.org/issues/1211532022-11-30T10:54:08Zmgrifalconi
<p>While deprecation of qe_run did not progress <a href="https://progress.opensuse.org/issues/99657" class="external">https://progress.opensuse.org/issues/99657</a> , turns out we have still some tests in our bucket using it:</p>
<p><a href="https://openqa.suse.de/tests/10055095#" class="external">https://openqa.suse.de/tests/10055095#</a><br>
<a href="https://openqa.suse.de/tests/10055092/modules/userspace_nfs/steps/1/src" class="external">https://openqa.suse.de/tests/10055092/modules/userspace_nfs/steps/1/src</a></p>
<p>We should either remove the tests or convert them as a normal perl module.</p>
<p>Then we should either:</p>
<ul>
<li>decommission qe_run and remove the framework entirely</li>
<li>find some squads that is still willing to use it and hand over the responsibility for it</li>
</ul>
openQA Tests - action #120958 (Rejected): [qe-core] test fails in rmt_featurehttps://progress.opensuse.org/issues/1209582022-11-25T10:10:36Zmgrifalconi
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP3-Server-DVD-Updates-x86_64-qam_rmt@64bit fails in<br>
<a href="https://openqa.suse.de/tests/10037750/modules/rmt_feature/steps/18" class="external">rmt_feature</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Testsuite maintained at <a href="https://gitlab.suse.de/qa-maintenance/qam-openqa-yml" class="external">https://gitlab.suse.de/qa-maintenance/qam-openqa-yml</a>. Meant for scheduling rmt tests on QAM Updates</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/10034620" class="external">20221124-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/10025473" class="external">20221123-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Server-DVD-Updates&machine=64bit&test=qam_rmt&version=15-SP3" class="external">latest</a></p>
openQA Tests - action #119377 (Rejected): [qe-core] test fails in ansiblehttps://progress.opensuse.org/issues/1193772022-10-25T13:47:31Zmgrifalconi
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>Test never worked on s390 on 15-sp4 Reverting it from schedule. We should test it on a development job group before adding it back on schedule.</p>
<p>openQA test in scenario sle-15-SP4-Server-DVD-Updates-s390x-mau-extratests2@s390x-kvm-sle12 fails in<br>
<a href="https://openqa.suse.de/tests/9806605/modules/ansible/steps/87" class="external">ansible</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Testsuite maintained at <a href="https://gitlab.suse.de/qa-maintenance/qam-openqa-yml" class="external">https://gitlab.suse.de/qa-maintenance/qam-openqa-yml</a>. Run console tests against aggregated test repo</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/9773901" class="external">20221020-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/9755646" class="external">20221018-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=s390x&distri=sle&flavor=Server-DVD-Updates&machine=s390x-kvm-sle12&test=mau-extratests2&version=15-SP4" class="external">latest</a></p>
openQA Tests - action #119326 (Rejected): [qe-core] test fails in clonehttps://progress.opensuse.org/issues/1193262022-10-25T06:29:46Zmgrifalconi
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP4-Server-DVD-Updates-aarch64-qam-gnome@aarch64-virtio fails in<br>
<a href="https://openqa.suse.de/tests/9806017/modules/clone/steps/8" class="external">clone</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Testsuite maintained at <a href="https://gitlab.suse.de/qa-maintenance/qam-openqa-yml" class="external">https://gitlab.suse.de/qa-maintenance/qam-openqa-yml</a>.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/9764615" class="external">20221019-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/9755663" class="external">20221018-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=aarch64&distri=sle&flavor=Server-DVD-Updates&machine=aarch64-virtio&test=qam-gnome&version=15-SP4" class="external">latest</a></p>
openQA Tests - action #115793 (Rejected): [qe-core] test fails in update_install on PowerPC size:Mhttps://progress.opensuse.org/issues/1157932022-08-26T06:39:44Zmgrifalconi
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>I see <em>very</em> often on this test a failure at the login screen, when the test is supposed to type 'root' and find the password prompt. It's sporadic but it's painful because needs sometimes several restarts to get green</p>
<p>openQA test in scenario sle-15-SP2-Server-DVD-Incidents-Install-ppc64le-qam-incidentinstall@ppc64le fails in<br>
<a href="https://openqa.suse.de/tests/9382566/modules/update_install/steps/148" class="external">update_install</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Testsuite maintained at <a href="https://gitlab.suse.de/qa-maintenance/qam-openqa-yml" class="external">https://gitlab.suse.de/qa-maintenance/qam-openqa-yml</a>. Incident Installation TEST<br>
MAX_JOB_TIME=9000 due to long texlive update</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/9382566" class="external">:24713:libtirpc</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/9382426" class="external">:25560:python-Flask-Security-Too</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=ppc64le&distri=sle&flavor=Server-DVD-Incidents-Install&machine=ppc64le&test=qam-incidentinstall&version=15-SP2" class="external">latest</a></p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1:</strong> The test does not sporadically fail anymore or the problem has been forwarded to the product maintainers</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Report a product bug for ppc64le 15-SP2</li>
</ul>
openQA Tests - action #113321 (Closed): [kernel] test fails in Sysctlhttps://progress.opensuse.org/issues/1133212022-07-06T13:59:13Zmgrifalconi
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>Test failing in all incidents for 15-SP4 and blocking updates.</p>
<p>Please consider forcing the result to green and/or unschedule of failures if the issue is on the test side.</p>
<p>openQA test in scenario sle-15-SP4-Server-DVD-Incidents-x86_64-mau-sles-sys-param-check@64bit-2gbram fails in<br>
<a href="https://openqa.suse.de/tests/9077802/modules/Sysctl/steps/160" class="external">Sysctl</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p><a href="https://gitlab.suse.de/qa-css/sys-param-check" class="external">https://gitlab.suse.de/qa-css/sys-param-check</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/9077802" class="external">:24775:MozillaFirefox</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/9077372" class="external">:24915:PackageKit</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Server-DVD-Incidents&machine=64bit-2gbram&test=mau-sles-sys-param-check&version=15-SP4" class="external">latest</a></p>
openQA Tests - action #112106 (Resolved): [qe-security] test fails in firefox_nss with FIPS modehttps://progress.opensuse.org/issues/1121062022-06-07T09:27:01Zmgrifalconi
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP1-Server-DVD-Updates-x86_64-mau-extratests-security-fips@64bit fails in<br>
<a href="https://openqa.suse.de/tests/8905986/modules/firefox_nss/steps/14" class="external">firefox_nss</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Testsuite maintained at <a href="https://gitlab.suse.de/qa-maintenance/qam-openqa-yml" class="external">https://gitlab.suse.de/qa-maintenance/qam-openqa-yml</a>.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/8880164" class="external">20220603-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/8868273" class="external">20220602-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Server-DVD-Updates&machine=64bit&test=mau-extratests-security-fips&version=15-SP1" class="external">latest</a></p>
openQA Tests - action #111051 (Resolved): [qe-sap] Server-DVD-HA-Incidents-x86_64 timeoutshttps://progress.opensuse.org/issues/1110512022-05-13T06:35:53Zmgrifalconi
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p><a href="https://openqa.suse.de/tests/8743807#next_previous" class="external">https://openqa.suse.de/tests/8743807#next_previous</a><br>
This kind of job usually takes 1h 50m where the timeout is 2h, I think timeout should be increased to avoid running into the timeout like it happened a few times.</p>
<p>openQA test in scenario sle-15-SP1-Server-DVD-HA-Incidents-x86_64-qam_ha_rolling_upgrade_migration_supportserver@64bit fails in<br>
<a href="https://openqa.suse.de/tests/8743807/modules/wait_children/steps/1" class="external">wait_children</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>The base test suite is used for job templates defined in YAML documents. It has no settings of its own.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/8743807" class="external">:24217:hawk2</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/8735576" class="external">:24187:golang-github-prometheus-node_exporter</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Server-DVD-HA-Incidents&machine=64bit&test=qam_ha_rolling_upgrade_migration_supportserver&version=15-SP1" class="external">latest</a></p>
openQA Tests - action #106371 (Resolved): [qe-core] test fails in libreoffice_mainmenu_componentshttps://progress.opensuse.org/issues/1063712022-02-09T11:03:57Zmgrifalconi
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>likely a new needle needed</p>
<p>openQA test in scenario sle-15-SP3-Desktop-DVD-Updates-x86_64-qam-regression-documentation@64bit fails in<br>
<a href="https://openqa.suse.de/tests/8124337/modules/libreoffice_mainmenu_components/steps/18" class="external">libreoffice_mainmenu_components</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Testsuite maintained at <a href="https://gitlab.suse.de/qa-maintenance/qam-openqa-yml" class="external">https://gitlab.suse.de/qa-maintenance/qam-openqa-yml</a>.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/8122377" class="external">20220209-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/8118328" class="external">20220208-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Desktop-DVD-Updates&machine=64bit&test=qam-regression-documentation&version=15-SP3" class="external">latest</a></p>
openQA Tests - action #101882 (New): [qe-core] aarch64 workers: test fails in patch_and_reboothttps://progress.opensuse.org/issues/1018822021-11-03T10:17:47Zmgrifalconi
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>Test expects to find the bootloader needle ( <a href="https://openqa.suse.de/tests/7588098#step/patch_and_reboot/52" class="external">https://openqa.suse.de/tests/7588098#step/patch_and_reboot/52</a> ) but somehow it is not picked by openqa and it fails.<br>
We could at the same time check for the login needle and skip the need of the bootloader if not found I suppose.</p>
<p>openQA test in scenario sle-15-Server-DVD-Updates-aarch64-qam-gnome@aarch64-virtio fails in<br>
<a href="https://openqa.suse.de/tests/7596208/modules/patch_and_reboot/steps/61" class="external">patch_and_reboot</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Testsuite maintained at <a href="https://gitlab.suse.de/qa-maintenance/qam-openqa-yml" class="external">https://gitlab.suse.de/qa-maintenance/qam-openqa-yml</a>.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/7594031" class="external">20211103-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/7588098" class="external">20211102-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=aarch64&distri=sle&flavor=Server-DVD-Updates&machine=aarch64-virtio&test=qam-gnome&version=15" class="external">latest</a></p>
QA - action #97274 (New): qam dashboard improvement ideashttps://progress.opensuse.org/issues/972742021-08-20T06:48:13Zmgrifalconi
<p>Hello, doing openQA review I always used smelt comments to find out which test run needs to be checked to approve an update.</p>
<p>Ideally approval is automated, but when a single test fails (out of dozens/hundreds) it still needs some manual work to decide if such failures can be ignored for that particular test.</p>
<p>I won't mention crosscheck aggregate runs with precedent days (see <a href="https://progress.opensuse.org/issues/97118" class="external">https://progress.opensuse.org/issues/97118</a>).</p>
<p>These are the current issues I found while using the dashboard for my week of review:</p>
<ul>
<li><strong>Sorting order</strong>: I like to sort on smelt the priority or due date to have an idea on the situation. Neither of which is available. Incidents are sorted by incident ID, which I do not care</li>
<li><strong>Missing Release Request ID</strong>: If I am given only a RR ID, I must go to smelt to find the incident and back to the dashboard.</li>
<li><strong>Result History</strong>: I can only see latest results, so I find more painful to crosscheck different days, but I would be happier to see such think automated (see other poo linked earlier). In the meantime though, it is just more painful than before. I also have a good overview of the situation near the end of the day, because in the morning all runs are still ongoing and cannot do review based on yesterday's results.</li>
<li><strong>Development Job Groups</strong>: such job groups are not ignored, also some test groups will fit in. This creates some confusion and time wasted.</li>
</ul>
<p>Extra thought: <br>
The dashboard and smelt might be duplicating some work. Why not having a link in smelt to the list of related tests on the dashboard? I would be using the indexing/priority/informations on smelt and then go on the dashboard to check tests, possibly with result history.<br>
What I am basically asking for is the same features as smelt comments, whichever implementation is used. </p>
QA - coordination #97121 (New): [epic] enable qem-bot comments on IBS (was: enable qa-maintenance...https://progress.opensuse.org/issues/971212021-08-18T12:25:23Zmgrifalconi
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>As a maintenance release coordinator I am being notified if there is any failing openQA test blocking automatic approval of a SLE maintenance update</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1:</strong> As soon as testing for an individual release request is finished and if there is at least one failing openQA test a comment is written in IBS informing about the failing openQA tests</li>
<li><strong>AC2:</strong> If there is no failing openQA test related to an individual release request no comment is written</li>
<li><strong>AC3:</strong> Only a single comment is ever written on a release request</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Within qem-bot we already have the feature to send out comments but it seems so far it does not look at the state of openQA jobs so it writes a comment for all release requests whenever triggered which means informing even about all currently running jobs. Maybe the next best task is to actually look at the state and only inform about failing openQA tests</li>
<li>Think about moving the trigger point of sending a comment into the approval step or something so when no automatic approval is done instead a comment is written</li>
<li>Ensure that only a single comment is written, not multiple whenever qem-bot is called</li>
</ul>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Original motivation: <br>
While the qem dashboard is agreed to not yet be productive, smelt comments are very useful while doing manual approval of updates.</p>
<p>I would like to have such resource back, at least until <a href="https://progress.opensuse.org/issues/97118" class="external">https://progress.opensuse.org/issues/97118</a> <a class="issue tracker-4 status-4 priority-4 priority-default child" title="action: enhance bot automatic approval: check multiple days (Feedback)" href="https://progress.opensuse.org/issues/97118">#97118</a> is sorted out.</p>