openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842021-08-16T13:36:01ZopenSUSE Project Management Tool
Redmine openQA Tests - action #96986 (Workable): [qe-core][sporadic][samba_adcli] net ads join / leave failshttps://progress.opensuse.org/issues/969862021-08-16T13:36:01Zgeorggkioulis@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p><code>net ads join</code> occasionally fails in <a href="https://openqa.suse.de/tests/6838830#step/samba_adcli/55" class="external">samba_adcli</a></p>
<p>The command <code>net ads join --domain geeko.com -U Administrator --no-dns-updates -i</code> occasionally fails with:</p>
<pre><code>ads_print_error: AD LDAP ERROR: 53 (Server is unwilling to perform): 0000001F: SvcErr: DSID-031A1236, problem 5003 (WILL_NOT_PERFORM), data 0
</code></pre>
<p>similar issue for the command <code>net ads leave --domain geeko.com -U Administrator -i'</code></p>
<p>For now it has been softfailed.</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/6839956#step/samba_adcli/60" class="external">ge0r/os-autoinst-distri-opensuse#retry-adcli-join</a> (or more recent)</p>
openQA Tests - action #96983 (Workable): [qe-core][sporadic][samba_adcli] adcli joining domain failshttps://progress.opensuse.org/issues/969832021-08-16T13:24:46Zgeorggkioulis@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>adcli join fails in <a href="https://openqa.suse.de/tests/6840326/modules/samba_adcli/steps/220" class="external">samba_adcli</a></p>
<p>The command <code>adcli join -v -W --domain geeko.com -U Administrator -C</code> sporadically results in :</p>
<pre><code>Couldn't perform discovery search: Can't contact LDAP server
* Received NetLogon info from: WIN-NHOU56DRDK4.geeko.com
! Cannot set computer password: Authentication error
adcli: joining domain geeko.com failed: Cannot set computer password: Authentication error
</code></pre>
<p>Increasing the number of retries just reduces the frequency of the failure. For now it has been softfailed.</p>
<p>The expected output of the aforementioned <code>adcli join</code> command can be seen <a href="https://openqa.suse.de/tests/6839956#step/samba_adcli/226" class="external">here</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/6840326" class="external">ge0r/os-autoinst-distri-opensuse#retry-adcli-join</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/6839956" class="external">ge0r/os-autoinst-distri-opensuse#retry-adcli-join</a> (or more recent)</p>
openQA Tests - coordination #96980 (Workable): [qe-core][samba_adcli][epic] Tracker for samba_adc...https://progress.opensuse.org/issues/969802021-08-16T13:23:29Zgeorggkioulis@suse.comopenQA Tests - action #96513 (Workable): [qe-core][sporadic][samba_adcli] wbinfo failshttps://progress.opensuse.org/issues/965132021-08-03T12:18:07Zgeorggkioulis@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP3-Server-DVD-Updates-aarch64-mau-extratests2@aarch64-virtio fails in<br>
<a href="https://openqa.suse.de/tests/6630974/modules/samba_adcli/steps/78" class="external">samba_adcli</a></p>
<p>Test samba_adcli sporadicly fails due to wbinfo failures<br>
eg <code>wbinfo -u</code> fails with <code>Error looking up domain users</code></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Run console tests against aggregated test repo</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/6630974" class="external">20210802-1</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/6628144" class="external">20210801-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=aarch64&distri=sle&flavor=Server-DVD-Updates&machine=aarch64-virtio&test=mau-extratests2&version=15-SP3" class="external">latest</a></p>
openQA Tests - action #95611 (Workable): [qe-core][samba_adcli] test fails in samba_adcli in s390...https://progress.opensuse.org/issues/956112021-07-19T08:30:46Zgeorggkioulis@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP3-Server-DVD-Updates-s390x-Build20210719-1-mau-extratests2@s390x-kvm-sle12 fails in <a href="https://openqa.suse.de/tests/6483346#step/samba_adcli/60" class="external">samba_adcli</a></p>
<p>From what I understand, the samba_adcli module has never been run for s390. </p>
<p>The <code>adcli join -v -W --domain geeko.com -U Administrator -C</code> does not work, even with multiple retries, possibly is a network access problem on one of the lpars</p>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ol>
<li>Run a manual installation or use an image on an s390 kvm machine and/or lpar (zkvm), and try to run the steps manually</li>
<li>If step above works, trigger a job in openQA and use developer mode (Trigger the job with PAUSE_AT=samba_adcli and use <a href="https://confluence.suse.com/pages/viewpage.action?pageId=742719853" class="external">this page</a> to figure out how to connect to the running machine, possibly for s390 zkvm the procedure might be different, ping szarate) and debug the network (starting with trying to ssh Administrator@$AD_ip/windows machine).</li>
<li>Update test module/and/or modify host, create follow up tickets as needed</li>
</ol>
QA - action #94600 (New): [tools][mtui] Communicate reduced visibility of openQA incident related...https://progress.opensuse.org/issues/946002021-06-23T13:49:30Zgeorggkioulis@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>The <code>Results from openQA incidents jobs:</code> section in a maintenance update's test log shows, as one would expect, the incident jobs related to the incident that is to be tested.<br>
It can happen that engineers testing the incident fall under the impression that the openQA coverage shown in the log is the complete openQA test coverage for that incident.<br>
It should thus be communicated that the <code>openQA incident jobs</code> section does not show the complete test coverage of the incident in openQA, but only a subset of it (the other being in aggregate runs that test the incident).</p>
<p>This should clarify to the engineers that the absence of failed incident jobs in the log does not mean necessarily that there are no other failed jobs related to the incident.</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1:</strong> Communicate that the jobs listed in the log of an update are not the complete set of jobs that test that update</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>One suggestion could be to remove that section from the log and instead link the incident comments (eg <a href="https://maintenance.suse.de/incident/19067/#comments" class="external">https://maintenance.suse.de/incident/19067/#comments</a>) where all jobs related to that incident are listed.</li>
</ul>
openQA Tests - action #89335 (Resolved): [qe-core][systemd] qa_test_systemd fails in check-unit t...https://progress.opensuse.org/issues/893352021-03-02T12:03:14Zgeorggkioulis@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-Server-DVD-Updates-x86_64-mau-qa_userspace_systemd@64bit fails in <code>check-unit</code> testcase<br>
<a href="http://angmar.suse.de/tests/3069/modules/1_systemd/steps/63" class="external">1_systemd</a></p>
<a name="More-info"></a>
<h2 >More info<a href="#More-info" class="wiki-anchor">¶</a></h2>
<p><code>check-unit</code> testcase fails both is sle-15 and sle-15-sp1 because <code>qaperf.service</code> of <code>qa_testset_automation</code> package fails to start for SLE-15 and SLE-15SP1.</p>
openQA Tests - action #88648 (Resolved): [qe-core][qem][systemd] qa_test_systemd fails in check-l...https://progress.opensuse.org/issues/886482021-02-16T13:51:51Zgeorggkioulis@suse.com
<p>The systemd testsuite (<code>qa_test_systemd</code>) fails in</p>
<ul>
<li><code>check-named</code> for sle 15, sle 15sp1 and sle 15sp2. The service <code>named.service</code> does not exist in those products.</li>
<li><code>check-lvm2-lvmetad</code> for sle 15sp2. The service <code>lvm2-lvmetad.service</code> does not exist in this product.</li>
</ul>
<p>The problem is a bit different than one might first think, because the default behavior of the testsuite should be to SKIP those missing service tests rather than fail.<br>
But how do we know what the default behavior should be?</p>
<p>To answer this, let's check sle 12sp5:<br>
In this product, the <code>named.service</code> does not exist, similar to sle 15 and above. However the <code>check-named</code> testcase is SKIPPED here.<br>
The <code>/usr/share/qa/tools/test_systemd_run</code> script (that runs the testsuite) in short runs <code>/usr/share/qa/qa_test_systemd/check-service.sh</code> against all to-be-tested services as listed in <code>/usr/share/qa/qa_test_systemd/tcf/qa_systemd.tcf</code>.<br>
<code>/usr/share/qa/qa_test_systemd/check-service.sh</code> contains a function <code>function get_loaded()</code> that gets the <code>Loaded:</code> status of the service that is being tested. Later in the code, if this status is <code>"not-found"</code>, then the script exits with <code>exit 22</code>. This results in the current service test being skipped.<br>
So for 12sp5 if we would be testing a service called <code>imaginary-service</code>, <code>get_loaded()</code> would run</p>
<pre><code> # systemctl status imaginary-service
imaginary-service.service
Loaded: not-found (Reason: No such file or directory)
Active: inactive (dead)
</code></pre>
<p>So after <code>grepping</code> the <code>Loaded</code> status (which is <code>"not-found"</code>), it would skip the test for <code>imaginary-service.service</code></p>
<p>However for sle 15 and above the output of systemctl has changed:<br>
Here we get</p>
<pre><code>systemctl status imaginary-service
Unit imaginary-service.service could not be found.
</code></pre>
<p>Which means that <code>get_loaded</code> cannot grep the <code>Loaded</code> status and exits with <code>exit 1</code>, resulting in a failing testcase.</p>
<p>Given the above, there are two potential actions to address the aforementioned fails:</p>
<ul>
<li>The testsuite behavior should be fixed for the sle 15 products, namely how the <code>get_loaded</code> function gets the loaded status.</li>
<li>I also believe (but I am not sure if it is the correct route) that apart from the above change, the tests for the services that are no longer found (<code>check-lvm2-lvmetad</code> and <code>check-named</code>) should be removed from the <code>qa_systemd.tcf</code> of the qa_test_systemd versions that correspond to those products</li>
</ul>
openQA Tests - action #88597 (Resolved): [qe-core][qem][systemd] qa_test_systemd fails in rc-loca...https://progress.opensuse.org/issues/885972021-02-15T09:31:10Zgeorggkioulis@suse.com
<p>An executable <code>boot.local</code> does not exist by default in sle15, sle15sp1 and sle15sp2.<br>
This results in <code>qa_test_systemd</code> not passing the <code>rc-local</code> service test.</p>
<p>A failure can be seen <a href="https://openqa.suse.de/tests/4191578#step/1_systemd/35" class="external">here</a></p>
openQA Tests - action #81044 (Resolved): [qe-core][qem] Add check for unreleased container imageshttps://progress.opensuse.org/issues/810442020-12-14T14:58:03Zgeorggkioulis@suse.com
<p>There is need to automate the release of 15-SP3 container images from <a href="https://build.suse.de/project/show/SUSE:SLE-15-SP3:Update:CR" class="external">https://build.suse.de/project/show/SUSE:SLE-15-SP3:Update:CR</a> to <a href="https://build.suse.de/project/show/SUSE:SLE-15-SP3:Update:CR:ToTest" class="external">https://build.suse.de/project/show/SUSE:SLE-15-SP3:Update:CR:ToTest</a>. <br>
Since 15-SP3 is not public, openQA container tests should not be scheduled and the container image should not be able to get released to the public registry.</p>
<p>This will be part of <a href="https://gitlab.suse.de/geor/container_bot" class="external">https://gitlab.suse.de/geor/container_bot</a>.<br>
Once this is implemented, the container_bot running in <code>qam.suse.de</code> should have it's version updated.</p>
openQA Tests - action #80360 (Resolved): [qe-core] Reboot gnome through mouse clicks on all productshttps://progress.opensuse.org/issues/803602020-11-25T11:41:55Zgeorggkioulis@suse.com
<p>GNOME 3.38 changes the openQA graphical reboot process.<br>
In order to avoid branching the reboot behavior based on gnome version, a common graphical reboot sequence should be adopted for throughout all products in <code>sub reboot_x11</code>, for GNOME.</p>
openQA Tests - action #78296 (Resolved): [qe-core][qem] test fails in install_updatehttps://progress.opensuse.org/issues/782962020-11-19T13:41:03Zgeorggkioulis@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP3-Server-DVD-Incidents-Minimal-x86_64-qam-minimal-full@64bit fails in<br>
<a href="https://openqa.suse.de/tests/4920287/modules/install_update/steps/48" class="external">install_update</a></p>
<p>The error message is <code>nothing provides libzypp >= 16.21.2 needed by zypper-1.13.57-21.32.1.x86_64</code></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>minimal = base pattern, minimal (enhanced base) pattern are additional convenience paclkages</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/4919728" class="external">:16986:zypper</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/4915695" class="external">:16967:ca-certificates-mozilla</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Server-DVD-Incidents-Minimal&machine=64bit&test=qam-minimal-full&version=12-SP3" class="external">latest</a></p>
openQA Tests - action #72037 (Workable): [yast][security][qem][shim] Enable shim testing on barem...https://progress.opensuse.org/issues/720372020-09-28T16:37:18Zgeorggkioulis@suse.com
<p>Although we do have openQA runs with secure boot, there is need for <code>shim</code> testing on baremetal machine with secure boot.</p>
<p>probably the following would need to be scheduled:</p>
<ul>
<li>security/mokutil_sign.pm</li>
<li>console/verify_efi_mok.pm</li>
</ul>
openQA Tests - action #71974 (Resolved): [qam][ant] test fails in anthttps://progress.opensuse.org/issues/719742020-09-28T10:56:15Zgeorggkioulis@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP5-Server-DVD-Updates-aarch64-mau-extratests@aarch64-virtio fails in<br>
<a href="https://openqa.suse.de/tests/4706226/modules/ant/steps/23" class="external">ant</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Run console tests against aggregated test repo</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/4682322" class="external">20200914-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=aarch64&distri=sle&flavor=Server-DVD-Updates&machine=aarch64-virtio&test=mau-extratests&version=12-SP5" class="external">latest</a></p>
openQA Tests - coordination #69055 (Resolved): [qe-core][qem][openvswitch][epic][sprint] Increase...https://progress.opensuse.org/issues/690552020-07-16T14:43:24Zgeorggkioulis@suse.com
<p>According to <a href="https://jira.suse.com/browse/ECO-2242" class="external">ECO-2242</a> Openvswitch will include some new packages in 15 SP2:<br>
Those will be:</p>
<ul>
<li>openvswitch-ipsec</li>
<li>openvswitch-pki</li>
<li>openvswitch-test</li>
<li>openvswitch-vtep</li>
</ul>
<p>Also there is a new set of ovn packages, those have been split into another ticket <a href="https://progress.opensuse.org/issues/70501" class="external">https://progress.opensuse.org/issues/70501</a>.</p>
<p>There is need to expand openvswitch testing to cover relevant usecases.<br>
Before implementation this will require some investigation on what scenarios to include.</p>