openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842022-06-24T07:49:53ZopenSUSE Project Management Tool
Redmine openQA Tests - action #112997 (Resolved): [qe-core] test fails in groupwise - groupwise core dumpshttps://progress.opensuse.org/issues/1129972022-06-24T07:49:53Zpunkioudi
<p>There is already an open <a href="https://bugzilla.suse.com/show_bug.cgi?id=1200576" class="external">[bug]</a> regarding this issue.<br>
The point is that it started happening around 1 week ago and it seems to be a regression of an update. <br>
The goal of this ticket is to identify which update is causing it and report it to <code>#team-lsg-qe-openqa-review</code> in slack.</p>
<a name="Suggestion"></a>
<h2 >Suggestion<a href="#Suggestion" class="wiki-anchor">¶</a></h2>
<ol>
<li>Check the Investigation tab between the last passed and first failed job.</li>
<li>Check which updates were added in the failed case.</li>
<li>In a VM with the updates installed, try removing these new updates</li>
</ol>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ol>
<li>Identify which update is causing the regression</li>
</ol>
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP3-Desktop-DVD-Updates-x86_64-qam-regression-message@64bit fails in<br>
<a href="https://openqa.suse.de/tests/9013840/modules/groupwise/steps/24" class="external">groupwise</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Testsuite maintained at <a href="https://gitlab.suse.de/qa-maintenance/qam-openqa-yml" class="external">https://gitlab.suse.de/qa-maintenance/qam-openqa-yml</a>.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/8954686" class="external">20220614-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/8950208" class="external">20220613-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Desktop-DVD-Updates&machine=64bit&test=qam-regression-message&version=15-SP3" class="external">latest</a></p>
openQA Tests - action #112907 (Rejected): [qe-core] test fails in welcome - waiting for selecting...https://progress.opensuse.org/issues/1129072022-06-23T07:07:38Zpunkioudi
<p>Thread for this topic: <a href="https://suse.slack.com/archives/C02CLB2LB7Z/p1655470441385699" class="external">https://suse.slack.com/archives/C02CLB2LB7Z/p1655470441385699</a><br>
For s390x 15-SP4 Full Media, product selection has been removed, so <code>welcome.pm</code> is not needed for these s390x runs.<br>
This failure happens also in qam-minimal+base testsuite: <a href="https://openqa.suse.de/tests/9008631#step/welcome/4" class="external">https://openqa.suse.de/tests/9008631#step/welcome/4</a></p>
<a name="Aceptance-criteria"></a>
<h2 >Aceptance criteria<a href="#Aceptance-criteria" class="wiki-anchor">¶</a></h2>
<ol>
<li>Modify (or even remove) welcome.pm from <code>mru-install-minimal-with-addons</code> and <code>qam-minimal+base</code> </li>
<li>Make sure that the two testsuites pass fine</li>
</ol>
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP4-Server-DVD-Updates-s390x-mru-install-minimal-with-addons@s390x-kvm-sle12 fails in<br>
<a href="https://openqa.suse.de/tests/9008974/modules/welcome/steps/4" class="external">welcome</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Testsuite maintained at <a href="https://gitlab.suse.de/qa-maintenance/qam-openqa-yml" class="external">https://gitlab.suse.de/qa-maintenance/qam-openqa-yml</a>.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/8955774" class="external">20220614-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=s390x&distri=sle&flavor=Server-DVD-Updates&machine=s390x-kvm-sle12&test=mru-install-minimal-with-addons&version=15-SP4" class="external">latest</a></p>
openQA Tests - action #112739 (Resolved): [qe-core] test fails in multipath - activation of multi...https://progress.opensuse.org/issues/1127392022-06-20T09:34:12Zpunkioudi
<p>The test expects the screen that asks if you want to activate multipath, but the registration screen appears instead.</p>
<a name="Acceptance-Criteria"></a>
<h3 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h3>
<ul>
<li>AC1: Check if this is a valid test case for SLES 15-SP4</li>
<li>AC2: Adjust the test for SLES 15-SP4</li>
</ul>
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP4-Server-DVD-Updates-x86_64-mru-install-minimal-with-addons-multipath@64bit fails in<br>
<a href="https://openqa.suse.de/tests/8983032/modules/multipath/steps/3" class="external">multipath</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Testsuite maintained at <a href="https://gitlab.suse.de/qa-maintenance/qam-openqa-yml" class="external">https://gitlab.suse.de/qa-maintenance/qam-openqa-yml</a>. Maintainer: <a href="mailto:pcervinka@suse.com">pcervinka@suse.com</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/8955677" class="external">20220614-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Server-DVD-Updates&machine=64bit&test=mru-install-minimal-with-addons-multipath&version=15-SP4" class="external">latest</a></p>
openQA Tests - action #112169 (Resolved): [qe-core] test fails in zdup - ls: cannot access /dev/d...https://progress.opensuse.org/issues/1121692022-06-08T07:50:21Zpunkioudi
<p>Investigate <code>/dev/disk/by-label</code> directory missing</p>
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario opensuse-15.4-DVD-Updates-x86_64-zdup-Leap-15.3-gnome@64bit fails in<br>
<a href="https://openqa.opensuse.org/tests/2405555/modules/zdup/steps/13" class="external">zdup</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.opensuse.org/tests/2405438" class="external">20220607-3</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=opensuse&flavor=DVD-Updates&machine=64bit&test=zdup-Leap-15.3-gnome&version=15.4" class="external">latest</a></p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ol>
<li>Reproduce the issue manually</li>
<li>Check if it is a product or infrastructure issue</li>
</ol>
<a name="Suggestion"></a>
<h2 >Suggestion<a href="#Suggestion" class="wiki-anchor">¶</a></h2>
<p>Install in virt-manager locally to see if the same issue appears.</p>
openQA Tests - action #111144 (Rejected): [qe-core] test fails in orphaned_packages_check - white...https://progress.opensuse.org/issues/1111442022-05-16T08:29:41Zpunkioudi
<p>This bug : <a href="https://bugzilla.opensuse.org/show_bug.cgi?id=1199442" class="external">https://bugzilla.opensuse.org/show_bug.cgi?id=1199442</a> has been already opened for the issue with <code>libpeas-loader-python</code>.<br>
As there is a possibility that it will not be fixed, the package can be added in whitelist.</p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li>AC1 Whitelist the package</li>
<li>AC2 Make sure that the tests now are green in Leap 15.3 Updates: <a href="https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=20220514-1&groupid=80" class="external">https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=20220514-1&groupid=80</a></li>
</ul>
openQA Tests - action #110656 (Resolved): [qe-core] test fails in orphaned_packages_check - missi...https://progress.opensuse.org/issues/1106562022-05-05T07:51:47Zpunkioudi
<p>It seems more like a bug (:</p>
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario opensuse-15.3-DVD-Updates-x86_64-gnome@64bit-2G fails in<br>
<a href="https://openqa.opensuse.org/tests/2329168/modules/orphaned_packages_check/steps/11" class="external">orphaned_packages_check</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Revert schedule to working settings - dleuenberger, 20211117</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.opensuse.org/tests/2328633" class="external">20220504-4</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.opensuse.org/tests/2328575" class="external">20220504-3</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=opensuse&flavor=DVD-Updates&machine=64bit-2G&test=gnome&version=15.3" class="external">latest</a></p>
openQA Infrastructure - action #98307 (Resolved): Many jobs in o3 fail with timeout_exceeded on o...https://progress.opensuse.org/issues/983072021-09-08T07:30:28Zpunkioudi
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>This issue has been observed mainly in the latest runs of Leap 15.3 Updates/Backports (qemu x86_64). This is the latest Build for Leap 15.3 Updates : <a href="https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=20210908-1&groupid=80" class="external">https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=20210908-1&groupid=80</a> and the 8 fails happened for the same reason --> <code>timeout: setup exceeded MAX_SETUP_TIME</code><br>
eg : <a href="https://openqa.opensuse.org/tests/1906875" class="external">https://openqa.opensuse.org/tests/1906875</a></p>
<p>Similar issues have been also spotted in the latest Build for Tumbleweed : <a href="https://openqa.opensuse.org/tests/overview?distri=microos&distri=opensuse&version=Tumbleweed&build=20210906&groupid=1" class="external">https://openqa.opensuse.org/tests/overview?distri=microos&distri=opensuse&version=Tumbleweed&build=20210906&groupid=1</a><br>
eg : <a href="https://openqa.opensuse.org/tests/1906246" class="external">https://openqa.opensuse.org/tests/1906246</a></p>
openQA Tests - action #96716 (Resolved): [qe-core][CI] Add CI check for module header not being u...https://progress.opensuse.org/issues/967162021-08-10T12:22:14Zpunkioudi
<p>When an existing perl module is being edited or a new one is created, the Copyright date has to be up-to-date.<br>
A CI check can be implemented, which will compare the current year date with the one included in the header of the edited module.</p>
<a name="Acceptance-criteria"></a>
<h3 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h3>
<ul>
<li>AC1: Each subtask is proposed as an RFC in the os-autoinst-distri-opensuse repo.</li>
<li>AC2: There's a corresponding entry in the <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/master/CONTRIBUTING.md#coding-style" class="external">contributing</a> document.</li>
</ul>
openQA Tests - action #95036 (Resolved): [Leap 15.3 Updates] Jobs are being restarted often, not ...https://progress.opensuse.org/issues/950362021-07-02T13:33:34Zpunkioudi
<p>It has been observed that the job group <a href="https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=20210702-1&groupid=80" class="external">[here]</a> re-starts the runs often during the day, which prevents the previous runs from finishing.<br>
This behavior can be seen in the screenshot below.</p>
openQA Tests - action #94859 (Resolved): [Leap15.3] test fails in zypper_arhttps://progress.opensuse.org/issues/948592021-06-29T10:43:18Zpunkioudi
<p>It seems that the <code>MIRROR_PREFIX</code> is missing from the settings.</p>
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario opensuse-15.3-DVD-Updates-x86_64-extra_tests_textmode@64bit-2G fails in<br>
<a href="https://openqa.opensuse.org/tests/1810523/modules/zypper_ar/steps/3" class="external">zypper_ar</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Maintainer: <a href="mailto:slindomansilla@suse.de">slindomansilla@suse.de</a>.<br>
Mainly post-installation console extra tests.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.opensuse.org/tests/1810523" class="external">20210628-2</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=opensuse&flavor=DVD-Updates&machine=64bit-2G&test=extra_tests_textmode&version=15.3" class="external">latest</a></p>
openQA Tests - action #94810 (Resolved): [Leap15.3][qem][qe-core] test fails in qam_zypper_patchhttps://progress.opensuse.org/issues/948102021-06-28T13:56:06Zpunkioudi
<p>It seems that the <code>zypper_add_repos.pm</code> that is scheduled before <code>qam_zypper_patch.pm</code>,doesn't add the needed repo.<br>
Consequently when the test tries to zypper patch the corresponding incidence, it fails.<br>
(It seems that a setting has to be configured)</p>
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario opensuse-15.3-DVD-Backports-x86_64-gnome@64bit-2G fails in<br>
<a href="https://openqa.opensuse.org/tests/1807814/modules/qam_zypper_patch/steps/11" class="external">qam_zypper_patch</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.opensuse.org/tests/1758801" class="external">:15953:hello.1616082711</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=opensuse&flavor=DVD-Backports&machine=64bit-2G&test=gnome&version=15.3" class="external">latest</a></p>
openQA Tests - action #93814 (Resolved): [qe-core][qem] Schedule network_hostname in maintenance ...https://progress.opensuse.org/issues/938142021-06-10T11:43:41Zpunkioudi
<p>Add <code>network_configuration</code> job in <code>Maintenance: Test Repo</code>, like : <a href="https://openqa.suse.de/tests/5990448" class="external">https://openqa.suse.de/tests/5990448</a></p>
openQA Tests - action #93270 (Resolved): [qe-core][qem] Schedule vsftpd in s390x runshttps://progress.opensuse.org/issues/932702021-05-31T10:12:15Zpunkioudi
<p>The vsftpd.pm fails in s390x, because of the following <a href="https://bugzilla.suse.com/show_bug.cgi?id=1176813" class="external">[bug]</a><br>
When the bug is resolved, vsftpd has to be removed of the <code>conditional_schedule</code> -> <code>arch_specific</code> area in <code>schedule/qam/common/mau-extratests2.yaml</code> and be transferred to <code>schedule</code> area in the same yaml file.</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC0</strong> Help is provided to Peter Simons with understanding what the vsftpd test suite is doing, and this information is documented in a separate ticket, to serve as building block for a test rewrite in the future.</li>
<li><strong>AC1</strong> Soft fail on s390 when the failure is the one mentioned in the bug (500 OOPS: vsftpd: security: 'one_process_model')</li>
<li><strong>AC2</strong> Verify the bugfix</li>
<li><strong>AC3</strong> Schedule tests/console/vsftpd in <code>schedule/qam/common/mau-extratests2.yaml</code> in <code>schedule</code></li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<p>The change would require to evaluate the exit code of the test run (the bash script), and evaluate the logs to search for the string, before either soft failing or failing in case another problem arises. </p>
openQA Tests - action #93264 (Resolved): [qe-core][qem] Add journald_fss, openvswitch_ssl, vsftpd...https://progress.opensuse.org/issues/932642021-05-31T09:46:21Zpunkioudi
<p>Add the following tests in QEM runs :</p>
<ul>
<li>tests/console/journald_fss.pm</li>
<li>tests/console/openvswitch_ssl.pm</li>
<li>tests/console/vsftpd.pm</li>
</ul>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1</strong> The tests are scheduled in <code>mau-extratests2</code> jobgroup in aggregate tests.</li>
</ul>
openQA Tests - action #86075 (Resolved): [qe-core][qem] Test openvswitch-vtephttps://progress.opensuse.org/issues/860752021-01-11T11:01:53Zpunkioudi
<p>For Tumbleweed, SLES 15-SP3 and SLES 15-SP2:</p>
<p>Add a testcase for openvswitch-vtep.</p>
<ul>
<li>Set up 2 VMs</li>
<li>Start the VTEP emulator</li>
<li>Set up the logical network (connect the two VMs to one switch)</li>
<li>Make a traffic analysis</li>
</ul>