openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842024-02-08T06:09:44ZopenSUSE Project Management Tool
Redmine openQA Tests - action #155137 (Workable): [security] oscap_bash_pci_dss_4 fails due to unexpect...https://progress.opensuse.org/issues/1551372024-02-08T06:09:44Ztjyrinki_susetjyrinki+redmine@suse.de
<p>aarch64 only:</p>
<p>15-SP4:<br>
<a href="https://openqa.suse.de/tests/13465079/modules/oscap_xccdf_eval#2/steps/25" class="external">https://openqa.suse.de/tests/13465079/modules/oscap_xccdf_eval#2/steps/25</a></p>
<p>15-SP5:<br>
<a href="https://openqa.suse.de/tests/13465157#step/oscap_xccdf_eval#2/25" class="external">https://openqa.suse.de/tests/13465157#step/oscap_xccdf_eval#2/25</a></p>
<p>15-SP6:<br>
<a href="https://openqa.suse.de/tests/13458991#step/oscap_xccdf_eval#2/25" class="external">https://openqa.suse.de/tests/13458991#step/oscap_xccdf_eval#2/25</a></p>
<p>x86_64 and s390x pass:<br>
SP4&SP5:<br>
<a href="https://openqa.suse.de/tests/13461333" class="external">https://openqa.suse.de/tests/13461333</a><br>
<a href="https://openqa.suse.de/tests/13461236" class="external">https://openqa.suse.de/tests/13461236</a><br>
<a href="https://openqa.suse.de/tests/13461772" class="external">https://openqa.suse.de/tests/13461772</a><br>
<a href="https://openqa.suse.de/tests/13461649" class="external">https://openqa.suse.de/tests/13461649</a><br>
SP6:<br>
<a href="https://openqa.suse.de/tests/13457751" class="external">https://openqa.suse.de/tests/13457751</a></p>
openQA Tests - action #155050 (Workable): [security] all oscap tests fail on x86_64 and aarch64 i...https://progress.opensuse.org/issues/1550502024-02-07T07:45:38Ztjyrinki_susetjyrinki+redmine@suse.de
<p>See for example:</p>
<p>openQA test in scenario sle-15-SP4-Server-DVD-Updates-aarch64-oscap_ansible_anssi_bp28_high@aarch64-virtio fails in<br>
<a href="https://openqa.suse.de/tests/13447534/modules/boot_to_desktop/steps/8" class="external">boot_to_desktop</a></p>
<p>This is after the yesterday's changes to switch to GUI environment.</p>
<p>However all of s390x passes: <a href="https://openqa.suse.de/tests/13446821" class="external">https://openqa.suse.de/tests/13446821</a></p>
<p>On x86_64 and aarch64 it boots the desktop HDD but somehow the DESKTOP variable is overridden from somewhere still to be textmode, which probably causes the problem.</p>
<p>On s390x it's the same but it happens not to break on boot, but it also doesn't seem to actually use the desktop as DESKTOP=textmode there too.</p>
openQA Tests - action #154696 (Resolved): [security] Most oscap tests fail on 15-SP6 in eval or r...https://progress.opensuse.org/issues/1546962024-02-01T08:59:37Ztjyrinki_susetjyrinki+redmine@suse.de
<p>Most oscap tests are failing on 15-SP6. See <a href="https://openqa.suse.de/tests/overview?arch=&flavor=&machine=&test=&modules=oscap_xccdf_eval&module_re=&group_glob=&not_group_glob=&comment=&distri=sle&version=15-SP6&build=50.2&groupid=268#" class="external">https://openqa.suse.de/tests/overview?arch=&flavor=&machine=&test=&modules=oscap_xccdf_eval&module_re=&group_glob=¬_group_glob=&comment=&distri=sle&version=15-SP6&build=50.2&groupid=268#</a> or latest build.</p>
<p>As an example <a href="https://openqa.suse.de/tests/13393791/modules/oscap_xccdf_eval#2/steps/25" class="external">https://openqa.suse.de/tests/13393791/modules/oscap_xccdf_eval#2/steps/25</a><br>
"fail" count in file stdout is 7, expected 3. Failed rules:<br>
xccdf_org.ssgproject.content_rule_aide_build_database, CCE-85787-0<br>
xccdf_org.ssgproject.content_rule_aide_periodic_cron_checking, CCE-85671-6<br>
xccdf_org.ssgproject.content_rule_aide_scan_notification, CCE-91214-7<br>
xccdf_org.ssgproject.content_rule_accounts_passwords_pam_tally2, CCE-85554-4<br>
xccdf_org.ssgproject.content_rule_audit_rules_privileged_commands_kmod, CCE-85591-6<br>
xccdf_org.ssgproject.content_rule_audit_rules_time_stime, CCE-85815-9<br>
xccdf_org.ssgproject.content_rule_grub2_l1tf_argument, </p>
openQA Tests - action #152803 (Resolved): [security] repository missing (while in fips_setup), wo...https://progress.opensuse.org/issues/1528032023-12-20T10:47:29Ztjyrinki_susetjyrinki+redmine@suse.de
<p>openQA test in scenario sle-15-SP4-Server-DVD-Updates-s390x-fips_ker_mode_openjdk@s390x-kvm fails in<br>
<a href="https://openqa.suse.de/tests/13121189/modules/fips_setup/steps/49" class="external">fips_setup</a></p>
<p>It passed earlier today but failed in a later unrelated step. Therefore the failure is not related to the updates being tested.</p>
openQA Tests - action #107347 (Resolved): [qe-core] test fails in system_rolehttps://progress.opensuse.org/issues/1073472022-02-23T13:02:01Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP4-Online-x86_64-textmode+role_xen@64bit fails in<br>
<a href="https://openqa.suse.de/tests/8216702/modules/system_role/steps/5" class="external">system_role</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Maintainer: QE Core</p>
<p>Selects Xen role in System Role window (12SP2+). Select bigger HDD size to resemble more realistic scenario: More place for virtual machines. This is also necessary to enable snapshots based on the installer logic. Related progress issues: <a href="https://progress.opensuse.org/issues/30853" class="external">https://progress.opensuse.org/issues/30853</a></p>
<p>Renamed from textmode+xen_server_role</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/8089629" class="external">91.2</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/8030295" class="external">88.4</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Online&machine=64bit&test=textmode%2Brole_xen&version=15-SP4" class="external">latest</a></p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<p>AC1: Make the Xen selection work again, a wrong needle was created?</p>
openQA Tests - action #94441 (Resolved): [qe-core] Re-schedule pidgin testshttps://progress.opensuse.org/issues/944412021-06-22T05:37:00Ztjyrinki_susetjyrinki+redmine@suse.de
<p>These were disabled due to <a href="https://progress.opensuse.org/issues/94177" class="external">https://progress.opensuse.org/issues/94177</a> and blocking many updates.</p>
<p>However, it turns out pidgin is still part of even SLE 15 WE, so it's a good idea to consider fixing the test too.</p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<p>AC1: Schedule pidgin tests - this time via YAML - on functional + maintenance releases.<br>
AC2: Before enabling, fix any problems that may still remain - likely useful to switch to irc.libera.chat if not yet done.</p>
openQA Tests - action #93895 (Resolved): [qe-core][qe-yast][qu] ext4_yast@s390x-zVM-vswitch-l3 fa...https://progress.opensuse.org/issues/938952021-06-11T11:32:23Ztjyrinki_susetjyrinki+redmine@suse.de
<p>See for example <a href="https://openqa.suse.de/tests/6209945" class="external">https://openqa.suse.de/tests/6209945</a></p>
<p>Even if it would pass bootloader, it would fail to setup_libyui. At least the latter should be fixed regardless of the bootloader problems.</p>
openQA Tests - action #93757 (Resolved): [qe-core][qe-yast][qu] test fails in setup_libyui on lvm...https://progress.opensuse.org/issues/937572021-06-10T06:16:12Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP2-Full-QR-aarch64-lvm_thin_provisioning@aarch64 fails in<br>
<a href="https://openqa.suse.de/tests/6209821/modules/setup_libyui/steps/4" class="external">setup_libyui</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Complete OS deployment with unencrypted LVM drive management. Test creates 2 LVM and BIOS boot partitions. Thin pool and thin lv resides on the second LVM partition, where /home (XFS) is being mounted. Maintainer: mloviska, poo#39023</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/6209821" class="external">391.12</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/6123981" class="external">391.8</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=aarch64&distri=sle&flavor=Full-QR&machine=aarch64&test=lvm_thin_provisioning&version=15-SP2" class="external">latest</a></p>
openQA Tests - action #93754 (Resolved): [qe-core][qe-yast][qu] xfs@svirt-xen-pv test fails in se...https://progress.opensuse.org/issues/937542021-06-10T06:05:25Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP2-Full-QR-x86_64-xfs@svirt-xen-pv fails in<br>
<a href="https://openqa.suse.de/tests/6210241/modules/setup_libyui/steps/8" class="external">setup_libyui</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Maintainer: QE Yast, QE Kernel</p>
<p>Installation test with explicit selection of "xfs" instead of default.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/6210241" class="external">391.12</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/6130040" class="external">391.8</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Full-QR&machine=svirt-xen-pv&test=xfs&version=15-SP2" class="external">latest</a></p>
openQA Tests - action #91187 (Resolved): [qe-core] Add existing tomcat test module to Product QE ...https://progress.opensuse.org/issues/911872021-04-15T06:17:58Ztjyrinki_susetjyrinki+redmine@suse.de
<p>After comparing test coverage of SLE 15 SP2 and SP3 in opneQA I identified several tests that are exclusive to either pre-release or post-release testing and could be easily used to increase our coverage just by using what we already have.</p>
<p>It is possible that are some errors and some of the tests from the list are already being used. It is also just my opinion, therefor review from other colleagues is more then welcome.</p>
<p>These are the X11 tests that run only after release and could be used also before the release (QEM -> product QE)</p>
<p>tests/x11/piglit/piglit.pm<br>
tests/x11/tomcat.pm</p>
openQA Tests - action #91184 (Rejected): [qe-core] Add existing network QEM tests to Product QEhttps://progress.opensuse.org/issues/911842021-04-15T06:17:20Ztjyrinki_susetjyrinki+redmine@suse.de
<p>After comparing test coverage of SLE 15 SP2 and SP3 in opneQA I identified several tests that are exclusive to either pre-release or post-release testing and could be easily used to increase our coverage just by using what we already have.</p>
<p>It is possible that are some errors and some of the tests from the list are already being used. It is also just my opinion, therefor review from other colleagues is more then welcome.</p>
<p>These are the tests that run only after release and could be used also before the release (QEM -> product QE)</p>
<p>tests/network/autofs_client.pm & tests/network/autofs_server.pm<br>
tests/network/salt_master.pm<br>
tests/network/salt_minion.pm<br>
tests/network/samba/samba_adcli.pm</p>
openQA Tests - action #91181 (Resolved): [qe-core] Add existing console QEM tests to Product QEhttps://progress.opensuse.org/issues/911812021-04-15T06:16:21Ztjyrinki_susetjyrinki+redmine@suse.de
<p>After comparing test coverage of SLE 15 SP2 and SP3 in opneQA I identified several tests that are exclusive to either pre-release or post-release testing and could be easily used to increase our coverage just by using what we already have.</p>
<p>It is possible that are some errors and some of the tests from the list are already being used. It is also just my opinion, therefor review from other colleagues is more then welcome.</p>
<p>These are the console tests that run only after release and could be used also before the release (QEM -> product QE)</p>
<p>tests/console/bind.pm<br>
tests/console/dracut_enhanced.pm<br>
tests/console/gd.pm<br>
tests/console/iotop.pm<br>
tests/console/journalctlLevels.pm<br>
tests/console/krb5.pm<br>
tests/console/libgcrypt.pm<br>
tests/console/libssh.pm<br>
tests/console/openssl_nodejs.pm<br>
tests/console/perf.pm<br>
tests/console/rsync_client.pm<br>
tests/console/rsync_server.pm<br>
tests/console/systemd_rpm_macros.pm<br>
tests/console/valgrind.pm</p>
openQA Tests - action #91106 (Resolved): [qe-core][qe-yast][qu] test fails in select_guided_setuphttps://progress.opensuse.org/issues/911062021-04-14T08:27:24Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>Started failing 18 days ago, likely needs to fork the yaml schedule.</p>
<p>openQA test in scenario sle-15-SP2-Full-QR-x86_64-ext4@svirt-xen-pv fails in<br>
<a href="https://openqa.suse.de/tests/5792646/modules/select_guided_setup/steps/2" class="external">select_guided_setup</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Maintainer: okurz</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/5767616" class="external">385.10</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/5725263" class="external">385.7</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Full-QR&machine=svirt-xen-pv&test=ext4&version=15-SP2" class="external">latest</a></p>
openQA Tests - action #89479 (Resolved): [qe-core] test fails in sssd - Fix sssd testing with ope...https://progress.opensuse.org/issues/894792021-03-04T10:40:19Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP3-Online-x86_64-extra_tests_textmode_phub@64bit fails in<br>
<a href="https://openqa.suse.de/tests/5646951/modules/sssd/steps/22" class="external">sssd</a></p>
<p>In the past, sssd used to be tested using python-pam module, however it's unmantained and it belonged in the package hub repo, see <a href="https://bugzilla.suse.com/show_bug.cgi?id=1180120">https://bugzilla.suse.com/show_bug.cgi?id=1180120</a> for more information</p>
<p>It is still affecting other teams like <a href="https://progress.opensuse.org/issues/88736" class="external">public cloud</a>, but on 15SP2 it is still being run for maintenance test repo and passing at <a href="https://openqa.suse.de/tests/5636854">https://openqa.suse.de/tests/5636854</a></p>
<p>In the end, this might be a complete rewrite of the sssd tests, rendering tests/sysauth/sssd.pm useless. A bit of background, those tests are a bit extensive but they were written by a developer that is long gone from the company, investing time in fixing or looking for an alternative to python-pam and rewrite the test suite is more expensive than switching to directly testing the service against the system (by means of directly using pam/passwd/getent)</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/4559227" class="external">14.2</a></p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Online&machine=64bit&test=extra_tests_textmode_phub&version=15-SP3" class="external">latest</a></p>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<p>Follow the approach used by <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/12075/files#diff-4e63d910050359ba446d37c691c72c4a4ee4fc8ae8c2b98d00996804e2bdb55dR91" class="external">this</a> pr, that sets up the Directory Service (389-ds in this case, but there's also the information for openldap).</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<p>AC1: sssd is being tested without other dependencies than pam for all codestreams (openSUSE and SLE)<br>
AC2: Move sssd tests from extra_tests_textmode_phub to extra_tests_textmode<br>
AC3: re-enable sssd testing on public cloud (Or team is informed that they can be re-enabled)</p>
<a name="Followup-during-review"></a>
<h3 >Followup during review<a href="#Followup-during-review" class="wiki-anchor">¶</a></h3>
<p>See how <a href="https://progress.opensuse.org/issues/89320">https://progress.opensuse.org/issues/89320</a> was implemented and evaluate whether a subticket is needed to unify the testing strategy or they are tackling two different approaches</p>
openQA Tests - action #50867 (Resolved): [qam] nfsidmap part of the autofs tests fail on SLE12https://progress.opensuse.org/issues/508672019-04-30T07:30:08Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<pre><code class="bash syntaxhl" data-language="bash">nfsidmap <span class="nt">-c</span>
<span class="s1">'id_resolver'</span> keyring was not found
</code></pre>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<ul>
<li>Build <a href="https://openqa.suse.de/tests/2844872#step/autofs_client/39" class="external">20190430</a>
In scenario sle-12-SP3-Server-DVD-Updates-x86_64-1-mau-autofs-server@64bit</li>
</ul>
<a name="Expected-results"></a>
<h2 >Expected results<a href="#Expected-results" class="wiki-anchor">¶</a></h2>
<p>I cannot find any expected result in OSD, so I consider this a new test.</p>
<a name="Further-information"></a>
<h2 >Further information<a href="#Further-information" class="wiki-anchor">¶</a></h2>
<p>Latest job in this scenario: <a href="https://openqa.suse.de/tests/latest?test=mau-autofs-server&flavor=Server-DVD-Updates&arch=x86_64&distri=sle&version=12-SP3&machine=64bit" class="external">https://openqa.suse.de/tests/latest?test=mau-autofs-server&flavor=Server-DVD-Updates&arch=x86_64&distri=sle&version=12-SP3&machine=64bit</a></p>