openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842023-11-28T06:58:19ZopenSUSE Project Management Tool
Redmine ALP - action #151558 (Resolved): [security] firstrun on sle-micro >= 6.0 should be ALPifiedhttps://progress.opensuse.org/issues/1515582023-11-28T06:58:19Ztjyrinki_susetjyrinki+redmine@suse.de
<p>openQA test in scenario sle-micro-6.0-Default-encrypted-x86_64-container_selinux@uefi fails in<br>
<a href="https://openqa.suse.de/tests/12874494/modules/firstrun/steps/5" class="external">firstrun</a></p>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle-micro&flavor=Default-encrypted&machine=uefi&test=container_selinux&version=6.0" class="external">latest</a></p>
<p>Firstrun is failing with distri sle-micro and version 6.0 - that is, ALP - in the encrypted flavor (that does not use ignition but uses firstrun wizard). This is likely due to it picking up the SLE Micro 5.x expections while it should now work as intended on ALP. There may or may not be difference between ALP Dolomite and ALP Marble in this regard, but likely it should be largely the same.</p>
<p>selinux_setup was updated to use is_alp || is_sle_micro('>=6.0'), jeos/firstrun should maybe using is_sle || is_sle_micro('<6.0') in some places and the former in other places, not sure what would be optimal.</p>
openQA Tests - action #135269 (Rejected): [security] test fails in system_preparehttps://progress.opensuse.org/issues/1352692023-09-06T18:08:00Ztjyrinki_susetjyrinki+redmine@suse.de
<p>openQA test in scenario sle-15-SP4-Server-DVD-Updates-s390x-mru-install-desktop-with-addons@s390x-kvm-sle12 fails in<br>
<a href="https://openqa.suse.de/tests/11970473/modules/system_prepare/steps/2" class="external">system_prepare</a></p>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/11970473" class="external">20230831-1</a> (current job)<br>
Last good: <a href="https://openqa.suse.de/tests/11942027" class="external">20230829-1</a> (or more recent)</p>
<p>Fails with "ssh: connect to host s390kvm082.suse.de port 22: No route to host".</p>
<p>Likely an infrastructure issue related to the moves, but should be seen if it can be workarounded or if something needs changing due to hardware moves.</p>
openQA Tests - action #134237 (Rejected): [security][ALP] Manual Testing for ALP Dolomite Build 5.6https://progress.opensuse.org/issues/1342372023-08-15T08:20:39Ztjyrinki_susetjyrinki+redmine@suse.de
<p>While openQA automated testing was running already, recently everything broke over there and we should likely do manual testing still of the latest ALP Dolomite build 5.6.</p>
<ul>
<li>Download: <a href="https://download.suse.de/ibs/SUSE:/ALP:/Products:/Dolomite:/1.0:/ToTest/images/ALP-Dolomite.x86_64-1.0-Default-encrypted-Build5.6.raw" class="external">https://download.suse.de/ibs/SUSE:/ALP:/Products:/Dolomite:/1.0:/ToTest/images/ALP-Dolomite.x86_64-1.0-Default-encrypted-Build5.6.raw</a></li>
<li>Documentation: <a href="https://documentation.suse.com/alp/dolomite/html/alp-dolomite/concept-alp-deployment.html" class="external">https://documentation.suse.com/alp/dolomite/html/alp-dolomite/concept-alp-deployment.html</a></li>
</ul>
<p>Steps:</p>
<ul>
<li>Raw image setup with TPM</li>
<li>Fallback to password disk decryption when TPM is removed</li>
<li>Check <code>audit.log</code> for AVC deny</li>
</ul>
<p>See previous similar ticket <a class="issue tracker-4 status-3 priority-4 priority-default closed" title="action: [security][ALP] Manual Testing for ALP Dolomite Build 2.1 (Resolved)" href="https://progress.opensuse.org/issues/133265">#133265</a></p>
openQA Tests - action #128252 (Rejected): [security] test fails in logs_from_installation_system ...https://progress.opensuse.org/issues/1282522023-04-25T06:55:35Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP4-Online-QR-s390x-fips_install_lvm_encrypt_separate_boot@s390x-kvm-sle12 fails in<br>
<a href="https://openqa.suse.de/tests/10959954/modules/logs_from_installation_system/steps/6" class="external">logs_from_installation_system</a></p>
<p>This is an old issue but I don't see an existing ticket for it.</p>
openQA Project - action #127238 (New): It's not possible to remove own force_result comments, and...https://progress.opensuse.org/issues/1272382023-04-05T06:42:05Ztjyrinki_susetjyrinki+redmine@suse.de
<p>Here is an example:</p>
<p><a href="https://openqa.suse.de/tests/10848924#comments" class="external">https://openqa.suse.de/tests/10848924#comments</a></p>
<p>The soft-fail forcing was done erronously, and would be wanted to be removed. However, when trying to remove the comment Forbidden message is given to the person who made the comment (the person is also Administrator).</p>
<p>This ticket looks like opposite of ticket <a class="issue tracker-4 status-1 priority-3 priority-lowest" title="action: It's possible to delete force_result comments (New)" href="https://progress.opensuse.org/issues/107239">#107239</a>, so I'm not sure what to do. However, in the recent months it feels there has been more related changes - now these un-deletable comments are also carried over automatically to new runs, and those carried over comments are also undeletable. If this kind of comment would happen in maintenance tests and couldn't be corrected (without availability of someone who has more direct rights than even Administrator has), it could mean even accidentally giving green light to an erronous update if the correction would be delayed.</p>
openQA Tests - action #125279 (Rejected): [security] test fails in verify_efi_mok - create_hdd_te...https://progress.opensuse.org/issues/1252792023-03-02T11:51:26Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP4-Online-QR-aarch64-aarch64_secureboot@aarch64 fails in <a href="https://openqa.suse.de/tests/10609863/modules/verify_efi_mok/steps/101" class="external">verify_efi_mok</a>. Last good: <a href="https://openqa.suse.de/tests/10019854" class="external">172.1</a> (or more recent)</p>
<p><em>Unlike</em> ticket <a class="issue tracker-4 status-3 priority-4 priority-default closed" title="action: [security] test fails in verify_efi_mok on 15-SP4 QU / aarch64 (Resolved)" href="https://progress.opensuse.org/issues/125264">#125264</a> where it was identified that a passing verify_efi_mok had UEFI_PFLASH_VARS = <a href="mailto:sle-15-SP4-aarch64-172.1-textmode@aarch64-uefi-vars_sb.qcow2">sle-15-SP4-aarch64-172.1-textmode@aarch64-uefi-vars_sb.qcow2</a> but now has UEFI_PFLASH_VARS = /usr/share/qemu/aavmf-aarch64-ms-vars.bin</p>
<p>... <em>drumroll</em> create_hdd_textmode_secureboot@aarch64 has it the other way around - it now has UEFI_PFLASH_VARS <a href="mailto:sle-15-SP4-aarch64-179.1-textmode@aarch64-uefi-vars.qcow2">sle-15-SP4-aarch64-179.1-textmode@aarch64-uefi-vars.qcow2</a> while when also verify_efi_mok worked create_hdd_textmode_secureboot@aarch64 had (<a href="https://openqa.suse.de/tests/9881708#settings" class="external">https://openqa.suse.de/tests/9881708#settings</a>) UEFI_PFLASH_VARS /usr/share/qemu/aavmf-aarch64-ms-vars.bin</p>
<p>This could explain why there seems to be a mismatch between what state the image is when it's created vs what it's later expected to be at.</p>
openQA Project - action #123724 (Resolved): auto_review not working despite ticket in openQA auto...https://progress.opensuse.org/issues/1237242023-01-27T07:20:44Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>Ticket #122215 seems not functional still, the affected tests do not get the softfail forcing still automatically but need to be set manually daily.</p>
<p>The ticket has:<br>
<code>auto_review:"Test result is NOT same as baseline":force_result:softfailed</code><br>
... at the end of the subject, and the ticket was moved to openQA auto review project.</p>
<p>The tests can be found at the 15-SP4 runs at <a href="https://openqa.suse.de/group_overview/429" class="external">https://openqa.suse.de/group_overview/429</a></p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1</strong>: Result is changed to softfailed as specified in the title of the ticket</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Verify that the regex valid/working e.g. <code>auto_review:"Test result is NOT same as baseline":force_result:softfailed</code>, maybe by putting the title in a unit test and seeing if that fails</li>
<li>Check that the ticket is filed correctly, i.e. using the force result tracker - this <strong>seems</strong> to be correct</li>
<li>Check the code in <a href="https://github.com/os-autoinst/scripts" class="external">https://github.com/os-autoinst/scripts</a></li>
</ul>
openQA Tests - action #123682 (Rejected): [security] aarch64 Failed to connect to '/tmp/mytpm12/s...https://progress.opensuse.org/issues/1236822023-01-26T06:05:08Ztjyrinki_susetjyrinki+redmine@suse.de
<p>See <a href="https://openqa.suse.de/tests/10375321" class="external">https://openqa.suse.de/tests/10375321</a> or always the latest at <a href="https://openqa.suse.de/tests/latest?arch=aarch64&distri=sle&flavor=Online&machine=aarch64&test=security_tpm2_swtpm&version=15-SP5" class="external">https://openqa.suse.de/tests/latest?arch=aarch64&distri=sle&flavor=Online&machine=aarch64&test=security_tpm2_swtpm&version=15-SP5</a></p>
<p>Swtpm device is incorrectly defined?</p>
openQA Project - action #119467 (Resolved): "Internal server error" on opening any job group fron...https://progress.opensuse.org/issues/1194672022-10-27T06:00:25Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>Build specific pages etc work, but job group front page like <a href="https://openqa.suse.de/group_overview/268" class="external">https://openqa.suse.de/group_overview/268</a> does not.</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1:</strong> No obvious related regression on OSD</li>
<li><strong>AC2:</strong> Test coverage for the branding button code exists for both the job comments as well as job group comments</li>
</ul>
openQA Tests - action #107341 (Rejected): [qe-core] test fails in vnc_two_passwordshttps://progress.opensuse.org/issues/1073412022-02-23T12:54:08Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>A failure in this module is currently linked to a flaky test tracker, but currently the error seems permanent in vnc_two_passwords.</p>
<hr>
<p>openQA test in scenario sle-15-SP4-Online-x86_64-extra_tests_gnome@svirt-xen-hvm fails in<br>
<a href="https://openqa.suse.de/tests/8216688/modules/vnc_two_passwords/steps/23" class="external">vnc_two_passwords</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Maintainer: QE Core, asmorodskyi. Extra tests which were designed to run on gnome , VNC_STALL_THRESHOLD is needed for xen svirt to don't turn off the scrreen after default 4 sec</p>
<p>New version of extra_tests_on_gnome for yaml scheduling</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/7935805" class="external">79.1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Online&machine=svirt-xen-hvm&test=extra_tests_gnome&version=15-SP4" class="external">latest</a></p>
openQA Tests - action #107320 (Rejected): [qe-core] test fails in prepare_test_data - sshd[2171]:...https://progress.opensuse.org/issues/1073202022-02-23T10:10:57Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>ssh connection is consistently dropping between the SUT and openQA at prepare_test_data, preventing further tests. </p>
<p>openQA test in scenario sle-15-SP4-Online-s390x-extra_tests_gnome@s390x-kvm-sle12 fails in<br>
<a href="https://openqa.suse.de/tests/8207530/modules/prepare_test_data/steps/10" class="external">prepare_test_data</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Maintainer: QE Core, asmorodskyi. Extra tests which were designed to run on gnome , VNC_STALL_THRESHOLD is needed for xen svirt to don't turn off the scrreen after default 4 sec</p>
<p>New version of extra_tests_on_gnome for yaml scheduling</p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC:0</strong> Switch the test to use root console to remove the initial failure/urgency</li>
<li><strong>AC:1</strong> Investigate: sshd[2171]: error: kex_exchange_identification: Connection closed by remote host</li>
<li><strong>AC:2</strong> Investigate if this test can be unscheduled. Tests may be able or already are downloading the necessary test data themselves. No need to download unneeded data.</li>
<li><strong>AC:3</strong> Make sure that the ssh console is necessary for s390, given that we have a working serial console</li>
<li><strong>AC:4</strong> Investigate if it is a backend/hardware problem with grenache/s390 machine</li>
<li><strong>AC:5</strong> Investigate if the problem is caused by the choice of <code>user-console</code></li>
</ul>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/7618963" class="external">61.1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=s390x&distri=sle&flavor=Online&machine=s390x-kvm-sle12&test=extra_tests_gnome&version=15-SP4" class="external">latest</a></p>
openQA Tests - action #91184 (Rejected): [qe-core] Add existing network QEM tests to Product QEhttps://progress.opensuse.org/issues/911842021-04-15T06:17:20Ztjyrinki_susetjyrinki+redmine@suse.de
<p>After comparing test coverage of SLE 15 SP2 and SP3 in opneQA I identified several tests that are exclusive to either pre-release or post-release testing and could be easily used to increase our coverage just by using what we already have.</p>
<p>It is possible that are some errors and some of the tests from the list are already being used. It is also just my opinion, therefor review from other colleagues is more then welcome.</p>
<p>These are the tests that run only after release and could be used also before the release (QEM -> product QE)</p>
<p>tests/network/autofs_client.pm & tests/network/autofs_server.pm<br>
tests/network/salt_master.pm<br>
tests/network/salt_minion.pm<br>
tests/network/samba/samba_adcli.pm</p>
openQA Tests - action #91178 (Rejected): [kernel-default][qem] Add existing kernel Product QE tes...https://progress.opensuse.org/issues/911782021-04-15T06:14:00Ztjyrinki_susetjyrinki+redmine@suse.de
<p>After comparing test coverage of SLE 15 SP2 and SP3 in opneQA I identified several tests that are exclusive to either pre-release or post-release testing and could be easily used to increase our coverage just by using what we already have.</p>
<p>It is possible that are some errors and some of the tests from the list are already being used. It is also just my opinion, therefor review from other colleagues is more then welcome.</p>
<p>These are the kernel tests that run only before release and could be used also after the release (product QE -> QEM)</p>
<p>tests/kernel/blktests.pm<br>
tests/kernel/kdump.pm<br>
tests/kernel/numa_irqbalance.pm<br>
tests/kernel/pressure_stall_information.pm<br>
tests/kernel/tuned.pm</p>
openQA Infrastructure - action #90275 (Resolved): Replacement openQA OSD aarch64 hardware (was: D...https://progress.opensuse.org/issues/902752021-03-18T10:29:54Ztjyrinki_susetjyrinki+redmine@suse.de
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>We have had a machine from orthos, but we need to renew the lease every now and then or lose it. It would be easier to have a more permanent solution for eg snapshot validations.</p>
<p>openQA tests aarch64 on KVM, this ticket would be about improving the baremetal aarch64 testing. We were not able to test RC1 on baremetal (non-rpi) aarch64 due to lack of access to hardware (eg problems on thunderx10)</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1</strong>: <strong>DONE</strong> Make new arm machines available</li>
<li><strong>AC2</strong>: openqaworker-arm-4 is salted and processing jobs</li>
<li><strong>AC3</strong>: openqaworker-arm-5 is salted and processing jobs</li>
</ul>
openQA Project - action #56789 (New): New needles from git repository not working with openqa-clo...https://progress.opensuse.org/issues/567892019-09-11T08:14:09Ztjyrinki_susetjyrinki+redmine@suse.de
<p>Use case:</p>
<p>To be able to test tests in production (openqa.opensuse.org or openqa.suse.de) before merging the needles and tests themselves, since results have proven to vary on those loaded machines compared to local openQA instance or VM.</p>
<p>It is currently working if there are no new needles involved, but this issue describes the problem with custom needles which would be theoretically supported by openqa-clone-custom-git-refspec but not working in practice.</p>
<p>Problem description:</p>
<p>First of all, documentation [1] says "Path to needles subdirectory to use, defaults to "needles" within PRODUCTDIR. Can be a git repository URL, comparable to CASEDIR", and CASEDIR states "for example <a href="mailto:git@github.com">git@github.com</a>:os-autoinst/os-autoinst-distri-opensuse.git#feature/test".</p>
<p>[1] <a href="https://github.com/os-autoinst/os-autoinst/blob/master/doc/backend_vars.asciidoc" class="external">https://github.com/os-autoinst/os-autoinst/blob/master/doc/backend_vars.asciidoc</a></p>
<p>However,</p>
<pre><code>openqa-clone-custom-git-refspec https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/8332 https://openqa.opensuse.org/tests/xxxxxxxx --apikey=XXX --apisecret=XXX NEEDLES_DIR=git@github.com:tjyrinki/os-autoinst-needles-opensuse.git#poo-12345
</code></pre>
<p>results in:</p>
<pre><code>Could not create directory '/var/lib/empty/.ssh'.
Host key verification failed.
fatal: Could not read from remote repository.
</code></pre>
<p>Using https instead (NEEDLES_DIR=<a href="https://github.com/tjyrinki/os-autoinst-needles-opensuse.git" class="external">https://github.com/tjyrinki/os-autoinst-needles-opensuse.git</a>) gets one further, but openQA complains about wrong needles location:</p>
<pre><code>init needles from /var/lib/openqa/pool/15/os-autoinst-needles-opensuse
Needle /var/lib/openqa/pool/15/os-autoinst-needles-opensuse/ssh-login-ok-20160813.json is not under project directory /var/lib/openqa/cache/xxx at /usr/lib/os-autoinst/needle.pm line 63.
</code></pre>
<p>Oliver Kurz suggested playing around with the PRODUCTDIR to try to workaround the forbidding use of (correctly checked out) needles dir which I did but it didn't get any better with trying to set that to eg pool/... directories, which also changes on every run.</p>