openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842023-01-10T17:29:46ZopenSUSE Project Management Tool
Redmine openQA Tests - action #122935 (Resolved): openqa: fix virtio console for user (user-virtio-terminal)https://progress.opensuse.org/issues/1229352023-01-10T17:29:46Zpvorelpetr.vorel@suse.com
<p>virtio console for user (user-virtio-terminal) was added in <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/14967">https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/14967</a> (<a class="issue tracker-4 status-3 priority-4 priority-default closed" title="action: [qe-core] virtio-terminal is missing for non root users (Resolved)" href="https://progress.opensuse.org/issues/88193">#88193</a>) and then used in various HPC tests: <a href="https://openqa.suse.de/tests/10220175">https://openqa.suse.de/tests/10220175</a> (sle-15-SP5-Online-x86_64-Build64.1-hpc_BETA_mpich_mpi_supportserver@64bit).</p>
<p>But it lack some functionality, thus workarounds needs to be used:</p>
<ul>
<li>user cannot switch from root-virtio-terminal (select_serial_terminal() which calls select_console('root-virtio-terminal')) to user-virtio-terminal (select_user_serial_terminal() which calls select_serial_terminal(0) which calls select_console('user-virtio-terminal')).
Workaround: kill sshd from 'root-console':</li>
</ul>
<pre><code class="text syntaxhl" data-language="text"> type_string('pkill -u root');
select_serial_terminal(0);
</code></pre>
<p>Used on various places:</p>
<ul>
<li><a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/9f84f058d22425bae123734c06a28fa988d5ba06/tests/hpc/mpi_master.pm#L39-L40">https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/9f84f058d22425bae123734c06a28fa988d5ba06/tests/hpc/mpi_master.pm#L39-L40</a></li>
<li><a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/9f84f058d22425bae123734c06a28fa988d5ba06/tests/hpc/mpi_master.pm#L62-L63">https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/9f84f058d22425bae123734c06a28fa988d5ba06/tests/hpc/mpi_master.pm#L62-L63</a></li>
<li><a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/9f84f058d22425bae123734c06a28fa988d5ba06/lib/hpcbase.pm#L354-L355">https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/9f84f058d22425bae123734c06a28fa988d5ba06/lib/hpcbase.pm#L354-L355</a></li>
</ul>
<p>Issue long time ago reported reported by Jozef Pupava.</p>
<ul>
<li>serial prompt change handling is not encapsulated in library
<a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/9f84f058d22425bae123734c06a28fa988d5ba06/lib/sles4sap.pm#L218-L222">https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/9f84f058d22425bae123734c06a28fa988d5ba06/lib/sles4sap.pm#L218-L222</a></li>
</ul>
<pre><code class="text syntaxhl" data-language="text"> # We need to change the 'serial_term_prompt' value for 'wait_serial'
my $serial_term_prompt = "$sapadmin> ";
enter_cmd(qq/PS1="$serial_term_prompt"/);
wait_serial(qr/PS1="$serial_term_prompt"/) if testapi::is_serial_terminal;
$testapi::distri->{serial_term_prompt} = "$serial_term_prompt";
</code></pre>
<p><a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/9f84f058d22425bae123734c06a28fa988d5ba06/lib/sles4sap.pm#L238-L239">https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/9f84f058d22425bae123734c06a28fa988d5ba06/lib/sles4sap.pm#L238-L239</a></p>
<pre><code class="text syntaxhl" data-language="text"> # Reset 'serial_term_prompt' value for 'wait_serial'
$testapi::distri->{serial_term_prompt} = '# ';
</code></pre>
<ul>
<li>output log for extra root console (activated by VIRTIO_CONSOLE_NUM=2) saved output in "Logs & Assets" to virtio_console1.log. It was renamed to serial_terminal_user.txt (unify with serial_terminal.txt), also any *.log file which is saved will be renamed to *.txt </li>
</ul>
<a name="CODE"></a>
<h3 >CODE<a href="#CODE" class="wiki-anchor">¶</a></h3>
<p>I prepared PR in all 3 git repositories:</p>
<ul>
<li><a href="https://github.com/os-autoinst/openQA/pull/4973">https://github.com/os-autoinst/openQA/pull/4973</a></li>
<li><a href="https://github.com/os-autoinst/os-autoinst/pull/2240">https://github.com/os-autoinst/os-autoinst/pull/2240</a></li>
<li><a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/16190">https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/16190</a></li>
</ul>
<p>Although I prepared code for live console also show the output of virtio_console_user.log, it does not work.</p>
<a name="Testing"></a>
<h3 >Testing<a href="#Testing" class="wiki-anchor">¶</a></h3>
<p>What needs special attention:</p>
<ul>
<li><p>HPC tests<br>
reason: use user-virtio-terminal, require tap worker (I don't have), maintainer: Ioannis Bonatakis<br>
e.g. sle-15-SP5-Online-x86_64-Build64.1-hpc_BETA_mpich_mpi_supportserver@64bit<br>
<a href="https://openqa.suse.de/tests/10220175">https://openqa.suse.de/tests/10220175</a></p></li>
<li><p>wicked tests<br>
reason: use VIRTIO_CONSOLE_NUM=2 - the output was renamed from virtio_console1.log to serial_terminal_user.txt, require tap worker (I don't have), maintainer: <a href="mailto:asmorodskyi@suse.de">asmorodskyi@suse.de</a>, <a href="mailto:cfamullaconrad@suse.de">cfamullaconrad@suse.de</a>, <a href="mailto:jalausuch@suse.com">jalausuch@suse.com</a><br>
e.g. wicked_ipv6_sut@64bit <a href="https://openqa.suse.de/tests/10219403">https://openqa.suse.de/tests/10219403</a><br>
wicked_ipv6_ref@64bit <a href="https://openqa.suse.de/tests/10219400">https://openqa.suse.de/tests/10219400</a></p></li>
</ul>
<p>which run also on o3: <a href="https://openqa.opensuse.org/tests/3029126">https://openqa.opensuse.org/tests/3029126</a> <a href="https://openqa.opensuse.org/tests/3029329">https://openqa.opensuse.org/tests/3029329</a></p>
<ul>
<li><p>mru-install-minimal-with-addons<br>
reason: system_prepare.pm uses prepare_serial_console(), which adds one serial console for user-virtio-terminal (this should work quite well), this also check installer</p></li>
<li><p>Sanity check for any LTP test (uses serial terminal)</p></li>
<li><p>Tested on image created by mru-install-minimal-with-addons with virtio tests:<br>
<code>TEST=virtio VIRTIO_CONSOLE=1 VIRTIO_CONSOLE_TEST=1 INSTALL_LTP= LTP_COMMAND_FILE= YAML_SCHEDULE= LTP_EXTRA_CONF_FLAGS= INCIDENT_ID= INCIDENT_REPO= PUBLISH_HDD_1= PUBLISH_PFLASH_VARS=</code><br>
<a href="http://quasar.suse.cz/tests/1742#downloads">http://quasar.suse.cz/tests/1742#downloads</a></p></li>
<li><p>The same problem might be for svirt, which is used for root-serial-ssh and user-serial-ssh (on both: s390x zkvm == qemu, which is on osd) and s390x z/VM, which is on o3), but that will be another effort, now it just needs to be tested if svirt works unaffected now.</p></li>
</ul>
<a name="Deployment"></a>
<h3 >Deployment<a href="#Deployment" class="wiki-anchor">¶</a></h3>
<p>It works altogether, but not sure how to deploy it. Maybe <a href="https://github.com/os-autoinst/openQA/pull/4973">https://github.com/os-autoinst/openQA/pull/4973</a> can be merged separately and deployed. Need to verify if <a href="https://github.com/os-autoinst/os-autoinst/pull/2240">https://github.com/os-autoinst/os-autoinst/pull/2240</a> can be deployed without <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/16190">https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/16190</a>.</p>
openQA Project - action #90347 (New): Support for downloading snapshotshttps://progress.opensuse.org/issues/903472021-03-19T10:54:39Zpvorelpetr.vorel@suse.com
<p>According to rpalethorpe (the author of <a href="https://github.com/os-autoinst/os-autoinst/pull/942" class="external">the big QEMU rewrite</a>, merged as <a href="https://github.com/os-autoinst/os-autoinst/pull/985" class="external">#985</a>) including snapshots inside the qcow2 image is only semi supported (libvirt does not use this feature so it is barely supported). Thus everybody uses overlay files instead. That's why he rolled our own snapshotting solution using backing files/overlays (otherwise doing basic things like reverting to a snapshot uses wierd code nobody supports).</p>
<p>The implementation saves overlay files in <code>vm-snapshots</code> directory (in <code>pool</code> directory) and <code>qemu_state.json</code> describes the snapshots. We need to allow user to download these files. I suggest to introduce new variable <code>SAVE_SNAPSHOTS</code> which would be by default off.</p>
<ul>
<li>document how to use these overlay files
Some more reading about overlays (external snapshots) and internal snapshots (<code>qemu-img</code>):</li>
<li><a href="https://www.linux-kvm.org/images/6/65/02x08B-Max_Reitz-Backups_with_QEMU.pdf" class="external">https://www.linux-kvm.org/images/6/65/02x08B-Max_Reitz-Backups_with_QEMU.pdf</a></li>
<li><a href="https://kashyapc.fedorapeople.org/virt/LinuxCon-NA-2016/A-Practical-Look-at-QEMU-Block-Layer-Primitives-LC-NA-2016.pdf" class="external">https://kashyapc.fedorapeople.org/virt/LinuxCon-NA-2016/A-Practical-Look-at-QEMU-Block-Layer-Primitives-LC-NA-2016.pdf</a></li>
<li><a href="https://libvirt.org/kbase/incrementalbackupinternals.html" class="external">https://libvirt.org/kbase/incrementalbackupinternals.html</a></li>
</ul>
openQA Tests - action #63373 (Resolved): [o3][kernel][scheduler][x86_64] Dependent (child) jobs s...https://progress.opensuse.org/issues/633732020-02-11T07:39:41Zpvorelpetr.vorel@suse.com
<p>LTP tests depend on install_ltp. On o3, child jobs start after finished tests, but that's before parent has uploaded needed dependencies. It just does not wait until <a href="mailto:ltp-cpuhotplug-opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp-qcow2.txt">ltp-cpuhotplug-opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp-qcow2.txt</a> has been uploaded. This file cannot be expressed a dependency in vars.json. But also <a href="mailto:opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp.qcow2">opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp.qcow2</a>, which is HDD_1 for child test (PUBLISH_HDD_1 for parent) has not been uploaded yet. Paret upload needed asset at 22:45:53, but test starts at 22:10:24. Is it a setup problem or a bug in scheduler? Similar setup is on osd, where it looks ok.</p>
<p>install_ltp.1169614.autoinst-log.txt (<a href="https://openqa.opensuse.org/tests/1169614/file/autoinst-log.txt">https://openqa.opensuse.org/tests/1169614/file/autoinst-log.txt</a>)</p>
<pre><code>[2020-02-10T22:40:43.0499 CET] [info] +++ setup notes +++
[2020-02-10T22:40:43.0499 CET] [info] Start time: 2020-02-10 21:40:43
...
[2020-02-10T22:45:52.0451 CET] [info] Isotovideo exit status: 0
[2020-02-10T22:45:52.0478 CET] [info] +++ worker notes +++
[2020-02-10T22:45:52.0478 CET] [info] End time: 2020-02-10 21:45:52
...
[2020-02-10T22:45:53.0303 CET] [info] Uploading ltp-cpuhotplug-opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp-qcow2.txt
...
[2020-02-10T22:46:01.0131 CET] [info] Uploading opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp.qcow2
</code></pre>
<p>install_ltp.1169614.worker-log.txt (<a href="https://openqa.opensuse.org/tests/1169614/file/worker-log.txt">https://openqa.opensuse.org/tests/1169614/file/worker-log.txt</a>)</p>
<pre><code>[2020-02-10T22:45:53.0303 CET] [info] Uploading ltp-cpuhotplug-opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp-qcow2.txt
[2020-02-10T22:45:53.0303 CET] [info] Uploading ltp-cpuhotplug-opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp-qcow2.txt using multiple chunks
[2020-02-10T22:45:53.0304 CET] [info] ltp-cpuhotplug-opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp-qcow2.txt: 1 chunks
[2020-02-10T22:45:53.0304 CET] [info] ltp-cpuhotplug-opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp-qcow2.txt: chunks of 1000000 bytes each
[2020-02-10T22:45:53.0383 CET] [info] ltp-cpuhotplug-opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp-qcow2.txt: Processing chunk 1/1 avg speed ~0.336KB/s
...
[2020-02-10T22:48:23.0775 CET] [info] opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp.qcow2: Processing chunk 1128/1128 avg speed ~342.062KB/s
</code></pre>
<p>ltp_cpuhotplug.1169623.autoinst-log.txt (<a href="https://openqa.opensuse.org/tests/1169623/file/autoinst-log.txt">https://openqa.opensuse.org/tests/1169623/file/autoinst-log.txt</a>)</p>
<pre><code>[2020-02-10T22:10:24.0956 UTC] [info] Start time: 2020-02-10 22:10:24
...
[2020-02-10T22:10:35.0098 UTC] [debug] Found ISO, caching openSUSE-Tumbleweed-DVD-x86_64-Snapshot20200209-Media.iso
[2020-02-10T22:10:35.0102 UTC] [info] Downloading openSUSE-Tumbleweed-DVD-x86_64-Snapshot20200209-Media.iso, request #27 sent to Cache Service
[2020-02-10T22:10:45.0203 UTC] [info] Download of openSUSE-Tumbleweed-DVD-x86_64-Snapshot20200209-Media.iso processed:
[info] [#27] Cache size of "/var/lib/openqa/cache" is 12GiB, with limit 50GiB
[info] [#27] Downloading "openSUSE-Tumbleweed-DVD-x86_64-Snapshot20200209-Media.iso" from "http://openqa1-opensuse/tests/1169623/asset/iso/openSUSE-Tumbleweed-DVD-x86_64-Snapshot20200209-Media.iso"
...
[2020-02-10T22:10:50.896 UTC] [debug] scheduling boot_ltp tests/kernel/boot_ltp.pm
Can not open runtest asset /var/lib/openqa/share/factory/other/ltp-cpuhotplug-opensuse-Tumbleweed-x86_64-20200209-DVD@64bit-with-ltp-qcow2.txt: No such file or directory at /var/lib/openqa/cache/openqa1-opensuse/tests/opensuse/lib/main_ltp.pm line 64.
Compilation failed in require at /usr/bin/isotovideo line 288.
[2020-02-10T22:10:50.896 UTC] [debug] terminating command server 4156 because test execution ended through exception
[2020-02-10T22:10:51.897 UTC] [debug] done with command server
4153: EXIT 1
</code></pre>
<p>ltp_cpuhotplug.1169623.worker-log.txt (<a href="https://openqa.opensuse.org/tests/1169623/file/worker-log.txt">https://openqa.opensuse.org/tests/1169623/file/worker-log.txt</a>)</p>
<pre><code>[2020-02-10T22:10:50.0261 UTC] [info] Preparing cgroup to start isotovideo
</code></pre> openQA Tests - action #61895 (Resolved): [kernel][ltp][grub][s390x] Implement solution for handli...https://progress.opensuse.org/issues/618952020-01-08T09:45:02Zpvorelpetr.vorel@suse.com
<p>PR <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9217" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9217</a> (and it's enhancement <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9252" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9252</a>) needs to be implemented also for s390x on svirt (S390_ZKVM).</p>
<p>NOTE: s390x on s390x backend is not planned to be implemented in this effort (see TODO in handle_grub_zvm()).</p>
openQA Tests - coordination #61203 (Resolved): [kernel][ltp][epic][grub] General solution for han...https://progress.opensuse.org/issues/612032019-12-19T15:16:08Zpvorelpetr.vorel@suse.com
<p>We should decide which kernel params are needed and adapt our solution for it.</p>
<p>we had <br>
1) general parameters in grub (for all tests, added via add_grub_cmdline_settings() into GRUB_CMDLINE_LINUX_DEFAULT grub variable in /etc/default/grub) <br>
2) and ima_policy=tcb added via GRUB_PARAM openqa test variable and add_custom_grub_entries() as separate boot option in grub.</p>
<p>Recently we added debug_pagealloc=on among general parameters<br>
<a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/commit/ba40311d3219f511408bd86a271044e08e574801" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse/commit/ba40311d3219f511408bd86a271044e08e574801</a><br>
(as <a href="https://jira.suse.com/browse/SLE-9743" class="external">https://jira.suse.com/browse/SLE-9743</a>; + some options are needed due <a href="https://jira.suse.com/browse/SLE-9505" class="external">https://jira.suse.com/browse/SLE-9505</a>)<br>
which found a problems with it in some QAM (ppc64le), QA (s390) and Tumbleweed tests (ppc64le)<br>
<a href="https://bugzilla.suse.com/show_bug.cgi?id=1159455" class="external">https://bugzilla.suse.com/show_bug.cgi?id=1159455</a><br>
<a href="https://bugzilla.suse.com/show_bug.cgi?id=1159096" class="external">https://bugzilla.suse.com/show_bug.cgi?id=1159096</a></p>
<p>While there is PR to temporarily revert debug_pagealloc=on<br>
<a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9206" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9206</a><br>
we should decide what params we need and how to achieve it.</p>
<p>If we need more parameters, we can achieve it via either<br>
1) type some params (editing grub config before boot, solution we have never used for LTP)<br>
2) or extend add_custom_grub_entries() to support more special entries than just one<br>
3) or drop IMA parameter and reuse GRUB_PARAM for something else <br>
4) or generate yet another LTP image with different parameters (waste of disc space)</p>
openQA Tests - action #60245 (Resolved): [kernel][aarch64] Change NIC name between openQA jobs le...https://progress.opensuse.org/issues/602452019-11-25T15:44:42Zpvorelpetr.vorel@suse.com
<p>There is NIC rename between openQA jobs. create_hdd_minimal_base+sdk [1] see eth0, so it creates config /etc/sysconfig/network/ifcfg-eth0. But some jobs (at least install_ltp on aarch64 [2] and maybe iscsi_ibft on intel [3]), which use this qcow2 image have eth1, so it fails due NIC not configured.</p>
<p>Workaround for this issue is to move LTP networks specific config [5] to some common place.</p>
<p>High priority as it breaks SLE15-SP2 testing on aarch64.</p>
<p>NOTE: previously it looked as yast bug (see <a href="https://bugzilla.suse.com/1157896" class="external">https://bugzilla.suse.com/1157896</a>)<br>
NOTE: it looked wicked tests are also affected [4], but according to different tags at history it probably not.</p>
<p>[1] <a href="https://openqa.suse.de/tests/3658114" class="external">https://openqa.suse.de/tests/3658114</a><br>
[2] <a href="https://openqa.suse.de/tests/3661934" class="external">https://openqa.suse.de/tests/3661934</a><br>
[3] <a href="https://openqa.suse.de/tests/3662282#step/hostname/10" class="external">https://openqa.suse.de/tests/3662282#step/hostname/10</a><br>
[4] <a href="https://openqa.suse.de/tests/3625067#step/wicked/3" class="external">https://openqa.suse.de/tests/3625067#step/wicked/3</a><br>
[5] <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/master/tests/kernel/boot_ltp.pm#L108" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/master/tests/kernel/boot_ltp.pm#L108</a></p>
openQA Project - action #57419 (Resolved): Display time spent on particular modulehttps://progress.opensuse.org/issues/574192019-09-26T10:26:09Zpvorelpetr.vorel@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>openQA displays a time spent on whole tests. It would be useful to have the information about the time spent on each test module.</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1:</strong> Elapsed time per test module is visible in the job details webUI page</li>
<li><strong>AC2:</strong> Same as <em>AC1</em> for API</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<p>We already have the information available in the scope of os-autoinst, e.g. as visible from autoinst-log.txt . We should make the information available to openQA in a structured manner and render it accordingly over API and webUI.</p>
<ul>
<li>Put elapsed time into module test result, e.g. existing json file in os-autoinst scope</li>
<li>When parsing module results also read out the elapsed time</li>
<li>Provide the elapsed time when job details are requested over API</li>
<li>Provide the elapsed time in the job details webUI page</li>
</ul>
openQA Project - action #57335 (Workable): [ui][ux][easy][beginner] Allow builds to be sorted by ...https://progress.opensuse.org/issues/573352019-09-25T09:07:11Zpvorelpetr.vorel@suse.com
<p><a href="https://openqa.suse.de/group_overview/158" class="external">https://openqa.suse.de/group_overview/158</a></p>
<p>Build0330 (4 days ago) # this one is not sorted, it should be below Build0331<br>
Build0333 (about 2 hours ago)<br>
Build0331 (a day ago)<br>
Build38.6 (6 days ago)<br>
Build38.5 (7 days ago)<br>
Build38.1 (8 days ago)<br>
Build0322 (8 days ago)<br>
Build36.1 (9 days ago)<br>
Build0319 (12 days ago)<br>
Build32.1 (20 days ago)</p>
<p>Or see attached screenshot.</p>
<p>NOTE: we need to use non-default "Sort by time job most recently created" as we have both SLE12 SP5 and SLE15 SP2 in this build (SLE12 SP5 is then listed behind SLE15 SP1 therefore is kind of hidden).</p>
openQA Tests - action #55985 (New): [svirt][serial][xen] Enable svirt serial console for XENhttps://progress.opensuse.org/issues/559852019-08-27T07:50:08Zpvorelpetr.vorel@suse.com
<p>Svirt serial console has been enabled only for s390x, used mainly for LTP tests.<br>
It'd be good to enable it for other archs, let's start with XEN as it was requested.<br>
See PR, which needs debugging and finding valid libvirt code part<br>
<a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/8191" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/8191</a></p>
<p>Fixes for original implementation for s390x (<a class="issue tracker-4 status-3 priority-4 priority-default closed" title="action: [s390x][svirt][ltp] Fix serial terminal console implementation for svirt backend and use it's output (Resolved)" href="https://progress.opensuse.org/issues/45863">#45863</a>)<br>
<a href="https://github.com/os-autoinst/os-autoinst/pull/1109" class="external">https://github.com/os-autoinst/os-autoinst/pull/1109</a></p>
<p>Some related PR to understand the code a bit<br>
<a href="https://github.com/os-autoinst/os-autoinst/pull/1176" class="external">https://github.com/os-autoinst/os-autoinst/pull/1176</a><br>
<a href="https://github.com/os-autoinst/os-autoinst/pull/1166" class="external">https://github.com/os-autoinst/os-autoinst/pull/1166</a><br>
<a href="https://github.com/os-autoinst/os-autoinst/pull/1154" class="external">https://github.com/os-autoinst/os-autoinst/pull/1154</a> (logging xml file in autoinst-log.txt)</p>
<p>NOTE: it's not working on Hyper-V and VMware either.</p>
openQA Tests - action #54260 (Rejected): [kernel][s390x] Occasional failures due timeouthttps://progress.opensuse.org/issues/542602019-07-15T10:06:31Zpvorelpetr.vorel@suse.com
<p>s390x sometimes dies during a test and we have no idea what is happening<br>
(no matter <a href="https://bugzilla.suse.com/show_bug.cgi?id=1140948" class="external">https://bugzilla.suse.com/show_bug.cgi?id=1140948</a> has been fixed and it's probably not caused by <a href="https://bugzilla.suse.com/show_bug.cgi?id=1136513" class="external">https://bugzilla.suse.com/show_bug.cgi?id=1136513</a> either).</p>
<p>It can be anything between openqa, ssh, kernel.</p>
<p>Here it looks like a timeout, but why?<br>
<a href="https://openqa.suse.de/tests/3055032#step/sem_unlink_2-2/7" class="external">https://openqa.suse.de/tests/3055032#step/sem_unlink_2-2/7</a></p>
<p>I'm going to test it on VM just with LTP (that's what I've done and nothing found on previous builds) and with my openQA instance (haven't tried yet).<br>
For both I'm going to use s390zp13.suse.de.</p>
<p>Problematic tests:</p>
<ul>
<li>ltp_syscalls (<a href="https://openqa.suse.de/tests/3054999#step/prot_hsymlinks/7" class="external">https://openqa.suse.de/tests/3054999#step/prot_hsymlinks/7</a>)</li>
<li>ltp_controllers (<a href="https://openqa.suse.de/tests/3055029#step/cgroup_fj_stress_cpu_2_9_each/1" class="external">https://openqa.suse.de/tests/3055029#step/cgroup_fj_stress_cpu_2_9_each/1</a>)</li>
<li>ltp_openposix (<a href="https://openqa.suse.de/tests/3055032#step/sem_unlink_2-2/6" class="external">https://openqa.suse.de/tests/3055032#step/sem_unlink_2-2/6</a>)</li>
<li>ltp_cve, kotd_ltp_cve (<a href="https://openqa.suse.de/tests/3168071#step/cve-2011-2183/7" class="external">https://openqa.suse.de/tests/3168071#step/cve-2011-2183/7</a>, <a href="https://openqa.suse.de/tests/3168079#step/cve-2011-2183/7" class="external">https://openqa.suse.de/tests/3168079#step/cve-2011-2183/7</a>)</li>
<li>install_ltp (found as problematic in the past, when serial console enabled, now working when disabled serial console with SERIAL_CONSOLE=0)</li>
</ul>
openQA Tests - action #54191 (Resolved): [kernel][ltp][ppc64le] mkswap01_sh sometimes fails on pp...https://progress.opensuse.org/issues/541912019-07-12T13:25:56Zpvorelpetr.vorel@suse.com
<p>mkswap01_sh test (mkswap01.sh script) sometimes fails on ppc64le on both SLE12 and SLE15 on timeout.</p>
<p><a href="https://openqa.suse.de/tests/3044443#step/mkswap01_sh/7" class="external">https://openqa.suse.de/tests/3044443#step/mkswap01_sh/7</a><br>
<a href="https://openqa.suse.de/tests/3037297#step/mkswap01_sh/7" class="external">https://openqa.suse.de/tests/3037297#step/mkswap01_sh/7</a><br>
<a href="https://openqa.suse.de/tests/2922520#step/mkswap01_sh/7" class="external">https://openqa.suse.de/tests/2922520#step/mkswap01_sh/7</a></p>
<p>mkswap01 8 TBROK: "check_for_file /dev/disk/by-uuid/cd2f0192-bb94-4907-ac3f-f099baede452" timed out</p>
<p>Manual testing on arm machine (don't have ppc atm) showed that timeout is close to achieve in TST_RETRY_FN_EXP_BACKOFF.<br>
IMHO this function should use LTP_TIMEOUT_MUL as other library functions which have timeout.</p>
<p>NOTE: for arm bug has been reported before, but that's for older version of code<br>
<a href="https://bugzilla.suse.com/show_bug.cgi?id=1073300" class="external">https://bugzilla.suse.com/show_bug.cgi?id=1073300</a><br>
<a href="https://bugzilla.suse.com/show_bug.cgi?id=1034157" class="external">https://bugzilla.suse.com/show_bug.cgi?id=1034157</a></p>
<p>It's a question whether timeout does not indicate some hidden bug (but it'd be then also for arm).</p>
openQA Tests - action #51743 (Resolved): [openqa] All LTP tests are failing on boot_ltp for openS...https://progress.opensuse.org/issues/517432019-05-21T12:37:33Zpvorelpetr.vorel@suse.com
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since on SLE12 SP5 and openSUSE</p>
<ul>
<li><a href="https://openqa.opensuse.org/tests/overview?distri=opensuse&version=Tumbleweed&build=20190516&groupid=32" class="external">Build 20190516</a> (openSUSE)</li>
</ul>
<p>install_ltp tests are running, than it does not see qcow2 image thus does not see GRUB and tries to boot from PXE<br>
<a href="https://openqa.opensuse.org/tests/936921#step/boot_ltp/2" class="external">https://openqa.opensuse.org/tests/936921#step/boot_ltp/2</a><br>
Other archs than x86_64 tests are ok:<br>
<a href="https://openqa.opensuse.org/tests/936570#step/boot_ltp/1" class="external">https://openqa.opensuse.org/tests/936570#step/boot_ltp/1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good:</p>
<ul>
<li><a href="https://openqa.opensuse.org/tests/overview?distri=opensuse&version=Tumbleweed&build=20190514&groupid=32" class="external">Build 20190514</a> (openSUSE)</li>
</ul>
<a name="Hint"></a>
<h2 >Hint<a href="#Hint" class="wiki-anchor">¶</a></h2>
<p>Qemu complains "Unknown host!"</p>
<pre><code>[2019-05-17T14:10:26.428 UTC] [debug] QEMU: QEMU emulator version 2.9.1(openSUSE Leap 42.3)
[2019-05-17T14:10:26.428 UTC] [debug] QEMU: Copyright (c) 2003-2017 Fabrice Bellard and the QEMU Project developers
[2019-05-17T14:10:26.428 UTC] [debug] QEMU: Unknown host!
[2019-05-17T14:10:26.428 UTC] [debug] QEMU: Unknown host!
[2019-05-17T14:10:26.428 UTC] [debug] QEMU: Unknown host!
[2019-05-17T14:10:26.428 UTC] [debug] QEMU: Unknown host!
[2019-05-17T14:10:26.428 UTC] [debug] QEMU: Unknown host!
</code></pre>
<p>NOTE: it cannot be reproduced outside of o3 (on osd or private worker).</p>
openQA Tests - action #50945 (Resolved): [tools][svirt] Svirt serial backend gets stalled by new ...https://progress.opensuse.org/issues/509452019-04-30T11:55:05Zpvorelpetr.vorel@suse.com
<p>Svirt serial backend gets stalled by new lines in command passed to script_run.</p>
<p>Workaround is to replace new line in code by new line character, see this diff<br>
from <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/6841" class="external">PR#6841</a> found when working on <a class="issue tracker-4 status-3 priority-4 priority-default closed" title="action: [s390x][svirt][ltp] Fix serial terminal console implementation for svirt backend and use it's output (Resolved)" href="https://progress.opensuse.org/issues/45863">#45863</a>, but that's not a solution.</p>
<p>------------------------- tests/kernel/install_ltp.pm -------------------------<br>
index c3dc476d8..de108b4cf 100644<br>
@@ -227,19 +227,9 @@ sub install_from_repo {<br>
sub setup_network {<br>
my $content;</p>
<ul>
<li> $content = <<EOF;
-# ltp specific setup
-pts/1
-pts/2
-pts/3
-pts/4
-pts/5
-pts/6
-pts/7
-pts/8
-pts/9
-EOF</li>
<li> assert_script_run("echo \"$content\" >> '/etc/securetty'");</li>
<li> # pts in /etc/securetty</li>
<li> $content = '# ltp specific setup\npts/1\npts/2\npts/3\npts/4\npts/5\npts/6\npts/7\npts/8\npts/9\n';</li>
<li> assert_script_run("printf \"$content\" >> /etc/securetty");</li>
</ul>
openQA Project - action #50729 (Rejected): [webui] Broken filtering with "Show only failures" in ...https://progress.opensuse.org/issues/507292019-04-25T07:58:00Zpvorelpetr.vorel@suse.com
<p>LTP test <a href="https://openqa.suse.de/tests/2823096#step/ADSP079/8" class="external">https://openqa.suse.de/tests/2823096#step/ADSP079/8</a> failed with</p>
<pre><code>Test died: Timed out waiting for LTP test case which may still be running or the OS may have crashed! at /var/lib/openqa/cache/openqa.suse.de/tests/sle/tests/kernel/run_ltp.pm line 316.
</code></pre>
<p>But it's not shown in External results tab when filtering with "Show only failures.<br>
Not sure if this is a problem of openQA search or test was not marked correctly by LTP module.</p>
openQA Project - action #50720 (Resolved): [tools][functional] Show icon for search in test suite...https://progress.opensuse.org/issues/507202019-04-25T07:40:55Zpvorelpetr.vorel@suse.com
<p>Searching in <a href="https://openqa.opensuse.org/admin/test_suites" class="external">test suites</a> takes long time. Therefore it'd be nice to show icon "search in progress".</p>