openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842017-12-29T05:11:01ZopenSUSE Project Management Tool
Redmine openQA Tests - action #29862 (Resolved): Update the test file of tracker_by_commandhttps://progress.opensuse.org/issues/298622017-12-29T05:11:01Zqkzhuqkzhu@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-Installer-DVD-x86_64-desktopapps-other@64bit-virtio-vga fails in<br>
<a href="https://openqa.suse.de/tests/1349036/modules/tracker_by_command/steps/11" class="external">tracker_by_command</a></p>
<p>The test file in this case is an empty file however tracker can't index empty file( I will file a bug for this).<br>
We should replace the empty file with a text file.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/1340516" class="external">408.1</a></p>
openQA Tests - action #27502 (Resolved): Upgrade x86_64 workers to QEMU 2.9.* or later for Waylan...https://progress.opensuse.org/issues/275022017-11-08T04:52:20Zqkzhuqkzhu@suse.com
<a name="Reasons"></a>
<h2 >Reasons:<a href="#Reasons" class="wiki-anchor">¶</a></h2>
<p>Currently we are using virtio-gpu (<strong>QEMUVGA=virtio</strong>) for Wayland testing on o.s.d and o3,<br>
but the QEMU version is too old to support save state (rollback to snapshot) of virtio-gpu.</p>
<p>Once one test module is failed it will terminated the whole job:</p>
<ul>
<li><a href="http://10.67.17.30/tests/1984">http://10.67.17.30/tests/1984</a></li>
</ul>
<p>We are preparing to enable all cases under <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/tree/master/tests/x11regressions" class="external">x11regressions</a> <br>
for SLED15, so it is better for the workers to have the ability to rollback to snapshot.</p>
<a name="Solutons"></a>
<h2 >Solutons:<a href="#Solutons" class="wiki-anchor">¶</a></h2>
<p>Previously, the rollback function for virtio-gpu was blocked by <a href="https://bugzilla.suse.com/show_bug.cgi?id=1025025" class="external">bsc#1025025</a>, <br>
however the bug was fixed now and the patch has released to QEMU 2.9.* and 2.10.*.</p>
<p><strong>We could:</strong></p>
<ol>
<li>Update all the x86_64 workers to a higher QEMU version, then revert <a href="https://github.com/os-autoinst/os-autoinst/pull/832/files" class="external">PR##832</a> to bring back
the rollback function for virtio-gpu.</li>
<li>Update some of the x86_64 worker to a higher QEMU version for Wayland testing, then revert
<a href="https://github.com/os-autoinst/os-autoinst/pull/832/files" class="external">PR##832</a></li>
</ol>
<a name="Validation-test"></a>
<h2 >Validation test:<a href="#Validation-test" class="wiki-anchor">¶</a></h2>
<p><strong>Steps:</strong></p>
<ol>
<li>Add the Virtualization repo on my local instance:
- <a href="http://download.opensuse.org/repositories/Virtualization/openSUSE_Leap_42.2/Virtualization.repo">http://download.opensuse.org/repositories/Virtualization/openSUSE_Leap_42.2/Virtualization.repo</a></li>
<li>Update QEMU to 2.10.*,
<code>rpm -qa | grep qemu:</code>
qemu-sgabios-8-398.1.noarch
qemu-tools-2.10.0-398.1.x86_64
qemu-block-rbd-2.10.0-398.1.x86_64
qemu-seabios-1.10.2-398.1.noarch
qemu-kvm-2.10.0-398.1.x86_64
qemu-2.10.0-398.1.x86_64
libvirt-daemon-driver-qemu-3.9.0-680.1.x86_64
qemu-block-ssh-2.10.0-398.1.x86_64
qemu-block-iscsi-2.10.0-398.1.x86_64
libvirt-daemon-qemu-3.9.0-680.1.x86_64
qemu-linux-user-2.10.1-411.2.x86_64
qemu-vgabios-1.10.2-398.1.noarch
qemu-block-curl-2.10.0-398.1.x86_64
qemu-x86-2.10.0-398.1.x86_64
qemu-ovmf-x86_64-2017+git1505340320.5afa5b8159-66.1.noarch
qemu-ksm-2.10.0-398.1.x86_64
qemu-ipxe-1.0.0-398.1.noarch</li>
<li>Uncomment line 183 of /usr/lib/os-autoinst/backend/<a href="https://github.com/os-autoinst/os-autoinst/blob/b9045f43a3c8186db352c7a5de8eea501d861a84/backend/qemu.pm#L183" class="external">qemu.pm</a>
<code>183# return if ($vars->{QEMUVGA} || '') eq 'virtio';</code></li>
</ol>
<p><strong>Results</strong></p>
<p>The worker could load the lastgood snapshot successfully:</p>
<ul>
<li><a href="http://10.67.17.30/tests/1985">http://10.67.17.30/tests/1985</a></li>
</ul>
openQA Tests - action #17270 (Resolved): test fails in sshd, ssh_cleanup, sshxtermhttps://progress.opensuse.org/issues/172702017-02-23T04:45:55Zqkzhuqkzhu@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP3-Desktop-DVD-x86_64-gnome@uefi fails in<br>
<a href="https://openqa.suse.de/tests/788034/modules/sshd/steps/16" class="external">sshd</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/788034" class="external">0124</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/786625" class="external">0123</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?version=12-SP3&arch=x86_64&machine=uefi&test=gnome&distri=sle&flavor=Desktop-DVD" class="external">latest</a></p>
openQA Tests - action #15462 (Closed): we should workaround for bsc#1013208 in consoletest_setup ...https://progress.opensuse.org/issues/154622016-12-13T03:06:17Zqkzhuqkzhu@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP3-Desktop-DVD-x86_64-textmode+proxy_SCC@uefi fails in<br>
<a href="https://openqa.suse.de/tests/665255/modules/consoletest_setup/steps/24" class="external">consoletest_setup</a></p>
<p>The nvidia repo is not ready for SLE12 SP3 since bsc#1013208, we could<br>
skip it by consoletest_setup as workaround.</p>
<p>see also: <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/2206" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/2206</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/629953" class="external">0050</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?flavor=Desktop-DVD&test=textmode%2Bproxy_SCC&machine=uefi&distri=sle&version=12-SP3&arch=x86_64" class="external">latest</a></p>
openQA Tests - action #15374 (Resolved): subroutine java_testing of firefox_java.pm should be upd...https://progress.opensuse.org/issues/153742016-12-08T07:24:10Zqkzhuqkzhu@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP2-Desktop-DVD-Updates-x86_64-qam-regression-firefox@64bit fails in<br>
<a href="https://openqa.suse.de/tests/659762/modules/firefox_java/steps/17" class="external">firefox_java</a></p>
<p>and SP1<br>
<a href="https://openqa.suse.de/tests/659761#step/firefox_java/17" class="external">firefox_java</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/658707" class="external">20161207-3</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/658451" class="external">20161207-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?flavor=Desktop-DVD-Updates&machine=64bit&test=qam-regression-firefox&distri=sle&version=12-SP2&arch=x86_64" class="external">latest</a></p>
openQA Tests - action #14858 (Resolved): shortcut of libreoffice_pyuno_bridge has changedhttps://progress.opensuse.org/issues/148582016-11-17T02:52:27Zqkzhuqkzhu@suse.com
<p>failed at: <a href="https://openqa.suse.de/tests/637594#step/libreoffice_pyuno_bridge/19" class="external">https://openqa.suse.de/tests/637594#step/libreoffice_pyuno_bridge/19</a></p>
<p>'alt-t' for Open Serer Authentication doesn't work, we'd better use assert_and_click</p>
openQA Tests - action #13672 (Resolved): yast2_bootloader fails in migration_offline_sled11_sp4*https://progress.opensuse.org/issues/136722016-09-12T04:29:21Zqkzhuqkzhu@suse.com
<p>yast2_bootloader fails in:<br>
migration_offline_sled11_sp4<br>
migration_offline_sled11_sp4+sdk<br>
migration_offline_sled11_sp4_kde</p>
<p><a href="https://openqa.suse.de/tests/555430#step/yast2_bootloader/5" class="external">https://openqa.suse.de/tests/555430#step/yast2_bootloader/5</a></p>
<p>However it passes in migration_offline_sled11_sp4_allpatterns</p>
openQA Tests - action #13120 (Resolved): SLED "regression": a lot of libreoffice tests are brokenhttps://progress.opensuse.org/issues/131202016-08-10T08:06:21Zqkzhuqkzhu@suse.com
<p>observation</p>
<p><a href="https://openqa.suse.de/tests/510351" class="external">https://openqa.suse.de/tests/510351</a></p>
<p>potentially product issue</p>
openQA Tests - action #13118 (Resolved): SLED "regression": all evolution tests are brokenhttps://progress.opensuse.org/issues/131182016-08-10T08:04:24Zqkzhuqkzhu@suse.com
<p>observation</p>
<p><a href="https://openqa.suse.de/tests/509150" class="external">https://openqa.suse.de/tests/509150</a></p>
<p>potentially product issue</p>
openQA Tests - action #13116 (Closed): SLED "regression":two empathy tests are brokenhttps://progress.opensuse.org/issues/131162016-08-10T08:03:00Zqkzhuqkzhu@suse.com
<p>observation</p>
<p><a href="https://openqa.suse.de/tests/509150" class="external">https://openqa.suse.de/tests/509150</a></p>
<p>potentially product issue</p>
openQA Tests - action #13006 (Resolved): Needles need update for 7 gnote cases and 2 evince cases...https://progress.opensuse.org/issues/130062016-08-04T06:38:52Zqkzhuqkzhu@suse.com
<p>We should update needles for these 9 cases, see:<br>
<a href="https://openqa.suse.de/tests/498608" class="external">https://openqa.suse.de/tests/498608</a></p>
openQA Tests - action #12996 (Resolved): Needles need update for two pidgin cases in x11regressio...https://progress.opensuse.org/issues/129962016-08-03T08:13:16Zqkzhuqkzhu@suse.com
<p>Pidgin_IRC failed at:<a href="https://openqa.suse.de/tests/497688#step/pidgin_IRC/15" class="external">https://openqa.suse.de/tests/497688#step/pidgin_IRC/15</a><br>
Pidgin_aim failed at:<a href="https://openqa.suse.de/tests/497688#step/pidgin_aim/25" class="external">https://openqa.suse.de/tests/497688#step/pidgin_aim/25</a></p>
openQA Tests - action #11324 (Resolved): script or needles need improve for yast2_snapper - migra...https://progress.opensuse.org/issues/113242016-03-25T07:47:01Zqkzhuqkzhu@suse.com
<p>The steps seems different from other scenarios in migration_offline_sled12sp1_sdk</p>
<p><a href="https://openqa.suse.de/tests/323994/modules/yast2_snapper/steps/44" class="external">https://openqa.suse.de/tests/323994/modules/yast2_snapper/steps/44</a></p>
openQA Tests - action #11168 (Resolved): sled textmode test loads yast2_nfs_serverhttps://progress.opensuse.org/issues/111682016-03-10T08:00:33Zqkzhuqkzhu@suse.com
<p>The Desktop product should not load these tests:<br>
yast2_nfs_server<br>
http_srv<br>
mysql_srv<br>
<a href="https://openqa.suse.de/tests/289722/modules/http_srv/steps/1" class="external">https://openqa.suse.de/tests/289722/modules/http_srv/steps/1</a></p>
<p>If we have a wrong main.pm ?</p>
openQA Tests - action #11166 (Resolved): reboot_gnome and shutdown tests failed because they requ...https://progress.opensuse.org/issues/111662016-03-10T07:35:35Zqkzhuqkzhu@suse.com
<p>SLED build 0419 all reboot_gnome and shutdown tests failed:<br>
reboot_gnome:<a href="https://openqa.suse.de/tests/289713/modules/reboot_gnome/steps/6" class="external">https://openqa.suse.de/tests/289713/modules/reboot_gnome/steps/6</a><br>
shutdown:<a href="https://openqa.suse.de/tests/289713/modules/shutdown/steps/1" class="external">https://openqa.suse.de/tests/289713/modules/shutdown/steps/1</a></p>
<p>[eg:in reboot_gnome]I have researched the autoinst-log and the video, found that after 'assert_and_click' the reboot button<br>
openQA should ran wait_boot, but it actually ran assert_screen(mustmatch='reboot-auth', timeout=15)</p>
<p>so all of these tests are failed.</p>