openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842018-02-09T15:55:33ZopenSUSE Project Management Tool
Redmine openQA Tests - action #31600 (Resolved): [qam]test fails in firefox_html5https://progress.opensuse.org/issues/316002018-02-09T15:55:33Zdasantiagodasantiago@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>Please use internal websites for testing, so a change in layout doesn't break things.<br>
There's <a href="https://html5test.opensuse.org/" class="external">https://html5test.opensuse.org/</a> for html5 test ;-)</p>
<p>openQA test in scenario sle-12-SP3-Desktop-DVD-Updates-x86_64-qam-regression-firefox@64bit fails in<br>
<a href="https://openqa.suse.de/tests/1462089/modules/firefox_html5/steps/22" class="external">firefox_html5</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/1456777" class="external">20180208-2</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/1456415" class="external">20180208-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?version=12-SP3&distri=sle&machine=64bit&test=qam-regression-firefox&flavor=Desktop-DVD-Updates&arch=x86_64" class="external">latest</a></p>
openQA Tests - action #31594 (Resolved): [QAM] test fails in runchttps://progress.opensuse.org/issues/315942018-02-09T15:36:32Zdasantiagodasantiago@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>This test is failing, according to some quick analysis, because the parent have the set the SCC_ADDONS wrong. It should be only ltss.</p>
<p>openQA test in scenario sle-12-SP1-Server-DVD-Updates-x86_64-mau-extratests@64bit fails in<br>
<a href="https://openqa.suse.de/tests/1460957/modules/runc/steps/18" class="external">runc</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/1384740" class="external">20180113-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/1379939" class="external">20180112-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?distri=sle&version=12-SP1&machine=64bit&flavor=Server-DVD-Updates&test=mau-extratests&arch=x86_64" class="external">latest</a></p>
openQA Tests - action #28720 (Resolved): [QAM] Increase timeouts in big downloadshttps://progress.opensuse.org/issues/287202017-12-01T12:41:40Zdasantiagodasantiago@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP3-Server-DVD-Incidents-x86_64-mau-extratests@64bit fails in<br>
<a href="https://openqa.suse.de/tests/1271561/modules/kdump_and_crash/steps/12" class="external">kdump_and_crash</a></p>
<p>This test failed, because the timeout was reached, while it was still downloading. Please increase the timeouts and take into consideration that sometimes the dowload speed is very slow.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/1201049" class="external">:5815:smt.1507555423</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?distri=sle&version=12-SP3&machine=64bit&arch=x86_64&test=mau-extratests&flavor=Server-DVD-Incidents" class="external">latest</a></p>
openQA Tests - action #28627 (Resolved): [QAM] test fails in apache_sslhttps://progress.opensuse.org/issues/286272017-11-30T09:48:05Zdasantiagodasantiago@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP1-Server-DVD-Updates-x86_64-qam-textmode@64bit fails in<br>
<a href="https://openqa.suse.de/tests/1281163/modules/apache_ssl/steps/14" class="external">apache_ssl</a></p>
<p>Starting today, all the apache_ssl tests are failing.</p>
<p>By comparing the output of a successfull command:</p>
<p>A failing one:</p>
<blockquote>
<p>$ gensslcert -n $(hostname) -e webmaster@$(hostname):<br>
hostname: Name or service no known<br>
comment mod_ssl server certificate<br>
name<br>
C XY<br>
ST unknown<br>
L unknown<br>
U web server<br>
O SUSE Linux Web Server<br>
CN susetest<br>
email webmaster@susetest<br>
srvdays 730<br>
CAdays 2190</p>
</blockquote>
<p>An old and successfull one:</p>
<blockquote>
<p>$ gensslcert -n $(hostname) -e webmaster@$(hostname):<br>
hostname: Name or service no known<br>
comment mod_ssl server certificate<br>
name susetest-<br>
C XY<br>
ST unknown<br>
L unknown<br>
U web server<br>
O SUSE Linux Web Server<br>
CN susetest<br>
email webmaster@susetest<br>
srvdays 730<br>
CAdays 2190</p>
</blockquote>
<p>It seems that the variable name isn't being set. This will then create the certicates as "/etc/apache2/ssl.crt/ca.crt" while we are looking for "/etc/apache2/ssl.crt/-ca.crt". To overcome this we need the -C parameter.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/1279615" class="external">20171129-2</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/1277328" class="external">20171129-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?distri=sle&version=12-SP1&machine=64bit&flavor=Server-DVD-Updates&arch=x86_64&test=qam-textmode" class="external">latest</a></p>
openQA Project - action #27112 (Resolved): [tools] os-autoinst with proper logging systemhttps://progress.opensuse.org/issues/271122017-10-30T10:30:35Zdasantiagodasantiago@suse.com
<p>The os-autoinst logging system should use a proper logger. In order to harmonize across the application the logging system, we should use Mojo::Log. Example:</p>
<p>From:</p>
<blockquote>
<p>open($logfd, ">", result_dir . "/autoinst-log.txt");</p>
</blockquote>
<p>To:</p>
<blockquote>
<p>Mojo::Log->new(handle => catfile($result_dir, 'autoinst-log.txt'), level => "debug");</p>
</blockquote>
openQA Project - action #23404 (Resolved): Serial output gets losthttps://progress.opensuse.org/issues/234042017-08-16T12:46:54Zdasantiagodasantiago@suse.com
<p>Sometimes the serial output gets lost. </p>
<p>This doesn't happen constantly.</p>
<p>Example:</p>
<p><code>COMMAND ; echo 123123-$?- > /dev/ttyS0</code></p>
<p>and the test will fail with:</p>
<pre><code># wait_serial expected: qr/(?^:123123-\d+-)/
# Result:
</code></pre>
<p>even when the <em>COMMAND</em> was executed without any issues. There's no entry in the serial0.txt file.</p>
<p>For now only i noticed in x86_64.</p>
<p>This happened in the test: <a href="https://openqa.suse.de/tests/1114687#step/piglit/14" class="external">https://openqa.suse.de/tests/1114687#step/piglit/14</a></p>
openQA Tests - action #23376 (Resolved): [functional][y] Improve variable documentationhttps://progress.opensuse.org/issues/233762017-08-15T12:05:41Zdasantiagodasantiago@suse.com
<p>There are a lot of variables that control the workflow. Unfortunately they aren't documented. To make things worse, there are a lot of variables with very similar names. For example: SCC_ADDONS, ADDONS, ADDONURL, ADDONURL_SDK</p>
<p>Let's document them.</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ol>
<li>At least following variables are described:
SCC_ADDONS, ADDONS, ADDONURL, ADDONURL_*, DESKTOP, VIDEOMODE, TEXTMODE, AUTOYAST, AUTOYAST_VERIFY</li>
</ol>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<p>As these variables are relevant to our test distri: <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse</a> we should define them there. </p>
<p>openQA variables are already well described here: <a href="https://github.com/os-autoinst/os-autoinst/blob/master/doc/backend_vars.asciidoc" class="external">https://github.com/os-autoinst/os-autoinst/blob/master/doc/backend_vars.asciidoc</a></p>
openQA Tests - action #23330 (Resolved): [qam]test fails in firefox because of http usage instead...https://progress.opensuse.org/issues/233302017-08-11T12:28:47Zdasantiagodasantiago@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>The needle is looking for "HTTPS" while the test is using "HTTP"</p>
<p>openQA test in scenario sle-12-SP1-Server-DVD-Incidents-x86_64-qam-gnome@64bit fails in<br>
<a href="https://openqa.suse.de/tests/1095533/modules/firefox/steps/12" class="external">firefox</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/1090200" class="external">:5309:xfsprogs.1501758672</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/1083833" class="external">:5300:kernel-source.1501437506</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?test=qam-gnome&distri=sle&arch=x86_64&version=12-SP1&machine=64bit&flavor=Server-DVD-Incidents" class="external">latest</a></p>
openQA Tests - action #23326 (Resolved): [sle][qam]test fails in addon_products_slehttps://progress.opensuse.org/issues/233262017-08-11T10:12:34Zdasantiagodasantiago@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>On SP3 looks like the font is bit different. the "SDK" word is different from SP2.</p>
<p>openQA test in scenario sle-12-SP3-Server-DVD-Updates-x86_64-create_hdd_minimal_base+sdk@64bit fails in<br>
<a href="https://openqa.suse.de/tests/1103394/modules/addon_products_sle/steps/27" class="external">addon_products_sle</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/1100129" class="external">20170809-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/1099384" class="external">20170808-2</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?test=create_hdd_minimal_base%2Bsdk&distri=sle&arch=x86_64&flavor=Server-DVD-Updates&machine=64bit&version=12-SP3" class="external">latest</a></p>
openQA Project - action #21818 (Resolved): Two workers can work on the same job at a timehttps://progress.opensuse.org/issues/218182017-08-07T16:18:59Zdasantiagodasantiago@suse.com
<p>The web interface is showing wrong image for an assert screen:</p>
<p><a href="https://openqa.suse.de/tests/1096055#step/shotwell_edit/20" class="external">https://openqa.suse.de/tests/1096055#step/shotwell_edit/20</a></p>
<p>If we look into the video, it looks like that the match was done correctly, however in the webinterface it shows the needle comparison against a wrong screen.</p>
<p>Please check the job above, for more info.</p>
openQA Tests - action #20156 (Resolved): [qam] - test fails in snapper_cleanuphttps://progress.opensuse.org/issues/201562017-06-29T14:58:55Zdasantiagodasantiago@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>The snapper_cleanup command fails because the partition runs out of free space.</p>
<p>openQA test in scenario sle-12-SP2-Server-DVD-Updates-x86_64-mau-filesystem@64bit fails in<br>
<a href="https://openqa.suse.de/tests/1032367/modules/snapper_cleanup/steps/126" class="external">snapper_cleanup</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/1032367" class="external">20170629-3</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/1031126" class="external">20170629-2</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?machine=64bit&arch=x86_64&test=mau-filesystem&flavor=Server-DVD-Updates&version=12-SP2&distri=sle" class="external">latest</a></p>
openQA Tests - action #19782 (Resolved): [qam] select_console('root-console') is failinghttps://progress.opensuse.org/issues/197822017-06-13T09:13:17Zdasantiagodasantiago@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>All the tests that contain the following code:<br>
<code><br>
select_console('root-console');<br>
</code></p>
<p>are failing.</p>
<p>Examples of failing tests:<br>
<a href="https://openqa.suse.de/tests/997964/modules/install_all_from_repository/steps/1/src" class="external">https://openqa.suse.de/tests/997964/modules/install_all_from_repository/steps/1/src</a><br>
<a href="https://openqa.suse.de/tests/997965/modules/conman/steps/1/src" class="external">https://openqa.suse.de/tests/997965/modules/conman/steps/1/src</a><br>
<a href="https://openqa.suse.de/tests/997955/modules/piglit/steps/1/src" class="external">https://openqa.suse.de/tests/997955/modules/piglit/steps/1/src</a><br>
Those tests are failing on the first step</p>
<p>openQA test in scenario sle-12-SP2-Desktop-DVD-Updates-x86_64-qam-regression-piglit@64bit fails in<br>
<a href="https://openqa.suse.de/tests/997955/modules/piglit/steps/2" class="external">piglit</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/994928" class="external">20170612-5</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/994827" class="external">20170612-2</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?machine=64bit&test=qam-regression-piglit&version=12-SP2&distri=sle&arch=x86_64&flavor=Desktop-DVD-Updates" class="external">latest</a></p>
openQA Tests - action #19372 (Resolved): Wireshark needles need to be updatedhttps://progress.opensuse.org/issues/193722017-05-25T12:20:13Zdasantiagodasantiago@suse.com
<p>The wireshark needles need to be updated.</p>
<p>THey are causing soft failures like:<br>
<a href="https://openqa.suse.de/tests/954551#step/wireshark/49" class="external">https://openqa.suse.de/tests/954551#step/wireshark/49</a></p>
openQA Tests - action #18926 (Resolved): test fails in patch_and_reboot - Wrong zypper commandhttps://progress.opensuse.org/issues/189262017-05-03T09:12:08Zdasantiagodasantiago@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP2-Server-DVD-Updates-x86_64-mau-qa_kernel_memeat@64bit fails in<br>
<a href="https://openqa.suse.de/tests/913155/modules/patch_and_reboot/steps/50" class="external">patch_and_reboot</a></p>
<p>The zypper command is wrong which makes the test to fail.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/913155" class="external">20170503-2</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/911868" class="external">20170503-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?test=mau-qa_kernel_memeat&version=12-SP2&machine=64bit&distri=sle&arch=x86_64&flavor=Server-DVD-Updates" class="external">latest</a></p>
openQA Tests - action #18902 (Resolved): [qam]test fails in firefox_pdf - Timeout too lowhttps://progress.opensuse.org/issues/189022017-05-02T15:29:21Zdasantiagodasantiago@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP1-Desktop-DVD-Updates-x86_64-qam-regression-firefox@64bit fails in<br>
<a href="https://openqa.suse.de/tests/911123/modules/firefox_pdf/steps/7" class="external">firefox_pdf</a></p>
<p>The timeout should be increased from 90seconds to 120s or even more: <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/master/lib/x11regressiontest.pm#L462" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/master/lib/x11regressiontest.pm#L462</a></p>
<p>This issue, doesn't happen always, but it seems to happen constantly.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/911020" class="external">20170502-3</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/910949" class="external">20170502-2</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?flavor=Desktop-DVD-Updates&machine=64bit&arch=x86_64&distri=sle&test=qam-regression-firefox&version=12-SP1" class="external">latest</a></p>