openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842022-03-01T11:13:54ZopenSUSE Project Management Tool
Redmine openQA Tests - action #107734 (New): [qe-core] Add iceWM tests to SLE >=15.2https://progress.opensuse.org/issues/1077342022-03-01T11:13:54Zslemkeslemke@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>Please also run this test on the following products:<br>
SLE15.2<br>
SLE15.3<br>
and all subsequent products.</p>
<p>The reason is, recently a problem that was caused by a Maintenance update was caught on OpenSUSE but not on SUSE, after some investigation we found out that on the SLE side we where not running the iceWM tests: <a href="https://openqa.opensuse.org/tests/2166536#step/shutdown/22" class="external">https://openqa.opensuse.org/tests/2166536#step/shutdown/22</a></p>
<p>This would be needed for Maintenance Updates.</p>
<p>thanks!</p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<p>AC0: Study the topic of system roles, what they mean in SLE and how the current os-autoinst-distri-openuse supports them.<br>
AC1: Schedule icewm using tests with SYSTEM_ROLE=textmode, testing on SLE 15-SP2 and newer. In this mode, the system boots to text mode, but X is available via systemctl start display-manager, from which logging in gives icewm.<br>
AC2: The scope of icewm tests is small, it is enough do installation with SYSTEM_ROLE_textmode, log in and start xterm, enter 'ls' (to check typing works) and finish. The needles should cover some graphical elements and some text (font), see the described regression.</p>
<a name="Further-Information"></a>
<h2 >Further Information<a href="#Further-Information" class="wiki-anchor">¶</a></h2>
<p>According to lib/main_common.pm, DESKTOP=minimalx is only used for SLE < 15, and for SLE >= 15 SYSTEM_ROLE=textmode should be used instead - textmode being "X server but no GNOME", while minimal being without X too.</p>
<p>While current usage is low, it's currently used by HA (SAP) squad in some testing at least (grep os-autoinst-distro-opensuse and <a href="https://gitlab.suse.de/openqa/all-yaml" class="external">https://gitlab.suse.de/openqa/all-yaml</a>). The current use seems to be using it in "text mode" for real, so no display manager or icewm is started even though available.</p>
openQA Tests - action #59348 (Rejected): [qam] rare test fail in yast2_apparmor when openQA is in...https://progress.opensuse.org/issues/593482019-11-12T11:20:40Zslemkeslemke@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario opensuse-Tumbleweed-DVD-x86_64-yast2_ncurses@64bit fails in<br>
<a href="https://openqa.opensuse.org/tests/1082294/modules/yast2_apparmor/steps/18" class="external">yast2_apparmor</a></p>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=opensuse&flavor=DVD&machine=64bit&test=yast2_ncurses&version=Tumbleweed#next_previous" class="external">latest</a></p>
<p>Solution is to change on line 200 from type_string to something like script_run to wait for a successful command exit.</p>
openQA Tests - action #57704 (Resolved): [qam] [yellow] random test fails in yast2_apparmor - tim...https://progress.opensuse.org/issues/577042019-10-04T12:33:23Zslemkeslemke@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP4-Server-DVD-Updates-x86_64-mau-extratests-yast2ui-textmode@64bit fails in<br>
<a href="https://openqa.suse.de/tests/3436234/modules/yast2_apparmor/steps/9" class="external">yast2_apparmor</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Run console tests against aggregated test repo</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/3422521" class="external">20190930-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/3420414" class="external">20190929-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Server-DVD-Updates&machine=64bit&test=mau-extratests-yast2ui-textmode&version=12-SP4" class="external">latest</a></p>
openQA Tests - action #57701 (Resolved): [qam] [yellow] yast2_http eventual timeout when installi...https://progress.opensuse.org/issues/577012019-10-04T12:09:54Zslemkeslemke@suse.com
<p>This is triggered every 4 times in 10 runs when installing extra dependencies (eg. apache2-prefork).</p>
<p>An slightly increased in wait_still_screen should fix that.</p>
<p>Problem can be seen here:<br>
<a href="https://openqa.suse.de/tests/3417520#next_previous" class="external">https://openqa.suse.de/tests/3417520#next_previous</a></p>
<p>This seems to affect only SLES15.</p>
openQA Tests - action #57545 (Resolved): [qam] [yellow] yast2_NIS random failhttps://progress.opensuse.org/issues/575452019-09-30T14:56:22Zslemkeslemke@suse.com
<p>Random fail:<br>
<a href="https://openqa.suse.de/tests/3422095" class="external">https://openqa.suse.de/tests/3422095</a></p>
<p>An improvement should be made to stop send alt-s, this has a counter-effect of changing tab and test fails.<br>
Suggestion is: send alt-s once and check_screen, if check_screen says alt-s was not accepted try once more.<br>
If it still fails give-up as probably openQA is not interpreting that key combination.</p>
openQA Tests - action #56420 (Resolved): [qam] test fails in yast2_ftp - SLES 12SP2 onlyhttps://progress.opensuse.org/issues/564202019-09-03T09:27:51Zslemkeslemke@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP2-Server-DVD-Updates-x86_64-mau-extratests-yast2ui-textmode@64bit fails in<br>
<a href="https://openqa.suse.de/tests/3318794/modules/yast2_ftp/steps/125" class="external">yast2_ftp</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Run console tests against aggregated test repo</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/3311908" class="external">20190830-2</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/3310477" class="external">20190830-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Server-DVD-Updates&machine=64bit&test=mau-extratests-yast2ui-textmode&version=12-SP2" class="external">latest</a></p>
openQA Tests - action #56186 (Closed): test fails in yast2_nishttps://progress.opensuse.org/issues/561862019-08-31T11:24:44Zslemkeslemke@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-Server-DVD-Updates-x86_64-mau-extratests-yast2ui-textmode@64bit fails in<br>
<a href="https://openqa.suse.de/tests/3314914/modules/yast2_nis/steps/21" class="external">yast2_nis</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Run console tests against aggregated test repo</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/3312112" class="external">20190830-2</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/3310681" class="external">20190830-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Server-DVD-Updates&machine=64bit&test=mau-extratests-yast2ui-textmode&version=15" class="external">latest</a></p>
openQA Tests - action #56177 (Resolved): [qam] test fails in yast2_ftphttps://progress.opensuse.org/issues/561772019-08-30T14:14:52Zslemkeslemke@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>resolution:</p>
<ul>
<li> if (is_sle('=15')) {</li>
<li> if (is_sle('=>15')) {</li>
</ul>
<p>This test also fail on SLES <=12.2</p>
<p>openQA test in scenario sle-15-SP1-Server-DVD-Updates-x86_64-mau-extratests-yast2ui-textmode@64bit fails in<br>
<a href="https://openqa.suse.de/tests/3312218/modules/yast2_ftp/steps/11" class="external">yast2_ftp</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Run console tests against aggregated test repo</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/3312218" class="external">20190830-2</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/3310779" class="external">20190830-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Server-DVD-Updates&machine=64bit&test=mau-extratests-yast2ui-textmode&version=15-SP1" class="external">latest</a></p>
openQA Tests - action #56171 (Resolved): [qam] test fails in yast2_apparmorhttps://progress.opensuse.org/issues/561712019-08-30T13:54:00Zslemkeslemke@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP1-Server-DVD-Updates-x86_64-mau-extratests-yast2ui-textmode@64bit fails in<br>
<a href="https://openqa.suse.de/tests/3312218/modules/yast2_apparmor/steps/6" class="external">yast2_apparmor</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Run console tests against aggregated test repo</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/3312218" class="external">20190830-2</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/3310779" class="external">20190830-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Server-DVD-Updates&machine=64bit&test=mau-extratests-yast2ui-textmode&version=15-SP1" class="external">latest</a></p>
qe-yam - action #55940 (Resolved): [qam][newt][libyui-ncurses-pkg] y2uitest_ncurses tests enable...https://progress.opensuse.org/issues/559402019-08-26T09:08:28Zslemkeslemke@suse.com
<p>Parent task is a port of tests from group "y2uitest_nurses"(which is not executed by QAM) to QAM.</p>
<p>"y2uitest_nurses" contains 12 yast2-ncurses tests, those 12 tests are used by QA-Product which mainly focus on new products (eg. sles15.1, 12.5) this means that same tests may not work with older releases(which is QA-Maintenance work).</p>
<p>The port (make those existing tests compatible with all existing(old products) SLES and Opensuse) task is an ongoing effort and 5 out of the 12 tests have been ported already, since there is 7 more tests to port we cannot already add "y2uitest_nurses" to run under QAM, the intention of this progress ticket is to add the already finished 5 tests(tracked on parent task) to a group that already runs for QAM, which will bring us the benefit of 5 extra tests.</p>
openQA Tests - action #52214 (Resolved): [functional][y] test fails in yast2_apparmorhttps://progress.opensuse.org/issues/522142019-05-28T09:50:46Zslemkeslemke@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP1-Installer-DVD-x86_64-yast2_ncurses@64bit fails in<br>
<a href="https://openqa.suse.de/tests/2918975/modules/yast2_apparmor/steps/6" class="external">yast2_apparmor</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Maintainer: zluo, riafarov Test for yast2 UI, ncurses only. Running on created gnome images which provides both text console for ncurses UI tests as well as the gnome environment for the GUI tests.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/2337091" class="external">126.1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/2329691" class="external">125.1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&version=15-SP1&flavor=Installer-DVD&distri=sle&machine=64bit&test=yast2_ncurses" class="external">latest</a></p>
qe-yam - action #50369 (Rejected): y2uitest_ncurses tests enablement for QAM : yast2_proxy.pmhttps://progress.opensuse.org/issues/503692019-04-12T12:16:29Zslemkeslemke@suse.com
<p>This is a rework task on existing yast2_proxy.pm test in order to:</p>
<p>Make the test backwards compatible with all supported SLE versions;<br>
Make the test backwards compatible with all supported Opensuse versions;<br>
Make the test compatible with all future SLES and Opensuse versions;</p>
qe-yam - action #50366 (Rejected): y2uitest_ncurses tests enablement for QAM : yast2_ntpclient.pmhttps://progress.opensuse.org/issues/503662019-04-12T12:15:44Zslemkeslemke@suse.com
<p>This is a rework task on existing yast2_ntpclient.pm test in order to:</p>
<p>Make the test backwards compatible with all supported SLE versions;<br>
Make the test backwards compatible with all supported Opensuse versions;<br>
Make the test compatible with all future SLES and Opensuse versions;</p>
qe-yam - action #46784 (Rejected): y2uitest_ncurses tests enablement for QAM [TRACKER]https://progress.opensuse.org/issues/467842019-01-28T17:22:33Zslemkeslemke@suse.com
<ul>
<li>Make it backwards compatible with all supported SLE versions;</li>
<li>Make it backwards compatible with all supported Opensuse versions;</li>
<li>Make it compatible with all future SLES and Opensuse versions;</li>
</ul>
<a name="PR-will-be-send-spited-by-sub-tests-so-each-test-will-get-its-sub-PR"></a>
<h2 >PR will be send spited by sub-tests, so each test will get its sub PR#<a href="#PR-will-be-send-spited-by-sub-tests-so-each-test-will-get-its-sub-PR" class="wiki-anchor">¶</a></h2>
openQA Tests - action #44720 (Rejected): test fails in sysstathttps://progress.opensuse.org/issues/447202018-12-04T16:26:20Zslemkeslemke@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario opensuse-15.1-DVD-x86_64-extra_tests_in_textmode@64bit fails in<br>
<a href="https://openqa.opensuse.org/tests/808887/modules/sysstat/steps/14" class="external">sysstat</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.opensuse.org/tests/707839" class="external">270.3</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?test=extra_tests_in_textmode&version=15.1&distri=opensuse&arch=x86_64&flavor=DVD&machine=64bit" class="external">latest</a></p>