openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842019-08-22T15:35:53ZopenSUSE Project Management Tool
Redmine openQA Tests - action #55844 (Resolved): [migration] test fails in aide_checkhttps://progress.opensuse.org/issues/558442019-08-22T15:35:53Zmsmeissnmeissner@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP2-Installer-DVD-x86_64-fips_tests_crypt_tool@64bit fails in<br>
<a href="https://openqa.suse.de/tests/3246052/modules/aide_check/steps/10" class="external">aide_check</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Maintainer: <a href="mailto:bchou@suse.com">bchou@suse.com</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/3246052" class="external">16.1</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Installer-DVD&machine=64bit&test=fips_tests_crypt_tool&version=15-SP2" class="external">latest</a></p>
openQA Tests - action #55676 (New): [opensuse] [qe-core] test fails in updates_packagekit_kdehttps://progress.opensuse.org/issues/556762019-08-19T05:45:07Zmsmeissnmeissner@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario opensuse-15.0-DVD-Updates-x86_64-kde@64bit-2G fails in<br>
<a href="https://openqa.opensuse.org/tests/1010742/modules/updates_packagekit_kde/steps/19" class="external">updates_packagekit_kde</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>TIMEOUT_SCALE property is added to avoid sporadic shutdown fails in kde@USBboot_64 scenario.</p>
<p>Added by : oorlov; </p>
<p>Related ticket: poo#37000</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.opensuse.org/tests/1004988" class="external">20190812-4</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.opensuse.org/tests/1004464" class="external">20190812-3</a> (or more recent)</p>
<p>This test is quite unstable. This largely seems to be to the delayed reaction of the kde systemtray bubble, it will change status slowly, and the test reacts on it and assumes <br>
it always shows the truth.</p>
<p>I see variants where it pops up the packagekit and expects it to install packages (while it was just turning from "updates avail" to "no updates" in the background),<br>
and also the other way round "no upadtes availbale" -> "red bobble" like in this run.</p>
<p>Even lots of retriggers can not get this green.</p>
<p>I think the logic loop in the test might need to cover more cases</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=opensuse&flavor=DVD-Updates&machine=64bit-2G&test=kde&version=15.0" class="external">latest</a></p>
openQA Tests - action #55412 (Resolved): [opensuse] test fails in sshd (cannot read /proc/sys/fs/...https://progress.opensuse.org/issues/554122019-08-13T05:06:08Zmsmeissnmeissner@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario opensuse-15.0-DVD-Updates-x86_64-gnome@uefi fails in<br>
<a href="https://openqa.opensuse.org/tests/1005429/modules/sshd/steps/18" class="external">sshd</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.opensuse.org/tests/1003485" class="external">20190810-2</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.opensuse.org/tests/1002917" class="external">20190810-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=opensuse&flavor=DVD-Updates&machine=uefi&test=gnome&version=15.0" class="external">latest</a></p>
openQA Tests - action #51494 (Rejected): [qam] test fails in sshdhttps://progress.opensuse.org/issues/514942019-05-15T11:56:19Zmsmeissnmeissner@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario opensuse-42.3-DVD-Updates-x86_64-cryptlvm@64bit-2G fails in<br>
<a href="https://openqa.opensuse.org/tests/934713/modules/sshd/steps/82" class="external">sshd</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Maintainers: okurz</p>
<p>Conduct installation with encrypted LVM selected during installation.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.opensuse.org/tests/929974" class="external">20190510-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.opensuse.org/tests/928851" class="external">20190509-2</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?version=42.3&test=cryptlvm&flavor=DVD-Updates&machine=64bit-2G&distri=opensuse&arch=x86_64" class="external">latest</a></p>
openQA Tests - action #50204 (Rejected): [functional][u][opensuse] no coverage for sssd and activ...https://progress.opensuse.org/issues/502042019-04-09T18:48:38Zmsmeissnmeissner@suse.com
<a name="User-story"></a>
<h2 >User story<a href="#User-story" class="wiki-anchor">¶</a></h2>
<p>We released a buggy openSUSE Leap 15.0 ldb update which broke SSSD based Active Directory authentication.</p>
<p><a href="https://bugzilla.suse.com/show_bug.cgi?id=1131686" class="external">https://bugzilla.suse.com/show_bug.cgi?id=1131686</a></p>
<p>This was not spotted by openqa.</p>
<p>It is very likely this is also happening in SLE15 itself, so far we did not receive customer reports.</p>
<p>Testing sssd against Active Directory would probably have shown this probelm.</p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1:</strong> sssd test module is extended to cover authentication against Active Directory</li>
</ul>
<a name="Tasks"></a>
<h2 >Tasks<a href="#Tasks" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>T1:</strong> Investigate what needs to be done for achieving this <strong>[timeboxed: 2h]</strong></li>
<li><strong>T2:</strong> Extend the test to cover this functionality</li>
</ul>
openQA Tests - action #49601 (Resolved): test fails in installation_overviewhttps://progress.opensuse.org/issues/496012019-03-24T07:00:37Zmsmeissnmeissner@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario opensuse-42.3-DVD-Updates-x86_64-cryptlvm@64bit-2G fails in<br>
<a href="https://openqa.opensuse.org/tests/888957/modules/installation_overview/steps/8" class="external">installation_overview</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Maintainers: okurz</p>
<p>Conduct installation with encrypted LVM selected during installation.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.opensuse.org/tests/888957" class="external">20190322-3</a> (current job)</p>
<p>This has started around Friday 22nd March.</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.opensuse.org/tests/888183" class="external">20190322-2</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?flavor=DVD-Updates&version=42.3&test=cryptlvm&distri=opensuse&arch=x86_64&machine=64bit-2G" class="external">latest</a></p>
openQA Tests - action #48056 (Resolved): [qam] test fails in update_install (LibreOffice needs to...https://progress.opensuse.org/issues/480562019-02-18T12:21:42Zmsmeissnmeissner@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-Server-DVD-Incidents-Install-x86_64-qam-incidentinstall@64bit fails in<br>
<a href="https://openqa.suse.de/tests/2469646/modules/update_install/steps/179" class="external">update_install</a></p>
<p>The problem is that installing the update runs out of disk space.</p>
<p>Might be an issue with the default size of the disk?</p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Incident Installation TEST</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/2469330" class="external">:10046:procps</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/2468347" class="external">:10346:bind</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?version=15&distri=sle&flavor=Server-DVD-Incidents-Install&test=qam-incidentinstall&arch=x86_64&machine=64bit" class="external">latest</a></p>
openQA Tests - action #47426 (Resolved): [functional][y][fast] test fails in encrypt_lvmhttps://progress.opensuse.org/issues/474262019-02-12T14:49:56Zmsmeissnmeissner@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario opensuse-42.3-DVD-Updates-x86_64-cryptlvm@64bit-2G fails in<br>
<a href="https://openqa.opensuse.org/tests/852217/modules/encrypt_lvm/steps/2" class="external">encrypt_lvm</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Maintainers: okurz</p>
<p>Conduct installation with encrypted LVM selected during installation.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.opensuse.org/tests/851737" class="external">20190212-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.opensuse.org/tests/851213" class="external">20190211-2</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?distri=opensuse&machine=64bit-2G&flavor=DVD-Updates&version=42.3&test=cryptlvm&arch=x86_64" class="external">latest</a></p>
openQA Tests - action #47321 (Rejected): [functional][u][opensuse][sporadic] openSUSE Leap 15.1 f...https://progress.opensuse.org/issues/473212019-02-09T15:23:50Zmsmeissnmeissner@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario opensuse-15.0-DVD-Updates-x86_64-gnome@64bit-2G fails in<br>
<a href="https://openqa.opensuse.org/tests/848696/modules/updates_packagekit_gpk/steps/3" class="external">updates_packagekit_gpk</a></p>
<p>on feb 7 the updates_packagekit_gpk started to fail on leap 15.0 tests</p>
<p>It seems there is a GNOME screen and it is no longer getting detected correctly.</p>
<p>Actually updates_packagekit_gpk already failed earlier in before, e.g. from 20 days ago:<br>
<a href="https://openqa.opensuse.org/tests/838957#step/updates_packagekit_gpk/3" class="external">https://openqa.opensuse.org/tests/838957#step/updates_packagekit_gpk/3</a><br>
on 2019-01-26</p>
<p>And we can find even older failures in the same modules but that could be different steps.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Often but not always</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.opensuse.org/tests/848606" class="external">20190207-3</a> however a lot of tests failed in before in a prerequisite</p>
<p>Last good: <a href="https://openqa.opensuse.org/tests/836503" class="external">20190124-1</a></p>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Change the assert_screen to increase the timeout to 60 seconds for the second loop, and add a soft failure already there</li>
<li>[easy] Apply a solution similar to: <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/6825" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/6825</a></li>
<li>Only focus on failures in the initial steps of updates_packagekit_gpk</li>
<li>Report product regression bug or fix test regression</li>
<li>Bisect test changes as well as product changes with <a href="https://progress.opensuse.org/projects/openqatests/wiki/Wiki#Statistical-investigation" class="external">statistical investigation</a></li>
<li>Optional: Increase stability of test module or scenario, e.g. by reordering test module schedule</li>
</ul>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?flavor=DVD-Updates&distri=opensuse&machine=64bit-2G&test=gnome&arch=x86_64&version=15.0" class="external">latest</a></p>
<a name="Workaround"></a>
<h2 >Workaround<a href="#Workaround" class="wiki-anchor">¶</a></h2>
<p>Retrigger failing jobs</p>
openQA Tests - action #47318 (Resolved): [functional][y][fast] leap 42.3 openssh tests broken sin...https://progress.opensuse.org/issues/473182019-02-09T15:11:15Zmsmeissnmeissner@suse.com
<p>openSUSE Leap 42.3 started failing openssh tests on February 7, 17:00</p>
<p><a href="https://openqa.opensuse.org/tests/849933#next_previous" class="external">https://openqa.opensuse.org/tests/849933#next_previous</a></p>
<p>The firewall seems not be started or has been stopped by something.</p>
<p>It might be related to oliver kurz merge regarding <br>
f8e8ccc67fa9fef324e166820f3662e21ef01b69<br>
that was merged on feb 6</p>
openQA Tests - action #47264 (Resolved): [functional][u] openSUSE Leap 42.3 broken since yesterdayhttps://progress.opensuse.org/issues/472642019-02-07T16:15:36Zmsmeissnmeissner@suse.com
<p>Our grub2_test has started to fail on February 6th</p>
<p><a href="https://openqa.opensuse.org/tests/848650#step/grub_test/3" class="external">https://openqa.opensuse.org/tests/848650#step/grub_test/3</a><br>
<a href="https://openqa.opensuse.org/tests/848650#next_previous" class="external">https://openqa.opensuse.org/tests/848650#next_previous</a></p>
<p>It seems as if "return" is not pressed anymore, but the openqa waits for the encrypted passphrase.</p>
<p>Likely git commit that caused the issue is 1a96c65b1fd93c1338aa1ca3bd7db86823d78a53<br><br>
we use UEFI=1 and so this workaround routine no longer returns, but waits for the passphrase.</p>
openQA Tests - action #42938 (Resolved): [qam] test fails in firefox_rsshttps://progress.opensuse.org/issues/429382018-10-25T15:17:44Zmsmeissnmeissner@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-Desktop-DVD-Updates-x86_64-qam-regression-firefox-SLED@64bit fails in<br>
<a href="https://openqa.suse.de/tests/2210959/modules/firefox_rss/steps/16" class="external">firefox_rss</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/2210959" class="external">20181025-2</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/2210942" class="external">20181024-2</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&flavor=Desktop-DVD-Updates&distri=sle&test=qam-regression-firefox-SLED&machine=64bit&version=15" class="external">latest</a></p>
<p>It seems a slashdot site bug.</p>
<p>The following feed works:</p>
<p><a href="http://rss.slashdot.org/Slashdot/slashdotMain" class="external">http://rss.slashdot.org/Slashdot/slashdotMain</a></p>
<p>but this one does not:</p>
<p><a href="http://rss.slashdot.org/Slashdot/slashdotLinux" class="external">http://rss.slashdot.org/Slashdot/slashdotLinux</a></p>
openQA Tests - action #42419 (Rejected): [qam] test fails in zypper_lifecycle_toolchain - needs a...https://progress.opensuse.org/issues/424192018-10-12T18:24:52Zmsmeissnmeissner@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP3-Server-DVD-Incidents-x86_64-qam-allpatterns+addons@64bit fails in<br>
<a href="https://openqa.suse.de/tests/2171278/modules/zypper_lifecycle_toolchain/steps/14" class="external">zypper_lifecycle_toolchain</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/2165669" class="external">:7963:openslp.1539058478</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/2165326" class="external">:7171:iproute2.1538487956</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?machine=64bit&test=qam-allpatterns%2Baddons&flavor=Server-DVD-Incidents&arch=x86_64&version=12-SP3&distri=sle" class="external">latest</a></p>
<p>We released gcc8 ... and the newlib packages conflict.</p>
<p>Can you fitler out the gcc7 variant?</p>
openQA Tests - action #42095 (Resolved): [qam] deepsea tests brokenhttps://progress.opensuse.org/issues/420952018-10-07T16:45:56Zmsmeissnmeissner@suse.com
<p>somehow the deepsea tests are broken , i think the deployed scripts no longer exist / got renamed</p>
<p><a href="https://openqa.suse.de/tests/2129651#step/deepsea_testsuite/30" class="external">https://openqa.suse.de/tests/2129651#step/deepsea_testsuite/30</a></p>
<p>this breaks SES5 openqa</p>
openQA Tests - action #40961 (Rejected): test fails in scc_registrationhttps://progress.opensuse.org/issues/409612018-09-13T08:30:24Zmsmeissnmeissner@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP3-Server-DVD-Updates-x86_64-mau-webserver@64bit fails in<br>
<a href="https://openqa.suse.de/tests/2038074/modules/scc_registration/steps/82" class="external">scc_registration</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/2036409" class="external">20180911-2</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/2034401" class="external">20180910-3</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?test=mau-webserver&machine=64bit&arch=x86_64&version=12-SP3&distri=sle&flavor=Server-DVD-Updates" class="external">latest</a></p>