openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842021-10-07T07:55:02ZopenSUSE Project Management Tool
Redmine openQA Tests - action #100518 (Resolved): test fails in docker_image -- timeout on `docker start`...https://progress.opensuse.org/issues/1005182021-10-07T07:55:02Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP3-Container-Image-Updates-s390x-sle-12-SP3_image_on_sle-15_host_docker@s390x-kvm-sle12 fails in<br>
<a href="https://openqa.suse.de/tests/7333020/modules/docker_image/steps/19" class="external">docker_image</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>The base test suite is used for job templates defined in YAML documents. It has no settings of its own.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/7330977" class="external">24.310</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/7314458" class="external">24.309</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=s390x&distri=sle&flavor=Container-Image-Updates&machine=s390x-kvm-sle12&test=sle-12-SP3_image_on_sle-15_host_docker&version=12-SP3" class="external">latest</a></p>
openQA Tests - action #97214 (Resolved): test fails in cockpit_servicehttps://progress.opensuse.org/issues/972142021-08-19T09:13:08Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario microos-Tumbleweed-MicroOS-Image-x86_64-microos_selinux@64bit fails in<br>
<a href="https://openqa.opensuse.org/tests/1879972/modules/cockpit_service/steps/8" class="external">cockpit_service</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Same test as microos but enabling SELinux after boot.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.opensuse.org/tests/1808622" class="external">20210626</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.opensuse.org/tests/1750717" class="external">20210519</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=microos&flavor=MicroOS-Image&machine=64bit&test=microos_selinux&version=Tumbleweed" class="external">latest</a></p>
<a name="Output"></a>
<h2 >Output<a href="#Output" class="wiki-anchor">¶</a></h2>
<pre><code># wait_serial expected: "Continue?"
# Result:
Checking for newer version.
transactional-update 3.5.1 started
Options: pkg install cockpit
Separate /var detected.
2021-08-19 02:28:05 tukit 3.5.1 started
2021-08-19 02:28:05 Options: -c11 open
2021-08-19 02:28:06 Using snapshot 11 as base for new snapshot 13.
2021-08-19 02:28:06 Syncing /etc of previous snapshot 10 as base into new snapshot "/.snapshots/13/snapshot"
2021-08-19 02:28:06 SELinux is enabled.
ID: 13
2021-08-19 02:28:06 Transaction completed.
Calling zypper install
2021-08-19 02:28:08 tukit 3.5.1 started
2021-08-19 02:28:08 Options: callext 13 zypper -R {} install cockpit
2021-08-19 02:28:08 Executing `zypper -R /tmp/transactional-update-1xMQeF install cockpit`:
Loading repository data...
Reading installed packages...
Resolving package dependencies...
Problem: the to be installed cockpit-245-1.1.x86_64 requires 'cockpit-system', but this requirement cannot be provided
not installable providers: cockpit-system-250-1.1.noarch[OSS]
Solution 1: install cockpit-bridge-250-1.1.i586 despite the inferior architecture
Solution 2: do not install cockpit-245-1.1.x86_64
Solution 3: break cockpit-245-1.1.x86_64 by ignoring some of its dependencies
Choose from above solutions by number or cancel [1/2/3/c/d/?] (c):
</code></pre> openQA Tests - action #97208 (Resolved): test fails in prepare_test_data - timeout exceeded of do...https://progress.opensuse.org/issues/972082021-08-19T08:50:44Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP5-AZURE-Basic-Updates-x86_64-publiccloud_containers@64bit fails in<br>
<a href="https://openqa.suse.de/tests/6890165/modules/prepare_test_data/steps/5" class="external">prepare_test_data</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>The base test suite is used for job templates defined in YAML documents. It has no settings of its own.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/6877116" class="external">20210818-1</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/6867963" class="external">20210817-1</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=AZURE-Basic-Updates&machine=64bit&test=publiccloud_containers&version=12-SP5" class="external">latest</a></p>
openQA Tests - action #97106 (Resolved): test fails in enable_selinuxhttps://progress.opensuse.org/issues/971062021-08-18T09:38:51Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>Command: <code>aureport -a</code></p>
<pre><code># Test died: script failed with : 3tByJ
AVC Report
===============================================================
# date time comm subj syscall class permission obj result event
===============================================================
<no events of interest were found>
SCRIPT_FINISHED3tByJ-1-
at /usr/lib/os-autoinst/testapi.pm line 1153.
</code></pre>
<p>From my POV this isn't a failure, we just didn't hit anything, not sure why <code>aureport -a</code> return 1 in such a case.<br>
<a href="https://github.com/linux-audit/audit-userspace/blob/master/src/aureport.c#L154" class="external">https://github.com/linux-audit/audit-userspace/blob/master/src/aureport.c#L154</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Same test as microos but enabling SELinux after boot.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.opensuse.org/tests/1808622" class="external">20210626</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.opensuse.org/tests/1750717" class="external">20210519</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=microos&flavor=MicroOS-Image&machine=64bit&test=microos_selinux&version=Tumbleweed" class="external">latest</a></p>
openQA Tests - action #66116 (Resolved): [qac][public cloud] Use VM id instead of name for Azurehttps://progress.opensuse.org/issues/661162020-04-27T21:49:40Zcfconradcfamullaconrad@suse.com
<p>In azure a VM can be specified by resource group (rg) plus instance name<br>
or by instance ID.<br>
With this patch we move from rg+name to ID, which make later usage more<br>
easy, but also breaks the implicit assumption that name and rg is always<br>
equal.</p>
openQA Tests - action #64782 (Resolved): [public cloud][kernel] GCE failed in upload_imagehttps://progress.opensuse.org/issues/647822020-03-24T23:24:19Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP2-GCE-x86_64-publiccloud_upload_img@gce_n1_standard_2 fails in<br>
<a href="https://openqa.suse.de/tests/4032758/modules/upload_image/steps/60" class="external">upload_image</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Upload a public-cloud image to the CSP. How the image get's uploaded depends on the CSP. If the image already exists, the upload gets skipped.</p>
<p>Maintainer: <a href="mailto:cfamullaconrad@suse.com">cfamullaconrad@suse.com</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/4030617" class="external">0012</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/4023584" class="external">0011</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=GCE&machine=gce_n1_standard_2&test=publiccloud_upload_img&version=15-SP2" class="external">latest</a></p>
openQA Tests - action #64643 (Resolved): [qac][public cloud] EC2-HVM-ARM image upload missing bil...https://progress.opensuse.org/issues/646432020-03-19T20:41:33Zcfconradcfamullaconrad@suse.com
<p>We need to use <code>--use-root-swap</code> when uploading "on-demand" images to EC2. This is not possible for ARM images, because of a bug in ec2uploadutils:</p>
<p><a href="https://bugzilla.suse.com/show_bug.cgi?id=1167148" class="external">https://bugzilla.suse.com/show_bug.cgi?id=1167148</a></p>
<pre><code>ec2uploadimg --access-id "$AWS_ACCESS_KEY_ID" -s "$AWS_SECRET_ACCESS_KEY" --backing-store ssd --grub2 --machine 'arm64' -n 'cfconrad-SLES15-SP2.aarch64-0.9.9-EC2-HVM-Build1.24.raw.xz' --virt-type hvm --sriov-support --use-root-swap --ena-support --verbose --regions 'eu-central-1' --ssh-key-pair 'openqa1584575383_0' --private-key-file QA_SSH_KEY.pem -d 'OpenQA tests' --ec2-ami ami-0df4259a0762ee347 -t a1.large --vpc-subnet-id subnet-b44c72df 'SLES15-SP2.aarch64-0.9.9-EC2-HVM-Build1.24.raw.xz' ;
</code></pre>
<p><code>subnet-b44c72df</code> is specified, cause otherwise it try to create it in Availability Zone <code>eu-central-1c</code> and there are no <code>a1.large</code> instance available.</p>
<p>The <code>ec2uploadimg</code> call fail with:</p>
<pre><code>Could not find disk device in helper instance with path /dev/sdf or /dev/xvdf
</code></pre> openQA Tests - action #64637 (Resolved): [qac][public cloud] Vault API run into timeouthttps://progress.opensuse.org/issues/646372020-03-19T16:21:49Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP2-Azure-CHOST-BYOS-x86_64-publiccloud_boottime@az_Standard_A2_v2 fails in<br>
<a href="https://openqa.suse.de/tests/4006512/modules/boottime/steps/28" class="external">boottime</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Test will measure boot time of SLE image inside Public Cloud providers ( Amazon,Microsoft, Google ) </p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/4006512" class="external">0008</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/3997725" class="external">0007</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Azure-CHOST-BYOS&machine=az_Standard_A2_v2&test=publiccloud_boottime&version=15-SP2" class="external">latest</a></p>
openQA Tests - action #64562 (Closed): [qac][public cloud][MACHINE=Standard_L8s_v2][FLAVOR=~Azure...https://progress.opensuse.org/issues/645622020-03-18T10:39:52Zcfconradcfamullaconrad@suse.com
<p>Terraform apply fail with machine type Standard_L8s_v2.</p>
openQA Tests - action #64144 (Resolved): [qac][public cloud] GCE upload fail with ResumableUpload...https://progress.opensuse.org/issues/641442020-03-03T18:18:55Zcfconradcfamullaconrad@suse.com
<p>ResumableUploadAbortException: 403 <a href="mailto:vaultopenqa-role-1580980463@suse-sle-qa.iam.gserviceaccount.com">vaultopenqa-role-1580980463@suse-sle-qa.iam.gserviceaccount.com</a> does not have storage.objects.delete access to openqa-suse-de/SLES15-SP2-BYOS.x86_64-0.9.3-GCE-Build2.26.tar.gz.</p>
<p><a href="https://openqa.suse.de/tests/3948523#step/upload_image/55" class="external">https://openqa.suse.de/tests/3948523#step/upload_image/55</a></p>
openQA Tests - action #60725 (Resolved): [kernel]Can't use an undefined value as a symbol referen...https://progress.opensuse.org/issues/607252019-12-05T10:55:30Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP5-Server-DVD-Incidents-Kernel-s390x-ltp_syscalls@s390x-kvm-sle12 fails in<br>
<a href="https://openqa.suse.de/tests/3662283/modules/boot_ltp/steps/24" class="external">boot_ltp</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>A large collection of tests for individual system calls. This is generally considered to be the most important test suit within the LTP.</p>
<p>The IPC tests have been filtered out from the syscalls runtest file. They are ran as part of the syscalls_ipc test case.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/3662283" class="external">:13400:kernel-ec2</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/3660987" class="external">4.12.14-142.1.g6e7819a</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=s390x&distri=sle&flavor=Server-DVD-Incidents-Kernel&machine=s390x-kvm-sle12&test=ltp_syscalls&version=12-SP5" class="external">latest</a></p>
openQA Tests - action #56462 (Resolved): [qac][public cloud] Improve boottime test - Adopt thresh...https://progress.opensuse.org/issues/564622019-09-04T13:23:05Zcfconradcfamullaconrad@suse.com
<p>Our current boot time threashold need to be Provider specific.<br>
This was aggregated with the PC team in the last meeting on 2020-03-16.</p>
<p>Also the guestregister is that slow, because of the provided SCC API. And currently PC-Team doesn't see any improvement possibilities from there side.</p>
openQA Tests - action #52919 (Resolved): [qac][public cloud] Add unit tests to PCW https://progress.opensuse.org/issues/529192019-06-12T08:02:25Zcfconradcfamullaconrad@suse.com
<p>We need unit tests in <a href="https://github.com/cfconrad/pcw" class="external">https://github.com/cfconrad/pcw</a></p>
<p>Hints:</p>
<ul>
<li><a href="https://streaming.nue.suse.com/i/dcm/shap/2019-06-05-python-tips-tricks.mp4" class="external">https://streaming.nue.suse.com/i/dcm/shap/2019-06-05-python-tips-tricks.mp4</a></li>
</ul>
openQA Project - action #44654 (Resolved): [tool] Summarize results in test details tabhttps://progress.opensuse.org/issues/446542018-12-03T13:35:29Zcfconradcfamullaconrad@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>To get a quick overview in test details the idea is to show grouped results in tab on details page, somehow similar to what we have in tests list: <img src="https://progress.opensuse.org/attachments/download/7238/overview.png" alt="short summary" loading="lazy" />.</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1:</strong> test details tabs shows test module results summary</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<p>The initial idea was to have it for "external results", but it could also apply to details, which need to be discussed. We also show the number of comments in the comment tab.</p>
openQA Project - action #40913 (Resolved): script_output sometimes fail on virtio consolehttps://progress.opensuse.org/issues/409132018-09-12T09:34:38Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>It seams randomly happen in openQA, that tests fail, cause "cat -" never finish.</p>
<a name="Steps-to-reproduce"></a>
<h2 >Steps to reproduce<a href="#Steps-to-reproduce" class="wiki-anchor">¶</a></h2>
<p>Observations on openQA</p>
<ul>
<li><a href="https://progress.opensuse.org/issues/30613#note-23" class="external">https://progress.opensuse.org/issues/30613#note-23</a> </li>
<li><a href="https://openqa.suse.de/tests/2031979#step/boot_ltp/78" class="external">https://openqa.suse.de/tests/2031979#step/boot_ltp/78</a></li>
</ul>
<p>I was able to bring my openQA instance in such a state. I'm actually not sure, if this<br>
is the same problem as we have in osd, but it looks similar. The big different is, that if it happen once,<br>
it happen always for that worker.</p>
<p>What I did so far:</p>
<ul>
<li>Start a test which is using virtio console</li>
<li>restart openQA while the test is running</li>
<li>run tests again</li>
</ul>
<a name="Problem"></a>
<h2 >Problem<a href="#Problem" class="wiki-anchor">¶</a></h2>
<p>A call like this:</p>
<pre><code>cat - > /tmp/script8RI3l.sh; echo 8RI3l-$?-
</code></pre>
<p>Doesn't get the EOT and so we never reach the prompt again.</p>
<a name="Suggestion"></a>
<h2 >Suggestion<a href="#Suggestion" class="wiki-anchor">¶</a></h2>
<p>We need deeper investigations.</p>