openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842020-04-27T21:49:40ZopenSUSE Project Management Tool
Redmine openQA Tests - action #66116 (Resolved): [qac][public cloud] Use VM id instead of name for Azurehttps://progress.opensuse.org/issues/661162020-04-27T21:49:40Zcfconradcfamullaconrad@suse.com
<p>In azure a VM can be specified by resource group (rg) plus instance name<br>
or by instance ID.<br>
With this patch we move from rg+name to ID, which make later usage more<br>
easy, but also breaks the implicit assumption that name and rg is always<br>
equal.</p>
openQA Tests - action #64782 (Resolved): [public cloud][kernel] GCE failed in upload_imagehttps://progress.opensuse.org/issues/647822020-03-24T23:24:19Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP2-GCE-x86_64-publiccloud_upload_img@gce_n1_standard_2 fails in<br>
<a href="https://openqa.suse.de/tests/4032758/modules/upload_image/steps/60" class="external">upload_image</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Upload a public-cloud image to the CSP. How the image get's uploaded depends on the CSP. If the image already exists, the upload gets skipped.</p>
<p>Maintainer: <a href="mailto:cfamullaconrad@suse.com">cfamullaconrad@suse.com</a></p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/4030617" class="external">0012</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/4023584" class="external">0011</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=GCE&machine=gce_n1_standard_2&test=publiccloud_upload_img&version=15-SP2" class="external">latest</a></p>
openQA Tests - action #64643 (Resolved): [qac][public cloud] EC2-HVM-ARM image upload missing bil...https://progress.opensuse.org/issues/646432020-03-19T20:41:33Zcfconradcfamullaconrad@suse.com
<p>We need to use <code>--use-root-swap</code> when uploading "on-demand" images to EC2. This is not possible for ARM images, because of a bug in ec2uploadutils:</p>
<p><a href="https://bugzilla.suse.com/show_bug.cgi?id=1167148" class="external">https://bugzilla.suse.com/show_bug.cgi?id=1167148</a></p>
<pre><code>ec2uploadimg --access-id "$AWS_ACCESS_KEY_ID" -s "$AWS_SECRET_ACCESS_KEY" --backing-store ssd --grub2 --machine 'arm64' -n 'cfconrad-SLES15-SP2.aarch64-0.9.9-EC2-HVM-Build1.24.raw.xz' --virt-type hvm --sriov-support --use-root-swap --ena-support --verbose --regions 'eu-central-1' --ssh-key-pair 'openqa1584575383_0' --private-key-file QA_SSH_KEY.pem -d 'OpenQA tests' --ec2-ami ami-0df4259a0762ee347 -t a1.large --vpc-subnet-id subnet-b44c72df 'SLES15-SP2.aarch64-0.9.9-EC2-HVM-Build1.24.raw.xz' ;
</code></pre>
<p><code>subnet-b44c72df</code> is specified, cause otherwise it try to create it in Availability Zone <code>eu-central-1c</code> and there are no <code>a1.large</code> instance available.</p>
<p>The <code>ec2uploadimg</code> call fail with:</p>
<pre><code>Could not find disk device in helper instance with path /dev/sdf or /dev/xvdf
</code></pre> openQA Tests - action #64637 (Resolved): [qac][public cloud] Vault API run into timeouthttps://progress.opensuse.org/issues/646372020-03-19T16:21:49Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-15-SP2-Azure-CHOST-BYOS-x86_64-publiccloud_boottime@az_Standard_A2_v2 fails in<br>
<a href="https://openqa.suse.de/tests/4006512/modules/boottime/steps/28" class="external">boottime</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Test will measure boot time of SLE image inside Public Cloud providers ( Amazon,Microsoft, Google ) </p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/4006512" class="external">0008</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/3997725" class="external">0007</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Azure-CHOST-BYOS&machine=az_Standard_A2_v2&test=publiccloud_boottime&version=15-SP2" class="external">latest</a></p>
openQA Tests - action #64571 (Rejected): [kernel][public cloud][FLAVOR=~Azure][MACHINE=Standard_D...https://progress.opensuse.org/issues/645712020-03-18T10:59:08Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>Error: compute.VirtualMachinesClient#CreateOrUpdate: Failure sending request: StatusCode=0 -- Original Error: autorest/azure: Service returned an error. Status= Code="OperationNotAllowed" Message="Operation could not be completed as it results in exceeding approved standardDSv3Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westeurope, Current Limit: 24, Current Usage: 18, Additional Required: 8, (Minimum) New Limit Required: 26. Submit a request for Quota increase at <a href="https://aka.ms/ProdportalCRP/?#create/Microsoft.Support/Parameters/%7B%22subId%22:%22c011786b-59d7-4817-880c-7cd8a6ca4b19%22,%22pesId%22:%2206bfd9d3-516b-d5c6-5802-169c800dec89%22,%22supportTopicId%22:%22e12e3d1d-7fa0-af33-c6d0-3c50df9658a3%22%7D" class="external">https://aka.ms/ProdportalCRP/?#create/Microsoft.Support/Parameters/%7B%22subId%22:%22c011786b-59d7-4817-880c-7cd8a6ca4b19%22,%22pesId%22:%2206bfd9d3-516b-d5c6-5802-169c800dec89%22,%22supportTopicId%22:%22e12e3d1d-7fa0-af33-c6d0-3c50df9658a3%22%7D</a> by specifying parameters listed in the ‘Details’ section for deployment to succeed. Please read more about quota limits at <a href="https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests" class="external">https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests</a>."</p>
<p>openQA test in scenario sle-15-SP2-Azure-Basic-x86_64-publiccloud_boottime@Standard_D8s_v3 fails in<br>
<a href="https://openqa.suse.de/tests/4004235/modules/boottime/steps/80" class="external">boottime</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>Test will measure boot time of SLE image inside Public Cloud providers ( Amazon,Microsoft, Google ) </p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/3858020" class="external">0.9.3-1.52</a></p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: (unknown) (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Azure-Basic&machine=Standard_D8s_v3&test=publiccloud_boottime&version=15-SP2" class="external">latest</a></p>
openQA Tests - action #64562 (Closed): [qac][public cloud][MACHINE=Standard_L8s_v2][FLAVOR=~Azure...https://progress.opensuse.org/issues/645622020-03-18T10:39:52Zcfconradcfamullaconrad@suse.com
<p>Terraform apply fail with machine type Standard_L8s_v2.</p>
openQA Tests - action #64144 (Resolved): [qac][public cloud] GCE upload fail with ResumableUpload...https://progress.opensuse.org/issues/641442020-03-03T18:18:55Zcfconradcfamullaconrad@suse.com
<p>ResumableUploadAbortException: 403 <a href="mailto:vaultopenqa-role-1580980463@suse-sle-qa.iam.gserviceaccount.com">vaultopenqa-role-1580980463@suse-sle-qa.iam.gserviceaccount.com</a> does not have storage.objects.delete access to openqa-suse-de/SLES15-SP2-BYOS.x86_64-0.9.3-GCE-Build2.26.tar.gz.</p>
<p><a href="https://openqa.suse.de/tests/3948523#step/upload_image/55" class="external">https://openqa.suse.de/tests/3948523#step/upload_image/55</a></p>
openQA Tests - action #63208 (Rejected): [kernel][public cloud] Increase standardDSv3Family Cores...https://progress.opensuse.org/issues/632082020-02-06T11:21:14Zcfconradcfamullaconrad@suse.com
<p><a href="https://openqa.suse.de/tests/3870290#step/run_ltp/85" class="external">https://openqa.suse.de/tests/3870290#step/run_ltp/85</a> </p>
<p>terraform apply fail with:</p>
<pre><code>Error: compute.VirtualMachinesClient#CreateOrUpdate: Failure sending request: StatusCode=0 -- Original Error: autorest/azure: Service returned an error. Status=<nil> Code="OperationNotAllowed" Message="Operation could not be completed as it results in exceeding approved standardDSv3Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westeurope, Current Limit: 16, Current Usage: 16, Additional Required: 8, (Minimum) New Limit Required: 24. Submit a request for Quota increase at https://aka.ms/ProdportalCRP/?#create/Microsoft.Support/Parameters/%7B%22subId%22:%22c011786b-59d7-4817-880c-7cd8a6ca4b19%22,%22pesId%22:%2206bfd9d3-516b-d5c6-5802-169c800dec89%22,%22supportTopicId%22:%22e12e3d1d-7fa0-af33-c6d0-3c50df9658a3%22%7D by specifying parameters listed in the ‘Details’ section for deployment to succeed. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests."
on plan.tf line 129, in resource "azurerm_virtual_machine" "openqa-vm":
129: resource "azurerm_virtual_machine" "openqa-vm" {
</code></pre> openQA Tests - action #60725 (Resolved): [kernel]Can't use an undefined value as a symbol referen...https://progress.opensuse.org/issues/607252019-12-05T10:55:30Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>openQA test in scenario sle-12-SP5-Server-DVD-Incidents-Kernel-s390x-ltp_syscalls@s390x-kvm-sle12 fails in<br>
<a href="https://openqa.suse.de/tests/3662283/modules/boot_ltp/steps/24" class="external">boot_ltp</a></p>
<a name="Test-suite-description"></a>
<h2 >Test suite description<a href="#Test-suite-description" class="wiki-anchor">¶</a></h2>
<p>A large collection of tests for individual system calls. This is generally considered to be the most important test suit within the LTP.</p>
<p>The IPC tests have been filtered out from the syscalls runtest file. They are ran as part of the syscalls_ipc test case.</p>
<a name="Reproducible"></a>
<h2 >Reproducible<a href="#Reproducible" class="wiki-anchor">¶</a></h2>
<p>Fails since (at least) Build <a href="https://openqa.suse.de/tests/3662283" class="external">:13400:kernel-ec2</a> (current job)</p>
<a name="Expected-result"></a>
<h2 >Expected result<a href="#Expected-result" class="wiki-anchor">¶</a></h2>
<p>Last good: <a href="https://openqa.suse.de/tests/3660987" class="external">4.12.14-142.1.g6e7819a</a> (or more recent)</p>
<a name="Further-details"></a>
<h2 >Further details<a href="#Further-details" class="wiki-anchor">¶</a></h2>
<p>Always latest result in this scenario: <a href="https://openqa.suse.de/tests/latest?arch=s390x&distri=sle&flavor=Server-DVD-Incidents-Kernel&machine=s390x-kvm-sle12&test=ltp_syscalls&version=12-SP5" class="external">latest</a></p>
openQA Tests - action #58739 (Closed): [qac][jdp][public cloud] Group publiccloud images by FLAVO...https://progress.opensuse.org/issues/587392019-10-28T12:32:56Zcfconradcfamullaconrad@suse.com
<p>Problem:<br>
Publiccloud-team produce image with KIWI and BUILD number. <br>
The result is, that we can get different KIWI-BUILD tuple within each FLAVOR (@see <a href="https://build.suse.de/package/view_file/SUSE:SLE-12-SP5:GA/SLES12-SP5-Azure/config.kiwi?expand=1" class="external">https://build.suse.de/package/view_file/SUSE:SLE-12-SP5:GA/SLES12-SP5-Azure/config.kiwi?expand=1</a>)</p>
<p>TODO:<br>
We need to adopt JDP to build groups based on VERSION-FLAVOR-ARCH-MACHINE. (@see <a href="https://gitlab.suse.de/rpalethorpe/jdp/blob/master/notebooks/Report-Status-Diff.ipynb" class="external">https://gitlab.suse.de/rpalethorpe/jdp/blob/master/notebooks/Report-Status-Diff.ipynb</a>)</p>
<p>Example list of PC images:</p>
<pre><code>SLES12-SP5-Azure.x86_64-0.9.0-Standard-On-Demand-Build3.2
SLES12-SP5-Azure.x86_64-0.9.0-Basic-On-Demand-Build3.2
SLES12-SP5-Azure.x86_64-0.9.1-BYOS-Build3.2
SLES12-SP5-EC2.x86_64-0.9.1-BYOS-Build1.55
SLES12-SP5-EC2.x86_64-0.9.1-On-Demand-Build1.55
SLES12-SP5-GCE.x86_64-0.9.1-On-Demand-Build1.55
SLES12-SP5-GCE.x86_64-0.9.1-BYOS-Build1.55
</code></pre>
<p>The FLAVOR variable from openQA contains both (CPS name and Image flavor), e.g. <code>GCE-On-Demand</code> or <code>Azure-Standard-On-Demand</code>.<br>
The BUILD variable form openQA contains KIWI and Build number, separated by <code>-</code>, e.g. <code>0.9.1-1.55</code>.</p>
openQA Tests - action #56462 (Resolved): [qac][public cloud] Improve boottime test - Adopt thresh...https://progress.opensuse.org/issues/564622019-09-04T13:23:05Zcfconradcfamullaconrad@suse.com
<p>Our current boot time threashold need to be Provider specific.<br>
This was aggregated with the PC team in the last meeting on 2020-03-16.</p>
<p>Also the guestregister is that slow, because of the provided SCC API. And currently PC-Team doesn't see any improvement possibilities from there side.</p>
openQA Tests - action #52919 (Resolved): [qac][public cloud] Add unit tests to PCW https://progress.opensuse.org/issues/529192019-06-12T08:02:25Zcfconradcfamullaconrad@suse.com
<p>We need unit tests in <a href="https://github.com/cfconrad/pcw" class="external">https://github.com/cfconrad/pcw</a></p>
<p>Hints:</p>
<ul>
<li><a href="https://streaming.nue.suse.com/i/dcm/shap/2019-06-05-python-tips-tricks.mp4" class="external">https://streaming.nue.suse.com/i/dcm/shap/2019-06-05-python-tips-tricks.mp4</a></li>
</ul>
openQA Tests - action #45758 (Rejected): [qac][public cloud] Get hard boot time limits for specif...https://progress.opensuse.org/issues/457582019-01-07T10:27:52Zcfconradcfamullaconrad@suse.com
<p>For the test modules, we should have fixed boot time limits for specific CSPs.</p>
<p>Q: The boot time is VM type related, do we need to take this into account?</p>
openQA Project - action #44654 (Resolved): [tool] Summarize results in test details tabhttps://progress.opensuse.org/issues/446542018-12-03T13:35:29Zcfconradcfamullaconrad@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>To get a quick overview in test details the idea is to show grouped results in tab on details page, somehow similar to what we have in tests list: <img src="https://progress.opensuse.org/attachments/download/7238/overview.png" alt="short summary" loading="lazy" />.</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1:</strong> test details tabs shows test module results summary</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<p>The initial idea was to have it for "external results", but it could also apply to details, which need to be discussed. We also show the number of comments in the comment tab.</p>
openQA Project - action #40913 (Resolved): script_output sometimes fail on virtio consolehttps://progress.opensuse.org/issues/409132018-09-12T09:34:38Zcfconradcfamullaconrad@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>It seams randomly happen in openQA, that tests fail, cause "cat -" never finish.</p>
<a name="Steps-to-reproduce"></a>
<h2 >Steps to reproduce<a href="#Steps-to-reproduce" class="wiki-anchor">¶</a></h2>
<p>Observations on openQA</p>
<ul>
<li><a href="https://progress.opensuse.org/issues/30613#note-23" class="external">https://progress.opensuse.org/issues/30613#note-23</a> </li>
<li><a href="https://openqa.suse.de/tests/2031979#step/boot_ltp/78" class="external">https://openqa.suse.de/tests/2031979#step/boot_ltp/78</a></li>
</ul>
<p>I was able to bring my openQA instance in such a state. I'm actually not sure, if this<br>
is the same problem as we have in osd, but it looks similar. The big different is, that if it happen once,<br>
it happen always for that worker.</p>
<p>What I did so far:</p>
<ul>
<li>Start a test which is using virtio console</li>
<li>restart openQA while the test is running</li>
<li>run tests again</li>
</ul>
<a name="Problem"></a>
<h2 >Problem<a href="#Problem" class="wiki-anchor">¶</a></h2>
<p>A call like this:</p>
<pre><code>cat - > /tmp/script8RI3l.sh; echo 8RI3l-$?-
</code></pre>
<p>Doesn't get the EOT and so we never reach the prompt again.</p>
<a name="Suggestion"></a>
<h2 >Suggestion<a href="#Suggestion" class="wiki-anchor">¶</a></h2>
<p>We need deeper investigations.</p>