openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842021-07-26T08:51:35ZopenSUSE Project Management Tool
Redmine openQA Project - action #95995 (Resolved): [sporadic][openqa-in-openqa] Test openqa_from_git eve...https://progress.opensuse.org/issues/959952021-07-26T08:51:35Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>In this test run <a href="https://openqa.opensuse.org/tests/1857293#step/openqa_webui/33" class="external">https://openqa.opensuse.org/tests/1857293#step/openqa_webui/33</a> the is a problem. Seems that the server is not responsive</p>
<pre><code># Test died: command 'while ! [ -f nohup.out ]; do sleep 1 ; done && grep -qP "Listening at.*(127.0.0.1|localhost)" <(tail -f -n0 nohup.out) ' timed out at openqa//tests/install/openqa_webui.pm line 68.
</code></pre>
<p><a href="https://openqa.opensuse.org/tests/1857293/logfile?filename=openqa_webui-openqa_nohup_out.txt" class="external">https://openqa.opensuse.org/tests/1857293/logfile?filename=openqa_webui-openqa_nohup_out.txt</a> shows</p>
<pre><code>[warn] [AssetPack] Unable to download https://cdnjs.cloudflare.com/ajax/libs/chosen/1.7.0/chosen.css: Connect timeout
Could not find input asset "https://cdnjs.cloudflare.com/ajax/libs/chosen/1.7.0/chosen.css". at /usr/lib/perl5/vendor_perl/5.32.1/Mojolicious/Plugin/AssetPack.pm line 172.
</code></pre>
<p>which <em>maybe</em> is causing the problem, maybe not.</p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: The above timeout does not appear again in at least 10 consecutive rounds</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Crosscheck in a passed test if the asset connect timeout warning also shows up to prevent us following a "red herring"</li>
<li>DONE: Check if the above download URL from asset definitions can work -> the link <a href="https://cdnjs.cloudflare.com/ajax/libs/chosen/1.7.0/chosen.css" class="external">https://cdnjs.cloudflare.com/ajax/libs/chosen/1.7.0/chosen.css</a> works</li>
<li>Try to reproduce locally as well as use <a href="https://progress.opensuse.org/projects/openqatests/wiki/Wiki#Statistical-investigation" class="external">https://progress.opensuse.org/projects/openqatests/wiki/Wiki#Statistical-investigation</a> to get statistics of failures</li>
<li>Prevent timeout either on low-level, e.g. asset preparation or high-level, e.g. retry within the openQA-in-openQA tests</li>
</ul>
QA - action #95854 (Rejected): Grafana doesn't show information during some minutes, but also we ...https://progress.opensuse.org/issues/958542021-07-22T10:17:59Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>On 2021-07-22 10:14 we can grafana is not showing getting any results of the Webui summary ping<br>
<a href="https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=76&orgId=1&from=1626941518339&to=1626942588243" class="external">https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=76&orgId=1&from=1626941518339&to=1626942588243</a><br>
And we can check that we have increase of CPU after the recovery<br>
<a href="https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=25&orgId=1" class="external">https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=25&orgId=1</a><br>
<a href="https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=25&orgId=1&from=1628060971570&to=1628663436435" class="external">https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=25&orgId=1&from=1628060971570&to=1628663436435</a></p>
<p>During the daily we checked that there weren't a huge quantity of pending jobs to explain the amount of CPU on the recovery.</p>
openQA Project - action #95721 (Resolved): [Sporadic] containers: tests fail with "Test died: no ...https://progress.opensuse.org/issues/957212021-07-20T11:36:37Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Eventually in some of the openQA container tests in openQA we find this error "Test died: no candidate needle with tag(s) 'inst-console' matched"<br>
See these examples:</p>
<p><a href="https://openqa.opensuse.org/tests/1847722#step/openqa_webui/3" class="external">https://openqa.opensuse.org/tests/1847722#step/openqa_webui/3</a><br>
<a href="https://openqa.opensuse.org/tests/1848261#step/openqa_webui/3" class="external">https://openqa.opensuse.org/tests/1848261#step/openqa_webui/3</a></p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: the test pass without these errors in high enough runs (check the current frequency of the problem)</li>
</ul>
<a name="Suggestion"></a>
<h2 >Suggestion<a href="#Suggestion" class="wiki-anchor">¶</a></h2>
<ul>
<li>Try to reproduce the problem locally</li>
<li>In the worst case increase the timeout</li>
</ul>
openQA Project - action #95179 (Resolved): [sporadic] containers: eventually the tests fails on s...https://progress.opensuse.org/issues/951792021-07-07T12:44:11Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Eventually we saw this error in the container tests.</p>
<pre><code class="text syntaxhl" data-language="text">Can not create MOJO_TMPDIR : mkdir /var/lib/openqa/share/factory/tmp: Permission denied at /usr/share/openqa/script/../lib/OpenQA/Setup.pm line 316.
</code></pre>
<ul>
<li><a href="https://openqa.opensuse.org/tests/1830297#step/single_container_webui/107" class="external">https://openqa.opensuse.org/tests/1830297#step/single_container_webui/107</a></li>
<li><a href="https://openqa.opensuse.org/tests/1778677#step/single_container_webui/107" class="external">https://openqa.opensuse.org/tests/1778677#step/single_container_webui/107</a></li>
</ul>
<p><a href="https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=openqa&flavor=dev&machine=64bit-2G&test=openqa_from_containers&version=Tumbleweed" class="external">https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=openqa&flavor=dev&machine=64bit-2G&test=openqa_from_containers&version=Tumbleweed</a></p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><em>AC 1</em>: The test is fixed and doesn't break here</li>
</ul>
<a name="Steps-to-reproduce"></a>
<h2 >Steps to reproduce<a href="#Steps-to-reproduce" class="wiki-anchor">¶</a></h2>
<ul>
<li>Find openqa tests failing on <a href="https://openqa.opensuse.org/tests/1830297#next_previous" class="external">https://openqa.opensuse.org/tests/1830297#next_previous</a></li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Try to reproduce this can locally</li>
<li>Try to fix it in openQA itself not just a package</li>
<li>The same menssage is logged by two different components, maybe is a concurrency problem</li>
</ul>
openQA Project - action #94030 (Resolved): Cleanup logging in autoinst-log.txt for download assetshttps://progress.opensuse.org/issues/940302021-06-15T12:51:18Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>In the ticket <a class="issue tracker-4 status-3 priority-4 priority-default closed child" title="action: Cleanup logging in autoinst-log.txt (Resolved)" href="https://progress.opensuse.org/issues/91527">#91527</a> we listed other cases to cleanup. One of these is the information of the assets download, e.g.</p>
<pre><code>[2021-05-17T13:49:33.0579 CEST] [info] Download of Tumbleweed.x86_64-1.0-virtualbox-Snapshot20210516.vagrant.virtualbox.box processed:
[info] [#358]
Cache size of "/var/lib/openqa/cache" is 57GiB, with limit 180GiB
[info] [#358]
Downloading "Tumbleweed.x86_64-1.0-virtualbox-Snapshot20210516.vagrant.virtualbox.box" from "http://openqa1-opensuse/tests/1745884/asset/other/Tumbleweed.x86_64-1.0-virtualbox-Snapshot20210516.vagrant.virtualbox.box"
[info] [#358]
Content of "/var/lib/openqa/cache/openqa1-opensuse/Tumbleweed.x86_64-1.0-virtualbox-Snapshot20210516.vagrant.virtualbox.box" has not changed, updating last use
</code></pre>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong> : indent with the same indentation criteria than in <a class="issue tracker-4 status-3 priority-4 priority-default closed child" title="action: Cleanup logging in autoinst-log.txt (Resolved)" href="https://progress.opensuse.org/issues/91527">#91527</a></li>
</ul>
<a name="Suggestion"></a>
<h2 >Suggestion<a href="#Suggestion" class="wiki-anchor">¶</a></h2>
<ul>
<li><a href="https://github.com/os-autoinst/os-autoinst/pull/1670" class="external">https://github.com/os-autoinst/os-autoinst/pull/1670</a></li>
<li>See: <a href="https://github.com/os-autoinst/os-autoinst/blob/09824a01348c41641d5cff8cd6d4192ad5ebd7a6/bmwqemu.pm#L199" class="external">https://github.com/os-autoinst/os-autoinst/blob/09824a01348c41641d5cff8cd6d4192ad5ebd7a6/bmwqemu.pm#L199</a></li>
</ul>
openQA Project - action #92833 (Resolved): containers: Web UI cannot connect to schedulerhttps://progress.opensuse.org/issues/928332021-05-19T09:08:20Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Trying to complete the task <a class="issue tracker-4 status-12 priority-4 priority-default child" title="action: How to run an openQA test in 5 minutes size:M (Workable)" href="https://progress.opensuse.org/issues/76978">#76978</a> I found a problem in the webui container. It cannot connect to the scheduler and the jobs still unscheduled</p>
<pre><code class="text syntaxhl" data-language="text">webui_2 | [warn] Unable to wakeup scheduler: Connection refused
</code></pre>
<p>This happens when we launch a web UI openQA using the docker-compose, and try to run a job (using clone_job)</p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: webui can connect to the scheduler</li>
</ul>
<a name="References"></a>
<h2 >References<a href="#References" class="wiki-anchor">¶</a></h2>
<ul>
<li>See the comments at <a class="issue tracker-4 status-12 priority-4 priority-default child" title="action: How to run an openQA test in 5 minutes size:M (Workable)" href="https://progress.opensuse.org/issues/76978#note-37">#76978#note-37</a></li>
</ul>
openQA Project - action #91752 (Resolved): jenkins: Multiple missing fields and errors in configu...https://progress.opensuse.org/issues/917522021-04-26T11:10:31Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Saving a new configuration is necessary to accomplish <a class="issue tracker-4 status-3 priority-5 priority-high3 closed behind-schedule" title="action: openQA-in-openQA tests always fail and results do not impact submission pipeline (Resolved)" href="https://progress.opensuse.org/issues/88754">#88754</a>. But it's impossible because multiple missing fields and errors in the UI configuration.<br>
It is not possible to save new changes.</p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: The configuration can be changed and saved</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Configuration url: <a href="http://jenkins.qa.suse.de/view/openQA-in-openQA/job/monitor-openQA_in_openQA-TW/configure" class="external">http://jenkins.qa.suse.de/view/openQA-in-openQA/job/monitor-openQA_in_openQA-TW/configure</a></li>
</ul>
openQA Project - action #91377 (Resolved): CI: fix static-check-containershttps://progress.opensuse.org/issues/913772021-04-19T14:37:06Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Current test is failing because hadolint project commit this<br>
<a href="https://github.com/hadolint/hadolint/commit/4cb8f28ebecfd0343241369952fc9b3e7e4ea866" class="external">https://github.com/hadolint/hadolint/commit/4cb8f28ebecfd0343241369952fc9b3e7e4ea866</a></p>
<p>Example:</p>
<pre><code># Static check of container/travis_test/Dockerfile
-:151 DL3059 info: Multiple consecutive `RUN` instructions. Consider consolidation.
-:152 DL3059 info: Multiple consecutive `RUN` instructions. Consider consolidation.
-:153 DL3059 info: Multiple consecutive `RUN` instructions. Consider consolidation.
-:159 DL3059 info: Multiple consecutive `RUN` instructions. Consider consolidation.
</code></pre>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: static-check-containers runs without error</li>
</ul>
openQA Project - action #91097 (Resolved): CI: "webui-docker-compose" eventually fails building i...https://progress.opensuse.org/issues/910972021-04-14T07:32:48Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Eventually the image build fails on the zipper command chain.<br>
On an initial observation it is not possible to determine witch one causes the problem</p>
<pre><code class="text syntaxhl" data-language="text">Building worker ...
The command '/bin/sh -c zypper ar -p 95 -f http://download.opensuse.org/repositories/devel:openQA/openSUSE_Leap_15.2 devel_openQA && zypper ar -p 90 -f http://download.opensuse.org/repositories/devel:openQA:Leap:15.2/openSUSE_Leap_15.2 devel_openQA_Leap && zypper --gpg-auto-import-keys ref && zypper in -y ca-certificates-mozilla curl gzip && zypper in -y openQA-worker qemu-arm qemu-ppc qemu-x86 qemu-tools && zypper in -y kmod && (zypper in -y qemu-ovmf-x86_64 ||:) && (zypper in -y qemu-uefi-aarch64 ||:) && zypper clean' returned a non-zero code: 8
ERROR: for worker (<Service: worker>, '')
Service 'worker' failed to build
</code></pre>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: The image is built without errors on the worker service</li>
</ul>
<a name="suggestions"></a>
<h2 >suggestions<a href="#suggestions" class="wiki-anchor">¶</a></h2>
<p>We don't have too much information in the logs, therefore the cause is not clear. Increase the log information could be a good first step to determine the problem.</p>
<a name="Other-examples"></a>
<h2 >Other examples<a href="#Other-examples" class="wiki-anchor">¶</a></h2>
<pre><code class="text syntaxhl" data-language="text">Building nginx ...
The command '/bin/sh -c zypper ar -p 95 -f http://download.opensuse.org/repositories/devel:openQA/openSUSE_Leap_15.2 devel_openQA && zypper ar -p 90 -f http://download.opensuse.org/repositories/devel:openQA:Leap:15.2/openSUSE_Leap_15.2 devel_openQA_Leap && zypper --gpg-auto-import-keys ref && zypper in -y --force-resolution openQA nginx && zypper clean' returned a non-zero code: 8
The command '/bin/sh -c zypper ar -p 95 -f http://download.opensuse.org/repositories/devel:openQA/openSUSE_Leap_15.2 devel_openQA && zypper ar -p 90 -f http://download.opensuse.org/repositories/devel:openQA:Leap:15.2/openSUSE_Leap_15.2 devel_openQA_Leap && zypper --gpg-auto-import-keys ref && zypper in -y ca-certificates-mozilla curl && zypper in -y --force-resolution openQA-local-db apache2 hostname which w3m && zypper clean' returned a non-zero code: 8
The command '/bin/sh -c zypper ar -p 95 -f http://download.opensuse.org/repositories/devel:openQA/openSUSE_Leap_15.2 devel_openQA && zypper ar -p 90 -f http://download.opensuse.org/repositories/devel:openQA:Leap:15.2/openSUSE_Leap_15.2 devel_openQA_Leap && zypper --gpg-auto-import-keys ref && zypper in -y ca-certificates-mozilla curl && zypper in -y --force-resolution openQA-local-db apache2 hostname which w3m && zypper clean' returned a non-zero code: 8
The command '/bin/sh -c zypper ar -p 95 -f http://download.opensuse.org/repositories/devel:openQA/openSUSE_Leap_15.2 devel_openQA && zypper ar -p 90 -f http://download.opensuse.org/repositories/devel:openQA:Leap:15.2/openSUSE_Leap_15.2 devel_openQA_Leap && zypper --gpg-auto-import-keys ref && zypper in -y ca-certificates-mozilla curl && zypper in -y --force-resolution openQA-local-db apache2 hostname which w3m && zypper clean' returned a non-zero code: 8
The command '/bin/sh -c zypper ar -p 95 -f http://download.opensuse.org/repositories/devel:openQA/openSUSE_Leap_15.2 devel_openQA && zypper ar -p 90 -f http://download.opensuse.org/repositories/devel:openQA:Leap:15.2/openSUSE_Leap_15.2 devel_openQA_Leap && zypper --gpg-auto-import-keys ref && zypper in -y ca-certificates-mozilla curl && zypper in -y --force-resolution openQA-local-db apache2 hostname which w3m && zypper clean' returned a non-zero code: 8
</code></pre> openSUSE admin - tickets #88751 (Resolved): Problem login into openqa.suse.de and openqa.opensuse...https://progress.opensuse.org/issues/887512021-02-18T12:30:03Zilausuchilausuch@suse.com
<p>When try to login, it navegates to the OpenID page, but after click on login this navigates to<br>
<a href="https://mirrorcache-eu.opensuse.org/" class="external">https://mirrorcache-eu.opensuse.org/</a><br>
or <br>
<a href="http://localhost/response?oic.time=161365126" class="external">http://localhost/response?oic.time=161365126</a></p>
<p>I checked this with firefox and chromium</p>
openQA Project - action #88482 (Resolved): Two absolute paths concatenated to form a default need...https://progress.opensuse.org/issues/884822021-02-08T13:07:40Zilausuchilausuch@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>Sometimes a job execution fails with this error</p>
<pre><code>needles_dir not found: /var/lib/openqa/share/tests/opensuse/var/lib/openqa/share/tests/opensuse/products/opensuse/needles (check vars.json?) at /usr/lib/os-autoinst/needle.pm line 330.
</code></pre>
<p>Is concatenating two absolute paths (<a href="https://github.com/os-autoinst/os-autoinst/blob/adbb28bc61ce4f21a55d07399eac7d48badc6b6f/needle.pm#L328" class="external">https://github.com/os-autoinst/os-autoinst/blob/adbb28bc61ce4f21a55d07399eac7d48badc6b6f/needle.pm#L328</a>) when needles directory doesn't exist.</p>
<a name="Reproduction"></a>
<h2 >Reproduction<a href="#Reproduction" class="wiki-anchor">¶</a></h2>
<p>Remove the directory needles from /var/lib/openqa/share/tests/opensuse/products/opensuse</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li>AC1: Needles folder has a working default or aborts if PRODUCT_DIR/needles doesn't exist</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Look into logic in <code>needle.pm</code></li>
<li>Improve error message to reveal relevant variables instead of hinting at <code>vars.json</code> i.e. <code>NEEDLES_DIR</code>, <code>CASEDIR</code> and <code>default_needles_dir</code></li>
<li>Log the missing <code>PRODUCTDIR}/needles</code> if this affects the default nedles folder to be used here</li>
</ul>
<a name="Work-around"></a>
<h2 >Work-around<a href="#Work-around" class="wiki-anchor">¶</a></h2>
<ul>
<li>Create a folder <code>PRODUCTDIR}/needles</code></li>
</ul>
QA - action #88183 (Resolved): [spike][timeboxed:20h] rancher: Create a simple selenium test for ...https://progress.opensuse.org/issues/881832021-01-25T10:26:02Zilausuchilausuch@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>And since openQA is widely used as a testing system. This ticket is intended to prove that the integration of rancher tests with openQA is possible, in particular in the case of the UI</p>
<a name="Problem"></a>
<h2 >Problem<a href="#Problem" class="wiki-anchor">¶</a></h2>
<p>OpenQA can use the standard method of using needles to test the UI (see <a href="https://openqa.opensuse.org/group_overview/78" class="external">https://openqa.opensuse.org/group_overview/78</a>), but since rancher UI is a browser application they propose to use more appropriate tools such as selenium. This ticket covers the creation of a simple selenium test for Ranche UI</p>
<a name="User-story"></a>
<h2 >User story<a href="#User-story" class="wiki-anchor">¶</a></h2>
<p>I would like to promote openQA as a testing tool, and collaterally create the seed for a Rancher UI test with selenium</p>
<a name="Suggestion"></a>
<h2 >Suggestion<a href="#Suggestion" class="wiki-anchor">¶</a></h2>
<p>Use Python as the main language of the test as it may be more familiar to selenium developers and can be run independently of openQA.</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li>AC1: Create a test using python to check some parts of the Rancher UI</li>
<li>AC2: Integrate in openQA as part of the tests in group <a href="https://openqa.opensuse.org/group_overview/78" class="external">https://openqa.opensuse.org/group_overview/78</a> </li>
</ul>
openQA Project - coordination #81060 (Blocked): [epic] openQA web UI in kuberneteshttps://progress.opensuse.org/issues/810602020-12-15T06:09:11Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Helm charts allows you to automate the deployment of a complex set of items in a kubernetes environment. These elements are not only limited to pods (containers) but also to configurations (configmaps and secrets), and all the resources they need in the correct order and with the proper checks.</p>
<p>Thanks to the work done in <a class="issue tracker-6 status-15 priority-4 priority-default parent" title="coordination: [saga][epic] Scale out: Redundant/load-balancing deployments of openQA, easy containers, containe... (Blocked)" href="https://progress.opensuse.org/issues/80142">#80142</a> we saw how to divide the web UI into parts, which were could be converted into HA and which had to remain standalone. In addition to how we should configure the load balancer to integrate each of the different services that make up the complete web UI.</p>
<p>This ticket proposes to create a helm chart capable of generating a complete and functional deployment of the web UI based on the following prerequisites:</p>
<ul>
<li>There is a pre-existing installation of kubernetes</li>
</ul>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1:</strong> The complete web UI HA is installed with the DB with the default options</li>
<li><strong>AC2:</strong> The web UI is accessible from outside of the cluster</li>
<li><strong>AC3:</strong> The helm chart is configurable with: Typical and basic parameters and, number of replicas for HA, type of persistence for DB, ...</li>
<li><strong>AC4:</strong> Documentation is completed with instructions of use</li>
<li><strong>AC5:</strong> Deployed together with rancher</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Highly recommended based on work already done in <a class="issue tracker-6 status-15 priority-4 priority-default parent" title="coordination: [saga][epic] Scale out: Redundant/load-balancing deployments of openQA, easy containers, containe... (Blocked)" href="https://progress.opensuse.org/issues/80142">#80142</a>, e.g. the existing docker-compose setup</li>
<li><del>Proof-of-concept of either openQA webUI <em>or</em> worker within kubernetes, e.g. using k3s or try rancher directly</del> done for both webUI and worker in <a class="issue tracker-4 status-3 priority-4 priority-default closed child" title="action: [timeboxed:20h][spike] openQA proof-of-concept within kubernetes size:M (Resolved)" href="https://progress.opensuse.org/issues/110524">#110524</a></li>
<li>Use local kubernetes deployments to development purposes (this avoid the infra needs). For instance: minikube, k3s,... </li>
<li>Figure out if is necessary to publish the helm chart and where: <a href="https://helm.sh/docs/howto/chart_releaser_action/">https://helm.sh/docs/howto/chart_releaser_action/</a></li>
<li>Combine with rancher</li>
<li>Ensure proper testing of the charts
<ul>
<li>Create kubernetes cluster inside docker inside GitHub Actions: <a href="https://github.com/marketplace/actions/kind-cluster">https://github.com/marketplace/actions/kind-cluster</a></li>
<li>Look at chart-testing tool: <a href="https://github.com/marketplace/actions/helm-chart-testing">https://github.com/marketplace/actions/helm-chart-testing</a></li>
<li>Try to deploy the chart inside CI</li>
</ul></li>
<li>Add definitions for init containers to allow fetching tests/needles from git repository during installation</li>
<li>As an alternative to git, provide a persistent volume claim template for shared volume (ReadMany) -- think about Longhorn</li>
<li>Add definition for rsyncd container to allow usage of cache service in the worker pod to synchronize data between webui and worker pods</li>
<li>Enhance customization options of the current chart, add common options (like annotations, pod security, replicas count, ...) which are provided by the blank helm templates (reuse initial templates created by <code>helm create</code>)</li>
</ul>
openQA Project - action #69244 (Resolved): Need to rebuild the video codecs after update the syst...https://progress.opensuse.org/issues/692442020-07-22T14:37:50Zilausuchilausuch@suse.com
<p>In Tumbleweed, after updating the system using <br>
sudo zypper dup --allow-vendor-change</p>
<p>All the jobs stopped with this error:</p>
<pre><code>Likely error from autoinst-log.txt:
[2020-07-22T15:46:45.0862 CEST] [info] [pid:2457] +++ setup notes +++
[2020-07-22T15:46:45.0862 CEST] [info] [pid:2457] Running on localhost.localdomain:1 (Linux 5.7.7-1-default #1 SMP Wed Jul 1 19:03:27 UTC 2020 (cba119b) x86_64)
[2020-07-22T15:46:45.0889 CEST] [debug] [pid:13759] +++ worker notes +++
�[37m[2020-07-22T15:46:46.822 CEST] [debug] Current version is 3d1c89cb598f231c00f81ed9b966ae9ed45490a0 [interface v20]
�[0m�[37m[2020-07-22T15:46:46.833 CEST] [debug] git hash in /hdd/openqa-devel/openqa/share/tests/opensuse: ae743b815a54245daa6c9dd569a630c1328b7b1d
�[0m�[37m[2020-07-22T15:46:46.983 CEST] [debug] usingenv DESKTOP=kde
�[0m�[37m[2020-07-22T15:46:46.983 CEST] [debug] usingenv DISTRI=opensuse
�[0m�[37m[2020-07-22T15:46:46.983 CEST] [debug] usingenv QEMUCPU=qemu64
�[0m�[37m[2020-07-22T15:46:46.984 CEST] [debug] usingenv INSTLANG=en_US
�[0m�[37m[2020-07-22T15:46:46.984 CEST] [debug] usingenv DVD=1
�[0m�[37m[2020-07-22T15:46:46.984 CEST] [debug] usingenv KDE=1
�[0m�[37m[2020-07-22T15:46:46.984 CEST] [debug] usingenv ISO=/hdd/openqa-devel/openqa/share/factory/iso/openSUSE-Leap-15.2-DVD-x86_64-Build695.1-Media.iso
�[0m�[37m[2020-07-22T15:46:46.984 CEST] [debug] usingenv ISO_MAXSIZE=4700372992
�[0m�[37m[2020-07-22T15:46:46.984 CEST] [debug] usingenv NOIMAGES=1
�[0m�[37m[2020-07-22T15:46:46.985 CEST] [debug] scheduling isosize tests/installation/isosize.pm
�[0m�[37m[2020-07-22T15:46:47.000 CEST] [debug] scheduling bootloader tests/installation/bootloader.pm
�[0m�[37m[2020-07-22T15:46:47.002 CEST] [debug] scheduling welcome tests/installation/welcome.pm
�[0m�[37m[2020-07-22T15:46:47.003 CEST] [debug] scheduling online_repos tests/installation/online_repos.pm
�[0m�[37m[2020-07-22T15:46:47.003 CEST] [debug] scheduling installation_mode tests/installation/installation_mode.pm
�[0m�[37m[2020-07-22T15:46:47.004 CEST] [debug] scheduling logpackages tests/installation/logpackages.pm
�[0m�[37m[2020-07-22T15:46:47.005 CEST] [debug] scheduling system_role tests/installation/system_role.pm
�[0m�[37m[2020-07-22T15:46:47.008 CEST] [debug] scheduling partitioning tests/installation/partitioning.pm
�[0m�[37m[2020-07-22T15:46:47.009 CEST] [debug] scheduling partitioning_finish tests/installation/partitioning_finish.pm
�[0m�[37m[2020-07-22T15:46:47.010 CEST] [debug] scheduling installer_timezone tests/installation/installer_timezone.pm
�[0m�[37m[2020-07-22T15:46:47.011 CEST] [debug] scheduling user_settings tests/installation/user_settings.pm
�[0m�[37m[2020-07-22T15:46:47.011 CEST] [debug] scheduling resolve_dependency_issues tests/installation/resolve_dependency_issues.pm
�[0m�[37m[2020-07-22T15:46:47.012 CEST] [debug] scheduling installation_overview tests/installation/installation_overview.pm
�[0m�[37m[2020-07-22T15:46:47.013 CEST] [debug] scheduling disable_grub_timeout tests/installation/disable_grub_timeout.pm
�[0m�[37m[2020-07-22T15:46:47.014 CEST] [debug] scheduling start_install tests/installation/start_install.pm
�[0m�[37m[2020-07-22T15:46:47.016 CEST] [debug] scheduling await_install tests/installation/await_install.pm
�[0m�[37m[2020-07-22T15:46:47.017 CEST] [debug] scheduling logs_from_installation_system tests/installation/logs_from_installation_system.pm
�[0m�[37m[2020-07-22T15:46:47.018 CEST] [debug] scheduling reboot_after_installation tests/installation/reboot_after_installation.pm
�[0m�[37m[2020-07-22T15:46:47.020 CEST] [debug] scheduling grub_test tests/installation/grub_test.pm
�[0m�[37m[2020-07-22T15:46:47.021 CEST] [debug] scheduling first_boot tests/installation/first_boot.pm
�[0m�[37m[2020-07-22T15:46:47.022 CEST] [debug] scheduling zypper_clear_repos tests/update/zypper_clear_repos.pm
�[0m�[37m[2020-07-22T15:46:47.023 CEST] [debug] scheduling zypper_ar tests/console/zypper_ar.pm
�[0m�[37m[2020-07-22T15:46:47.023 CEST] [debug] scheduling zypper_ref tests/console/zypper_ref.pm
�[0m�[37m[2020-07-22T15:46:47.024 CEST] [debug] scheduling prepare_system_for_update_tests tests/update/prepare_system_for_update_tests.pm
�[0m�[37m[2020-07-22T15:46:47.057 CEST] [debug] scheduling updates_packagekit_kde tests/update/updates_packagekit_kde.pm
�[0m�[37m[2020-07-22T15:46:47.058 CEST] [debug] scheduling check_system_is_updated tests/update/check_system_is_updated.pm
�[0m�[37m[2020-07-22T15:46:47.060 CEST] [debug] scheduling system_prepare tests/console/system_prepare.pm
�[0m�[37m[2020-07-22T15:46:47.061 CEST] [debug] scheduling check_network tests/console/check_network.pm
�[0m�[37m[2020-07-22T15:46:47.063 CEST] [debug] scheduling system_state tests/console/system_state.pm
�[0m�[37m[2020-07-22T15:46:47.064 CEST] [debug] scheduling prepare_test_data tests/console/prepare_test_data.pm
�[0m�[37m[2020-07-22T15:46:47.065 CEST] [debug] scheduling consoletest_setup tests/console/consoletest_setup.pm
�[0m�[37m[2020-07-22T15:46:47.067 CEST] [debug] scheduling keymap_or_locale tests/locale/keymap_or_locale.pm
�[0m�[37m[2020-07-22T15:46:47.068 CEST] [debug] scheduling force_scheduled_tasks tests/console/force_scheduled_tasks.pm
�[0m�[37m[2020-07-22T15:46:47.069 CEST] [debug] scheduling textinfo tests/console/textinfo.pm
�[0m�[37m[2020-07-22T15:46:47.069 CEST] [debug] scheduling hostname tests/console/hostname.pm
�[0m�[37m[2020-07-22T15:46:47.070 CEST] [debug] scheduling x_vt tests/console/x_vt.pm
�[0m�[37m[2020-07-22T15:46:47.071 CEST] [debug] scheduling zypper_lr tests/console/zypper_lr.pm
�[0m�[37m[2020-07-22T15:46:47.071 CEST] [debug] scheduling ncurses tests/console/ncurses.pm
�[0m�[37m[2020-07-22T15:46:47.085 CEST] [debug] scheduling yast2_lan tests/console/yast2_lan.pm
�[0m�[37m[2020-07-22T15:46:47.086 CEST] [debug] scheduling curl_https tests/console/curl_https.pm
�[0m�[37m[2020-07-22T15:46:47.087 CEST] [debug] scheduling salt tests/console/salt.pm
�[0m�[37m[2020-07-22T15:46:47.088 CEST] [debug] scheduling glibc_sanity tests/console/glibc_sanity.pm
�[0m�[37m[2020-07-22T15:46:47.089 CEST] [debug] scheduling zypper_in tests/console/zypper_in.pm
�[0m�[37m[2020-07-22T15:46:47.090 CEST] [debug] scheduling zypper_log tests/console/zypper_log.pm
�[0m�[37m[2020-07-22T15:46:47.091 CEST] [debug] scheduling yast2_i tests/console/yast2_i.pm
�[0m�[37m[2020-07-22T15:46:47.092 CEST] [debug] scheduling yast2_bootloader tests/console/yast2_bootloader.pm
�[0m�[37m[2020-07-22T15:46:47.093 CEST] [debug] scheduling vim tests/console/vim.pm
�[0m�[37m[2020-07-22T15:46:47.093 CEST] [debug] scheduling firewall_enabled tests/console/firewall_enabled.pm
�[0m�[37m[2020-07-22T15:46:47.095 CEST] [debug] scheduling sshd tests/console/sshd.pm
�[0m�[37m[2020-07-22T15:46:47.096 CEST] [debug] scheduling ssh_cleanup tests/console/ssh_cleanup.pm
�[0m�[37m[2020-07-22T15:46:47.097 CEST] [debug] scheduling sshfs tests/console/sshfs.pm
�[0m�[37m[2020-07-22T15:46:47.098 CEST] [debug] scheduling mtab tests/console/mtab.pm
�[0m�[37m[2020-07-22T15:46:47.100 CEST] [debug] scheduling orphaned_packages_check tests/console/orphaned_packages_check.pm
�[0m�[37m[2020-07-22T15:46:47.102 CEST] [debug] scheduling consoletest_finish tests/console/consoletest_finish.pm
�[0m�[37m[2020-07-22T15:46:47.103 CEST] [debug] scheduling user_gui_login tests/x11/user_gui_login.pm
�[0m�[37m[2020-07-22T15:46:47.104 CEST] [debug] scheduling desktop_runner tests/x11/desktop_runner.pm
�[0m�[37m[2020-07-22T15:46:47.105 CEST] [debug] scheduling xterm tests/x11/xterm.pm
�[0m�[37m[2020-07-22T15:46:47.106 CEST] [debug] scheduling keymap_or_locale_x11 tests/locale/keymap_or_locale_x11.pm
�[0m�[37m[2020-07-22T15:46:47.107 CEST] [debug] scheduling sshxterm tests/x11/sshxterm.pm
�[0m�[37m[2020-07-22T15:46:47.108 CEST] [debug] scheduling firefox tests/x11/firefox.pm
�[0m�[37m[2020-07-22T15:46:47.109 CEST] [debug] scheduling firefox_audio tests/x11/firefox_audio.pm
�[0m�[37m[2020-07-22T15:46:47.110 CEST] [debug] scheduling chromium tests/x11/chromium.pm
�[0m�[37m[2020-07-22T15:46:47.111 CEST] [debug] scheduling ooffice tests/x11/ooffice.pm
�[0m�[37m[2020-07-22T15:46:47.112 CEST] [debug] scheduling oomath tests/x11/oomath.pm
�[0m�[37m[2020-07-22T15:46:47.113 CEST] [debug] scheduling oocalc tests/x11/oocalc.pm
�[0m�[37m[2020-07-22T15:46:47.114 CEST] [debug] scheduling plasma_browser_integration tests/x11/plasma_browser_integration.pm
�[0m�[37m[2020-07-22T15:46:47.115 CEST] [debug] scheduling khelpcenter tests/x11/khelpcenter.pm
�[0m�[37m[2020-07-22T15:46:47.116 CEST] [debug] scheduling systemsettings5 tests/x11/systemsettings5.pm
�[0m�[37m[2020-07-22T15:46:47.117 CEST] [debug] scheduling dolphin tests/x11/dolphin.pm
�[0m�[37m[2020-07-22T15:46:47.118 CEST] [debug] scheduling glxgears tests/x11/glxgears.pm
�[0m�[37m[2020-07-22T15:46:47.119 CEST] [debug] scheduling desktop_mainmenu tests/x11/desktop_mainmenu.pm
�[0m�[37m[2020-07-22T15:46:47.120 CEST] [debug] scheduling inkscape tests/x11/inkscape.pm
�[0m�[37m[2020-07-22T15:46:47.120 CEST] [debug] scheduling gimp tests/x11/gimp.pm
�[0m�[37m[2020-07-22T15:46:47.121 CEST] [debug] scheduling hexchat tests/x11/hexchat.pm
�[0m�[37m[2020-07-22T15:46:47.122 CEST] [debug] scheduling vlc tests/x11/vlc.pm
�[0m�[37m[2020-07-22T15:46:47.122 CEST] [debug] scheduling kate tests/x11/kate.pm
�[0m�[37m[2020-07-22T15:46:47.123 CEST] [debug] scheduling amarok tests/x11/amarok.pm
�[0m�[37m[2020-07-22T15:46:47.123 CEST] [debug] scheduling kontact tests/x11/kontact.pm
�[0m�[37m[2020-07-22T15:46:47.124 CEST] [debug] scheduling reboot_plasma5 tests/x11/reboot_plasma5.pm
�[0m�[37m[2020-07-22T15:46:47.125 CEST] [debug] scheduling cleanup_before_shutdown tests/shutdown/cleanup_before_shutdown.pm
�[0m�[37m[2020-07-22T15:46:47.126 CEST] [debug] scheduling shutdown tests/shutdown/shutdown.pm
�[0m[2020-07-22T15:46:47.134 CEST] [info] cmdsrv: daemon reachable under http://*:20013/o8X92o04PoBLWMVM/
[2020-07-22T15:46:47.136 CEST] [info] Listening at "http://[::]:20013"
Web application available at http://[::]:20013
�[37m[2020-07-22T15:46:47.142 CEST] [debug] git hash in /hdd/openqa-devel/openqa/share/tests/opensuse/products/opensuse/needles: 6955e2d93059cc4886e50a593c49ebb83ab37c08
�[0m�[37m[2020-07-22T15:46:47.142 CEST] [debug] init needles from /hdd/openqa-devel/openqa/share/tests/opensuse/products/opensuse/needles
�[0m�[37m[2020-07-22T15:46:47.593 CEST] [debug] inst-console-20200224 contains inst-console twice
�[0m�[37m[2020-07-22T15:46:48.191 CEST] [debug] loaded 7197 needles
�[0m�[37m[2020-07-22T15:46:48.322 CEST] [debug] Blocking SIGTERM
�[0m�[37m[2020-07-22T15:46:48.353 CEST] [debug] Unblocking SIGTERM
�[0m�[37m[2020-07-22T15:46:48.356 CEST] [debug] [autotest] process exited: 8
�[0m13759: channel_out 15, channel_in 14
�[37m[2020-07-22T15:46:48.468 CEST] [debug] Blocking SIGTERM
�[0m�[37m[2020-07-22T15:46:48.486 CEST] [debug] Unblocking SIGTERM
�[0mUse of uninitialized value $_[2] in substr at /usr/lib/perl5/5.30.1/x86_64-linux-thread-multi/IO/Handle.pm line 473.
Use of uninitialized value $_[1] in substr at /usr/lib/perl5/5.30.1/x86_64-linux-thread-multi/IO/Handle.pm line 473.
�[37m[2020-07-22T15:46:48.490 CEST] [debug] backend process exited: 8
�[0mremove_tree qemuscreenshot
myjsonrpc: remote end terminated connection, stopping at /hdd/openqa-devel/repos/os-autoinst/myjsonrpc.pm line 57, <GEN15> line 3.
�[37m[2020-07-22T15:46:48.593 CEST] [debug] terminating command server 13767 because test execution ended through exception
�[0m�[37m[2020-07-22T15:46:49.796 CEST] [debug] done with command server
�[0m�[37m[2020-07-22T15:46:49.796 CEST] [debug] stopping autotest process 13771
�[0m�[37m[2020-07-22T15:46:49.797 CEST] [debug] done with autotest process
�[0m13759: EXIT 1
[2020-07-22T15:46:49.0935 CEST] [info] [pid:2457] Isotovideo exit status: 1
[2020-07-22T15:46:50.0133 CEST] [info] [pid:2457] +++ worker notes +++
[2020-07-22T15:46:50.0135 CEST] [info] [pid:2457] End time: 2020-07-22 13:46:50
[2020-07-22T15:46:50.0136 CEST] [info] [pid:2457] Result: diaed
[2020-07-22T15:46:50.0159 CEST] [info] [pid:13776] Uploading vars.json
[2020-07-22T15:46:50.0335 CEST] [info] [pid:13776] Uploading autoinst-log.txt
</code></pre>
<p>After rebuild the os-autoinst codecs this worked again</p>
<pre><code>cd /hdd/openqa-devel/repos/os-autoinst
make clean
./autogen.sh
make
</code></pre> openQA Project - action #65954 (Rejected): Create a way to check which jobs contain a testhttps://progress.opensuse.org/issues/659542020-04-22T06:03:01Zilausuchilausuch@suse.com
<p>Using this url <a href="https://openqa.suse.de/admin/test_suites" class="external">https://openqa.suse.de/admin/test_suites</a> we could find a test. <br>
And therefore in "All tests" page <a href="https://openqa.suse.de/tests" class="external">https://openqa.suse.de/tests</a> page we could try to find this test in last finished jobs list. <br>
But sometimes it doesn't appears because this list is limited to 500 jobs.<br>
I could be interesting to get which jobs contain this test</p>