openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842021-07-26T08:51:35ZopenSUSE Project Management Tool
Redmine openQA Project - action #95995 (Resolved): [sporadic][openqa-in-openqa] Test openqa_from_git eve...https://progress.opensuse.org/issues/959952021-07-26T08:51:35Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>In this test run <a href="https://openqa.opensuse.org/tests/1857293#step/openqa_webui/33" class="external">https://openqa.opensuse.org/tests/1857293#step/openqa_webui/33</a> the is a problem. Seems that the server is not responsive</p>
<pre><code># Test died: command 'while ! [ -f nohup.out ]; do sleep 1 ; done && grep -qP "Listening at.*(127.0.0.1|localhost)" <(tail -f -n0 nohup.out) ' timed out at openqa//tests/install/openqa_webui.pm line 68.
</code></pre>
<p><a href="https://openqa.opensuse.org/tests/1857293/logfile?filename=openqa_webui-openqa_nohup_out.txt" class="external">https://openqa.opensuse.org/tests/1857293/logfile?filename=openqa_webui-openqa_nohup_out.txt</a> shows</p>
<pre><code>[warn] [AssetPack] Unable to download https://cdnjs.cloudflare.com/ajax/libs/chosen/1.7.0/chosen.css: Connect timeout
Could not find input asset "https://cdnjs.cloudflare.com/ajax/libs/chosen/1.7.0/chosen.css". at /usr/lib/perl5/vendor_perl/5.32.1/Mojolicious/Plugin/AssetPack.pm line 172.
</code></pre>
<p>which <em>maybe</em> is causing the problem, maybe not.</p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: The above timeout does not appear again in at least 10 consecutive rounds</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Crosscheck in a passed test if the asset connect timeout warning also shows up to prevent us following a "red herring"</li>
<li>DONE: Check if the above download URL from asset definitions can work -> the link <a href="https://cdnjs.cloudflare.com/ajax/libs/chosen/1.7.0/chosen.css" class="external">https://cdnjs.cloudflare.com/ajax/libs/chosen/1.7.0/chosen.css</a> works</li>
<li>Try to reproduce locally as well as use <a href="https://progress.opensuse.org/projects/openqatests/wiki/Wiki#Statistical-investigation" class="external">https://progress.opensuse.org/projects/openqatests/wiki/Wiki#Statistical-investigation</a> to get statistics of failures</li>
<li>Prevent timeout either on low-level, e.g. asset preparation or high-level, e.g. retry within the openQA-in-openQA tests</li>
</ul>
QA - action #95854 (Rejected): Grafana doesn't show information during some minutes, but also we ...https://progress.opensuse.org/issues/958542021-07-22T10:17:59Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>On 2021-07-22 10:14 we can grafana is not showing getting any results of the Webui summary ping<br>
<a href="https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=76&orgId=1&from=1626941518339&to=1626942588243" class="external">https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=76&orgId=1&from=1626941518339&to=1626942588243</a><br>
And we can check that we have increase of CPU after the recovery<br>
<a href="https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=25&orgId=1" class="external">https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=25&orgId=1</a><br>
<a href="https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=25&orgId=1&from=1628060971570&to=1628663436435" class="external">https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=25&orgId=1&from=1628060971570&to=1628663436435</a></p>
<p>During the daily we checked that there weren't a huge quantity of pending jobs to explain the amount of CPU on the recovery.</p>
openQA Project - action #95721 (Resolved): [Sporadic] containers: tests fail with "Test died: no ...https://progress.opensuse.org/issues/957212021-07-20T11:36:37Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Eventually in some of the openQA container tests in openQA we find this error "Test died: no candidate needle with tag(s) 'inst-console' matched"<br>
See these examples:</p>
<p><a href="https://openqa.opensuse.org/tests/1847722#step/openqa_webui/3" class="external">https://openqa.opensuse.org/tests/1847722#step/openqa_webui/3</a><br>
<a href="https://openqa.opensuse.org/tests/1848261#step/openqa_webui/3" class="external">https://openqa.opensuse.org/tests/1848261#step/openqa_webui/3</a></p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: the test pass without these errors in high enough runs (check the current frequency of the problem)</li>
</ul>
<a name="Suggestion"></a>
<h2 >Suggestion<a href="#Suggestion" class="wiki-anchor">¶</a></h2>
<ul>
<li>Try to reproduce the problem locally</li>
<li>In the worst case increase the timeout</li>
</ul>
openQA Project - action #95179 (Resolved): [sporadic] containers: eventually the tests fails on s...https://progress.opensuse.org/issues/951792021-07-07T12:44:11Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Eventually we saw this error in the container tests.</p>
<pre><code class="text syntaxhl" data-language="text">Can not create MOJO_TMPDIR : mkdir /var/lib/openqa/share/factory/tmp: Permission denied at /usr/share/openqa/script/../lib/OpenQA/Setup.pm line 316.
</code></pre>
<ul>
<li><a href="https://openqa.opensuse.org/tests/1830297#step/single_container_webui/107" class="external">https://openqa.opensuse.org/tests/1830297#step/single_container_webui/107</a></li>
<li><a href="https://openqa.opensuse.org/tests/1778677#step/single_container_webui/107" class="external">https://openqa.opensuse.org/tests/1778677#step/single_container_webui/107</a></li>
</ul>
<p><a href="https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=openqa&flavor=dev&machine=64bit-2G&test=openqa_from_containers&version=Tumbleweed" class="external">https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=openqa&flavor=dev&machine=64bit-2G&test=openqa_from_containers&version=Tumbleweed</a></p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><em>AC 1</em>: The test is fixed and doesn't break here</li>
</ul>
<a name="Steps-to-reproduce"></a>
<h2 >Steps to reproduce<a href="#Steps-to-reproduce" class="wiki-anchor">¶</a></h2>
<ul>
<li>Find openqa tests failing on <a href="https://openqa.opensuse.org/tests/1830297#next_previous" class="external">https://openqa.opensuse.org/tests/1830297#next_previous</a></li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Try to reproduce this can locally</li>
<li>Try to fix it in openQA itself not just a package</li>
<li>The same menssage is logged by two different components, maybe is a concurrency problem</li>
</ul>
openQA Project - action #94030 (Resolved): Cleanup logging in autoinst-log.txt for download assetshttps://progress.opensuse.org/issues/940302021-06-15T12:51:18Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>In the ticket <a class="issue tracker-4 status-3 priority-4 priority-default closed child" title="action: Cleanup logging in autoinst-log.txt (Resolved)" href="https://progress.opensuse.org/issues/91527">#91527</a> we listed other cases to cleanup. One of these is the information of the assets download, e.g.</p>
<pre><code>[2021-05-17T13:49:33.0579 CEST] [info] Download of Tumbleweed.x86_64-1.0-virtualbox-Snapshot20210516.vagrant.virtualbox.box processed:
[info] [#358]
Cache size of "/var/lib/openqa/cache" is 57GiB, with limit 180GiB
[info] [#358]
Downloading "Tumbleweed.x86_64-1.0-virtualbox-Snapshot20210516.vagrant.virtualbox.box" from "http://openqa1-opensuse/tests/1745884/asset/other/Tumbleweed.x86_64-1.0-virtualbox-Snapshot20210516.vagrant.virtualbox.box"
[info] [#358]
Content of "/var/lib/openqa/cache/openqa1-opensuse/Tumbleweed.x86_64-1.0-virtualbox-Snapshot20210516.vagrant.virtualbox.box" has not changed, updating last use
</code></pre>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong> : indent with the same indentation criteria than in <a class="issue tracker-4 status-3 priority-4 priority-default closed child" title="action: Cleanup logging in autoinst-log.txt (Resolved)" href="https://progress.opensuse.org/issues/91527">#91527</a></li>
</ul>
<a name="Suggestion"></a>
<h2 >Suggestion<a href="#Suggestion" class="wiki-anchor">¶</a></h2>
<ul>
<li><a href="https://github.com/os-autoinst/os-autoinst/pull/1670" class="external">https://github.com/os-autoinst/os-autoinst/pull/1670</a></li>
<li>See: <a href="https://github.com/os-autoinst/os-autoinst/blob/09824a01348c41641d5cff8cd6d4192ad5ebd7a6/bmwqemu.pm#L199" class="external">https://github.com/os-autoinst/os-autoinst/blob/09824a01348c41641d5cff8cd6d4192ad5ebd7a6/bmwqemu.pm#L199</a></li>
</ul>
openQA Project - action #92893 (Resolved): containers, docker-compose: Ensure that the scheduler ...https://progress.opensuse.org/issues/928932021-05-20T10:34:39Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Trying to complete the task <a class="issue tracker-4 status-12 priority-4 priority-default child" title="action: How to run an openQA test in 5 minutes size:M (Workable)" href="https://progress.opensuse.org/issues/76978">#76978</a> I found a problem in the webui container. It cannot connect to the scheduler and the jobs still unscheduled</p>
<pre><code class="text syntaxhl" data-language="text">scheduler_1 | -- Blocking request (http://127.0.0.1:9527/api/send_job)
scheduler_1 | -- Connect 41d600104970be636ece6296a21d1bdc (http://127.0.0.1:9527)
</code></pre>
<p>It could be easily fixed adding OPENQA_WEB_SOCKETS_HOST: "websockets" to the scheduler declaration</p>
<p>But then an other problems happens:</p>
<pre><code class="text syntaxhl" data-language="text">scheduler_1 | -- Client <<< Server (http://websockets:9527/api/send_job)
scheduler_1 | HTTP/1.1 403 Forbidden\x0d
scheduler_1 | Content-Length: 26\x0d
scheduler_1 | Server: Mojolicious (Perl)\x0d
scheduler_1 | Date: Thu, 20 May 2021 10:24:45 GMT\x0d
scheduler_1 | Content-Type: application/json;charset=UTF-8\x0d
scheduler_1 | \x0d
scheduler_1 | {"error":"Not authorized"}
</code></pre>
<p>This happens when we launch a web UI openQA using the docker-compose, and try to run a job (using clone_job)</p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: scheduler can connect to websockets without problems</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Investigate the auth method to these services. Maybe the auth method is only localhost</li>
<li>Check that the client.ini has the correct credentials</li>
</ul>
<a name="References"></a>
<h2 >References<a href="#References" class="wiki-anchor">¶</a></h2>
<p>See the comments at <a class="issue tracker-4 status-3 priority-4 priority-default closed behind-schedule" title="action: containers: Web UI cannot connect to scheduler (Resolved)" href="https://progress.opensuse.org/issues/92833#note-6">#92833#note-6</a></p>
openQA Project - action #91752 (Resolved): jenkins: Multiple missing fields and errors in configu...https://progress.opensuse.org/issues/917522021-04-26T11:10:31Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Saving a new configuration is necessary to accomplish <a class="issue tracker-4 status-3 priority-5 priority-high3 closed behind-schedule" title="action: openQA-in-openQA tests always fail and results do not impact submission pipeline (Resolved)" href="https://progress.opensuse.org/issues/88754">#88754</a>. But it's impossible because multiple missing fields and errors in the UI configuration.<br>
It is not possible to save new changes.</p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: The configuration can be changed and saved</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Configuration url: <a href="http://jenkins.qa.suse.de/view/openQA-in-openQA/job/monitor-openQA_in_openQA-TW/configure" class="external">http://jenkins.qa.suse.de/view/openQA-in-openQA/job/monitor-openQA_in_openQA-TW/configure</a></li>
</ul>
openQA Project - action #91377 (Resolved): CI: fix static-check-containershttps://progress.opensuse.org/issues/913772021-04-19T14:37:06Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Current test is failing because hadolint project commit this<br>
<a href="https://github.com/hadolint/hadolint/commit/4cb8f28ebecfd0343241369952fc9b3e7e4ea866" class="external">https://github.com/hadolint/hadolint/commit/4cb8f28ebecfd0343241369952fc9b3e7e4ea866</a></p>
<p>Example:</p>
<pre><code># Static check of container/travis_test/Dockerfile
-:151 DL3059 info: Multiple consecutive `RUN` instructions. Consider consolidation.
-:152 DL3059 info: Multiple consecutive `RUN` instructions. Consider consolidation.
-:153 DL3059 info: Multiple consecutive `RUN` instructions. Consider consolidation.
-:159 DL3059 info: Multiple consecutive `RUN` instructions. Consider consolidation.
</code></pre>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: static-check-containers runs without error</li>
</ul>
openQA Project - action #91046 (Resolved): CI: "webui-docker-compose" seems that eventually fails...https://progress.opensuse.org/issues/910462021-04-13T09:08:23Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>In <a class="issue tracker-4 status-3 priority-4 priority-default closed child" title="action: containers: The deploy using docker-compose is not stable and eventually fails (Resolved)" href="https://progress.opensuse.org/issues/89731">#89731</a> we introduced a initial webui container in charge of initializing the database. We have a test where the health check failed<br>
<a href="https://github.com/os-autoinst/openQA/pull/3838/checks?check_run_id=2329551052" class="external">https://github.com/os-autoinst/openQA/pull/3838/checks?check_run_id=2329551052</a></p>
<p>The problem is that the docker-compose exit with an error because the health check of the webuid_db_init container failed</p>
<pre><code class="text syntaxhl" data-language="text"> Name Command State Ports
------------------------------------------------------------------------------------------------------------------------------------------------
webui_db_1 docker-entrypoint.sh postgres Up (healthy) 5432/tcp
webui_webui_db_init_1 sh -c chmod -R a+rwX /data ... Up (unhealthy) 443/tcp, 80/tcp, 0.0.0.0:49153->9526/tcp, 9527/tcp, 9528/tcp, 9529/tcp
make: *** [Makefile:306: test-containers-compose] Error 1
</code></pre>
<p>The healthcheck is this one <br>
<a href="https://github.com/os-autoinst/openQA/blob/abd9a2297430377cd9876c3cbcec8b2cb4302722/container/webui/docker-compose.yaml#L116" class="external">https://github.com/os-autoinst/openQA/blob/abd9a2297430377cd9876c3cbcec8b2cb4302722/container/webui/docker-compose.yaml#L116</a></p>
<p>Take in consideration the DB error lines</p>
<pre><code class="text syntaxhl" data-language="text">db_1 | 2021-04-13 02:43:08.038 UTC [98] ERROR: relation "api_keys" does not exist at character 15
db_1 | 2021-04-13 02:43:08.038 UTC [98] STATEMENT: select * from api_keys;
db_1 | 2021-04-13 02:43:10.441 UTC [100] ERROR: relation "dbix_class_deploymenthandler_versions" does not exist at character 24
db_1 | 2021-04-13 02:43:10.441 UTC [100] STATEMENT: SELECT me.version FROM dbix_class_deploymenthandler_versions me ORDER BY id DESC LIMIT $1
db_1 | 2021-04-13 02:43:10.446 UTC [100] ERROR: relation "dbix_class_deploymenthandler_versions" does not exist at character 24
</code></pre>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: Determine the cause of the failure</li>
<li><strong>AC 2</strong>: Fix the problem</li>
</ul>
openQA Project - action #89752 (Resolved): containers: Add a worker service as part of the docker...https://progress.opensuse.org/issues/897522021-03-09T16:05:55Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>To have a complete openQA deployment using the docker-compose at least one worker should be created</p>
<a name="Acceptance-Criteria"></a>
<h2 >Acceptance Criteria<a href="#Acceptance-Criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC 1</strong>: Worker service is part of the compose workflow</li>
<li><strong>AC 2</strong>: The number of workers is configurable.</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>See: <a href="https://github.com/os-autoinst/openQA/pull/3755" class="external">https://github.com/os-autoinst/openQA/pull/3755</a></li>
<li>Add a section for the worker service to <code>container/webui/docker-compose.yaml</code></li>
<li>Add a variable like <code>$WORKER_COUNT</code></li>
<li>Add a corresponding healthcheck</li>
</ul>
openQA Project - action #88482 (Resolved): Two absolute paths concatenated to form a default need...https://progress.opensuse.org/issues/884822021-02-08T13:07:40Zilausuchilausuch@suse.com
<a name="Observation"></a>
<h2 >Observation<a href="#Observation" class="wiki-anchor">¶</a></h2>
<p>Sometimes a job execution fails with this error</p>
<pre><code>needles_dir not found: /var/lib/openqa/share/tests/opensuse/var/lib/openqa/share/tests/opensuse/products/opensuse/needles (check vars.json?) at /usr/lib/os-autoinst/needle.pm line 330.
</code></pre>
<p>Is concatenating two absolute paths (<a href="https://github.com/os-autoinst/os-autoinst/blob/adbb28bc61ce4f21a55d07399eac7d48badc6b6f/needle.pm#L328" class="external">https://github.com/os-autoinst/os-autoinst/blob/adbb28bc61ce4f21a55d07399eac7d48badc6b6f/needle.pm#L328</a>) when needles directory doesn't exist.</p>
<a name="Reproduction"></a>
<h2 >Reproduction<a href="#Reproduction" class="wiki-anchor">¶</a></h2>
<p>Remove the directory needles from /var/lib/openqa/share/tests/opensuse/products/opensuse</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li>AC1: Needles folder has a working default or aborts if PRODUCT_DIR/needles doesn't exist</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Look into logic in <code>needle.pm</code></li>
<li>Improve error message to reveal relevant variables instead of hinting at <code>vars.json</code> i.e. <code>NEEDLES_DIR</code>, <code>CASEDIR</code> and <code>default_needles_dir</code></li>
<li>Log the missing <code>PRODUCTDIR}/needles</code> if this affects the default nedles folder to be used here</li>
</ul>
<a name="Work-around"></a>
<h2 >Work-around<a href="#Work-around" class="wiki-anchor">¶</a></h2>
<ul>
<li>Create a folder <code>PRODUCTDIR}/needles</code></li>
</ul>
openQA Project - action #88187 (Resolved): Set the addresses in the "internal clients" configurablehttps://progress.opensuse.org/issues/881872021-01-25T10:46:37Zilausuchilausuch@suse.com
<p>Problem:<br>
The listening addresses are hardcoded to localhost within the different "internal clients" (e.g. lib/OpenQA/Scheduler/Client.pm and lib/OpenQA/WebSockets/Client.pm).<br>
This limitation prevents running the different parts of the web UI on different hosts, e.g. a load balanced environment because the different components (scheduler, websockets, …) cannot communicate witch each other.</p>
<p>Suggested solution:<br>
Read an environment variable like OPENQA_SCHEDULER_HOST. This environment variable needs then be supplied to all other containers. <br>
Note: It looks like the livehandler and gru don't have a client. That likely means it is no necessary to care about them as no other services access them (via HTTP).</p>
<p>AC1: The addresses in the "internal clients" are configurable</p>
openQA Project - coordination #81060 (Blocked): [epic] openQA web UI in kuberneteshttps://progress.opensuse.org/issues/810602020-12-15T06:09:11Zilausuchilausuch@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>Helm charts allows you to automate the deployment of a complex set of items in a kubernetes environment. These elements are not only limited to pods (containers) but also to configurations (configmaps and secrets), and all the resources they need in the correct order and with the proper checks.</p>
<p>Thanks to the work done in <a class="issue tracker-6 status-15 priority-4 priority-default parent" title="coordination: [saga][epic] Scale out: Redundant/load-balancing deployments of openQA, easy containers, containe... (Blocked)" href="https://progress.opensuse.org/issues/80142">#80142</a> we saw how to divide the web UI into parts, which were could be converted into HA and which had to remain standalone. In addition to how we should configure the load balancer to integrate each of the different services that make up the complete web UI.</p>
<p>This ticket proposes to create a helm chart capable of generating a complete and functional deployment of the web UI based on the following prerequisites:</p>
<ul>
<li>There is a pre-existing installation of kubernetes</li>
</ul>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1:</strong> The complete web UI HA is installed with the DB with the default options</li>
<li><strong>AC2:</strong> The web UI is accessible from outside of the cluster</li>
<li><strong>AC3:</strong> The helm chart is configurable with: Typical and basic parameters and, number of replicas for HA, type of persistence for DB, ...</li>
<li><strong>AC4:</strong> Documentation is completed with instructions of use</li>
<li><strong>AC5:</strong> Deployed together with rancher</li>
</ul>
<a name="Suggestions"></a>
<h2 >Suggestions<a href="#Suggestions" class="wiki-anchor">¶</a></h2>
<ul>
<li>Highly recommended based on work already done in <a class="issue tracker-6 status-15 priority-4 priority-default parent" title="coordination: [saga][epic] Scale out: Redundant/load-balancing deployments of openQA, easy containers, containe... (Blocked)" href="https://progress.opensuse.org/issues/80142">#80142</a>, e.g. the existing docker-compose setup</li>
<li><del>Proof-of-concept of either openQA webUI <em>or</em> worker within kubernetes, e.g. using k3s or try rancher directly</del> done for both webUI and worker in <a class="issue tracker-4 status-3 priority-4 priority-default closed child" title="action: [timeboxed:20h][spike] openQA proof-of-concept within kubernetes size:M (Resolved)" href="https://progress.opensuse.org/issues/110524">#110524</a></li>
<li>Use local kubernetes deployments to development purposes (this avoid the infra needs). For instance: minikube, k3s,... </li>
<li>Figure out if is necessary to publish the helm chart and where: <a href="https://helm.sh/docs/howto/chart_releaser_action/">https://helm.sh/docs/howto/chart_releaser_action/</a></li>
<li>Combine with rancher</li>
<li>Ensure proper testing of the charts
<ul>
<li>Create kubernetes cluster inside docker inside GitHub Actions: <a href="https://github.com/marketplace/actions/kind-cluster">https://github.com/marketplace/actions/kind-cluster</a></li>
<li>Look at chart-testing tool: <a href="https://github.com/marketplace/actions/helm-chart-testing">https://github.com/marketplace/actions/helm-chart-testing</a></li>
<li>Try to deploy the chart inside CI</li>
</ul></li>
<li>Add definitions for init containers to allow fetching tests/needles from git repository during installation</li>
<li>As an alternative to git, provide a persistent volume claim template for shared volume (ReadMany) -- think about Longhorn</li>
<li>Add definition for rsyncd container to allow usage of cache service in the worker pod to synchronize data between webui and worker pods</li>
<li>Enhance customization options of the current chart, add common options (like annotations, pod security, replicas count, ...) which are provided by the blank helm templates (reuse initial templates created by <code>helm create</code>)</li>
</ul>
openQA Project - action #69244 (Resolved): Need to rebuild the video codecs after update the syst...https://progress.opensuse.org/issues/692442020-07-22T14:37:50Zilausuchilausuch@suse.com
<p>In Tumbleweed, after updating the system using <br>
sudo zypper dup --allow-vendor-change</p>
<p>All the jobs stopped with this error:</p>
<pre><code>Likely error from autoinst-log.txt:
[2020-07-22T15:46:45.0862 CEST] [info] [pid:2457] +++ setup notes +++
[2020-07-22T15:46:45.0862 CEST] [info] [pid:2457] Running on localhost.localdomain:1 (Linux 5.7.7-1-default #1 SMP Wed Jul 1 19:03:27 UTC 2020 (cba119b) x86_64)
[2020-07-22T15:46:45.0889 CEST] [debug] [pid:13759] +++ worker notes +++
�[37m[2020-07-22T15:46:46.822 CEST] [debug] Current version is 3d1c89cb598f231c00f81ed9b966ae9ed45490a0 [interface v20]
�[0m�[37m[2020-07-22T15:46:46.833 CEST] [debug] git hash in /hdd/openqa-devel/openqa/share/tests/opensuse: ae743b815a54245daa6c9dd569a630c1328b7b1d
�[0m�[37m[2020-07-22T15:46:46.983 CEST] [debug] usingenv DESKTOP=kde
�[0m�[37m[2020-07-22T15:46:46.983 CEST] [debug] usingenv DISTRI=opensuse
�[0m�[37m[2020-07-22T15:46:46.983 CEST] [debug] usingenv QEMUCPU=qemu64
�[0m�[37m[2020-07-22T15:46:46.984 CEST] [debug] usingenv INSTLANG=en_US
�[0m�[37m[2020-07-22T15:46:46.984 CEST] [debug] usingenv DVD=1
�[0m�[37m[2020-07-22T15:46:46.984 CEST] [debug] usingenv KDE=1
�[0m�[37m[2020-07-22T15:46:46.984 CEST] [debug] usingenv ISO=/hdd/openqa-devel/openqa/share/factory/iso/openSUSE-Leap-15.2-DVD-x86_64-Build695.1-Media.iso
�[0m�[37m[2020-07-22T15:46:46.984 CEST] [debug] usingenv ISO_MAXSIZE=4700372992
�[0m�[37m[2020-07-22T15:46:46.984 CEST] [debug] usingenv NOIMAGES=1
�[0m�[37m[2020-07-22T15:46:46.985 CEST] [debug] scheduling isosize tests/installation/isosize.pm
�[0m�[37m[2020-07-22T15:46:47.000 CEST] [debug] scheduling bootloader tests/installation/bootloader.pm
�[0m�[37m[2020-07-22T15:46:47.002 CEST] [debug] scheduling welcome tests/installation/welcome.pm
�[0m�[37m[2020-07-22T15:46:47.003 CEST] [debug] scheduling online_repos tests/installation/online_repos.pm
�[0m�[37m[2020-07-22T15:46:47.003 CEST] [debug] scheduling installation_mode tests/installation/installation_mode.pm
�[0m�[37m[2020-07-22T15:46:47.004 CEST] [debug] scheduling logpackages tests/installation/logpackages.pm
�[0m�[37m[2020-07-22T15:46:47.005 CEST] [debug] scheduling system_role tests/installation/system_role.pm
�[0m�[37m[2020-07-22T15:46:47.008 CEST] [debug] scheduling partitioning tests/installation/partitioning.pm
�[0m�[37m[2020-07-22T15:46:47.009 CEST] [debug] scheduling partitioning_finish tests/installation/partitioning_finish.pm
�[0m�[37m[2020-07-22T15:46:47.010 CEST] [debug] scheduling installer_timezone tests/installation/installer_timezone.pm
�[0m�[37m[2020-07-22T15:46:47.011 CEST] [debug] scheduling user_settings tests/installation/user_settings.pm
�[0m�[37m[2020-07-22T15:46:47.011 CEST] [debug] scheduling resolve_dependency_issues tests/installation/resolve_dependency_issues.pm
�[0m�[37m[2020-07-22T15:46:47.012 CEST] [debug] scheduling installation_overview tests/installation/installation_overview.pm
�[0m�[37m[2020-07-22T15:46:47.013 CEST] [debug] scheduling disable_grub_timeout tests/installation/disable_grub_timeout.pm
�[0m�[37m[2020-07-22T15:46:47.014 CEST] [debug] scheduling start_install tests/installation/start_install.pm
�[0m�[37m[2020-07-22T15:46:47.016 CEST] [debug] scheduling await_install tests/installation/await_install.pm
�[0m�[37m[2020-07-22T15:46:47.017 CEST] [debug] scheduling logs_from_installation_system tests/installation/logs_from_installation_system.pm
�[0m�[37m[2020-07-22T15:46:47.018 CEST] [debug] scheduling reboot_after_installation tests/installation/reboot_after_installation.pm
�[0m�[37m[2020-07-22T15:46:47.020 CEST] [debug] scheduling grub_test tests/installation/grub_test.pm
�[0m�[37m[2020-07-22T15:46:47.021 CEST] [debug] scheduling first_boot tests/installation/first_boot.pm
�[0m�[37m[2020-07-22T15:46:47.022 CEST] [debug] scheduling zypper_clear_repos tests/update/zypper_clear_repos.pm
�[0m�[37m[2020-07-22T15:46:47.023 CEST] [debug] scheduling zypper_ar tests/console/zypper_ar.pm
�[0m�[37m[2020-07-22T15:46:47.023 CEST] [debug] scheduling zypper_ref tests/console/zypper_ref.pm
�[0m�[37m[2020-07-22T15:46:47.024 CEST] [debug] scheduling prepare_system_for_update_tests tests/update/prepare_system_for_update_tests.pm
�[0m�[37m[2020-07-22T15:46:47.057 CEST] [debug] scheduling updates_packagekit_kde tests/update/updates_packagekit_kde.pm
�[0m�[37m[2020-07-22T15:46:47.058 CEST] [debug] scheduling check_system_is_updated tests/update/check_system_is_updated.pm
�[0m�[37m[2020-07-22T15:46:47.060 CEST] [debug] scheduling system_prepare tests/console/system_prepare.pm
�[0m�[37m[2020-07-22T15:46:47.061 CEST] [debug] scheduling check_network tests/console/check_network.pm
�[0m�[37m[2020-07-22T15:46:47.063 CEST] [debug] scheduling system_state tests/console/system_state.pm
�[0m�[37m[2020-07-22T15:46:47.064 CEST] [debug] scheduling prepare_test_data tests/console/prepare_test_data.pm
�[0m�[37m[2020-07-22T15:46:47.065 CEST] [debug] scheduling consoletest_setup tests/console/consoletest_setup.pm
�[0m�[37m[2020-07-22T15:46:47.067 CEST] [debug] scheduling keymap_or_locale tests/locale/keymap_or_locale.pm
�[0m�[37m[2020-07-22T15:46:47.068 CEST] [debug] scheduling force_scheduled_tasks tests/console/force_scheduled_tasks.pm
�[0m�[37m[2020-07-22T15:46:47.069 CEST] [debug] scheduling textinfo tests/console/textinfo.pm
�[0m�[37m[2020-07-22T15:46:47.069 CEST] [debug] scheduling hostname tests/console/hostname.pm
�[0m�[37m[2020-07-22T15:46:47.070 CEST] [debug] scheduling x_vt tests/console/x_vt.pm
�[0m�[37m[2020-07-22T15:46:47.071 CEST] [debug] scheduling zypper_lr tests/console/zypper_lr.pm
�[0m�[37m[2020-07-22T15:46:47.071 CEST] [debug] scheduling ncurses tests/console/ncurses.pm
�[0m�[37m[2020-07-22T15:46:47.085 CEST] [debug] scheduling yast2_lan tests/console/yast2_lan.pm
�[0m�[37m[2020-07-22T15:46:47.086 CEST] [debug] scheduling curl_https tests/console/curl_https.pm
�[0m�[37m[2020-07-22T15:46:47.087 CEST] [debug] scheduling salt tests/console/salt.pm
�[0m�[37m[2020-07-22T15:46:47.088 CEST] [debug] scheduling glibc_sanity tests/console/glibc_sanity.pm
�[0m�[37m[2020-07-22T15:46:47.089 CEST] [debug] scheduling zypper_in tests/console/zypper_in.pm
�[0m�[37m[2020-07-22T15:46:47.090 CEST] [debug] scheduling zypper_log tests/console/zypper_log.pm
�[0m�[37m[2020-07-22T15:46:47.091 CEST] [debug] scheduling yast2_i tests/console/yast2_i.pm
�[0m�[37m[2020-07-22T15:46:47.092 CEST] [debug] scheduling yast2_bootloader tests/console/yast2_bootloader.pm
�[0m�[37m[2020-07-22T15:46:47.093 CEST] [debug] scheduling vim tests/console/vim.pm
�[0m�[37m[2020-07-22T15:46:47.093 CEST] [debug] scheduling firewall_enabled tests/console/firewall_enabled.pm
�[0m�[37m[2020-07-22T15:46:47.095 CEST] [debug] scheduling sshd tests/console/sshd.pm
�[0m�[37m[2020-07-22T15:46:47.096 CEST] [debug] scheduling ssh_cleanup tests/console/ssh_cleanup.pm
�[0m�[37m[2020-07-22T15:46:47.097 CEST] [debug] scheduling sshfs tests/console/sshfs.pm
�[0m�[37m[2020-07-22T15:46:47.098 CEST] [debug] scheduling mtab tests/console/mtab.pm
�[0m�[37m[2020-07-22T15:46:47.100 CEST] [debug] scheduling orphaned_packages_check tests/console/orphaned_packages_check.pm
�[0m�[37m[2020-07-22T15:46:47.102 CEST] [debug] scheduling consoletest_finish tests/console/consoletest_finish.pm
�[0m�[37m[2020-07-22T15:46:47.103 CEST] [debug] scheduling user_gui_login tests/x11/user_gui_login.pm
�[0m�[37m[2020-07-22T15:46:47.104 CEST] [debug] scheduling desktop_runner tests/x11/desktop_runner.pm
�[0m�[37m[2020-07-22T15:46:47.105 CEST] [debug] scheduling xterm tests/x11/xterm.pm
�[0m�[37m[2020-07-22T15:46:47.106 CEST] [debug] scheduling keymap_or_locale_x11 tests/locale/keymap_or_locale_x11.pm
�[0m�[37m[2020-07-22T15:46:47.107 CEST] [debug] scheduling sshxterm tests/x11/sshxterm.pm
�[0m�[37m[2020-07-22T15:46:47.108 CEST] [debug] scheduling firefox tests/x11/firefox.pm
�[0m�[37m[2020-07-22T15:46:47.109 CEST] [debug] scheduling firefox_audio tests/x11/firefox_audio.pm
�[0m�[37m[2020-07-22T15:46:47.110 CEST] [debug] scheduling chromium tests/x11/chromium.pm
�[0m�[37m[2020-07-22T15:46:47.111 CEST] [debug] scheduling ooffice tests/x11/ooffice.pm
�[0m�[37m[2020-07-22T15:46:47.112 CEST] [debug] scheduling oomath tests/x11/oomath.pm
�[0m�[37m[2020-07-22T15:46:47.113 CEST] [debug] scheduling oocalc tests/x11/oocalc.pm
�[0m�[37m[2020-07-22T15:46:47.114 CEST] [debug] scheduling plasma_browser_integration tests/x11/plasma_browser_integration.pm
�[0m�[37m[2020-07-22T15:46:47.115 CEST] [debug] scheduling khelpcenter tests/x11/khelpcenter.pm
�[0m�[37m[2020-07-22T15:46:47.116 CEST] [debug] scheduling systemsettings5 tests/x11/systemsettings5.pm
�[0m�[37m[2020-07-22T15:46:47.117 CEST] [debug] scheduling dolphin tests/x11/dolphin.pm
�[0m�[37m[2020-07-22T15:46:47.118 CEST] [debug] scheduling glxgears tests/x11/glxgears.pm
�[0m�[37m[2020-07-22T15:46:47.119 CEST] [debug] scheduling desktop_mainmenu tests/x11/desktop_mainmenu.pm
�[0m�[37m[2020-07-22T15:46:47.120 CEST] [debug] scheduling inkscape tests/x11/inkscape.pm
�[0m�[37m[2020-07-22T15:46:47.120 CEST] [debug] scheduling gimp tests/x11/gimp.pm
�[0m�[37m[2020-07-22T15:46:47.121 CEST] [debug] scheduling hexchat tests/x11/hexchat.pm
�[0m�[37m[2020-07-22T15:46:47.122 CEST] [debug] scheduling vlc tests/x11/vlc.pm
�[0m�[37m[2020-07-22T15:46:47.122 CEST] [debug] scheduling kate tests/x11/kate.pm
�[0m�[37m[2020-07-22T15:46:47.123 CEST] [debug] scheduling amarok tests/x11/amarok.pm
�[0m�[37m[2020-07-22T15:46:47.123 CEST] [debug] scheduling kontact tests/x11/kontact.pm
�[0m�[37m[2020-07-22T15:46:47.124 CEST] [debug] scheduling reboot_plasma5 tests/x11/reboot_plasma5.pm
�[0m�[37m[2020-07-22T15:46:47.125 CEST] [debug] scheduling cleanup_before_shutdown tests/shutdown/cleanup_before_shutdown.pm
�[0m�[37m[2020-07-22T15:46:47.126 CEST] [debug] scheduling shutdown tests/shutdown/shutdown.pm
�[0m[2020-07-22T15:46:47.134 CEST] [info] cmdsrv: daemon reachable under http://*:20013/o8X92o04PoBLWMVM/
[2020-07-22T15:46:47.136 CEST] [info] Listening at "http://[::]:20013"
Web application available at http://[::]:20013
�[37m[2020-07-22T15:46:47.142 CEST] [debug] git hash in /hdd/openqa-devel/openqa/share/tests/opensuse/products/opensuse/needles: 6955e2d93059cc4886e50a593c49ebb83ab37c08
�[0m�[37m[2020-07-22T15:46:47.142 CEST] [debug] init needles from /hdd/openqa-devel/openqa/share/tests/opensuse/products/opensuse/needles
�[0m�[37m[2020-07-22T15:46:47.593 CEST] [debug] inst-console-20200224 contains inst-console twice
�[0m�[37m[2020-07-22T15:46:48.191 CEST] [debug] loaded 7197 needles
�[0m�[37m[2020-07-22T15:46:48.322 CEST] [debug] Blocking SIGTERM
�[0m�[37m[2020-07-22T15:46:48.353 CEST] [debug] Unblocking SIGTERM
�[0m�[37m[2020-07-22T15:46:48.356 CEST] [debug] [autotest] process exited: 8
�[0m13759: channel_out 15, channel_in 14
�[37m[2020-07-22T15:46:48.468 CEST] [debug] Blocking SIGTERM
�[0m�[37m[2020-07-22T15:46:48.486 CEST] [debug] Unblocking SIGTERM
�[0mUse of uninitialized value $_[2] in substr at /usr/lib/perl5/5.30.1/x86_64-linux-thread-multi/IO/Handle.pm line 473.
Use of uninitialized value $_[1] in substr at /usr/lib/perl5/5.30.1/x86_64-linux-thread-multi/IO/Handle.pm line 473.
�[37m[2020-07-22T15:46:48.490 CEST] [debug] backend process exited: 8
�[0mremove_tree qemuscreenshot
myjsonrpc: remote end terminated connection, stopping at /hdd/openqa-devel/repos/os-autoinst/myjsonrpc.pm line 57, <GEN15> line 3.
�[37m[2020-07-22T15:46:48.593 CEST] [debug] terminating command server 13767 because test execution ended through exception
�[0m�[37m[2020-07-22T15:46:49.796 CEST] [debug] done with command server
�[0m�[37m[2020-07-22T15:46:49.796 CEST] [debug] stopping autotest process 13771
�[0m�[37m[2020-07-22T15:46:49.797 CEST] [debug] done with autotest process
�[0m13759: EXIT 1
[2020-07-22T15:46:49.0935 CEST] [info] [pid:2457] Isotovideo exit status: 1
[2020-07-22T15:46:50.0133 CEST] [info] [pid:2457] +++ worker notes +++
[2020-07-22T15:46:50.0135 CEST] [info] [pid:2457] End time: 2020-07-22 13:46:50
[2020-07-22T15:46:50.0136 CEST] [info] [pid:2457] Result: diaed
[2020-07-22T15:46:50.0159 CEST] [info] [pid:13776] Uploading vars.json
[2020-07-22T15:46:50.0335 CEST] [info] [pid:13776] Uploading autoinst-log.txt
</code></pre>
<p>After rebuild the os-autoinst codecs this worked again</p>
<pre><code>cd /hdd/openqa-devel/repos/os-autoinst
make clean
./autogen.sh
make
</code></pre> openQA Project - action #65954 (Rejected): Create a way to check which jobs contain a testhttps://progress.opensuse.org/issues/659542020-04-22T06:03:01Zilausuchilausuch@suse.com
<p>Using this url <a href="https://openqa.suse.de/admin/test_suites" class="external">https://openqa.suse.de/admin/test_suites</a> we could find a test. <br>
And therefore in "All tests" page <a href="https://openqa.suse.de/tests" class="external">https://openqa.suse.de/tests</a> page we could try to find this test in last finished jobs list. <br>
But sometimes it doesn't appears because this list is limited to 500 jobs.<br>
I could be interesting to get which jobs contain this test</p>