https://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842017-11-27T09:59:02ZopenSUSE Project Management ToolopenQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=747912017-11-27T09:59:02Znicksingernsinger@suse.com
<ul></ul><p>I've the same issue on my local installation using the packages provided for TW. My current version is:</p>
<pre><code>rpm -qf $(which openqa)
openQA-4.5.1505912862.696bb634-99.1.noarch
</code></pre>
<p>with the following entries in /var/log/openqa:</p>
<pre><code>[Mon Nov 27 10:57:24 2017] [3508:debug] GET "/admin/workers"
[Mon Nov 27 10:57:24 2017] [3508:debug] Routing to controller "OpenQA::WebAPI::Controller::Admin::Workers" and action "index"
[Mon Nov 27 10:57:24 2017] [3508:debug] dispatching IPC ws_is_worker_connected to websockets: [1]
[Mon Nov 27 10:57:24 2017] [websockets:debug] IPC calling ws_is_worker_connected
[Mon Nov 27 10:57:24 2017] [3508:debug] IPC finished
[Mon Nov 27 10:57:24 2017] [3508:debug] dispatching IPC ws_is_worker_connected to websockets: [2]
[Mon Nov 27 10:57:24 2017] [websockets:debug] IPC calling ws_is_worker_connected
[Mon Nov 27 10:57:24 2017] [3508:debug] IPC finished
[Mon Nov 27 10:57:24 2017] [3508:debug] dispatching IPC ws_is_worker_connected to websockets: [3]
[Mon Nov 27 10:57:24 2017] [websockets:debug] IPC calling ws_is_worker_connected
[Mon Nov 27 10:57:24 2017] [3508:debug] IPC finished
[Mon Nov 27 10:57:24 2017] [3508:debug] dispatching IPC ws_is_worker_connected to websockets: [4]
[Mon Nov 27 10:57:24 2017] [websockets:debug] IPC calling ws_is_worker_connected
[Mon Nov 27 10:57:24 2017] [3508:debug] IPC finished
[Mon Nov 27 10:57:24 2017] [3508:debug] dispatching IPC ws_is_worker_connected to websockets: [5]
[Mon Nov 27 10:57:24 2017] [websockets:debug] IPC calling ws_is_worker_connected
[Mon Nov 27 10:57:24 2017] [3508:debug] IPC finished
[Mon Nov 27 10:57:24 2017] [3508:debug] dispatching IPC ws_is_worker_connected to websockets: [6]
[Mon Nov 27 10:57:24 2017] [websockets:debug] IPC calling ws_is_worker_connected
[Mon Nov 27 10:57:24 2017] [3508:debug] IPC finished
[Mon Nov 27 10:57:24 2017] [3508:debug] dispatching IPC ws_is_worker_connected to websockets: [7]
[Mon Nov 27 10:57:24 2017] [websockets:debug] Received from worker "45" worker_status message "$VAR1 = {
'job' => {},
'status' => 'free',
'type' => 'worker_status'
};
"
[Mon Nov 27 10:57:24 2017] [websockets:debug] Possibly worker 45 should be freed.
[Mon Nov 27 10:57:54 2017] [websockets:debug] Failed parsing status message : DBIx::Class::Storage::DBI::_exec_txn_commit(): DBI Exception: DBD::SQLite::db commit failed: database is locked at /usr/share/openqa/script/../lib/OpenQA/WebSockets/Server.pm line 306
</code></pre>
<p>The webui is unusable afterwards and has to be restarted to be responsive again.</p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=747942017-11-27T10:05:12Zcoolocoolo@suse.com
<ul><li><strong>Subject</strong> changed from <i>openQA WebUI - checking Wokers encounters error for bad gateway </i> to <i>Sqlite support busted</i></li></ul><p>ok, we will drop sqlite support - it's just not fit for the task. then we can also reduce dbix usage and concentrate on postgresql features offering better performance.</p>
<p>So reset your installations and use postgresql</p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=748422017-11-27T13:42:34Zzluo
<ul></ul><p><a class="user active user-mention" href="https://progress.opensuse.org/users/15">@coolo</a> I've changed database. openQA uses postgresql now and Workers can be showed correctly... thanks!</p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=748902017-11-28T06:36:41Zcoolocoolo@suse.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li><li><strong>Assignee</strong> set to <i>coolo</i></li><li><strong>Target version</strong> set to <i>Ready</i></li></ul><p>I'm working to adapt the test suite to use postgresql. I'm currently playing with a temporary postgresql server started only for the test suites - to avoid permission setup problems and thelike.</p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=748962017-11-28T06:42:33Zokurzokurz@suse.com
<ul></ul><p>Having real tests with postgres is of course a good idea but I would prefer to keep sqlite support. You can tell me what you expect from me to keep the support.</p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=749022017-11-28T08:32:27Zcoolocoolo@suse.com
<ul></ul><p>Sorry, I'm not going down that route. Sqlite just no longer works for us - developers setup their systems following the instructions and what they get is a time bomb.</p>
<p><img src="http://tclhost.com/UzORStL.gif" alt="" /></p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=749892017-11-28T15:35:40ZEDiGiacintoedigiacinto@suse.com
<ul></ul><p>coolo wrote:</p>
<blockquote>
<p>Sorry, I'm not going down that route. Sqlite just no longer works for us - developers setup their systems following the instructions and what they get is a time bomb.</p>
<p><img src="http://tclhost.com/UzORStL.gif" alt="" /></p>
</blockquote>
<p>Where is the +1 button here? :P</p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=763402017-12-02T09:39:10Zokurzokurz@suse.com
<ul></ul><p>I don't know if the original error report was about <a class="issue tracker-4 status-6 priority-3 priority-lowest closed" title="action: sqlite database implementation does not support more than 5000 jobs in the database (was: on webu... (Rejected)" href="https://progress.opensuse.org/issues/12950">#12950</a> . This is one limitation of sqlite I know is making a problem for us. Of course it's not suitable for a multi-user production instance but for in-memory testing as well as the initial setup system IMHO it's a preferrable choice. I also have in mind when we ask bug assignees to install openQA themselves: For them especially we should make openQA as lightweight and easy to setup as possible. I think sqlite is easier in this context then postgres.</p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=763532017-12-02T15:30:41Zcoolocoolo@suse.com
<ul></ul><p>So you know nothing about sqlite limitation, but want to keep it. Your arguments are not quite consistent. Anyway, I don't want to argue with you anyway: sqlite support will be dropped. And once that is done, we can even reduce the dbix usage to a sane level.</p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=763732017-12-02T21:19:13Zokurzokurz@suse.com
<ul></ul><p>coolo wrote:</p>
<blockquote>
<p>So you know nothing about sqlite limitation,</p>
</blockquote>
<p>I know that it's based on a single file. Parallel access and write performance is low, scalability is low, setup and backup is easy. I developed programs that use sqlite but sure, never programmed on sqlite source code myself.</p>
<blockquote>
<p>but want to keep it.</p>
</blockquote>
<p>Sure, I want to keep the easy setup and backup. I don't see how my arguments are not consistent. Sure, don't argue with me. You made your decision and the world will not stop :) No need to answer.</p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=764642017-12-04T08:54:48Zszarate
<ul><li><strong>Subject</strong> changed from <i>Sqlite support busted</i> to <i>[tools] Sqlite support busted</i></li><li><strong>Target version</strong> changed from <i>Ready</i> to <i>Current Sprint</i></li></ul> openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=764732017-12-04T09:00:47ZEDiGiacintoedigiacinto@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-4 priority-default closed" href="/issues/25970">action #25970</a>: Profile/Optimize _workers_checker in WebSockets server</i> added</li></ul> openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=771992017-12-05T15:46:43Zcoolocoolo@suse.com
<ul><li><strong>Subject</strong> changed from <i>[tools] Sqlite support busted</i> to <i>[tools][sprint 201711.2] Sqlite support busted</i></li><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li></ul><p>sqlite support is dropped</p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=774512017-12-06T06:30:47Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>Resolved</i> to <i>In Progress</i></li></ul><p><a href="https://github.com/os-autoinst/openQA/pull/1515" class="external">https://github.com/os-autoinst/openQA/pull/1515</a> was the according PR</p>
<ul>
<li>the openQA-in-openQA test for "openqa_from_git" fails with "Installing the dependencies failed Module 'Dbd::Pg' is not installed"</li>
<li>the openQA-in-openQA test for "openqa_install+publish" fails with the webui service being unable to connect to a database, probably because it is not started and configured automatically -> special setup package in spec file?</li>
</ul>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=774802017-12-06T08:18:34Zszarate
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li></ul><p><a class="user active user-mention" href="https://progress.opensuse.org/users/17668">@okurz</a> that's a new issue that needs to be open. </p>
<p>Setting up the database during the install <a href="http://mailman.suse.de/mlarch/SuSE/openqa/2017/openqa.2017.12/msg00004.html" class="external">http://mailman.suse.de/mlarch/SuSE/openqa/2017/openqa.2017.12/msg00004.html</a></p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=774982017-12-06T08:26:05Zszarate
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-5 priority-high3 closed" href="/issues/28961">action #28961</a>: openQA in openQA tests are broken</i> added</li></ul> openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=775372017-12-06T08:49:40Zzluo
<ul></ul><p><a class="user active user-mention" href="https://progress.opensuse.org/users/17668">@okurz</a> I have a running setup with postgres. Maybe you need to run command like: grant all privileges on database dbname to dbuser;</p>
openQA Project - action #28429: [tools][sprint 201711.2] Sqlite support bustedhttps://progress.opensuse.org/issues/28429?journal_id=943362018-02-26T11:07:10Zszarate
<ul><li><strong>Target version</strong> changed from <i>Current Sprint</i> to <i>Done</i></li></ul>