https://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842019-10-18T18:19:02ZopenSUSE Project Management ToolopenQA Project - action #58379: isotovideo is slow to shutdown / error messages on proper shutdownhttps://progress.opensuse.org/issues/58379?journal_id=2513452019-10-18T18:19:02Zokurzokurz@suse.com
<ul><li><strong>Copied from</strong> <i><a class="issue tracker-4 status-3 priority-4 priority-default closed" href="/issues/57707">action #57707</a>: isotovideo fails to terminate cleanly, message "isotovideo: unable to inform websocket clients about stopping command server: Request timeout", regression from 4cd4af2b</i> added</li></ul> openQA Project - action #58379: isotovideo is slow to shutdown / error messages on proper shutdownhttps://progress.opensuse.org/issues/58379?journal_id=2553332019-11-07T08:35:27Zcoolocoolo@suse.com
<ul><li><strong>Priority</strong> changed from <i>Normal</i> to <i>Low</i></li></ul> openQA Project - action #58379: isotovideo is slow to shutdown / error messages on proper shutdownhttps://progress.opensuse.org/issues/58379?journal_id=2606092019-11-28T15:35:43Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li><li><strong>Assignee</strong> set to <i>okurz</i></li></ul><p>Working on improving the output, e.g. in <a href="https://github.com/os-autoinst/os-autoinst/pull/1277" class="external">https://github.com/os-autoinst/os-autoinst/pull/1277</a> . Also I think the upstream project Mojo::IOLoop::ReadWriteProcess has a problem so I created a patch: <a href="https://github.com/mudler/Mojo-IOLoop-ReadWriteProcess/pull/6" class="external">https://github.com/mudler/Mojo-IOLoop-ReadWriteProcess/pull/6</a></p>
openQA Project - action #58379: isotovideo is slow to shutdown / error messages on proper shutdownhttps://progress.opensuse.org/issues/58379?journal_id=2635162019-12-10T13:08:22Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-12 priority-3 priority-lowest" href="/issues/53999">action #53999</a>: openqa-worker (isotovideo) dumps core / segfaults quite often on several workers and distributions for cancelled jobs</i> added</li></ul> openQA Project - action #58379: isotovideo is slow to shutdown / error messages on proper shutdownhttps://progress.opensuse.org/issues/58379?journal_id=2769672020-02-06T08:00:58Zlivdywanliv.dywan@suse.com
<ul><li><strong>Target version</strong> set to <i>Current Sprint</i></li></ul> openQA Project - action #58379: isotovideo is slow to shutdown / error messages on proper shutdownhttps://progress.opensuse.org/issues/58379?journal_id=2774592020-02-07T16:00:57Zokurzokurz@suse.com
<ul></ul><p><a href="https://github.com/os-autoinst/os-autoinst/pull/1277" class="external">https://github.com/os-autoinst/os-autoinst/pull/1277</a> merged, next <a href="https://github.com/os-autoinst/os-autoinst/pull/1349" class="external">https://github.com/os-autoinst/os-autoinst/pull/1349</a> , after that <a href="https://github.com/os-autoinst/os-autoinst/pull/1284" class="external">https://github.com/os-autoinst/os-autoinst/pull/1284</a></p>
openQA Project - action #58379: isotovideo is slow to shutdown / error messages on proper shutdownhttps://progress.opensuse.org/issues/58379?journal_id=2795202020-02-21T11:33:39Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Workable</i></li><li><strong>Assignee</strong> deleted (<del><i>okurz</i></del>)</li><li><strong>Target version</strong> deleted (<del><i>Current Sprint</i></del>)</li></ul><p><a href="https://github.com/os-autoinst/os-autoinst/pull/1277" class="external">https://github.com/os-autoinst/os-autoinst/pull/1277</a> and <a href="https://github.com/os-autoinst/os-autoinst/pull/1349" class="external">https://github.com/os-autoinst/os-autoinst/pull/1349</a> are done. I don't have further good ideas right now :)</p>
openQA Project - action #58379: isotovideo is slow to shutdown / error messages on proper shutdownhttps://progress.opensuse.org/issues/58379?journal_id=2839412020-03-06T21:47:40Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>Workable</i> to <i>Feedback</i></li><li><strong>Assignee</strong> set to <i>okurz</i></li></ul><p>Actually had an idea what I could do and managed to update <a href="https://github.com/mudler/Mojo-IOLoop-ReadWriteProcess/pull/6" class="external">https://github.com/mudler/Mojo-IOLoop-ReadWriteProcess/pull/6</a> which I consider mergeable now.</p>
<p><a href="https://github.com/os-autoinst/os-autoinst/pull/1360" class="external">https://github.com/os-autoinst/os-autoinst/pull/1360</a> for a further improvement in the isotovideo shutdown process.</p>
openQA Project - action #58379: isotovideo is slow to shutdown / error messages on proper shutdownhttps://progress.opensuse.org/issues/58379?journal_id=2868932020-03-20T21:00:50Zokurzokurz@suse.com
<ul></ul><p>After <a href="https://github.com/mudler/Mojo-IOLoop-ReadWriteProcess/pull/6" class="external">https://github.com/mudler/Mojo-IOLoop-ReadWriteProcess/pull/6</a> was merged there were some flaky test failures so I created <a href="https://github.com/mudler/Mojo-IOLoop-ReadWriteProcess/pull/7" class="external">https://github.com/mudler/Mojo-IOLoop-ReadWriteProcess/pull/7</a> but still flaky test failures in master branch so now I created <a href="https://github.com/mudler/Mojo-IOLoop-ReadWriteProcess/pull/8" class="external">https://github.com/mudler/Mojo-IOLoop-ReadWriteProcess/pull/8</a>. Waiting for test results, merge, release of a new version.</p>
openQA Project - action #58379: isotovideo is slow to shutdown / error messages on proper shutdownhttps://progress.opensuse.org/issues/58379?journal_id=2872832020-03-24T14:45:31Zokurzokurz@suse.com
<ul><li><strong>Due date</strong> set to <i>2020-04-14</i></li><li><strong>Status</strong> changed from <i>Feedback</i> to <i>Blocked</i></li></ul><p>waiting for merge of <a href="https://github.com/mudler/Mojo-IOLoop-ReadWriteProcess/pull/8" class="external">https://github.com/mudler/Mojo-IOLoop-ReadWriteProcess/pull/8</a> . Will wait some time until I will kindly remind.</p>
openQA Project - action #58379: isotovideo is slow to shutdown / error messages on proper shutdownhttps://progress.opensuse.org/issues/58379?journal_id=2930452020-04-15T13:07:19Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>Blocked</i> to <i>Resolved</i></li></ul><p>PR was merged and a new release 0.25 was published which is by now also published as packages within openSUSE:Factory as well as our derived branch projects in devel:openQA. Also deployed by now on osd and o3 workers. No problems reported. Taking any example job, e.g. <a href="https://openqa.suse.de/tests/4125075/file/autoinst-log.txt">https://openqa.suse.de/tests/4125075/file/autoinst-log.txt</a> I can find:</p>
<pre><code>[2020-04-15T14:54:13.264 CEST] [debug] EVENT {"event":"STOP","timestamp":{"microseconds":657695,"seconds":1586955252}}
[2020-04-15T14:54:13.267 CEST] [debug] ||| finished shutdown_ltp kernel at 2020-04-15 12:54:13 (35 s)
[2020-04-15T14:54:13.269 CEST] [debug] stopping autotest process 18989
[2020-04-15T14:54:13.276 CEST] [debug] [autotest] process exited: 0
[2020-04-15T14:54:13.276 CEST] [debug] done with autotest process
[2020-04-15T14:54:13.276 CEST] [debug] terminating command server 18898 because test execution ended
[2020-04-15T14:54:13.276 CEST] [debug] isotovideo: informing websocket clients before stopping command server: http://127.0.0.1:20283/ttVvf5JAFkA9USqT/broadcast
[2020-04-15T14:54:13.286 CEST] [debug] commands process exited: 0
[2020-04-15T14:54:13.287 CEST] [debug] done with command server
[2020-04-15T14:54:13.287 CEST] [debug] isotovideo done
[2020-04-15T14:54:13.287 CEST] [debug] BACKEND SHUTDOWN 1
[2020-04-15T14:54:13.288 CEST] [info] ::: OpenQA::Qemu::Proc::save_state: Saving QEMU state to qemu_state.json
[2020-04-15T14:54:14.317 CEST] [debug] flushing frames
[2020-04-15T14:54:14.352 CEST] [debug] QEMU: qemu-system-x86_64: terminating on signal 15 from pid 19005 (/usr/bin/isotovideo: backen)
[2020-04-15T14:54:14.353 CEST] [debug] sending magic and exit
[2020-04-15T14:54:14.353 CEST] [debug] received magic close
[2020-04-15T14:54:14.375 CEST] [debug] backend process exited: 0
[2020-04-15T14:54:14.376 CEST] [debug] stopping backend process 19005
[2020-04-15T14:54:14.376 CEST] [debug] done with backend process
18895: EXIT 0
[2020-04-15T14:54:14.0451 CEST] [info] [pid:25970] Isotovideo exit status: 0
</code></pre>
<p>That is a shutdown within 800ms compared to previously about 6s \o/</p>
openQA Project - action #58379: isotovideo is slow to shutdown / error messages on proper shutdownhttps://progress.opensuse.org/issues/58379?journal_id=3160182020-07-31T10:01:12Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-6 status-3 priority-5 priority-high3 closed behind-schedule" href="/issues/65118">coordination #65118</a>: [epic] multimachine test fails with symptoms "websocket refusing connection" and other unclear reasons</i> added</li></ul>