https://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842022-02-11T14:06:38ZopenSUSE Project Management ToolopenQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4901472022-02-11T14:06:38Zokurzokurz@suse.com
<ul><li><strong>Project</strong> changed from <i>openQA Infrastructure</i> to <i>openQA Project</i></li><li><strong>Category</strong> set to <i>Regressions/Crashes</i></li><li><strong>Status</strong> changed from <i>New</i> to <i>Feedback</i></li><li><strong>Assignee</strong> set to <i>okurz</i></li><li><strong>Target version</strong> set to <i>Ready</i></li></ul><p>please follow the ticket template from <a href="https://progress.opensuse.org/projects/openqav3/wiki/#Defects" class="external">https://progress.opensuse.org/projects/openqav3/wiki/#Defects</a> . I saw that the problems only appear with the new build. Did you crosscheck with an older build? Did you crosscheck with an older state of tests?</p>
<p>I triggered investigation runs now with <code>echo https://openqa.suse.de/tests/8140400 | host=openqa.suse.de openqa-investigate</code>, comment available in <a href="https://openqa.suse.de/tests/8140400#comment-485767" class="external">https://openqa.suse.de/tests/8140400#comment-485767</a> . Awaiting test results.</p>
openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4901542022-02-11T14:07:30Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-4 priority-default closed" href="/issues/105882">action #105882</a>: Test using svirt backend fails with auto_review:"Error connecting to VNC server.*localhost.*Connection refused"</i> added</li></ul> openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4901632022-02-11T14:48:29Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>Feedback</i> to <i>In Progress</i></li></ul><ul>
<li>uefi-gi-guest_sles12sp5-on-host_developing-xen:investigate:retry: <a href="https://openqa.suse.de/t8140847" class="external">https://openqa.suse.de/t8140847</a> passed</li>
<li>uefi-gi-guest_sles12sp5-on-host_developing-xen:investigate:last_good_tests:78a8b9064552b95543ab89a27a5678bb7987bbc8: <a href="https://openqa.suse.de/t8140848" class="external">https://openqa.suse.de/t8140848</a> failed</li>
<li>uefi-gi-guest_sles12sp5-on-host_developing-xen:investigate:last_good_build:91.2: <a href="https://openqa.suse.de/t8140849" class="external">https://openqa.suse.de/t8140849</a> failed</li>
<li>uefi-gi-guest_sles12sp5-on-host_developing-xen:investigate:last_good_tests_and_build:78a8b9064552b95543ab89a27a5678bb7987bbc8+91.2: <a href="https://openqa.suse.de/t8140935" class="external">https://openqa.suse.de/t8140935</a> passed</li>
</ul>
<p>so inconclusive results. I triggered <code>build=okurz_investigation_poo106654; end=040 openqa-clone-set https://openqa.suse.de/tests/8140935 ${build}_uefi-gi-guest_sles12sp5-on-host_developing-xen:investigate:last_good_tests_and_build:78a8b9064552b95543ab89a27a5678bb7987bbc8+91.2 SCHEDULE=tests/boot/boot_from_pxe</code></p>
<p>so awaiting results from <a href="https://openqa.suse.de/tests/overview?build=okurz_investigation_poo106654_uefi-gi-guest_sles12sp5-on-host_developing-xen%3Ainvestigate%3Alast_good_tests_and_build%3A78a8b9064552b95543ab89a27a5678bb7987bbc8%2B91.2&distri=sle&version=15-SP4" class="external">https://openqa.suse.de/tests/overview?build=okurz_investigation_poo106654_uefi-gi-guest_sles12sp5-on-host_developing-xen%3Ainvestigate%3Alast_good_tests_and_build%3A78a8b9064552b95543ab89a27a5678bb7987bbc8%2B91.2&distri=sle&version=15-SP4</a></p>
openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4901692022-02-11T15:05:43Zmkittlermarius.kittler@suse.com
<ul></ul><p>This PR should fix the problem, I'm currently testing it on openqaworker2: <a href="https://github.com/os-autoinst/os-autoinst/pull/1953" class="external">https://github.com/os-autoinst/os-autoinst/pull/1953</a></p>
<p>The test job I've created is still scheduled: <a href="https://openqa.suse.de/tests/8141551" class="external">https://openqa.suse.de/tests/8141551</a></p>
openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4902162022-02-11T17:05:30Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-3 priority-lowest closed child" href="/issues/99663">action #99663</a>: Use more perl signatures - os-autoinst size:M</i> added</li></ul> openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4902462022-02-12T04:10:55Zopenqa_reviewopenqa-review@suse.de
<ul><li><strong>Due date</strong> set to <i>2022-02-26</i></li></ul><p>Setting due date based on mean cycle time of SUSE QE Tools</p>
openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4902642022-02-12T09:27:17Zokurzokurz@suse.com
<ul><li><strong>Subject</strong> changed from <i>[ipmi][openqa][vnc] Massive test run failures due to "IO::Socket::INET: connect: Connection refused"</i> to <i>[ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to auto_review:"Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retry</i></li><li><strong>Description</strong> updated (<a title="View differences" href="/journals/490264/diff?detail_id=463720">diff</a>)</li></ul><p>The fix was deployed with <a href="https://gitlab.suse.de/openqa/osd-deployment/-/pipelines/318539" class="external">https://gitlab.suse.de/openqa/osd-deployment/-/pipelines/318539</a> . <a href="https://openqa.suse.de/tests/overview?build=okurz_investigation_poo106654_uefi-gi-guest_sles12sp5-on-host_developing-xen%3Ainvestigate%3Alast_good_tests_and_build%3A78a8b9064552b95543ab89a27a5678bb7987bbc8%2B91.2&distri=sle&version=15-SP4" class="external">https://openqa.suse.de/tests/overview?build=okurz_investigation_poo106654_uefi-gi-guest_sles12sp5-on-host_developing-xen%3Ainvestigate%3Alast_good_tests_and_build%3A78a8b9064552b95543ab89a27a5678bb7987bbc8%2B91.2&distri=sle&version=15-SP4</a> shows 39/40 passed for tests that either just passed in before or with the fix applied. One job failed which was running before deployment. I retriggered this job as <a href="https://openqa.suse.de/tests/8152116" class="external">https://openqa.suse.de/tests/8152116</a> , currently running. Adding <a href="https://github.com/os-autoinst/scripts/blob/master/README.md#auto-review---automatically-detect-known-issues-in-openqa-jobs-label-openqa-jobs-with-ticket-references-and-optionally-retrigger" class="external">https://github.com/os-autoinst/scripts/blob/master/README.md#auto-review---automatically-detect-known-issues-in-openqa-jobs-label-openqa-jobs-with-ticket-references-and-optionally-retrigger</a> control parameters.</p>
openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4903042022-02-14T00:30:57Zwaynechen55wchen@suse.com
<ul></ul><p>okurz wrote:</p>
<blockquote>
<p>please follow the ticket template from <a href="https://progress.opensuse.org/projects/openqav3/wiki/#Defects" class="external">https://progress.opensuse.org/projects/openqav3/wiki/#Defects</a> . I saw that the problems only appear with the new build. Did you crosscheck with an older build? Did you crosscheck with an older state of tests?</p>
<p>I triggered investigation runs now with <code>echo https://openqa.suse.de/tests/8140400 | host=openqa.suse.de openqa-investigate</code>, comment available in <a href="https://openqa.suse.de/tests/8140400#comment-485767" class="external">https://openqa.suse.de/tests/8140400#comment-485767</a> . Awaiting test results.</p>
</blockquote>
<p>Templates will be followed.</p>
<p>okurz wrote:</p>
<blockquote>
<p>The fix was deployed with <a href="https://gitlab.suse.de/openqa/osd-deployment/-/pipelines/318539" class="external">https://gitlab.suse.de/openqa/osd-deployment/-/pipelines/318539</a> . <a href="https://openqa.suse.de/tests/overview?build=okurz_investigation_poo106654_uefi-gi-guest_sles12sp5-on-host_developing-xen%3Ainvestigate%3Alast_good_tests_and_build%3A78a8b9064552b95543ab89a27a5678bb7987bbc8%2B91.2&distri=sle&version=15-SP4" class="external">https://openqa.suse.de/tests/overview?build=okurz_investigation_poo106654_uefi-gi-guest_sles12sp5-on-host_developing-xen%3Ainvestigate%3Alast_good_tests_and_build%3A78a8b9064552b95543ab89a27a5678bb7987bbc8%2B91.2&distri=sle&version=15-SP4</a> shows 39/40 passed for tests that either just passed in before or with the fix applied. One job failed which was running before deployment. I retriggered this job as <a href="https://openqa.suse.de/tests/8152116" class="external">https://openqa.suse.de/tests/8152116</a> , currently running. Adding <a href="https://github.com/os-autoinst/scripts/blob/master/README.md#auto-review---automatically-detect-known-issues-in-openqa-jobs-label-openqa-jobs-with-ticket-references-and-optionally-retrigger" class="external">https://github.com/os-autoinst/scripts/blob/master/README.md#auto-review---automatically-detect-known-issues-in-openqa-jobs-label-openqa-jobs-with-ticket-references-and-optionally-retrigger</a> control parameters.</p>
</blockquote>
<p>Thanks. I will follow up on the results.</p>
openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4903062022-02-14T00:35:48Zwaynechen55wchen@suse.com
<ul></ul><p>mkittler wrote:</p>
<blockquote>
<p>This PR should fix the problem, I'm currently testing it on openqaworker2: <a href="https://github.com/os-autoinst/os-autoinst/pull/1953" class="external">https://github.com/os-autoinst/os-autoinst/pull/1953</a></p>
<p>The test job I've created is still scheduled: <a href="https://openqa.suse.de/tests/8141551" class="external">https://openqa.suse.de/tests/8141551</a></p>
</blockquote>
<p>Thanks for your info.</p>
openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4907892022-02-15T02:17:05Zwaynechen55wchen@suse.com
<ul></ul><p>Looks like the issue is resolved.</p>
openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4907932022-02-15T02:19:33Zwaynechen55wchen@suse.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li></ul> openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4969782022-03-02T00:03:13Zopenqa_reviewopenqa-review@suse.de
<ul></ul><p>This is an autogenerated message for openQA integration by the openqa_review script:</p>
<p>This bug is still referenced in a failing openQA test: jeos@RPi2B<br>
<a href="https://openqa.opensuse.org/tests/2191462" class="external">https://openqa.opensuse.org/tests/2191462</a></p>
<p>To prevent further reminder comments one of the following options should be followed:</p>
<ol>
<li>The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted</li>
<li>The openQA job group is moved to "Released" or "EOL" (End-of-Life)</li>
<li>The bugref in the openQA scenario is removed or replaced, e.g. <code>label:wontfix:boo1234</code></li>
</ol>
<p>Expect the next reminder at the earliest in 28 days if nothing changes in this ticket.</p>
openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=4992212022-03-09T21:21:13Zokurzokurz@suse.com
<ul><li><strong>Due date</strong> deleted (<del><i>2022-02-26</i></del>)</li><li><strong>Status</strong> changed from <i>Resolved</i> to <i>Feedback</i></li></ul><p>The above job is 21 days old but still the latest job in this scenario. I retriggered it in the hope to end up with a successful cloned job. Currently running <a href="https://openqa.opensuse.org/tests/2236473" class="external">https://openqa.opensuse.org/tests/2236473</a></p>
openQA Project - action #106654: [ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retryhttps://progress.opensuse.org/issues/106654?journal_id=5081552022-04-05T20:21:30Zokurzokurz@suse.com
<ul><li><strong>Subject</strong> changed from <i>[ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to auto_review:"Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retry</i> to <i>[ipmi][openqa][vnc] Massive test run failures with 'IO::Socket::INET: connect: Connection refused' due to "Use of uninitialized value.*connect_timeout in addition.*consoles/VNC.pm line 13.*":retry</i></li><li><strong>Status</strong> changed from <i>Feedback</i> to <i>Resolved</i></li></ul><p><a href="https://openqa.opensuse.org/tests/2282397" class="external">https://openqa.opensuse.org/tests/2282397</a> looks ok, at least not failing as in before.</p>