https://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842020-12-18T13:38:35ZopenSUSE Project Management ToolopenQA Infrastructure - action #81198: [tracker-ticket] openqaworker-arm-{1..3} have network problems (cacheservice, OSD reachability). IPv6 disabled for nowhttps://progress.opensuse.org/issues/81198?journal_id=3589282020-12-18T13:38:35Znicksingernsinger@suse.com
<ul></ul><p>I disabled it on arm-2 for now with:</p>
<pre><code>sysctl -a | grep disable_ipv6 | grep -v tap | cut -d= -f 1 | awk '{$1=$1;print}' | xargs -I{} echo {}=1 > /etc/sysctl.d/99-poo81198.conf
</code></pre>
<p>rebooting now to verify and afterwards I will apply it to arm-1 and arm-3 too</p>
openQA Infrastructure - action #81198: [tracker-ticket] openqaworker-arm-{1..3} have network problems (cacheservice, OSD reachability). IPv6 disabled for nowhttps://progress.opensuse.org/issues/81198?journal_id=3600812020-12-29T10:21:19ZXiaojing_liuxliu1@suse.com
<ul></ul><p>On 2020-12-29, the networker problem happened on arm-3. Here is an example: <a href="https://openqa.suse.de/tests/5227454" class="external">https://openqa.suse.de/tests/5227454</a><br>
I disabled IPv6 on arm-3 according to <a class="user active user-mention" href="https://progress.opensuse.org/users/24624">@nicksinger</a> comments, and reboot the machine.</p>
openQA Infrastructure - action #81198: [tracker-ticket] openqaworker-arm-{1..3} have network problems (cacheservice, OSD reachability). IPv6 disabled for nowhttps://progress.opensuse.org/issues/81198?journal_id=3613252021-01-08T09:42:27Zokurzokurz@suse.com
<ul><li><strong>Target version</strong> set to <i>future</i></li></ul> openQA Infrastructure - action #81198: [tracker-ticket] openqaworker-arm-{1..3} have network problems (cacheservice, OSD reachability). IPv6 disabled for nowhttps://progress.opensuse.org/issues/81198?journal_id=3782182021-01-15T16:05:44Zmkittlermarius.kittler@suse.com
<ul></ul><p>Looks like IPv6 was not actually disabled on <code>openqaworker-arm-1</code> today. <code>ip addr</code> showed IPv6 addresses. <code>wget http://openqa.suse.de/…</code> was using IPv6 which did not work (only <code>wget -4 …</code> worked). After restarting wicked it worked again (also <code>wget -6 …</code>). The output of <code>ip addr</code> for <code>eth0</code> looks like before though; only the "sec" values differ slightly.</p>
openQA Infrastructure - action #81198: [tracker-ticket] openqaworker-arm-{1..3} have network problems (cacheservice, OSD reachability). IPv6 disabled for nowhttps://progress.opensuse.org/issues/81198?journal_id=3782212021-01-15T16:12:38Zmkittlermarius.kittler@suse.com
<ul></ul><blockquote>
<p>After restarting wicked it worked again (also wget -6 …).</p>
</blockquote>
<p>And now not anymore. This didn't last very long. I applied the same command as <a class="user active user-mention" href="https://progress.opensuse.org/users/24624">@nicksinger</a> did for arm-2 on arm-1 and will reboot the machine.</p>
openQA Infrastructure - action #81198: [tracker-ticket] openqaworker-arm-{1..3} have network problems (cacheservice, OSD reachability). IPv6 disabled for nowhttps://progress.opensuse.org/issues/81198?journal_id=3806012021-01-27T14:32:09Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-4 priority-default closed" href="/issues/81026">action #81026</a>: many jobs incomplete with auto_review:"(?s)Running on openqaworker-arm-2.*failed: 521 Connect timeout.*Result: setup failure":retry</i> added</li></ul> openQA Infrastructure - action #81198: [tracker-ticket] openqaworker-arm-{1..3} have network problems (cacheservice, OSD reachability). IPv6 disabled for nowhttps://progress.opensuse.org/issues/81198?journal_id=3806052021-01-27T14:32:41Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>Feedback</i> to <i>New</i></li></ul> openQA Infrastructure - action #81198: [tracker-ticket] openqaworker-arm-{1..3} have network problems (cacheservice, OSD reachability). IPv6 disabled for nowhttps://progress.opensuse.org/issues/81198?journal_id=3821462021-02-10T09:49:08Znicksingernsinger@suse.com
<ul></ul><p>nicksinger wrote:</p>
<blockquote>
<p>I disabled it on arm-2 for now with:</p>
<pre><code>sysctl -a | grep disable_ipv6 | grep -v tap | cut -d= -f 1 | awk '{$1=$1;print}' | xargs -I{} echo {}=1 > /etc/sysctl.d/99-poo81198.conf
</code></pre>
<p>rebooting now to verify and afterwards I will apply it to arm-1 and arm-3 too</p>
</blockquote>
<p>I've excluded the loopback interface from that file now, see <a href="https://progress.opensuse.org/issues/88225" class="external">https://progress.opensuse.org/issues/88225</a> for details why</p>
openQA Infrastructure - action #81198: [tracker-ticket] openqaworker-arm-{1..3} have network problems (cacheservice, OSD reachability). IPv6 disabled for nowhttps://progress.opensuse.org/issues/81198?journal_id=6108652023-03-08T19:06:52Zokurzokurz@suse.com
<ul><li><strong>Tags</strong> set to <i>infra</i></li></ul> openQA Infrastructure - action #81198: [tracker-ticket] openqaworker-arm-{1..3} have network problems (cacheservice, OSD reachability). IPv6 disabled for nowhttps://progress.opensuse.org/issues/81198?journal_id=7597692024-02-05T07:34:05Zokurzokurz@suse.com
<ul><li><strong>Target version</strong> changed from <i>future</i> to <i>Ready</i></li></ul> openQA Infrastructure - action #81198: [tracker-ticket] openqaworker-arm-{1..3} have network problems (cacheservice, OSD reachability). IPv6 disabled for nowhttps://progress.opensuse.org/issues/81198?journal_id=7599462024-02-05T12:14:56Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Resolved</i></li><li><strong>Assignee</strong> set to <i>okurz</i></li></ul><p><code>sudo salt -C 'G@roles:worker' cmd.run 'ls -l /etc/sysctl.d/'</code> shows no occurences of the workarounds. For all machines we currently have in production IPv6 works fine.</p>