action #81198
closed
[tracker-ticket] openqaworker-arm-{1..3} have network problems (cacheservice, OSD reachability). IPv6 disabled for now
Added by nicksinger over 3 years ago.
Updated 3 months ago.
Description
As we face repeated network problems with our arm workers (e.g. https://progress.opensuse.org/issues/81026) we decided to disable ipv6 once again completely on all our arm workers.
This ticket is to track this change to revisit it after the Christmas holidays
I disabled it on arm-2 for now with:
sysctl -a | grep disable_ipv6 | grep -v tap | cut -d= -f 1 | awk '{$1=$1;print}' | xargs -I{} echo {}=1 > /etc/sysctl.d/99-poo81198.conf
rebooting now to verify and afterwards I will apply it to arm-1 and arm-3 too
- Target version set to future
Looks like IPv6 was not actually disabled on openqaworker-arm-1 today. ip addr showed IPv6 addresses. wget http://openqa.suse.de/… was using IPv6 which did not work (only wget -4 … worked). After restarting wicked it worked again (also wget -6 …). The output of ip addr for eth0 looks like before though; only the "sec" values differ slightly.
After restarting wicked it worked again (also wget -6 …).
And now not anymore. This didn't last very long. I applied the same command as @nicksinger did for arm-2 on arm-1 and will reboot the machine.
- Related to action #81026: many jobs incomplete with auto_review:"(?s)Running on openqaworker-arm-2.*failed: 521 Connect timeout.*Result: setup failure":retry added
- Status changed from Feedback to New
nicksinger wrote:
I disabled it on arm-2 for now with:
sysctl -a | grep disable_ipv6 | grep -v tap | cut -d= -f 1 | awk '{$1=$1;print}' | xargs -I{} echo {}=1 > /etc/sysctl.d/99-poo81198.conf
rebooting now to verify and afterwards I will apply it to arm-1 and arm-3 too
I've excluded the loopback interface from that file now, see https://progress.opensuse.org/issues/88225 for details why
- Target version changed from future to Ready
- Status changed from New to Resolved
- Assignee set to okurz
sudo salt -C 'G@roles:worker' cmd.run 'ls -l /etc/sysctl.d/' shows no occurences of the workarounds. For all machines we currently have in production IPv6 works fine.
Also available in: Atom
PDF