Project

General

Profile

Actions
Copy link

action #134948

closed

Ensure IPv6 is working in the OSD setup (since we have workers in PRG2 and the VM has been migrated) size:M

Added by mkittler 8 months ago. Updated 7 months ago.

Status:
Resolved
Priority:
High
Assignee:
okurz
Category:
-
Target version:
openQA Project - Ready
Start date:
2023-08-31
Due date:
% Done:

20%

Estimated time:
Tags:
network, ipv6, infra, Eng-Infra, prg2

Description

Observation

martchus@openqa:~> ping worker40.oqa.prg2.suse.org
PING worker40.oqa.prg2.suse.org(worker40.oqa.prg2.suse.org (2a07:de40:b203:12:10:145:10:13)) 56 data bytes
From 2a07:de40:b203:12:0:ff:fe4f:7c2b (2a07:de40:b203:12:0:ff:fe4f:7c2b) icmp_seq=1 Destination unreachable: Address unreachable
…
From 2a07:de40:b203:12:0:ff:fe4f:7c2b (2a07:de40:b203:12:0:ff:fe4f:7c2b) icmp_seq=6 Destination unreachable: Address unreachable
^C
--- worker40.oqa.prg2.suse.org ping statistics ---
8 packets transmitted, 0 received, +6 errors, 100% packet loss, time 7132ms

martchus@openqa:~> ping -4 worker40.oqa.prg2.suse.org
PING  (10.145.10.13) 56(84) bytes of data.
64 bytes from worker40.oqa.prg2.suse.org (10.145.10.13): icmp_seq=1 ttl=64 time=0.110 ms
…
64 bytes from worker40.oqa.prg2.suse.org (10.145.10.13): icmp_seq=4 ttl=64 time=0.110 ms
^C
---  ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3058ms
rtt min/avg/max/mdev = 0.110/0.113/0.118/0.003 ms

This problem is not specific to worker40.oqa.prg2.suse.org. It also leads to failing alerts that have been silenced for now: https://stats.openqa-monitor.qa.suse.de/alerting/silence/444a55a0-8fce-43fd-8a85-50c817d0f46d/edit?alertmanager=grafana

Acceptance criteria

  • AC1: The mentioned silences are no longer necessary
  • AC2: We still have alerting for reachability of those hosts (maybe only for IPv4, in the best case the underlying problem is fixed)

Suggestions

  • Work with Eng-Infra to make AAAA records and DHCPv6 work
  • Remove workaround from openqa-salt-states after IPv6 problems have been addressed

Related issues 3 (1 open — 2 closed)

Related to openQA Infrastructure - action #133358: Migration of o3 VM to PRG2 - Ensure IPv6 is fully workingBlockedokurz

Actions
Related to openQA Infrastructure - action #127991: Fix DNS entry or IPv6 connectivity of qe-jumpy.suse.deResolvedmkittler2023-04-19

Actions
Related to openQA Infrastructure - action #134912: Gradually phase out NUE1 based openQA workers size:MResolvedokurz

Actions
Actions
Copy link
 #1

Updated by okurz 8 months ago

  • Tags set to infra, ipv6, network, Eng-Infra, prg2
  • Assignee set to okurz
Actions
Copy link
 #2

Updated by okurz 8 months ago

  • Related to action #133358: Migration of o3 VM to PRG2 - Ensure IPv6 is fully working added
Actions
Copy link
 #3

Updated by okurz 8 months ago

  • Related to action #127991: Fix DNS entry or IPv6 connectivity of qe-jumpy.suse.de added
Actions
Copy link
 #4

Updated by okurz 8 months ago

  • Subject changed from Ensure IPv6 is working in the OSD setup (since we have workers in Prage and the VM has been migrated) to Ensure IPv6 is working in the OSD setup (since we have workers in PRG2 and the VM has been migrated)
  • Due date set to 2023-09-14
  • Status changed from New to Feedback

https://suse.slack.com/archives/C04MDKHQE20/p1693510248138209

@infra Machines in oqa.prg2.suse.org have AAAA records but the DHCP server does not seem to give out DHCP6 leases making machines not fully reachable. Please help to fix this as we don't have access to the DHCP server. See https://progress.opensuse.org/issues/134948 for details (bringing up here as suggested by mflores instead of SD ticket as it's related to the migration)

and set reminder to myself in Slack about the message.

Actions
Copy link
 #7

Updated by mcaj 8 months ago

  • % Done changed from 0 to 20

Hi, we have started IPv6 RA for the vlan oqa.prg2.suse.org. Any machine in the network will get IPv6 address made based on his MAC, with the prefix 2a07:de40:b203:12::/64.
That means we need to change DNS to be be based on ipv4 address but based on MAC.

I do not have access directly to workers,
Can you please check there:

  • the worker has IPv6 from RA server
  • what Ipv6 address the worker get. - based on this we can do MR to change AAAA records in DNS.
Actions
Copy link
 #8

Updated by okurz 8 months ago

@mcaj same as for any other openqa.suse.de machines your ssh key should be on the machines. Feel welcome to try e.g. ssh worker39.oqa.prg2.suse.org and experiment with DHCPv6, reboot and such

Actions
Copy link
 #9

Updated by okurz 8 months ago

  • Subject changed from Ensure IPv6 is working in the OSD setup (since we have workers in PRG2 and the VM has been migrated) to Ensure IPv6 is working in the OSD setup (since we have workers in PRG2 and the VM has been migrated) size:M
  • Description updated (diff)
Actions
Copy link
 #10

Updated by okurz 8 months ago

  • Related to action #134912: Gradually phase out NUE1 based openQA workers size:M added
Actions
Copy link
 #11

Updated by okurz 8 months ago

  • Priority changed from Normal to High

turning to "High" as #134912 now depends on it.

Actions
Copy link
 #12

Updated by okurz 8 months ago

(Martin Caj) please test ipv6 work workers in Prague. I updated DNS and seem to be working at least for me:
ping -c2 worker40.oqa.prg2.suse.org.
PING worker40.oqa.prg2.suse.org.(2a07:de40:b203:12:7ec2:55ff:fe24:dece (2a07:de40:b203:12:7ec2:55ff:fe24:dece)) 56 data bytes
64 bytes from 2a07:de40:b203:12:7ec2:55ff:fe24:dece (2a07:de40:b203:12:7ec2:55ff:fe24:dece): icmp_seq=1 ttl=59 time=89.9 ms
64 bytes from 2a07:de40:b203:12:7ec2:55ff:fe24:dece (2a07:de40:b203:12:7ec2:55ff:fe24:dece): icmp_seq=2 ttl=59 time=122 ms
(Oliver Kurz) Looks awesome:

for i in {29..40}; do ping -c1 worker$i.oqa.prg2.suse.org; done
PING worker29.oqa.prg2.suse.org(worker29.oqa.prg2.suse.org (2a07:de40:b203:12:7ec2:55ff:fe24:de9c)) 56 data bytes
64 bytes from worker29.oqa.prg2.suse.org (2a07:de40:b203:12:7ec2:55ff:fe24:de9c): icmp_seq=1 ttl=64 time=0.149 ms
…
PING worker40.oqa.prg2.suse.org(worker40.oqa.prg2.suse.org (2a07:de40:b203:12:7ec2:55ff:fe24:dece)) 56 data bytes
64 bytes from worker40.oqa.prg2.suse.org (2a07:de40:b203:12:7ec2:55ff:fe24:dece): icmp_seq=1 ttl=64 time=0.136 ms

I'd say problem solved?

Actions
Copy link
 #13

Updated by okurz 8 months ago

Actions
Copy link
 #14

Updated by okurz 8 months ago

https://gitlab.suse.de/openqa/salt-states-openqa/-/merge_requests/977 merged. I removed the according silence. IPv6 on openqa.suse.de itself is not yet fully configured.

https://suse.slack.com/archives/C04MDKHQE20/p1694436743403769?thread_ts=1693510248.138209&cid=C04MDKHQE20

(Oliver Kurz) @Martin Caj still planning to work on IPv6 for openqa.suse.de aka openqa.oqa.prg2.suse.org?

Actions
Copy link
 #15

Updated by okurz 8 months ago

  • Due date changed from 2023-09-14 to 2023-09-28

Last point in linked thread was from yesterday but no update from mcaj yet.

Actions
Copy link
 #16

Updated by okurz 7 months ago

Actions
Copy link
 #17

Updated by okurz 7 months ago

Finally some progress after more reminders https://suse.slack.com/archives/C04MDKHQE20/p1695208493432869?thread_ts=1695203039.285769&cid=C04MDKHQE20

(Glen D'souza) Oliver, I will work with our team on the topics above and will revert back to you.
(Martin Caj) for 3. AAAA I see the problem and I'm working on the fix now.
(Martin Caj) @Oliver Kurz is this ok : https://gitlab.suse.de/OPS-Service/salt/-/merge_requests/4064
(Oliver Kurz) well, I can ping the address. So assuming that this is the address that OSD has, then yes, that looks very good
(Martin Caj) done:
host openqa.oqa.prg2.suse.org.
openqa.oqa.prg2.suse.org has address 10.145.10.207
openqa.oqa.prg2.suse.org has IPv6 address 2a07:de40:b203:12:0:ff:fe4f:7c2b

ping openqa.oqa.prg2.suse.org.

PING openqa.oqa.prg2.suse.org.(openqa.oqa.prg2.suse.org (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
64 bytes from openqa.oqa.prg2.suse.org (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=63 time=0.304 ms
64 bytes from openqa.oqa.prg2.suse.org (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=2 ttl=63 time=0.301 ms
(edited)

Confirmed from multiple locations of salt-controlled machines:

okurz@openqa:~> sudo salt \* cmd.run 'ping -c1 openqa.suse.de'
worker38.oqa.prg2.suse.org:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=64 time=0.112 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms
worker37.oqa.prg2.suse.org:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=64 time=0.104 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms
backup-qam.qe.nue2.suse.org:
    PING openqa.oqa.prg2.suse.org (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.oqa.prg2.suse.org (10.145.10.207): icmp_seq=1 ttl=62 time=4.50 ms

    --- openqa.oqa.prg2.suse.org ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 4.502/4.502/4.502/0.000 ms
worker39.oqa.prg2.suse.org:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=64 time=0.102 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms
worker29.oqa.prg2.suse.org:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=64 time=0.139 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms
worker30.oqa.prg2.suse.org:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=64 time=0.145 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms
worker40.oqa.prg2.suse.org:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=64 time=0.125 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms
sapworker1.qe.nue2.suse.org:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=62 time=4.52 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 4.515/4.515/4.515/0.000 ms
openqaworker1.qe.nue2.suse.org:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=62 time=4.53 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 4.528/4.528/4.528/0.000 ms
storage.oqa.suse.de:
    PING openqa.suse.de(2a07:de40:b203:12:0:ff:fe4f:7c2b (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from 2a07:de40:b203:12:0:ff:fe4f:7c2b (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=61 time=11.3 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 11.294/11.294/11.294/0.000 ms
worker3.oqa.suse.de:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=61 time=11.1 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 11.052/11.052/11.052/0.000 ms
worker8.oqa.suse.de:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=61 time=11.0 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 11.002/11.002/11.002/0.000 ms
openqa.suse.de:
    PING openqa.suse.de(openqa.oqa.prg2.suse.org (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.oqa.prg2.suse.org (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=64 time=0.017 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 0.017/0.017/0.017/0.000 ms
openqaworker18.qa.suse.cz:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=58 time=22.0 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 22.003/22.003/22.003/0.000 ms
openqaworker17.qa.suse.cz:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=58 time=21.3 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 21.295/21.295/21.295/0.000 ms
openqaworker16.qa.suse.cz:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=58 time=19.4 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 19.448/19.448/19.448/0.000 ms
qesapworker-prg7.qa.suse.cz:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=58 time=23.6 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 23.642/23.642/23.642/0.000 ms
qesapworker-prg4.qa.suse.cz:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=58 time=24.0 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 23.956/23.956/23.956/0.000 ms
qesapworker-prg5.qa.suse.cz:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=58 time=24.2 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 24.165/24.165/24.165/0.000 ms
qesapworker-prg6.qa.suse.cz:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=58 time=24.6 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 24.550/24.550/24.550/0.000 ms
petrol.qe.nue2.suse.org:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=62 time=4.52 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 4.522/4.522/4.522/0.000 ms
worker5.oqa.suse.de:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=61 time=10.9 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 10.885/10.885/10.885/0.000 ms
powerqaworker-qam-1.qa.suse.de:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=60 time=11.1 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 11.054/11.054/11.054/0.000 ms
openqaworker14.qa.suse.cz:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=58 time=23.5 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 23.515/23.515/23.515/0.000 ms
qamasternue.qa.suse.de:
    PING openqa.oqa.prg2.suse.org (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.oqa.prg2.suse.org (10.145.10.207): icmp_seq=1 ttl=62 time=4.47 ms

    --- openqa.oqa.prg2.suse.org ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 4.471/4.471/4.471/0.000 ms
worker2.oqa.suse.de:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=61 time=10.8 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 10.833/10.833/10.833/0.000 ms
openqaw5-xen.qa.suse.de:
    PING openqa.suse.de(2a07:de40:b203:12:0:ff:fe4f:7c2b (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from 2a07:de40:b203:12:0:ff:fe4f:7c2b (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=60 time=11.3 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 11.321/11.321/11.321/0.000 ms
imagetester.qe.nue2.suse.org:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=62 time=4.54 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 4.541/4.541/4.541/0.000 ms
openqa-monitor.qa.suse.de:
    PING openqa.oqa.prg2.suse.org (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.oqa.prg2.suse.org (10.145.10.207): icmp_seq=1 ttl=62 time=6.20 ms

    --- openqa.oqa.prg2.suse.org ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 6.196/6.196/6.196/0.000 ms
malbec.arch.suse.de:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=60 time=11.2 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 11.173/11.173/11.173/0.000 ms
baremetal-support.qa.suse.de:
    PING openqa.oqa.prg2.suse.org (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.oqa.prg2.suse.org (10.145.10.207): icmp_seq=1 ttl=62 time=4.55 ms

    --- openqa.oqa.prg2.suse.org ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 4.550/4.550/4.550/0.000 ms
worker10.oqa.suse.de:
    PING openqa.suse.de(openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b)) 56 data bytes
    64 bytes from openqa.suse.de (2a07:de40:b203:12:0:ff:fe4f:7c2b): icmp_seq=1 ttl=61 time=11.0 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 10.958/10.958/10.958/0.000 ms
diesel.qe.nue2.suse.org:
    PING salt (10.145.10.207) 56(84) bytes of data.
    64 bytes from salt (10.145.10.207): icmp_seq=1 ttl=62 time=4.50 ms

    --- salt ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 4.499/4.499/4.499/0.000 ms
openqa-piworker.qa.suse.de:
    PING openqa.oqa.prg2.suse.org (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.oqa.prg2.suse.org (10.145.10.207): icmp_seq=1 ttl=62 time=4.54 ms

    --- openqa.oqa.prg2.suse.org ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 4.540/4.540/4.540/0.000 ms
jenkins.qa.suse.de:
    PING openqa.oqa.prg2.suse.org (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.oqa.prg2.suse.org (10.145.10.207): icmp_seq=1 ttl=62 time=18.3 ms

    --- openqa.oqa.prg2.suse.org ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 18.326/18.326/18.326/0.000 ms
backup.qa.suse.de:
    PING openqa.oqa.prg2.suse.org (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.oqa.prg2.suse.org (10.145.10.207): icmp_seq=1 ttl=62 time=4.53 ms

    --- openqa.oqa.prg2.suse.org ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 4.529/4.529/4.529/0.000 ms
tumblesle.qa.suse.de:
    PING openqa.oqa.prg2.suse.org (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.oqa.prg2.suse.org (10.145.10.207): icmp_seq=1 ttl=62 time=7.49 ms

    --- openqa.oqa.prg2.suse.org ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 7.490/7.490/7.490/0.000 ms
schort-server.qa.suse.de:
    PING openqa.oqa.prg2.suse.org (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.oqa.prg2.suse.org (10.145.10.207): icmp_seq=1 ttl=62 time=4.60 ms

    --- openqa.oqa.prg2.suse.org ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 4.602/4.602/4.602/0.000 ms
openqaworker-arm-3.suse.de:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=60 time=11.0 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 11.026/11.026/11.026/0.000 ms
openqaworker-arm-2.suse.de:
    PING openqa.suse.de (10.145.10.207) 56(84) bytes of data.
    64 bytes from openqa.suse.de (10.145.10.207): icmp_seq=1 ttl=60 time=11.0 ms

    --- openqa.suse.de ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 10.972/10.972/10.972/0.000 ms

Waiting for any more related effect on monitoring+alerting or similar if any.

Actions
Copy link
 #18

Updated by okurz 7 months ago

  • Due date deleted (2023-09-28)
  • Status changed from Feedback to Resolved

No alerts in https://monitor.qa.suse.de/alerting/list?search=state:firing and checked multiple monitoring dashboards. No problems seen, resolving.

Actions
Copy link

Also available in: Atom PDF