Project

General

Profile

Actions

action #170041

closed

Configure wireguard tunnels on hosts located in the NUE2 server room - at least one KVM@PowerNV host size:S

Added by okurz about 1 month ago. Updated 21 days ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Feature requests
Start date:
2024-11-08
Due date:
% Done:

0%

Estimated time:

Description

Acceptance criteria

  • AC1: At least one KVM@PowerNV host in the NUE2 server room can work on OSD openQA tests again

Suggestions

  • Follow steps from #169564 but focus on one KVM@PowerNV host, i.e. one of diesel+petrol+mania
  • Handle any ppc64le specifics, block on product bugs, apply workaround, etc.
  • Ensure KVM@PowerNV OSD jobs are picked up and executed properly again
  • Remove the silence alertname=Queue: State (SUSE) - too few jobs executed alert from https://stats.openqa-monitor.qa.suse.de/alerting/silences

Related issues 2 (1 open1 closed)

Copied from openQA Infrastructure (public) - action #169564: Configure wireguard tunnels on OSD production hosts needed for openQA located in the NUE2 server room size:SResolvedmkittler

Actions
Copied to openQA Infrastructure (public) - action #170101: Use grenache-1 as KVM@PowerNV hostNew2024-11-08

Actions
Actions #1

Updated by okurz about 1 month ago

  • Copied from action #169564: Configure wireguard tunnels on OSD production hosts needed for openQA located in the NUE2 server room size:S added
Actions #2

Updated by okurz about 1 month ago

  • Description updated (diff)
  • Status changed from New to Blocked
Actions #3

Updated by okurz 30 days ago

I already installed wireguard-tools manually now on diesel. kmod list | grep wireguard does not list wireguard. I assume we can actually not get wireguard to run on the machines in the current state as we are running Linux 5.3 from Leap 15.3 due to regressions in newer versions, see https://bugzilla.suse.com/show_bug.cgi?id=1202138 as originally found in #114565 . We could try even newer kernels, e.g. Tumbleweed.

Actions #4

Updated by okurz 29 days ago

Actions #5

Updated by jlausuch 24 days ago

What about Leap 15.6? It comes with 6.4.0 (Tumbleweed is now 6.11.8).

Actions #6

Updated by okurz 24 days ago

jlausuch wrote in #note-5:

What about Leap 15.6? It comes with 6.4.0

yes, we tried that as part of #157975, hit even worse problems as in #162296 and for ppc reverted back to Leap 15.5 for now followed in #169939

Actions #7

Updated by okurz 24 days ago

  • Priority changed from High to Low
  • Target version changed from Ready to future

szarate suggested to focus on Power10 instead so leaving this aside for now.

Actions #8

Updated by okurz 23 days ago

  • Due date set to 2024-12-10
  • Status changed from Blocked to Feedback
  • Priority changed from Low to Normal
  • Target version changed from future to Ready

The nice surprise is that we can actually run wireguard on our Power8 machines with Linux 5.3 and we have first passed OSD jobs, e.g. https://openqa.suse.de/tests/16003531 . Maybe wireguard was actually backported within the SUSE kernel. So effectively this is being worked on. It just doesn't need any special handling so far. We will monitor jobs over the next days.

Actions #9

Updated by okurz 23 days ago

  • Subject changed from Configure wireguard tunnels on hosts located in the NUE2 server room - at least one KVM@PowerNV host to Configure wireguard tunnels on hosts located in the NUE2 server room - at least one KVM@PowerNV host size:S
  • Description updated (diff)
Actions #10

Updated by okurz 21 days ago

  • Due date deleted (2024-12-10)
  • Status changed from Feedback to Resolved

I checked the history of workers and I can see a significant number of passed openQA jobs on all three mania+diesel+petrol

Actions

Also available in: Atom PDF