Project

General

Profile

Actions

action #53525

closed

Upgrade o3 workers to Leap 15.1

Added by okurz almost 5 years ago. Updated almost 5 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
-
Start date:
2019-06-26
Due date:
2019-07-20
% Done:

0%

Estimated time:

Description

Follow #50453#note-6


Related issues 2 (0 open2 closed)

Related to openQA Project - action #52451: test incompletes reproducibly in first_boot of krypton-live-install with "Seems like os-autoinst has produced a result which openQA can not display."Resolvedokurz2019-05-31

Actions
Related to openQA Infrastructure - action #43937: align o3 workers (done: "imagetester" and) "power8" with the others which are currently "transactional-update" hostsResolvedokurz2018-11-15

Actions
Actions #1

Updated by okurz almost 5 years ago

  • Related to action #52451: test incompletes reproducibly in first_boot of krypton-live-install with "Seems like os-autoinst has produced a result which openQA can not display." added
Actions #2

Updated by okurz almost 5 years ago

Could help with #52451

Actions #3

Updated by okurz almost 5 years ago

Starting with openqaworker1. There are currently some qemu jobs running but in the background I can still prepare the upgrade.

Actions #4

Updated by okurz almost 5 years ago

Following #50453#note-6 I replaced repos with Leap 15.1 ones, then did a zypper dup --allow-vendor-change within transactional-pkg shell. After reboot I checked that no systemd services failed and also jobs were successfully "starting". However, today in the morning a lot of jobs on o3 were incomplete due to Can't locate object method "set_expected_autoinst_failures" via package "Distribution::Opensuse::Tumbleweed" at /var/lib/openqa/cache/openqa1-opensuse/tests/opensuse/products/opensuse/main.pm line 78. as in https://openqa.opensuse.org/tests/969205/file/autoinst-log.txt due to the fact that os-autoinst and openQA got installed from the official Leap 15.1 oss repo instead of devel:openQA.

So I disabled the workers with

systemctl disable --now openqa-worker.target

and fixed that with proper repo permissions within transactional-pkg shell:

zypper mr -p 95 -r 1
zypper mr -p 90 -r 2
zypper dup --allow-vendor-change

and outside the shell:

systemctl enable openqa-worker.target && reboot

checked after reboot that all workers are fine.

Actions #5

Updated by okurz almost 5 years ago

  • Related to action #43937: align o3 workers (done: "imagetester" and) "power8" with the others which are currently "transactional-update" hosts added
Actions #6

Updated by okurz almost 5 years ago

  • Status changed from In Progress to Blocked

waiting for #52451 first where it is beneficial to keep old workers around.

Actions #7

Updated by okurz almost 5 years ago

  • Status changed from Blocked to In Progress

experiment in #52451 conducted, can upgrade further workers, e.g. openqaworker4. Will keep imagetester on Leap 15.0 but set the worker class to "imagetester" only so that we can debug further if necessary.

https://openqa.opensuse.org/tests/977251 triggered as test job on w4 after upgrade. Job started all good, restarted workers so job retriggered.

Actions #8

Updated by okurz almost 5 years ago

  • Due date set to 2019-07-20
  • Status changed from In Progress to Feedback

change done on imagetester, waiting for feedback if any regarding debugging.

Actions #9

Updated by okurz almost 5 years ago

  • Status changed from Feedback to In Progress

updated https://bugzilla.opensuse.org/show_bug.cgi?id=1137520#c4 that I will do the update now after the due date was reached.

Actions #10

Updated by okurz almost 5 years ago

  • Status changed from In Progress to Resolved

imagetester is back online, upgraded, worker class back to qemu_x86_64, test job started to execute fine.

Actions

Also available in: Atom PDF