Project

General

Profile

action #102464

openQA Infrastructure - coordination #99183: [epic] Upgrade all our infrastructure, e.g. o3+osd workers+webui, to openSUSE Leap 15.3

Upgrade OBS package CI checks to Leap 15.3 (os-autoinst+openQA) size:M

Added by okurz 2 months ago. Updated about 5 hours ago.

Status:
In Progress
Priority:
High
Assignee:
Category:
Organisational
Target version:
Start date:
2021-09-24
Due date:
2022-02-11
% Done:

0%

Estimated time:
Difficulty:

Description

Motivation

As we use Leap 15.3 as CI container base in os-autoinst and openQA so far already AFAIK we should also run the according OBS checks on Leap 15.3

Acceptance criteria

  • AC1: OBS checks run on pull requests for both os-autoinst and openQA test on Leap 15.3

Suggestions

github-obs-scm-pr-checks.png (61.7 KB) github-obs-scm-pr-checks.png Github PR checks tinita, 2021-12-15 11:39
12309

Related issues

Copied from openQA Infrastructure - action #99240: Upgrade CI container image versions to Leap 15.3 size:MResolved2021-09-24

History

#1 Updated by okurz 2 months ago

  • Copied from action #99240: Upgrade CI container image versions to Leap 15.3 size:M added

#2 Updated by okurz 2 months ago

  • Target version set to Ready

#3 Updated by okurz 2 months ago

  • Project changed from openQA Infrastructure to openQA Project
  • Category set to Organisational

#4 Updated by cdywan 2 months ago

  • Description updated (diff)
  • Status changed from New to Workable

#5 Updated by okurz 2 months ago

  • Description updated (diff)

#6 Updated by okurz about 2 months ago

  • Priority changed from Normal to High

#7 Updated by tinita about 2 months ago

  • Status changed from Workable to In Progress
  • Assignee set to tinita

#8 Updated by tinita about 2 months ago

It's configured on some of coolo's personal machines, and he will switch it to 15.3, but it will stop working "soon" because github will "switch off the auth keys".

So we should switch to the OBS CI integration soon.

#10 Updated by tinita about 2 months ago

I created a token and added a workflow to my fork https://github.com/perlpunk/os-autoinst

It's working in general. The original package is branched into ...:PR-123/os-autoinst, that means it is ready to build, but I need to figure out how to restrict the architectures and repos, so that we don't test all of them in every PR.

#11 Updated by openqa_review about 2 months ago

  • Due date set to 2021-12-25

Setting due date based on mean cycle time of SUSE QE Tools

#12 Updated by tinita about 2 months ago

  • Status changed from In Progress to Feedback

It seems there are still some limitations and/or bugs.

First I used the branch_package approach.
This worked in principle, but there are way too many platforms to test.
There is the filter feature to only report the platforms back to GitHub which we are interested in.
However, the builds for all the other platforms will still run, so it's a waste of energy, and the platforms
we want to see might start later.

As dmarcoux suggested, I tried the link_package + configure_repositories feature. The effect is as expected,
the repo is configured only with the specified platforms: https://build.opensuse.org/package/show/home:tinita:branches:devel:openQA:GitHubLink:perlpunk:os-autoinst:PR-10/os-autoinst

The first problem is that the multibuild tests for os-autoinst:os-autoinst-test are not appearing in the list of Github checks.
I created an issue: https://github.com/openSUSE/open-build-service/issues/11975

Another limitation is that the checks don't appear as pending "immediately", but only appear in the pull request when they are finished.
This is a (soon documented) limitation of multibuilds. See https://github.com/openSUSE/obs-docu/pull/212

For now I would say this is blocked because of the multibuild problem.

Meanwhile, coolo configured Leap 15.3 on his machine, so AC1 is fulfilled for now, but at some point it will stop working.
Not sure what to do.

#13 Updated by tinita about 1 month ago

12309

I set myself a weekly reminder to look if the OBS multibuild issue has been resolved.

When it has been resolved at some point, a pull request like the following should be created to see if it works: https://github.com/perlpunk/os-autoinst/pull/10

As you can see in the attached screenshot, only 4 os-autoinst checks are reported back, but not os-autoinst:os-autoinst-test
But they are built: https://build.opensuse.org/package/show/home:tinita:branches:devel:openQA:GitHubLink:perlpunk:os-autoinst:PR-10/os-autoinst

Regarding old tokens being deactivated on Github: https://github.blog/2021-04-05-behind-githubs-new-authentication-token-formats/ (there is no date mentioned)

#14 Updated by okurz about 1 month ago

  • Due date deleted (2021-12-25)

removing due-date for blocked task as you can check the external reference https://github.com/openSUSE/open-build-service/issues/11975 as provided for the resolution of Blocker.

#16 Updated by tinita 7 days ago

  • Status changed from Blocked to In Progress

According to https://github.com/openSUSE/open-build-service/issues/11975 the fix was merged and deployed \o/

#17 Updated by tinita 7 days ago

  • Status changed from In Progress to Feedback

I created a PR to add the workflow: https://github.com/os-autoinst/os-autoinst/pull/1929

I added a short documentation what's required (Tokens, Webhook) to the .obs/workflows.yml itself.

#18 Updated by tinita 4 days ago

The fact that multibuilds only report the final success or fail is a documented limitation.
However, I created a feature request https://github.com/openSUSE/open-build-service/issues/12121 and it seems that this shouldn't be the case anymore. Dany is investigating.

My PR was approved and merged meanwhile, so we will be able to see how it behaves.
Waiting for a PR showing up that uses the new workflow.

#19 Updated by tinita 4 days ago

Forgot that Oli needs to enable the workflow, because only he can create a webhook in the project.

#20 Updated by tinita 4 days ago

  • Assignee changed from tinita to okurz

#21 Updated by tinita 3 days ago

  • Assignee changed from okurz to tinita

#22 Updated by tinita 1 day ago

#23 Updated by tinita about 19 hours ago

  • Status changed from Feedback to In Progress

Now working on the same thing for the openQA repo.

#24 Updated by openqa_review about 5 hours ago

  • Due date set to 2022-02-11

Setting due date based on mean cycle time of SUSE QE Tools

Also available in: Atom PDF