Project

General

Profile

Actions
Copy link

action #132236

closed

coordination #127031: [saga][epic] openQA for SUSE customers

coordination #127910: [epic] openQA in SLE modules

Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:M

Added by jbaier_cz over 1 year ago. Updated 4 months ago.

Status:
Closed
Priority:
Low
Assignee:
dheidler
Category:
Feature requests
Target version:
Ready
Start date:
2023-04-26
Due date:
% Done:

0%

Estimated time:

Description

Motivation

For now the decision regarding SLE module or such is still pending but we can at least update package dependencies and packages that are already in SLE or packagehub so that openQA in Leap works in a current version without needing devel:openQA or devel:openQA:Leap

#128651 shows, that we can submit some of the openQA/os-autoinst dependencies into Leap / SLE update repositories. We should plan next steps.

Acceptance criteria

  • AC1: All SRs from #128651-12 (or superseeding SRs) are accepted
  • AC2: All os-autoinst and openQA dependencies are provided in a sufficient up-to-date version in SLE+packagehub

Suggestions

  • Clean-up packages inside devel:openQA:Leap:15.X project, also see #127883 and #128087
  • Follow SRs from #128651-12
  • Handle not-accepted updates
  • Try to use only ways that any non-SUSE employee can also take, e.g. no SRs within IBS

Out of scope

  • Full automatic submissions into openSUSE:Backports:SLE-15-SPx:Update (or SUSE:SLE-15-SPx:Update), see #132395

Related issues 4 (0 open — 4 closed)

Related to openQA Project (public) - action #160715: Error message in obs-check-package-origin size:SResolvedjbaier_cz2024-05-22

Actions
Related to openQA Project (public) - action #165683: Current openQA+os-autoinst+dependencies in pure SLE size:MResolvedmkittler2024-08-22

Actions
Copied from openQA Project (public) - action #128651: [spike][timeboxed:20h] Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:MResolvedjbaier_cz2023-04-26

Actions
Copied to openQA Project (public) - action #132395: Current openQA+os-autoinst+dependencies are updated automatically in SLE+packagehubRejectedokurz

Actions
Actions
Copy link
 #1

Updated by jbaier_cz over 1 year ago

  • Copied from action #128651: [spike][timeboxed:20h] Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:M added
Actions
Copy link
 #2

Updated by jbaier_cz over 1 year ago

  • Subject changed from Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:M to Current openQA+os-autoinst+dependencies updated in SLE+packagehub
  • Description updated (diff)
  • Category deleted (Feature requests)
  • Assignee deleted (jbaier_cz)
  • Priority changed from High to Normal
Actions
Copy link
 #3

Updated by okurz over 1 year ago

  • Copied to action #132395: Current openQA+os-autoinst+dependencies are updated automatically in SLE+packagehub added
Actions
Copy link
 #4

Updated by okurz over 1 year ago

  • Subject changed from Current openQA+os-autoinst+dependencies updated in SLE+packagehub to Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:M
  • Description updated (diff)
  • Due date deleted (2023-07-14)
  • Category set to Feature requests
Actions
Copy link
 #5

Updated by okurz over 1 year ago

  • Status changed from New to Workable
Actions
Copy link
 #6

Updated by okurz over 1 year ago

  • Target version changed from Ready to future
Actions
Copy link
 #7

Updated by okurz 8 months ago

  • Target version changed from future to Ready
Actions
Copy link
 #8

Updated by jbaier_cz 7 months ago

  • Related to action #157984: Upgrade CI container image versions to Leap 15.6 size:S added
Actions
Copy link
 #9

Updated by jbaier_cz 7 months ago

  • Related to deleted (action #157984: Upgrade CI container image versions to Leap 15.6 size:S)
Actions
Copy link
 #10

Updated by okurz 7 months ago

  • Priority changed from Normal to High
Actions
Copy link
 #11

Updated by livdywan 7 months ago 路 Edited

jbaier_cz wrote:

Motivation

For now the decision regarding SLE module or such is still pending but we can at least update package dependencies and packages that are already in SLE or packagehub so that openQA in Leap works in a current version without needing devel:openQA or devel:openQA:Leap

#128651 shows, that we can submit some of the openQA/os-autoinst dependencies into Leap / SLE update repositories. We should plan next steps.

Acceptance criteria

  • AC1: All SRs from #128651-12 (or superseeding SRs) are accepted

Reads like all SR's have been accepted. However #128651#note-17 might suggest there's something missing?

https://github.com/os-autoinst/scripts/actions/workflows/obs-list-dependencies.yml collects package versions. However it also includes all indirect deps like reboot-manager which we don't require specifics versions of
@tinita filed #160715 about the errors in the workflow

Suggestion: Use a SLE container for an Acceptance Test to assess the current state and make it easy to verify

Actions
Copy link
 #12

Updated by livdywan 7 months ago

  • Related to action #160715: Error message in obs-check-package-origin size:S added
Actions
Copy link
 #13

Updated by livdywan 7 months ago

Suggestion: Use a SLE container for an Acceptance Test to assess the current state and make it easy to verify

https://packagehub.suse.com/packages/openQA/

podman run --rm -ti registry.suse.com/suse/sles12sp5:latest

I seem to remember using a SLE image before, but this one doesn't have SUSEConnect on it? And I failed to trace the ticket back to where we previously tested and hopefully documented it.

Actions
Copy link
 #14

Updated by jbaier_cz 7 months ago

livdywan wrote in #note-13:

Suggestion: Use a SLE container for an Acceptance Test to assess the current state and make it easy to verify

https://packagehub.suse.com/packages/openQA/

podman run --rm -ti registry.suse.com/suse/sles12sp5:latest

I seem to remember using a SLE image before, but this one doesn't have SUSEConnect on it? And I failed to trace the ticket back to where we previously tested and hopefully documented it.

Are you sure you want to use 12-SP5? I thought we are targeting 15-SP5 (or maybe even SP6?).

Actions
Copy link
 #15

Updated by livdywan 7 months ago

I seem to remember using a SLE image before, but this one doesn't have SUSEConnect on it? And I failed to trace the ticket back to where we previously tested and hopefully documented it.

Are you sure you want to use 12-SP5? I thought we are targeting 15-SP5 (or maybe even SP6?).

No. I tried to find a usable image first of all. registry.suse.com/suse/sle15:latest (which is 15.5 atm) gave me the same result.

Actions
Copy link
 #16

Updated by dheidler 7 months ago

  • Status changed from Workable to In Progress
  • Assignee set to dheidler
Actions
Copy link
 #17

Updated by openqa_review 7 months ago

  • Due date set to 2024-06-19

Setting due date based on mean cycle time of SUSE QE Tools

Actions
Copy link
 #18

Updated by dheidler 7 months ago

Modules required to satisfy dependencies:

suseconnect -p PackageHub/15.5/x86_64
suseconnect -p sle-module-desktop-applications/15.5/x86_64
suseconnect -p sle-module-development-tools/15.5/x86_64
Actions
Copy link
 #19

Updated by okurz 7 months ago

Probably you also need the workstation extension, see http://open.qa/docs/#_installation

Actions
Copy link
 #20

Updated by dheidler 7 months ago 路 Edited 

# zypper in os-autoinst
Refreshing service 'Basesystem_Module_15_SP5_x86_64'.
Refreshing service 'Desktop_Applications_Module_15_SP5_x86_64'.
Refreshing service 'Development_Tools_Module_15_SP5_x86_64'.
Refreshing service 'Python_3_Module_15_SP5_x86_64'.
Refreshing service 'SUSE_Linux_Enterprise_Server_15_SP5_x86_64'.
Refreshing service 'SUSE_Package_Hub_15_SP5_x86_64'.
Refreshing service 'Server_Applications_Module_15_SP5_x86_64'.
Loading repository data...
Reading installed packages...
Resolving package dependencies...

Problem: 1: nothing provides 'libopencv_core.so.405()(64bit)' needed by the to be installed os-autoinst-4.6.1639403953.ae94c4bd-bp155.3.11.x86_64
 Solution 1: do not install os-autoinst-4.6.1639403953.ae94c4bd-bp155.3.11.x86_64
 Solution 2: break os-autoinst-4.6.1639403953.ae94c4bd-bp155.3.11.x86_64 by ignoring some of its dependencies

Choose from above solutions by number or cancel [1/2/c/d/?] (c):

That seems to be provided by the WE module, but I can't add that because https://bugzilla.suse.com/show_bug.cgi?id=1226006

suseconnect -p sle-we/15.5/x86_64 -r REDACTED

a subsequent zypper ref might help, though.

Actions
Copy link
 #21

Updated by dheidler 7 months ago

There are fixed needed for the bootstrap script which selects the wrong url for the SUSE:CA repo:
https://download.suse.de/ibs/SUSE:/CA/SLES_15.5

Actions
Copy link
 #22

Updated by dheidler 7 months ago 路 Edited 

Likely error from autoinst-log.txt:
[2024-06-06T11:00:53.489976+02:00] [info] +++ setup notes +++
[2024-06-06T11:00:53.490211+02:00] [info] Running on localhost:1 (Linux 5.14.21-150500.55.65-default #1 SMP PREEMPT_DYNAMIC Thu May 23 04:57:11 UTC 2024 (a46829d) x86_64)
[2024-06-06T11:00:53.497161+02:00] [debug] +++ worker notes +++
[2024-06-06T11:00:53.732355+02:00] [debug] Current version is 4.6.1639403953.ae94c4bd [interface v24]
fatal: detected dubious ownership in repository at '/var/lib/openqa/share/tests/opensuse'
To add an exception for this directory, call:

    git config --global --add safe.directory /var/lib/openqa/share/tests/opensuse
[2024-06-06T11:00:53.746457+02:00] [debug] git hash in opensuse: UNKNOWN
Mojo::File::spurt is deprecated in favor of Mojo::File::spew at /usr/lib/os-autoinst/bmwqemu.pm line 73.
Can't locate SemVer.pm in @INC (you may need to install the SemVer module) (@INC contains: . opensuse/lib /var/lib/openqa/pool/1/blib/arch /var/lib/openqa/pool/1/blib/lib /usr/lib/os-autoinst /usr/lib/perl5/site_perl/5.26.1/x86_64-linux-thread-multi /usr/lib/perl5/site_perl/5.26.1 /usr/lib/perl5/vendor_perl/5.26.1/x86_64-linux-thread-multi /usr/lib/perl5/vendor_perl/5.26.1 /usr/lib/perl5/5.26.1/x86_64-linux-thread-multi /usr/lib/perl5/5.26.1 /usr/lib/perl5/site_perl) at opensuse/lib/version_utils.pm line 15.

Of course it is not that easy to ensure the dependencies of the test distribution, because os-autoinst-distri-opensuse-deps comes from a repo and the test distri comes from git here.

Actions
Copy link
 #23

Updated by dheidler 7 months ago

And here we have an actual problem:

Likely error from autoinst-log.txt:
[2024-06-06T11:10:36.828105+02:00] [info] +++ setup notes +++
[2024-06-06T11:10:36.828284+02:00] [info] Running on localhost:1 (Linux 5.14.21-150500.55.65-default #1 SMP PREEMPT_DYNAMIC Thu May 23 04:57:11 UTC 2024 (a46829d) x86_64)
[2024-06-06T11:10:36.833772+02:00] [debug] +++ worker notes +++
[2024-06-06T11:10:37.044543+02:00] [debug] Current version is 4.6.1639403953.ae94c4bd [interface v24]
[2024-06-06T11:10:37.051202+02:00] [debug] git hash in opensuse: e45ed66cec89a9c70e46d45fdb64a5b5ada6e50c
Mojo::File::spurt is deprecated in favor of Mojo::File::spew at /usr/lib/os-autoinst/bmwqemu.pm line 73.
"SERIAL_USER_TERMINAL_DEFAULT_DEVICE" is not exported by the backend::svirt module
 "SERIAL_USER_TERMINAL_DEFAULT_PORT" is not exported by the backend::svirt module
Can't continue after import errors at opensuse/lib/susedistribution.pm line 23.

The test distribution expects symbols that only exist in a newer openQA version.

Actions
Copy link
 #26

Updated by dheidler 6 months ago

  • Status changed from In Progress to Blocked

Waiting for MR to get accepted as the further MRs will build on top of this one.

Actions
Copy link
 #27

Updated by livdywan 6 months ago

dheidler wrote in #note-25:

https://build.suse.de/request/show/333542

Can we do anything to push this? It's been sitting there a week. Otherwise this ticket should not be High 馃

Actions
Copy link
 #28

Updated by okurz 6 months ago

  • Due date changed from 2024-06-19 to 2024-07-03
  • Status changed from Blocked to Workable

https://build.suse.de/request/show/333542 about rubygem-sass, was just accepted. Can you handle more dependencies then?

Actions
Copy link
 #29

Updated by dheidler 6 months ago

  • Status changed from Workable to In Progress

I asked in #discuss-packaging - apparently some auto accept feature did not trigger for some reason.

Actions
Copy link
 #30

Updated by dheidler 6 months ago

Missing dependencies:

[dheidler@midas ~]$ osc maintained perl-YAML-LibYAML
SUSE:SLE-15:Update/perl-YAML-LibYAML
[dheidler@midas ~]$ osc maintained perl-Test-MockModule
SUSE:SLE-15:Update/perl-Test-MockModule
openSUSE:Backports:SLE-15-SP6:Update/perl-Test-MockModule
[dheidler@midas ~]$ osc maintained perl-Perl-Tidy
openSUSE:Backports:SLE-15-SP5:Update/perl-Perl-Tidy
openSUSE:Backports:SLE-15-SP6:Update/perl-Perl-Tidy
[dheidler@midas ~]$ osc maintained perl-Mojolicious
openSUSE:Backports:SLE-15-SP5:Update/perl-Mojolicious
openSUSE:Backports:SLE-15-SP6:Update/perl-Mojolicious
[dheidler@midas ~]$ osc maintained perl-Mojo-SQLite
openSUSE:Backports:SLE-15-SP5:Update/perl-Mojo-SQLite using sources from openSUSE:Maintenance:18029/perl-Mojo-SQLite.openSUSE_Backports_SLE-15-SP5_Update
openSUSE:Backports:SLE-15-SP6:Update/perl-Mojo-SQLite
[dheidler@midas ~]$ osc maintained perl-Minion
openSUSE:Backports:SLE-15-SP5:Update/perl-Minion
openSUSE:Backports:SLE-15-SP6:Update/perl-Minion
[dheidler@midas ~]$ osc maintained perl-Devel-Cover
SUSE:SLE-15:Update/perl-Devel-Cover
[dheidler@midas ~]$ osc maintained perl-DBI
SUSE:SLE-15-SP2:Update/perl-DBI
[dheidler@midas ~]$ osc maintained perl-DBD-SQLite
SUSE:SLE-15-SP3:Update/perl-DBD-SQLite
[dheidler@midas ~]$ osc maintained perl-DBD-Pg
SUSE:SLE-15-SP2:Update/perl-DBD-Pg
SUSE:SLE-15-SP6:GA/perl-DBD-Pg

Already submitted:

[dheidler@midas ~]$ osc maintained rubygem-sass
SUSE:SLE-15:Update/rubygem-sass
Actions
Copy link
 #31

Updated by dheidler 6 months ago 路 Edited

iosc mr openSUSE.org:openSUSE:Factory perl-YAML-LibYAML perl-Devel-Cover SUSE:SLE-15:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15:Update')
336295
https://build.suse.de/request/show/336295

Actions
Copy link
 #32

Updated by dheidler 6 months ago 路 Edited

Had to revoke that request. We also need

[dheidler@midas ~]$ osc maintained perl-B-Debug
openSUSE:Backports:SLE-15-SP5:Update/perl-B-Debug
openSUSE:Backports:SLE-15-SP6:Update/perl-B-Debug

for perl-Devel-Cover. But that one is not in SLE yet.
So we cannot easily add it - that would require an ECO I guess.

The other option might be to add perl-Devel-Cover to openSUSE:Backports:SLE-15-SP5:Update.
That might circumvent the ECO.

$ osc mr -m "openQA update https://progress.opensuse.org/issues/132236" openSUSE:Factory perl-Devel-Cover openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181748
https://build.opensuse.org/request/show/1181748

Actions
Copy link
 #33

Updated by dheidler 6 months ago 路 Edited

$ iosc mr openSUSE.org:openSUSE:Factory perl-YAML-LibYAML SUSE:SLE-15:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15:Update')
336296
https://build.suse.de/request/show/336296

https://build.opensuse.org/request/show/1181753

Actions
Copy link
 #34

Updated by dheidler 6 months ago 路 Edited

$ osc mr openSUSE:Factory perl-Test-MockModule openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181754
https://build.opensuse.org/request/show/1181754

Actions
Copy link
 #35

Updated by dheidler 6 months ago

$ osc mr openSUSE:Factory perl-Perl-Tidy openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181755
https://build.opensuse.org/request/show/1181755

Actions
Copy link
 #36

Updated by dheidler 6 months ago 路 Edited

$ osc mr openSUSE:Factory perl-Mojolicious perl-Mojo-SQLite openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181756
https://build.opensuse.org/request/show/1181756

perl-Mojo-SQLite requires perl-DBD-SQLite - so better have
perl-DBI, perl-DBD-SQLite, perl-DBD-Pg updated before or with perl-Mojolicious and perl-Mojo-SQLite

Actions
Copy link
 #37

Updated by dheidler 6 months ago

$ osc mr openSUSE:Factory perl-Minion openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181760
https://build.opensuse.org/request/show/1181760

Actions
Copy link
 #38

Updated by dheidler 6 months ago

$ iosc mr openSUSE.org:openSUSE:Factory perl-DBI perl-DBD-SQLite perl-DBD-Pg SUSE:SLE-15-SP6:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15-SP6:Update')
336298
https://build.suse.de/request/show/336298

Actions
Copy link
 #39

Updated by dheidler 6 months ago 路 Edited

2do after https://build.suse.de/request/show/336298:
$ osc mr openSUSE:Factory perl-Mojolicious perl-Mojo-SQLite openSUSE:Backports:SLE-15-SP6:Update

Then the actual openQA and os-autoinst pkgs can be updated (or in the same mr).

Actions
Copy link
 #40

Updated by tinita 6 months ago 路 Edited

dheidler wrote in #note-32:

Had to revoke that request. We also need

[dheidler@midas ~]$ osc maintained perl-B-Debug
openSUSE:Backports:SLE-15-SP5:Update/perl-B-Debug
openSUSE:Backports:SLE-15-SP6:Update/perl-B-Debug

for perl-Devel-Cover. But that one is not in SLE yet.

Actually the latest Devel::Cover doesn't require that anymore:
https://metacpan.org/dist/Devel-Cover/changes#L30

That was probably simply missed when autoupdating it. At some point it was added as a manual dependency.
I will remove it in d:l:p

edit: https://build.opensuse.org/request/show/1181790

Actions
Copy link
 #41

Updated by dheidler 6 months ago

$ iosc mr openSUSE.org:devel:languages:perl perl-YAML-LibYAML SUSE:SLE-15:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15:Update')
336342
https://build.suse.de/request/show/336342

Actions
Copy link
 #42

Updated by dheidler 6 months ago 路 Edited

Mention all backported security fixes in perl-DBI changes:
https://build.opensuse.org/request/show/1181935

Actions
Copy link
 #43

Updated by dheidler 6 months ago

Mention bugfixes in perl-DBD-Pg changes:
https://build.opensuse.org/request/show/1181966

Actions
Copy link
 #44

Updated by dheidler 6 months ago

Mention bugfixes in perl-DBD-SQLite changes:
https://build.opensuse.org/request/show/1181972

Actions
Copy link
 #45

Updated by dheidler 6 months ago

Let's see if this will get accepted:

$ iosc mr openSUSE.org:devel:languages:perl perl-DBI perl-DBD-SQLite perl-DBD-Pg SUSE:SLE-15-SP6:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15-SP6:Update')
336387
https://build.suse.de/request/show/336387

Actions
Copy link
 #46

Updated by dheidler 6 months ago

Removed Patches that were never in Factory not mentioned in https://build.suse.de/request/show/336387.
So branching the packages in ibs and mentioning removal of patches.

$ iosc mr home:dheidler:oqa perl-DBI perl-DBD-SQLite perl-DBD-Pg SUSE:SLE-15-SP6:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15-SP6:Update')
336423
https://build.suse.de/request/show/336423

Actions
Copy link
 #47

Updated by dheidler 6 months ago 路 Edited

Actions
Copy link
 #48

Updated by dheidler 6 months ago

  • Status changed from In Progress to Blocked
Actions
Copy link
 #49

Updated by livdywan 6 months ago

dheidler wrote in #note-47:

Seems to be waiting on reviews from @pgajdos and @pmonrealgonzalez. Might be worth poking them via Slack? It is a High ticket afterall.

Actions
Copy link
 #50

Updated by okurz 6 months ago

  • Due date deleted (2024-07-03)
  • Priority changed from High to Low

livdywan wrote in #note-49:

Seems to be waiting on reviews from @pgajdos and @pmonrealgonzalez. Might be worth poking them via Slack? It is a High ticket afterall.

That problem we can address :) We have open SRs/MRs and that's good enough for now. We can wait for longer. Reduced High->Low and removed due-date.

Actions
Copy link
 #51

Updated by dheidler 5 months ago

Got the remaining review from pgajdos for https://build.suse.de/request/show/336342 and https://build.suse.de/request/show/336487 but the requests are still to be accepted.

Afterwards two more requests are needed that each depend on the previous one.

Actions
Copy link
 #52

Updated by mkittler 4 months ago

  • Related to action #165683: Current openQA+os-autoinst+dependencies in pure SLE size:M added
Actions
Copy link
 #53

Updated by dheidler 4 months ago

Actions
Copy link
 #54

Updated by dheidler 4 months ago

iosc mr home:dheidler:oqa perl-Mojolicious perl-Mojo-SQLite SUSE:SLE-15-SP6:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15-SP6:Update')
342278
https://build.suse.de/request/show/342278

Actions
Copy link
 #55

Updated by dheidler 4 months ago

Actions
Copy link
 #56

Updated by dheidler 4 months ago 路 Edited

  • Status changed from Blocked to Closed

I just realized that perl-Mojo-SQLite - while building fine on Leap - doesn't build on SLE due to the dependencies perl(SQL::Abstract::Pg) >= 1.0 and perl(URI::db) >= 0.15 being in backports only, but perl-Mojo-SQLite being part of SLE.

Moving them to SLE would require a large number of other dependencies to be moved.
This is something that can be done for an upcoming release (like Marius is doing right now in #165683 for 15SP7)
but sending Maintainance Requests for all new dependency packages to an existing release is not really feasible.

So I would close this ticket now in favor of Marius' work for 15SP7.

Actions
Copy link

Also available in: Atom PDF