QA » openQA Project

jbaier_cz wrote:

Motivation¶

For now the decision regarding SLE module or such is still pending but we can at least update package dependencies and packages that are already in SLE or packagehub so that openQA in Leap works in a current version without needing devel:openQA or devel:openQA:Leap

#128651 shows, that we can submit some of the openQA/os-autoinst dependencies into Leap / SLE update repositories. We should plan next steps.

Acceptance criteria¶

• AC1: All SRs from #128651-12 (or superseeding SRs) are accepted

Reads like all SR's have been accepted. However #128651#note-17 might suggest there's something missing?

https://github.com/os-autoinst/scripts/actions/workflows/obs-list-dependencies.yml collects package versions. However it also includes all indirect deps like reboot-manager which we don't require specifics versions of
@tinita filed #160715 about the errors in the workflow

Suggestion: Use a SLE container for an Acceptance Test to assess the current state and make it easy to verify

Suggestion: Use a SLE container for an Acceptance Test to assess the current state and make it easy to verify

https://packagehub.suse.com/packages/openQA/

podman run --rm -ti registry.suse.com/suse/sles12sp5:latest

I seem to remember using a SLE image before, but this one doesn't have SUSEConnect on it? And I failed to trace the ticket back to where we previously tested and hopefully documented it.

livdywan wrote in #note-13:

Suggestion: Use a SLE container for an Acceptance Test to assess the current state and make it easy to verify

https://packagehub.suse.com/packages/openQA/

podman run --rm -ti registry.suse.com/suse/sles12sp5:latest

I seem to remember using a SLE image before, but this one doesn't have SUSEConnect on it? And I failed to trace the ticket back to where we previously tested and hopefully documented it.

Are you sure you want to use 12-SP5? I thought we are targeting 15-SP5 (or maybe even SP6?).

I seem to remember using a SLE image before, but this one doesn't have SUSEConnect on it? And I failed to trace the ticket back to where we previously tested and hopefully documented it.

Are you sure you want to use 12-SP5? I thought we are targeting 15-SP5 (or maybe even SP6?).

No. I tried to find a usable image first of all. registry.suse.com/suse/sle15:latest (which is 15.5 atm) gave me the same result.

Modules required to satisfy dependencies:

suseconnect -p PackageHub/15.5/x86_64
suseconnect -p sle-module-desktop-applications/15.5/x86_64
suseconnect -p sle-module-development-tools/15.5/x86_64

Probably you also need the workstation extension, see http://open.qa/docs/#_installation

# zypper in os-autoinst
Refreshing service 'Basesystem_Module_15_SP5_x86_64'.
Refreshing service 'Desktop_Applications_Module_15_SP5_x86_64'.
Refreshing service 'Development_Tools_Module_15_SP5_x86_64'.
Refreshing service 'Python_3_Module_15_SP5_x86_64'.
Refreshing service 'SUSE_Linux_Enterprise_Server_15_SP5_x86_64'.
Refreshing service 'SUSE_Package_Hub_15_SP5_x86_64'.
Refreshing service 'Server_Applications_Module_15_SP5_x86_64'.
Loading repository data...
Reading installed packages...
Resolving package dependencies...

Problem: 1: nothing provides 'libopencv_core.so.405()(64bit)' needed by the to be installed os-autoinst-4.6.1639403953.ae94c4bd-bp155.3.11.x86_64
 Solution 1: do not install os-autoinst-4.6.1639403953.ae94c4bd-bp155.3.11.x86_64
 Solution 2: break os-autoinst-4.6.1639403953.ae94c4bd-bp155.3.11.x86_64 by ignoring some of its dependencies

Choose from above solutions by number or cancel [1/2/c/d/?] (c):

That seems to be provided by the WE module, but I can't add that because https://bugzilla.suse.com/show_bug.cgi?id=1226006

suseconnect -p sle-we/15.5/x86_64 -r REDACTED

a subsequent zypper ref might help, though.

There are fixed needed for the bootstrap script which selects the wrong url for the SUSE:CA repo:
https://download.suse.de/ibs/SUSE:/CA/SLES_15.5

Likely error from autoinst-log.txt:
[2024-06-06T11:00:53.489976+02:00] [info] +++ setup notes +++
[2024-06-06T11:00:53.490211+02:00] [info] Running on localhost:1 (Linux 5.14.21-150500.55.65-default #1 SMP PREEMPT_DYNAMIC Thu May 23 04:57:11 UTC 2024 (a46829d) x86_64)
[2024-06-06T11:00:53.497161+02:00] [debug] +++ worker notes +++
[2024-06-06T11:00:53.732355+02:00] [debug] Current version is 4.6.1639403953.ae94c4bd [interface v24]
fatal: detected dubious ownership in repository at '/var/lib/openqa/share/tests/opensuse'
To add an exception for this directory, call:

    git config --global --add safe.directory /var/lib/openqa/share/tests/opensuse
[2024-06-06T11:00:53.746457+02:00] [debug] git hash in opensuse: UNKNOWN
Mojo::File::spurt is deprecated in favor of Mojo::File::spew at /usr/lib/os-autoinst/bmwqemu.pm line 73.
Can't locate SemVer.pm in @INC (you may need to install the SemVer module) (@INC contains: . opensuse/lib /var/lib/openqa/pool/1/blib/arch /var/lib/openqa/pool/1/blib/lib /usr/lib/os-autoinst /usr/lib/perl5/site_perl/5.26.1/x86_64-linux-thread-multi /usr/lib/perl5/site_perl/5.26.1 /usr/lib/perl5/vendor_perl/5.26.1/x86_64-linux-thread-multi /usr/lib/perl5/vendor_perl/5.26.1 /usr/lib/perl5/5.26.1/x86_64-linux-thread-multi /usr/lib/perl5/5.26.1 /usr/lib/perl5/site_perl) at opensuse/lib/version_utils.pm line 15.

Of course it is not that easy to ensure the dependencies of the test distribution, because os-autoinst-distri-opensuse-deps comes from a repo and the test distri comes from git here.

And here we have an actual problem:

Likely error from autoinst-log.txt:
[2024-06-06T11:10:36.828105+02:00] [info] +++ setup notes +++
[2024-06-06T11:10:36.828284+02:00] [info] Running on localhost:1 (Linux 5.14.21-150500.55.65-default #1 SMP PREEMPT_DYNAMIC Thu May 23 04:57:11 UTC 2024 (a46829d) x86_64)
[2024-06-06T11:10:36.833772+02:00] [debug] +++ worker notes +++
[2024-06-06T11:10:37.044543+02:00] [debug] Current version is 4.6.1639403953.ae94c4bd [interface v24]
[2024-06-06T11:10:37.051202+02:00] [debug] git hash in opensuse: e45ed66cec89a9c70e46d45fdb64a5b5ada6e50c
Mojo::File::spurt is deprecated in favor of Mojo::File::spew at /usr/lib/os-autoinst/bmwqemu.pm line 73.
"SERIAL_USER_TERMINAL_DEFAULT_DEVICE" is not exported by the backend::svirt module
 "SERIAL_USER_TERMINAL_DEFAULT_PORT" is not exported by the backend::svirt module
Can't continue after import errors at opensuse/lib/susedistribution.pm line 23.

The test distribution expects symbols that only exist in a newer openQA version.

https://github.com/os-autoinst/openQA/pull/5677 reviewed & merged

https://build.suse.de/request/show/333542

dheidler wrote in #note-25:

https://build.suse.de/request/show/333542

Can we do anything to push this? It's been sitting there a week. Otherwise this ticket should not be High 🤔

Missing dependencies:

[dheidler@midas ~]$ osc maintained perl-YAML-LibYAML
SUSE:SLE-15:Update/perl-YAML-LibYAML
[dheidler@midas ~]$ osc maintained perl-Test-MockModule
SUSE:SLE-15:Update/perl-Test-MockModule
openSUSE:Backports:SLE-15-SP6:Update/perl-Test-MockModule
[dheidler@midas ~]$ osc maintained perl-Perl-Tidy
openSUSE:Backports:SLE-15-SP5:Update/perl-Perl-Tidy
openSUSE:Backports:SLE-15-SP6:Update/perl-Perl-Tidy
[dheidler@midas ~]$ osc maintained perl-Mojolicious
openSUSE:Backports:SLE-15-SP5:Update/perl-Mojolicious
openSUSE:Backports:SLE-15-SP6:Update/perl-Mojolicious
[dheidler@midas ~]$ osc maintained perl-Mojo-SQLite
openSUSE:Backports:SLE-15-SP5:Update/perl-Mojo-SQLite using sources from openSUSE:Maintenance:18029/perl-Mojo-SQLite.openSUSE_Backports_SLE-15-SP5_Update
openSUSE:Backports:SLE-15-SP6:Update/perl-Mojo-SQLite
[dheidler@midas ~]$ osc maintained perl-Minion
openSUSE:Backports:SLE-15-SP5:Update/perl-Minion
openSUSE:Backports:SLE-15-SP6:Update/perl-Minion
[dheidler@midas ~]$ osc maintained perl-Devel-Cover
SUSE:SLE-15:Update/perl-Devel-Cover
[dheidler@midas ~]$ osc maintained perl-DBI
SUSE:SLE-15-SP2:Update/perl-DBI
[dheidler@midas ~]$ osc maintained perl-DBD-SQLite
SUSE:SLE-15-SP3:Update/perl-DBD-SQLite
[dheidler@midas ~]$ osc maintained perl-DBD-Pg
SUSE:SLE-15-SP2:Update/perl-DBD-Pg
SUSE:SLE-15-SP6:GA/perl-DBD-Pg

Already submitted:

[dheidler@midas ~]$ osc maintained rubygem-sass
SUSE:SLE-15:Update/rubygem-sass

iosc mr openSUSE.org:openSUSE:Factory perl-YAML-LibYAML perl-Devel-Cover SUSE:SLE-15:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15:Update')
336295
https://build.suse.de/request/show/336295

Had to revoke that request. We also need

[dheidler@midas ~]$ osc maintained perl-B-Debug
openSUSE:Backports:SLE-15-SP5:Update/perl-B-Debug
openSUSE:Backports:SLE-15-SP6:Update/perl-B-Debug

for perl-Devel-Cover. But that one is not in SLE yet.
So we cannot easily add it - that would require an ECO I guess.

The other option might be to add perl-Devel-Cover to openSUSE:Backports:SLE-15-SP5:Update.
That might circumvent the ECO.

$ osc mr -m "openQA update https://progress.opensuse.org/issues/132236" openSUSE:Factory perl-Devel-Cover openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181748
https://build.opensuse.org/request/show/1181748

$ iosc mr openSUSE.org:openSUSE:Factory perl-YAML-LibYAML SUSE:SLE-15:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15:Update')
336296
https://build.suse.de/request/show/336296

https://build.opensuse.org/request/show/1181753

$ osc mr openSUSE:Factory perl-Test-MockModule openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181754
https://build.opensuse.org/request/show/1181754

$ osc mr openSUSE:Factory perl-Perl-Tidy openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181755
https://build.opensuse.org/request/show/1181755

$ osc mr openSUSE:Factory perl-Mojolicious perl-Mojo-SQLite openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181756
https://build.opensuse.org/request/show/1181756

perl-Mojo-SQLite requires perl-DBD-SQLite - so better have
perl-DBI, perl-DBD-SQLite, perl-DBD-Pg updated before or with perl-Mojolicious and perl-Mojo-SQLite

$ osc mr openSUSE:Factory perl-Minion openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181760
https://build.opensuse.org/request/show/1181760

$ iosc mr openSUSE.org:openSUSE:Factory perl-DBI perl-DBD-SQLite perl-DBD-Pg SUSE:SLE-15-SP6:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15-SP6:Update')
336298
https://build.suse.de/request/show/336298

2do after https://build.suse.de/request/show/336298:
$ osc mr openSUSE:Factory perl-Mojolicious perl-Mojo-SQLite openSUSE:Backports:SLE-15-SP6:Update

Then the actual openQA and os-autoinst pkgs can be updated (or in the same mr).

dheidler wrote in #note-32:

Had to revoke that request. We also need

[dheidler@midas ~]$ osc maintained perl-B-Debug
openSUSE:Backports:SLE-15-SP5:Update/perl-B-Debug
openSUSE:Backports:SLE-15-SP6:Update/perl-B-Debug

for perl-Devel-Cover. But that one is not in SLE yet.

Actually the latest Devel::Cover doesn't require that anymore:
https://metacpan.org/dist/Devel-Cover/changes#L30

That was probably simply missed when autoupdating it. At some point it was added as a manual dependency.
I will remove it in d:l:p

edit: https://build.opensuse.org/request/show/1181790

$ iosc mr openSUSE.org:devel:languages:perl perl-YAML-LibYAML SUSE:SLE-15:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15:Update')
336342
https://build.suse.de/request/show/336342

Mention all backported security fixes in perl-DBI changes:
https://build.opensuse.org/request/show/1181935

Mention bugfixes in perl-DBD-Pg changes:
https://build.opensuse.org/request/show/1181966

Mention bugfixes in perl-DBD-SQLite changes:
https://build.opensuse.org/request/show/1181972

Let's see if this will get accepted:

$ iosc mr openSUSE.org:devel:languages:perl perl-DBI perl-DBD-SQLite perl-DBD-Pg SUSE:SLE-15-SP6:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15-SP6:Update')
336387
https://build.suse.de/request/show/336387

Removed Patches that were never in Factory not mentioned in https://build.suse.de/request/show/336387.
So branching the packages in ibs and mentioning removal of patches.

$ iosc mr home:dheidler:oqa perl-DBI perl-DBD-SQLite perl-DBD-Pg SUSE:SLE-15-SP6:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15-SP6:Update')
336423
https://build.suse.de/request/show/336423

• perl-YAML-LibYAML https://build.suse.de/request/show/336342
• perl-Test-MockModule https://build.opensuse.org/request/show/1181754
• perl-Perl-Tidy https://build.opensuse.org/request/show/1181755
• perl-Minion https://build.opensuse.org/request/show/1181760
• perl-Devel-Cover https://build.opensuse.org/request/show/1181748
• https://build.suse.de/request/show/336487
  • perl-DBI
  • perl-DBD-SQLite
  • perl-DBD-Pg
• waiting for perl-DBI, perl-DBD-SQLite and perl-DBD-Pg
  • perl-Mojolicious
  • perl-Mojo-SQLite
• waiting for all above:
  • openQA
  • os-autoinst
  • os-autoinst-distri-openSUSE-deps?

dheidler wrote in #note-47:

• perl-YAML-LibYAML https://build.suse.de/request/show/336342
• perl-Test-MockModule https://build.opensuse.org/request/show/1181754
• perl-Perl-Tidy https://build.opensuse.org/request/show/1181755
• perl-Minion https://build.opensuse.org/request/show/1181760
• perl-Devel-Cover https://build.opensuse.org/request/show/1181748
• https://build.suse.de/request/show/336487
  • perl-DBI
  • perl-DBD-SQLite
  • perl-DBD-Pg
• waiting for perl-DBI, perl-DBD-SQLite and perl-DBD-Pg
  • perl-Mojolicious
  • perl-Mojo-SQLite
• waiting for all above:
  • openQA
  • os-autoinst
  • os-autoinst-distri-openSUSE-deps?

Seems to be waiting on reviews from @pgajdos and @pmonrealgonzalez. Might be worth poking them via Slack? It is a High ticket afterall.