action #132236
closedcoordination #127031: [saga][epic] openQA for SUSE customers
coordination #127910: [epic] openQA in SLE modules
Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:M
Description
Motivation¶
For now the decision regarding SLE module or such is still pending but we can at least update package dependencies and packages that are already in SLE or packagehub so that openQA in Leap works in a current version without needing devel:openQA or devel:openQA:Leap
#128651 shows, that we can submit some of the openQA/os-autoinst dependencies into Leap / SLE update repositories. We should plan next steps.
Acceptance criteria¶
- AC1: All SRs from #128651-12 (or superseeding SRs) are accepted
- AC2: All os-autoinst and openQA dependencies are provided in a sufficient up-to-date version in SLE+packagehub
Suggestions¶
- Clean-up packages inside devel:openQA:Leap:15.X project, also see #127883 and #128087
- Follow SRs from #128651-12
- Handle not-accepted updates
- Try to use only ways that any non-SUSE employee can also take, e.g. no SRs within IBS
Out of scope¶
- Full automatic submissions into openSUSE:Backports:SLE-15-SPx:Update (or SUSE:SLE-15-SPx:Update), see #132395
Updated by jbaier_cz over 1 year ago
- Copied from action #128651: [spike][timeboxed:20h] Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:M added
Updated by jbaier_cz over 1 year ago
- Subject changed from Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:M to Current openQA+os-autoinst+dependencies updated in SLE+packagehub
- Description updated (diff)
- Category deleted (
Feature requests) - Assignee deleted (
jbaier_cz) - Priority changed from High to Normal
Updated by okurz about 1 year ago
- Copied to action #132395: Current openQA+os-autoinst+dependencies are updated automatically in SLE+packagehub added
Updated by okurz about 1 year ago
- Subject changed from Current openQA+os-autoinst+dependencies updated in SLE+packagehub to Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:M
- Description updated (diff)
- Due date deleted (
2023-07-14) - Category set to Feature requests
Updated by jbaier_cz 5 months ago
- Related to action #157984: Upgrade CI container image versions to Leap 15.6 size:S added
Updated by jbaier_cz 5 months ago
- Related to deleted (action #157984: Upgrade CI container image versions to Leap 15.6 size:S)
Updated by livdywan 5 months ago 路 Edited
jbaier_cz wrote:
Motivation¶
For now the decision regarding SLE module or such is still pending but we can at least update package dependencies and packages that are already in SLE or packagehub so that openQA in Leap works in a current version without needing devel:openQA or devel:openQA:Leap
#128651 shows, that we can submit some of the openQA/os-autoinst dependencies into Leap / SLE update repositories. We should plan next steps.
Acceptance criteria¶
- AC1: All SRs from #128651-12 (or superseeding SRs) are accepted
Reads like all SR's have been accepted. However #128651#note-17 might suggest there's something missing?
https://github.com/os-autoinst/scripts/actions/workflows/obs-list-dependencies.yml collects package versions. However it also includes all indirect deps like reboot-manager which we don't require specifics versions of
@tinita filed #160715 about the errors in the workflow
Suggestion: Use a SLE container for an Acceptance Test to assess the current state and make it easy to verify
Updated by livdywan 5 months ago
- Related to action #160715: Error message in obs-check-package-origin size:S added
Updated by livdywan 4 months ago
Suggestion: Use a SLE container for an Acceptance Test to assess the current state and make it easy to verify
https://packagehub.suse.com/packages/openQA/
podman run --rm -ti registry.suse.com/suse/sles12sp5:latest
I seem to remember using a SLE image before, but this one doesn't have SUSEConnect on it? And I failed to trace the ticket back to where we previously tested and hopefully documented it.
Updated by jbaier_cz 4 months ago
livdywan wrote in #note-13:
Suggestion: Use a SLE container for an Acceptance Test to assess the current state and make it easy to verify
https://packagehub.suse.com/packages/openQA/
podman run --rm -ti registry.suse.com/suse/sles12sp5:latest
I seem to remember using a SLE image before, but this one doesn't have SUSEConnect on it? And I failed to trace the ticket back to where we previously tested and hopefully documented it.
Are you sure you want to use 12-SP5? I thought we are targeting 15-SP5 (or maybe even SP6?).
Updated by livdywan 4 months ago
I seem to remember using a SLE image before, but this one doesn't have SUSEConnect on it? And I failed to trace the ticket back to where we previously tested and hopefully documented it.
Are you sure you want to use 12-SP5? I thought we are targeting 15-SP5 (or maybe even SP6?).
No. I tried to find a usable image first of all. registry.suse.com/suse/sle15:latest
(which is 15.5 atm) gave me the same result.
Updated by openqa_review 4 months ago
- Due date set to 2024-06-19
Setting due date based on mean cycle time of SUSE QE Tools
Updated by okurz 4 months ago
Probably you also need the workstation extension, see http://open.qa/docs/#_installation
Updated by dheidler 4 months ago 路 Edited
# zypper in os-autoinst
Refreshing service 'Basesystem_Module_15_SP5_x86_64'.
Refreshing service 'Desktop_Applications_Module_15_SP5_x86_64'.
Refreshing service 'Development_Tools_Module_15_SP5_x86_64'.
Refreshing service 'Python_3_Module_15_SP5_x86_64'.
Refreshing service 'SUSE_Linux_Enterprise_Server_15_SP5_x86_64'.
Refreshing service 'SUSE_Package_Hub_15_SP5_x86_64'.
Refreshing service 'Server_Applications_Module_15_SP5_x86_64'.
Loading repository data...
Reading installed packages...
Resolving package dependencies...
Problem: 1: nothing provides 'libopencv_core.so.405()(64bit)' needed by the to be installed os-autoinst-4.6.1639403953.ae94c4bd-bp155.3.11.x86_64
Solution 1: do not install os-autoinst-4.6.1639403953.ae94c4bd-bp155.3.11.x86_64
Solution 2: break os-autoinst-4.6.1639403953.ae94c4bd-bp155.3.11.x86_64 by ignoring some of its dependencies
Choose from above solutions by number or cancel [1/2/c/d/?] (c):
That seems to be provided by the WE module, but I can't add that because https://bugzilla.suse.com/show_bug.cgi?id=1226006
suseconnect -p sle-we/15.5/x86_64 -r REDACTED
a subsequent zypper ref
might help, though.
Updated by dheidler 4 months ago
There are fixed needed for the bootstrap script which selects the wrong url for the SUSE:CA repo:
https://download.suse.de/ibs/SUSE:/CA/SLES_15.5
Updated by dheidler 4 months ago 路 Edited
Likely error from autoinst-log.txt:
[2024-06-06T11:00:53.489976+02:00] [info] +++ setup notes +++
[2024-06-06T11:00:53.490211+02:00] [info] Running on localhost:1 (Linux 5.14.21-150500.55.65-default #1 SMP PREEMPT_DYNAMIC Thu May 23 04:57:11 UTC 2024 (a46829d) x86_64)
[2024-06-06T11:00:53.497161+02:00] [debug] +++ worker notes +++
[2024-06-06T11:00:53.732355+02:00] [debug] Current version is 4.6.1639403953.ae94c4bd [interface v24]
fatal: detected dubious ownership in repository at '/var/lib/openqa/share/tests/opensuse'
To add an exception for this directory, call:
git config --global --add safe.directory /var/lib/openqa/share/tests/opensuse
[2024-06-06T11:00:53.746457+02:00] [debug] git hash in opensuse: UNKNOWN
Mojo::File::spurt is deprecated in favor of Mojo::File::spew at /usr/lib/os-autoinst/bmwqemu.pm line 73.
Can't locate SemVer.pm in @INC (you may need to install the SemVer module) (@INC contains: . opensuse/lib /var/lib/openqa/pool/1/blib/arch /var/lib/openqa/pool/1/blib/lib /usr/lib/os-autoinst /usr/lib/perl5/site_perl/5.26.1/x86_64-linux-thread-multi /usr/lib/perl5/site_perl/5.26.1 /usr/lib/perl5/vendor_perl/5.26.1/x86_64-linux-thread-multi /usr/lib/perl5/vendor_perl/5.26.1 /usr/lib/perl5/5.26.1/x86_64-linux-thread-multi /usr/lib/perl5/5.26.1 /usr/lib/perl5/site_perl) at opensuse/lib/version_utils.pm line 15.
Of course it is not that easy to ensure the dependencies of the test distribution, because os-autoinst-distri-opensuse-deps comes from a repo and the test distri comes from git here.
Updated by dheidler 4 months ago
And here we have an actual problem:
Likely error from autoinst-log.txt:
[2024-06-06T11:10:36.828105+02:00] [info] +++ setup notes +++
[2024-06-06T11:10:36.828284+02:00] [info] Running on localhost:1 (Linux 5.14.21-150500.55.65-default #1 SMP PREEMPT_DYNAMIC Thu May 23 04:57:11 UTC 2024 (a46829d) x86_64)
[2024-06-06T11:10:36.833772+02:00] [debug] +++ worker notes +++
[2024-06-06T11:10:37.044543+02:00] [debug] Current version is 4.6.1639403953.ae94c4bd [interface v24]
[2024-06-06T11:10:37.051202+02:00] [debug] git hash in opensuse: e45ed66cec89a9c70e46d45fdb64a5b5ada6e50c
Mojo::File::spurt is deprecated in favor of Mojo::File::spew at /usr/lib/os-autoinst/bmwqemu.pm line 73.
"SERIAL_USER_TERMINAL_DEFAULT_DEVICE" is not exported by the backend::svirt module
"SERIAL_USER_TERMINAL_DEFAULT_PORT" is not exported by the backend::svirt module
Can't continue after import errors at opensuse/lib/susedistribution.pm line 23.
The test distribution expects symbols that only exist in a newer openQA version.
Updated by livdywan 4 months ago
https://github.com/os-autoinst/openQA/pull/5677 reviewed & merged
Updated by okurz 4 months ago
- Due date changed from 2024-06-19 to 2024-07-03
- Status changed from Blocked to Workable
https://build.suse.de/request/show/333542 about rubygem-sass, was just accepted. Can you handle more dependencies then?
Updated by dheidler 4 months ago
Missing dependencies:
[dheidler@midas ~]$ osc maintained perl-YAML-LibYAML
SUSE:SLE-15:Update/perl-YAML-LibYAML
[dheidler@midas ~]$ osc maintained perl-Test-MockModule
SUSE:SLE-15:Update/perl-Test-MockModule
openSUSE:Backports:SLE-15-SP6:Update/perl-Test-MockModule
[dheidler@midas ~]$ osc maintained perl-Perl-Tidy
openSUSE:Backports:SLE-15-SP5:Update/perl-Perl-Tidy
openSUSE:Backports:SLE-15-SP6:Update/perl-Perl-Tidy
[dheidler@midas ~]$ osc maintained perl-Mojolicious
openSUSE:Backports:SLE-15-SP5:Update/perl-Mojolicious
openSUSE:Backports:SLE-15-SP6:Update/perl-Mojolicious
[dheidler@midas ~]$ osc maintained perl-Mojo-SQLite
openSUSE:Backports:SLE-15-SP5:Update/perl-Mojo-SQLite using sources from openSUSE:Maintenance:18029/perl-Mojo-SQLite.openSUSE_Backports_SLE-15-SP5_Update
openSUSE:Backports:SLE-15-SP6:Update/perl-Mojo-SQLite
[dheidler@midas ~]$ osc maintained perl-Minion
openSUSE:Backports:SLE-15-SP5:Update/perl-Minion
openSUSE:Backports:SLE-15-SP6:Update/perl-Minion
[dheidler@midas ~]$ osc maintained perl-Devel-Cover
SUSE:SLE-15:Update/perl-Devel-Cover
[dheidler@midas ~]$ osc maintained perl-DBI
SUSE:SLE-15-SP2:Update/perl-DBI
[dheidler@midas ~]$ osc maintained perl-DBD-SQLite
SUSE:SLE-15-SP3:Update/perl-DBD-SQLite
[dheidler@midas ~]$ osc maintained perl-DBD-Pg
SUSE:SLE-15-SP2:Update/perl-DBD-Pg
SUSE:SLE-15-SP6:GA/perl-DBD-Pg
Already submitted:
[dheidler@midas ~]$ osc maintained rubygem-sass
SUSE:SLE-15:Update/rubygem-sass
Updated by dheidler 4 months ago 路 Edited
iosc mr openSUSE.org:openSUSE:Factory perl-YAML-LibYAML perl-Devel-Cover SUSE:SLE-15:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15:Update')
336295
https://build.suse.de/request/show/336295
Updated by dheidler 4 months ago 路 Edited
Had to revoke that request. We also need
[dheidler@midas ~]$ osc maintained perl-B-Debug
openSUSE:Backports:SLE-15-SP5:Update/perl-B-Debug
openSUSE:Backports:SLE-15-SP6:Update/perl-B-Debug
for perl-Devel-Cover. But that one is not in SLE yet.
So we cannot easily add it - that would require an ECO I guess.
The other option might be to add perl-Devel-Cover to openSUSE:Backports:SLE-15-SP5:Update.
That might circumvent the ECO.
$ osc mr -m "openQA update https://progress.opensuse.org/issues/132236" openSUSE:Factory perl-Devel-Cover openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181748
https://build.opensuse.org/request/show/1181748
Updated by dheidler 4 months ago 路 Edited
$ iosc mr openSUSE.org:openSUSE:Factory perl-YAML-LibYAML SUSE:SLE-15:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15:Update')
336296
https://build.suse.de/request/show/336296
Updated by dheidler 4 months ago 路 Edited
$ osc mr openSUSE:Factory perl-Test-MockModule openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181754
https://build.opensuse.org/request/show/1181754
Updated by dheidler 4 months ago
$ osc mr openSUSE:Factory perl-Perl-Tidy openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181755
https://build.opensuse.org/request/show/1181755
Updated by dheidler 4 months ago 路 Edited
$ osc mr openSUSE:Factory perl-Mojolicious perl-Mojo-SQLite openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181756
https://build.opensuse.org/request/show/1181756
perl-Mojo-SQLite requires perl-DBD-SQLite - so better have
perl-DBI, perl-DBD-SQLite, perl-DBD-Pg updated before or with perl-Mojolicious and perl-Mojo-SQLite
Updated by dheidler 4 months ago
$ osc mr openSUSE:Factory perl-Minion openSUSE:Backports:SLE-15-SP6:Update
Using target project 'openSUSE:Maintenance'. (release in 'openSUSE:Backports:SLE-15-SP6:Update')
1181760
https://build.opensuse.org/request/show/1181760
Updated by dheidler 4 months ago
$ iosc mr openSUSE.org:openSUSE:Factory perl-DBI perl-DBD-SQLite perl-DBD-Pg SUSE:SLE-15-SP6:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15-SP6:Update')
336298
https://build.suse.de/request/show/336298
Updated by dheidler 4 months ago 路 Edited
2do after https://build.suse.de/request/show/336298:
$ osc mr openSUSE:Factory perl-Mojolicious perl-Mojo-SQLite openSUSE:Backports:SLE-15-SP6:Update
Then the actual openQA and os-autoinst pkgs can be updated (or in the same mr).
Updated by tinita 4 months ago 路 Edited
dheidler wrote in #note-32:
Had to revoke that request. We also need
[dheidler@midas ~]$ osc maintained perl-B-Debug
openSUSE:Backports:SLE-15-SP5:Update/perl-B-Debug
openSUSE:Backports:SLE-15-SP6:Update/perl-B-Debugfor perl-Devel-Cover. But that one is not in SLE yet.
Actually the latest Devel::Cover doesn't require that anymore:
https://metacpan.org/dist/Devel-Cover/changes#L30
That was probably simply missed when autoupdating it. At some point it was added as a manual dependency.
I will remove it in d:l:p
Updated by dheidler 4 months ago
$ iosc mr openSUSE.org:devel:languages:perl perl-YAML-LibYAML SUSE:SLE-15:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15:Update')
336342
https://build.suse.de/request/show/336342
Updated by dheidler 4 months ago 路 Edited
Mention all backported security fixes in perl-DBI changes:
https://build.opensuse.org/request/show/1181935
Updated by dheidler 4 months ago
Mention bugfixes in perl-DBD-Pg changes:
https://build.opensuse.org/request/show/1181966
Updated by dheidler 4 months ago
Mention bugfixes in perl-DBD-SQLite changes:
https://build.opensuse.org/request/show/1181972
Updated by dheidler 4 months ago
Let's see if this will get accepted:
$ iosc mr openSUSE.org:devel:languages:perl perl-DBI perl-DBD-SQLite perl-DBD-Pg SUSE:SLE-15-SP6:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15-SP6:Update')
336387
https://build.suse.de/request/show/336387
Updated by dheidler 4 months ago
Removed Patches that were never in Factory not mentioned in https://build.suse.de/request/show/336387.
So branching the packages in ibs and mentioning removal of patches.
$ iosc mr home:dheidler:oqa perl-DBI perl-DBD-SQLite perl-DBD-Pg SUSE:SLE-15-SP6:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15-SP6:Update')
336423
https://build.suse.de/request/show/336423
Updated by dheidler 3 months ago 路 Edited
- perl-YAML-LibYAML https://build.suse.de/request/show/336342
perl-Test-MockModulehttps://build.opensuse.org/request/show/1181754perl-Perl-Tidyhttps://build.opensuse.org/request/show/1181755perl-Minionhttps://build.opensuse.org/request/show/1181760perl-Devel-Coverhttps://build.opensuse.org/request/show/1181748- https://build.suse.de/request/show/336487
- perl-DBI
- perl-DBD-SQLite
- perl-DBD-Pg
- waiting for perl-DBI, perl-DBD-SQLite and perl-DBD-Pg
- perl-Mojolicious
- perl-Mojo-SQLite
- waiting for all above:
- openQA
- os-autoinst
- os-autoinst-distri-openSUSE-deps?
Updated by livdywan 3 months ago
dheidler wrote in #note-47:
- perl-YAML-LibYAML https://build.suse.de/request/show/336342
perl-Test-MockModulehttps://build.opensuse.org/request/show/1181754perl-Perl-Tidyhttps://build.opensuse.org/request/show/1181755perl-Minionhttps://build.opensuse.org/request/show/1181760perl-Devel-Coverhttps://build.opensuse.org/request/show/1181748- https://build.suse.de/request/show/336487
- perl-DBI
- perl-DBD-SQLite
- perl-DBD-Pg
- waiting for perl-DBI, perl-DBD-SQLite and perl-DBD-Pg
- perl-Mojolicious
- perl-Mojo-SQLite
- waiting for all above:
- openQA
- os-autoinst
- os-autoinst-distri-openSUSE-deps?
Seems to be waiting on reviews from @pgajdos and @pmonrealgonzalez. Might be worth poking them via Slack? It is a High ticket afterall.
Updated by okurz 3 months ago
- Due date deleted (
2024-07-03) - Priority changed from High to Low
livdywan wrote in #note-49:
Seems to be waiting on reviews from @pgajdos and @pmonrealgonzalez. Might be worth poking them via Slack? It is a High ticket afterall.
That problem we can address :) We have open SRs/MRs and that's good enough for now. We can wait for longer. Reduced High->Low and removed due-date.
Updated by dheidler 2 months ago
Got the remaining review from pgajdos for https://build.suse.de/request/show/336342 and https://build.suse.de/request/show/336487 but the requests are still to be accepted.
Afterwards two more requests are needed that each depend on the previous one.
Updated by mkittler about 1 month ago
- Related to action #165683: Current openQA+os-autoinst+dependencies in pure SLE size:M added
Updated by dheidler about 1 month ago
perl-YAML-LibYAMLhttps://build.suse.de/request/show/336342perl-Test-MockModulehttps://build.opensuse.org/request/show/1181754perl-Perl-Tidyhttps://build.opensuse.org/request/show/1181755perl-Minionhttps://build.opensuse.org/request/show/1181760perl-Devel-Coverhttps://build.opensuse.org/request/show/1181748- https://build.suse.de/request/show/336487
perl-DBIperl-DBD-SQLiteperl-DBD-Pg
- waiting for perl-DBI, perl-DBD-SQLite and perl-DBD-Pg
- perl-Mojolicious
- perl-Mojo-SQLite
- waiting for all above:
- openQA
- os-autoinst
- os-autoinst-distri-openSUSE-deps?
Updated by dheidler about 1 month ago
iosc mr home:dheidler:oqa perl-Mojolicious perl-Mojo-SQLite SUSE:SLE-15-SP6:Update
Using target project 'SUSE:Maintenance'. (release in 'SUSE:SLE-15-SP6:Update')
342278
https://build.suse.de/request/show/342278
Updated by dheidler about 1 month ago
perl-YAML-LibYAMLhttps://build.suse.de/request/show/336342perl-Test-MockModulehttps://build.opensuse.org/request/show/1181754perl-Perl-Tidyhttps://build.opensuse.org/request/show/1181755perl-Minionhttps://build.opensuse.org/request/show/1181760perl-Devel-Coverhttps://build.opensuse.org/request/show/1181748- https://build.suse.de/request/show/336487
perl-DBIperl-DBD-SQLiteperl-DBD-Pg
waiting for perl-DBI, perl-DBD-SQLite and perl-DBD-Pghttps://build.suse.de/request/show/342278- perl-Mojolicious
- perl-Mojo-SQLite
- waiting for all above:
- openQA
- os-autoinst
- os-autoinst-distri-openSUSE-deps?
Updated by dheidler about 1 month ago 路 Edited
- Status changed from Blocked to Closed
I just realized that perl-Mojo-SQLite - while building fine on Leap - doesn't build on SLE due to the dependencies perl(SQL::Abstract::Pg) >= 1.0
and perl(URI::db) >= 0.15
being in backports only, but perl-Mojo-SQLite being part of SLE.
Moving them to SLE would require a large number of other dependencies to be moved.
This is something that can be done for an upcoming release (like Marius is doing right now in #165683 for 15SP7)
but sending Maintainance Requests for all new dependency packages to an existing release is not really feasible.
So I would close this ticket now in favor of Marius' work for 15SP7.