action #168097
open[qe-core] Make openqa.suse.de tests work with mirrors instead of dist.suse.de or download.suse.de
0%
Description
Motivation¶
Upcoming changes to the network will have the effect that dist.suse.de is not accessible anymore for any workload running in NUE2 hence osado tests relying on that should use https://mirror.nue2.suse.org/ instead of corresponding paths in http://dist.suse.de/ along with ensuring that relevant content is available already as https://mirror.nue2.suse.org/ might only have the relevant test assets available delayed.
Acceptance criteria¶
- AC1: osado tests do not rely on http://dist.suse.de or http://download.suse.de when running from NUE2
- AC2: osado tests do not rely on NUE2 resources when running from other locations
- AC3.1: Mirrors are defined in workerconf.sls
Out of scope¶
- AC3.2: qem-bot handles also different mirrors here
Suggestions¶
- Review occurences of
git grep dist.suse.de
within osado and provide means to override the path based on openQA test variables - Same for download.suse.de
- Same for https://github.com/openSUSE/qem-bot/ see here
- Consider setting local mirror variables in https://gitlab.suse.de/openqa/salt-pillars-openqa/-/blob/master/openqa/workerconf.sls
Updated by okurz 20 days ago
- Project changed from QA to openQA Tests
- Subject changed from Make openqa.suse.de tests work with mirrors instead of dist.suse.de to [core] Make openqa.suse.de tests work with mirrors instead of dist.suse.de or download.suse.de
- Description updated (diff)
- Category set to Enhancement to existing tests
- Assignee deleted (
okurz)
Updated by szarate 1 day ago · Edited
I take that http://dist.suse.de
and http://download.suse.de
are the same or contain the same information? is that assumption correct?
Also: https://confluence.suse.com/display/~moroni_flores/embargoed-proxy
Updated by dzedro 1 day ago · Edited
I wanted simply replace in medium types download.suse.de
& dist.suse.de
with mirror.nue2.suse.org
, but looks like not everything works
This works
OS_TEST_REPOS=https://download.suse.de/ibs/SUSE:/ALP:/Source:/Standard:/1.0:/Staging:/C/images/repo/SL-Micro-6.0-x86_64/
This does not work
OS_TEST_REPOS=https://mirror.nue2.suse.org/ibs/SUSE:/ALP:/Source:/Standard:/1.0:/Staging:/C/images/repo/SL-Micro-6.0-x86_64/
or
works
QA_HEAD_REPO=http://dist.suse.de/ibs/QA:/Head/SLE-15-SP2/
QA_WEB_REPO=http://dist.suse.de/ibs/QA:/SLE15SP2/update/
does not work
QA_HEAD_REPO=http://mirror.nue2.suse.org/ibs/QA:/Head/SLE-15-SP2/
QA_WEB_REPO=http://mirror.nue2.suse.org/QA:/SLE15SP2/update/
Updated by mkittler 1 day ago
I've seen your qem-bot PR, see my comment on GitHub. I'll review the pillars change.
Note that I have been working on #168115 which had a similar goal. Checkout comment #168115#note-14 for my findings (or rather problems I ran into; I was not really successful in using the mirror for maintenance test).
Updated by dzedro about 14 hours ago · Edited
IDK what is the point of this changes when we will still use download/dist.suse.de
Also this and probably other repos should be mirrored on mirror.nue2.suse.org
?
http://dist.suse.de/ibs/Devel:/SLEnkins:/testsuites/SLE_12_SP5/ e.g. http://dist.suse.de/ibs/QA:/SLE15SP1/update/ # SLENKINS_TESTSUITES_REPO is sthis still used ?
http://dist.suse.de/ibs/QA:/VERSION/update/ e.g. http://dist.suse.de/ibs/QA:/SLE15SP2/update/ # QA_WEB_REPO
http://download.suse.de/ibs/home:/:/branches:/ e.g. http://download.suse.de/ibs/home:/pcervinka:/branches:/QA:/Head/SLE-15-SP5
http://download.suse.de/ibs/Devel:/Kernel:/VERSION/standard/ e.g. http://download.suse.de/ibs/Devel:/Kernel:/SLE15-SP3/standard/
http://download.suse.de/ibs/Devel:/PubCloud:/Stable:/CrossCloud:/Micro:/
http://download.suse.de/ibs/SUSE:/VERSION:/GA/images/ e.g. http://download.suse.de/ibs/SUSE:/SLE-15-SP6:/GA/images/SLES15-SP6.x86_64-1.0.0-EC2-Build1.26.raw.xz # PUBLIC_CLOUD_IMAGE_LOCATION
http://download.suse.de/ibs/SUSE:/VERSION:/GA/images/ e.g. https://download.suse.de/ibs/SUSE:/SLE-15-SP6:/GA/images/
Updated by szarate about 12 hours ago
@dzedro are those test settings?
if so, I would prefer to use variable expansion, QA_HEAD_REPO=https://%REPO_MIRROR_HOST%/ibs/QA:/Head/SLE-%VERSION%
which will have to be updated/defined at the moment of either running the test, or scheduling it, but that's for tools team to decide.
Changes to qam-bot are clearly out of scope for qe-core.
Updated by szarate about 9 hours ago
- Related to action #169159: Allow variable expansion before a job starts added
Updated by szarate about 9 hours ago
Marking AC3.2 as out of scope; changes required exceed what qe-core can do.