action #46094
closed[sle][functional][u] test fails in installation - missing assets or wrong link
Added by mloviska over 5 years ago. Updated about 5 years ago.
0%
Description
Observation¶
openQA test in scenario sle-12-SP5-Server-DVD-x86_64-autoyast_reinstall@64bit fails in
installation
Several autoyast profiles can be directly accessible via link https://openqa.suse.de/assets/other/.
2019-01-11 14:11:06 <3> install(3709) [Ruby] transfer/file_from_url.rb:153 Can't find URL: http://10.0.2.2:20053/N12YU0rdRc_3eUTv/assets/other/var/lib/openqa/pool/5/02368815-autoinst.xml
[2019-01-11T15:05:58.0284 CET] [debug] running on openqaworker13:5 (Linux 4.4.140-62-default #1 SMP Tue Jul 17 12:14:34 UTC 2018 (951943d) x86_64)
[2019-01-11T15:05:59.076 CET] [debug] Current version is 4.5.1544111663.31867f0e [interface v13]
[2019-01-11T15:05:59.086 CET] [debug] git hash in /var/lib/openqa/cache/openqa.suse.de/tests/sle: b714daed3778974a4340f9e148de5b3c17d3e43c
[2019-01-11T15:05:59.099 CET] [info] cmdsrv: daemon reachable under http://*:20053/N12YU0rdRc_3eUTv/
[2019-01-11T15:05:59.102 CET] [info] Listening at "http://[::]:20053"
Server available at http://[::]:20053
Reproducible¶
Fails since (at least) Build 0112
Expected result¶
Last good: sle-12-SP4-Server-DVD-x86_64-Build0456-autoyast_reinstall@64bit
Further details¶
Always latest result in this scenario: latest
Updated by JRivrain over 5 years ago
I think this ticket duplicates https://progress.opensuse.org/issues/45038. The Same thing happens on leap and Tumbleweed, probably on sle 15 too but the test has not run for months.
Updated by riafarov over 5 years ago
- Due date set to 2019-01-29
- Status changed from New to Workable
I believe we should take a closer look rather soon.
Updated by mloviska over 5 years ago
Incorrect expansion of variable ASSET_1 "ASSET_1" : "/var/lib/openqa/pool/5/02368815-autoinst.xml"
Definition of autoyast_reinstall:
ASSET_1=autoinst.xml
AUTOYAST=ASSET_1
DESKTOP=gnome
HDDSIZEGB=30
INSTALLONLY=1
START_AFTER_TEST=clone_system
Updated by mloviska over 5 years ago
"ISO" : "/var/lib/openqa/pool/5/SLE-12-SP5-Server-DVD-x86_64-Build0112-Media1.iso"
Updated by mloviska over 5 years ago
Sle15sp1 is affected as well
"ISO" : "/var/lib/openqa/pool/18/SLE-15-SP1-Installer-DVD-x86_64-Build141.1-Media1.iso",
sle-15-SP1-Installer-DVD-x86_64-Build141.1-autoyast_tftp@64bit
Updated by mloviska over 5 years ago
I guess, we can eliminated rsync.pl:
{
"ARCH" : "x86_64",
"BUILD" : "0109",
"BUILD_HA" : "0038",
"BUILD_HA_GEO" : "0026",
"BUILD_SDK" : "0087",
"BUILD_SLE" : "0109",
"BUILD_WE" : "0046",
"DISTRI" : "SLE",
"FLAVOR" : "SAP-DVD",
"ISO" : "SLE-12-SP5-SAP-DVD-x86_64-Build0109-Media1.iso",
"MIRROR_FTP" : "ftp://openqa.suse.de/SLE-12-SP5-SAP-DVD-x86_64-Build0109-Media1",
"MIRROR_HTTP" : "http://openqa.suse.de/assets/repo/SLE-12-SP5-SAP-DVD-x86_64-Build0109-Media1",
"MIRROR_HTTPS" : "https://openqa.suse.de/assets/repo/SLE-12-SP5-SAP-DVD-x86_64-Build0109-Media1",
"MIRROR_NFS" : "nfs://openqa.suse.de/var/lib/openqa/share/factory/repo/SLE-12-SP5-SAP-DVD-x86_64-Build0109-Media1",
"MIRROR_SMB" : "smb://openqa.suse.de/inst/SLE-12-SP5-SAP-DVD-x86_64-Build0109-Media1",
"REPO_0" : "SLE-12-SP5-SAP-DVD-x86_64-Build0109-Media1",
"REPO_10" : "SLE-12-SP5-SDK-POOL-x86_64-Media1.license",
"REPO_11" : "SLE-12-SP5-WE-POOL-x86_64-Media1",
"REPO_12" : "SLE-12-SP5-WE-POOL-x86_64-Media1.license",
"REPO_13" : "SLE-12-SP5-HA-POOL-x86_64-Media1",
"REPO_14" : "SLE-12-SP5-HA-POOL-x86_64-Media1.license",
"REPO_15" : "SLE-12-SP5-HA-GEO-POOL-s390x-x86_64-Media1",
"REPO_16" : "SLE-12-SP5-HA-GEO-POOL-s390x-x86_64-Media1.license",
"REPO_17" : "SLE-12-SP5-SAP-POOL-x86_64-Media1",
"REPO_18" : "SLE-12-SP5-HPC-POOL-x86_64-Media1",
"REPO_19" : "SLE-12-SP5-HPC-POOL-x86_64-Media1.license",
"REPO_20" : "SLE-12-SP5-Live-Patching-POOL-x86_64-Media1",
"REPO_21" : "SLE-12-SP5-Live-Patching-POOL-x86_64-Media1.license",
"REPO_9" : "SLE-12-SP5-SDK-POOL-x86_64-Media1",
"REPO_SLES_SAP" : "SLE-12-SP5-SAP-POOL-x86_64-Media1",
"REPO_SLE_HA" : "SLE-12-SP5-HA-POOL-x86_64-Media1",
"REPO_SLE_HA_GEO" : "SLE-12-SP5-HA-GEO-POOL-s390x-x86_64-Media1",
"REPO_SLE_HPC" : "SLE-12-SP5-HPC-POOL-x86_64-Media1",
"REPO_SLE_LIVE_PATCHING" : "SLE-12-SP5-Live-Patching-POOL-x86_64-Media1",
"REPO_SLE_SDK" : "SLE-12-SP5-SDK-POOL-x86_64-Media1",
"REPO_SLE_WE" : "SLE-12-SP5-WE-POOL-x86_64-Media1",
"VERSION" : "12-SP5"
}
Updated by mloviska over 5 years ago
sle-12-SP5-Server-DVD-x86_64-Build0112-clone_system@64bit - my local instance
"ISO" : "/var/lib/openqa/pool/5/SLE-12-SP5-Server-DVD-x86_64-Build0112-Media1.iso",
[2019-01-16T10:29:59.0127 CET] [debug] [pid:17940] +++ worker notes +++
[2019-01-16T10:29:59.0127 CET] [debug] [pid:17940] start time: 2019-01-16 09:29:59
[2019-01-16T10:29:59.0127 CET] [debug] [pid:17940] running on localhost:5 (Linux 4.19.12-1-default #1 SMP PREEMPT Sat Dec 22 08:59:36 UTC 2018 (c634493) x86_64)
[2019-01-16T10:29:59.763 CET] [debug] Current version is 4.5.1547491587.dfe47801 [interface v13]
[2019-01-16T10:29:59.771 CET] [debug] git hash in /var/lib/openqa/share/tests/sle: b19b743ef5819d5c0f61c52ba28e6165f5643d4f
[2019-01-16T10:29:59.778 CET] [info] cmdsrv: daemon reachable under http://*:20053/xrzD84SczLthUN25/
[2019-01-16T10:29:59.780 CET] [info] Listening at "http://[::]:20053"
Server available at http://[::]:20053
[2019-01-16T10:29:59.871 CET] [debug] default desktop: gnome
[2019-01-16T10:29:59.872 CET] [debug] usingenv DESKTOP=gnome
[2019-01-16T10:29:59.872 CET] [debug] usingenv DISTRI=sle
[2019-01-16T10:29:59.872 CET] [debug] usingenv NOAUTOLOGIN=1
[2019-01-16T10:29:59.872 CET] [debug] usingenv QEMUCPU=qemu64
[2019-01-16T10:29:59.872 CET] [debug] usingenv INSTLANG=en_US
[2019-01-16T10:29:59.872 CET] [debug] usingenv DVD=1
[2019-01-16T10:29:59.872 CET] [debug] usingenv GNOME=1
[2019-01-16T10:29:59.872 CET] [debug] usingenv ISO=/var/lib/openqa/pool/5/SLE-12-SP5-Server-DVD-x86_64-Build0112-Media1.iso
[2019-01-16T10:29:59.872 CET] [debug] usingenv ISO_MAXSIZE=4700372992
[2019-01-16T10:29:59.872 CET] [debug] usingenv SLE_PRODUCT=sles
[2019-01-16T10:29:59.968 CET] [debug] scheduling boot_to_desktop tests/boot/boot_to_desktop.pm
[2019-01-16T10:29:59.970 CET] [debug] scheduling system_prepare tests/console/system_prepare.pm
[2019-01-16T10:29:59.971 CET] [debug] scheduling consoletest_setup tests/console/consoletest_setup.pm
[2019-01-16T10:29:59.985 CET] [debug] scheduling yast2_clone_system tests/console/yast2_clone_system.pm
[2019-01-16T10:29:59.986 CET] [debug] scheduling consoletest_finish tests/console/consoletest_finish.pm
[2019-01-16T10:29:59.989 CET] [debug] init needles from /var/lib/openqa/share/tests/sle/products/sle/needles
[2019-01-16T10:30:01.413 CET] [debug] loaded 8242 needles
[2019-01-16T10:30:01.717 CET] [debug] git hash in /var/lib/openqa/share/tests/sle/products/sle/needles: 31a51f573c218c8af182bd0401724ce3dac46766
sle-12-SP5-Server-DVD-x86_64-Build0112-clone_system@64bit - OSD
"ISO" : "/var/lib/openqa/pool/16/SLE-12-SP5-Server-DVD-x86_64-Build0112-Media1.iso",
[2019-01-11T11:53:40.0597 CET] [debug] +++ worker notes +++
[2019-01-11T11:53:40.0598 CET] [debug] start time: 2019-01-11 10:53:40
[2019-01-11T11:53:40.0598 CET] [debug] running on openqaworker13:16 (Linux 4.4.140-62-default #1 SMP Tue Jul 17 12:14:34 UTC 2018 (951943d) x86_64)
[2019-01-11T11:53:41.409 CET] [debug] Current version is 4.5.1544111663.31867f0e [interface v13]
[2019-01-11T11:53:41.421 CET] [debug] git hash in /var/lib/openqa/cache/openqa.suse.de/tests/sle: 0a3d61f5374ddbcb0c7b6bda894f2daa2052025c
[2019-01-11T11:53:41.432 CET] [info] cmdsrv: daemon reachable under http://*:20163/yHT__UYyVltA7o4n/
[2019-01-11T11:53:41.434 CET] [info] Listening at "http://[::]:20163"
Server available at http://[::]:20163
[2019-01-11T11:53:41.513 CET] [debug] default desktop: gnome
[2019-01-11T11:53:41.513 CET] [debug] usingenv DESKTOP=gnome
[2019-01-11T11:53:41.514 CET] [debug] usingenv DISTRI=sle
[2019-01-11T11:53:41.514 CET] [debug] usingenv NOAUTOLOGIN=1
[2019-01-11T11:53:41.514 CET] [debug] usingenv QEMUCPU=qemu64
[2019-01-11T11:53:41.514 CET] [debug] usingenv INSTLANG=en_US
[2019-01-11T11:53:41.514 CET] [debug] usingenv DVD=1
[2019-01-11T11:53:41.514 CET] [debug] usingenv GNOME=1
[2019-01-11T11:53:41.514 CET] [debug] usingenv ISO=/var/lib/openqa/pool/16/SLE-12-SP5-Server-DVD-x86_64-Build0112-Media1.iso
[2019-01-11T11:53:41.514 CET] [debug] usingenv ISO_MAXSIZE=4700372992
[2019-01-11T11:53:41.514 CET] [debug] usingenv SLE_PRODUCT=sles
[2019-01-11T11:53:41.763 CET] [debug] scheduling boot_to_desktop tests/boot/boot_to_desktop.pm
[2019-01-11T11:53:41.766 CET] [debug] scheduling system_prepare tests/console/system_prepare.pm
[2019-01-11T11:53:41.767 CET] [debug] scheduling consoletest_setup tests/console/consoletest_setup.pm
[2019-01-11T11:53:41.784 CET] [debug] scheduling yast2_clone_system tests/console/yast2_clone_system.pm
[2019-01-11T11:53:41.785 CET] [debug] scheduling consoletest_finish tests/console/consoletest_finish.pm
[2019-01-11T11:53:41.791 CET] [debug] init needles from /var/lib/openqa/cache/openqa.suse.de/tests/sle/products/sle/needles
[2019-01-11T11:53:43.565 CET] [debug] loaded 8235 needles
[2019-01-11T11:53:44.122 CET] [debug] git hash in /var/lib/openqa/cache/openqa.suse.de/tests/sle/products/sle/needles: 116f0257da033a4187c627c7b1ed88b14025bd11
http://eris.suse.cz/tests/9177#step/installation/38
http://eris.suse.cz/tests/9177/file/vars.json
"ASSETDIR" : "/var/lib/openqa/share/factory",
"ASSET_1" : "/var/lib/openqa/pool/6/00009176-autoinst.xml",
Updated by riafarov over 5 years ago
Duplicate of https://progress.opensuse.org/issues/45038
Updated by okurz over 5 years ago
hm, couldn't find an obvious location within the source of os-autoinst or openQA where the asset path would be "overwritten" but I guess when you can reproduce the issue with a local openQA instance you can easily check where the path replacement is done. Maybe put in some print-debugging to see the intermediate state of the variables.
Updated by okurz over 5 years ago
- Status changed from Workable to Blocked
So I suggest we work on #45038 first
Updated by okurz over 5 years ago
- Blocked by action #45038: [functional][y][leap] test fails in installation - autoyast profile can not be retrieved, no network? added
Updated by mloviska over 5 years ago
As mentioned in related ticket https://progress.opensuse.org/issues/45038
https://github.com/os-autoinst/os-autoinst-distri-opensuse/blame/322a13d242cb2705a9e151553de36098647f538e/lib/bootloader_setup.pm#L530
https://github.com/os-autoinst/os-autoinst/blame/dfe4780173438a80b6ecd8d5804700e97c0a6346/testapi.pm#L1908
The test code part haven't been touch in some time.
Updated by mloviska over 5 years ago
- Status changed from Blocked to In Progress
Seems like the worker is not changing the content either
[2019-01-16T10:36:03.0193 CET] [debug] [pid:2917] setting REPO_SLES_DEBUG=SLE-12-SP5-SERVER-POOL-x86_64-Build0112-Media3
[2019-01-16T10:36:03.0193 CET] [debug] [pid:2917] setting AUTOYAST=ASSET_1
[2019-01-16T10:36:03.0194 CET] [debug] [pid:2917] setting BETA=1
[2019-01-16T10:36:03.0194 CET] [debug] [pid:2917] setting CHECKSUM_ISO=f1d003e577d26d66c8bf066ea0c0c16339247e3835a7219a5af289c47233f5eb
[2019-01-16T10:36:03.0194 CET] [debug] [pid:2917] setting DISTRI=sle
[2019-01-16T10:36:03.0194 CET] [debug] [pid:2917] setting CACHEDIRECTORY=/var/lib/openqa/cache
[2019-01-16T10:36:03.0194 CET] [debug] [pid:2917] setting BACKEND=qemu
[2019-01-16T10:36:03.0194 CET] [debug] [pid:2917] setting VERSION=12-SP5
[2019-01-16T10:36:03.0194 CET] [debug] [pid:2917] setting ASSET_1=00009176-autoinst.xml
[2019-01-16T10:36:03.0194 CET] [debug] [pid:2917] setting REPO_22=SLE-12-SP5-Live-Patching-POOL-x86_64-Build0016-Media1
[2019-01-16T10:36:03.0194 CET] [debug] [pid:2917] setting REPO_17=SLE-12-SP5-HA-POOL-x86_64-Build0038-Media1.license
[2019-01-16T10:36:03.0194 CET] [debug] [pid:2917] setting BUILD_HA_GEO=0026
[2019-01-16T10:36:03.0194 CET] [debug] [pid:2917] setting REPO_20=SLE-12-SP5-HPC-POOL-x86_64-Build0109-Media1
[2019-01-16T10:36:03.0194 CET] [debug] [pid:2917] setting FLAVOR=Server-DVD
[2019-01-16T10:36:03.0195 CET] [debug] [pid:2917] setting ISO_MAXSIZE=4700372992
[2019-01-16T10:36:03.0195 CET] [debug] [pid:2917] setting ARCH=x86_64
[2019-01-16T10:36:03.0195 CET] [debug] [pid:2917] setting REPO_SLE_HA_GEO=SLE-12-SP5-HA-GEO-POOL-s390x-x86_64-Build0026-Media1
[2019-01-16T10:36:03.0195 CET] [debug] [pid:2917] setting REPO_15=SLE-12-SP5-WE-POOL-x86_64-Build0046-Media1.license
[2019-01-16T10:36:03.0195 CET] [debug] [pid:2917] setting INSTALLONLY=1
[2019-01-16T10:36:03.0195 CET] [debug] [pid:2917] setting QA_WEB_REPO=http://dist.suse.de/install/SLP/SLE-12-Module-Web-Scripting-LATEST/x86_64/CD1/
[2019-01-16T10:36:03.0195 CET] [debug] [pid:2917] setting QEMUCPU=qemu64
[2019-01-16T10:36:03.0195 CET] [debug] [pid:2917] setting DESKTOP=gnome
[2019-01-16T10:36:03.0195 CET] [debug] [pid:2917] setting REPO_SLE_WE=SLE-12-SP5-WE-POOL-x86_64-Build0046-Media1
[2019-01-16T10:36:03.0195 CET] [debug] [pid:2917] setting REPO_SLE_HPC=SLE-12-SP5-HPC-POOL-x86_64-Build0109-Media1
[2019-01-16T10:36:03.0195 CET] [debug] [pid:2917] setting NAME=00009177-sle-12-SP5-Server-DVD-x86_64-Build0112-autoyast_reinstall@64bit
[2019-01-16T10:36:03.0196 CET] [debug] [pid:2917] Found ASSET_1, caching 00009176-autoinst.xml
Updated by mloviska over 5 years ago
- Estimated time set to 5.00 h
regression introduced by https://github.com/os-autoinst/openQA/pull/1907. Code works as expected without the loop. http://dhcp165.suse.cz/tests/2926
Updated by mloviska over 5 years ago
- Blocked by deleted (action #45038: [functional][y][leap] test fails in installation - autoyast profile can not be retrieved, no network?)
Updated by okurz over 5 years ago
- Related to action #45038: [functional][y][leap] test fails in installation - autoyast profile can not be retrieved, no network? added
Updated by riafarov over 5 years ago
- Priority changed from Normal to High
As we have only this AY scenario enabled on all architectures, I raise the priority.
Updated by szarate over 5 years ago
- Related to action #43511: [functional][u] Asset cache does not support ASSET_ assets added
Updated by szarate over 5 years ago
- Related to deleted (action #43511: [functional][u] Asset cache does not support ASSET_ assets)
Updated by szarate over 5 years ago
- Blocked by action #43511: [functional][u] Asset cache does not support ASSET_ assets added
Updated by okurz over 5 years ago
- Subject changed from [sle][functional][y] test fails in installation - missing assets or wrong link to [sle][functional][u] test fails in installation - missing assets or wrong link
- Target version set to Milestone 22
let's change to u-team then
Updated by szarate over 5 years ago
- Status changed from In Progress to Feedback
- Target version deleted (
Milestone 22)
So I went with the revert path - should have done that earlier -, which will refrain people from using the dynamic test scheduling on production (i.e: workers with caching enabled), but will allow this to work again.
Updated by okurz about 5 years ago
This is an autogenerated message for openQA integration by the openqa_review script:
This bug is still referenced in a failing openQA test: autoyast_reinstall
https://openqa.suse.de/tests/2450973
Updated by okurz about 5 years ago
- Status changed from Feedback to Resolved
PR was deployed. Latest job is green again: https://openqa.suse.de/tests/2506696
Thanks for your work.
Updated by okurz about 5 years ago
- Status changed from Resolved to Feedback
strange, the x86_64 one looks fine, https://openqa.suse.de/tests/2522097 is the same kind of broken on aarch though.
could you please take a look?
Updated by SLindoMansilla about 5 years ago
- Status changed from Feedback to Workable
Removing from tickets waiting for feedback. Since the requested feedback should come from the assignee.
Updated by szarate about 5 years ago
- Status changed from Workable to Feedback
- Priority changed from High to Normal
Gonna set it to feedback for now, there was a deploy 13 days ago, and also if the x86_64 scenario passed, there's no reason for this to be the same issue, likely a missing update on the worker or something similar. There seems to be bsc#1129409 affecting the parent job for SLE-15 scenario, so no verification can be done for the time being on the autoyast_reinstall scenario, so likely just monitor the latest job