Project

General

Profile

Actions
Copy link

action #28893

closed

coordination #25380: [sle][functional][epic] test fails in install - tries to install SLE12 packages -> update test for sle15

[sle][functional][story][hard] Adapt test suite toolchain_zypper to boot from a hdd with an already installed system

Added by SLindoMansilla about 7 years ago. Updated about 7 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
SLindoMansilla
Category:
Enhancement to existing tests
Target version:
openQA Project (public) - Milestone 13
Start date:
2017-12-05
Due date:
2017-12-19
% Done:

0%

Estimated time:
Difficulty:

Description

Story

As an openQA test developer, I want to adapt the test suite toolchain_zypper to boot from a hdd with an already installed system, so I maintain retro compatibility between SLE 12-SP3, 12-SP4 and 15 with the same test suite.

Acceptance criteria

  • AC1: The test suite create_hdd_textmode works for SLE 12-SP3, 12-SP4 and 15 on aarch64, ppc64le and x86_64
  • AC2: The test suite toolchain_zypper boots from an existing installation for SLE 12-SP3, 12-SP4 and 15.

Tasks

  1. Clone the job for create_hdd_textmode from SLE 12-SP3, which was only done for x86_64, for aarch64 and ppc64le.
  2. Make adaptions needed to create_hdd_textmode from SLE 12-SP3 to work on aarch64, ppc64le and x86_64 for SLE 12-SP3, 12-SP4 and 15.
  3. Make adaptions needed to toolchain_zypper from SLE 12-SP3 to work on aarch64, ppc64le and x86_64 for SLE 12-SP3, 12-SP4 and 15.

Further information

Settings already on OSD for test suite toolchain_zypper

BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDDSIZEGB=20
HDD_1=sle-%VERSION%-%ARCH%-%BUILD%-textmode@%MACHINE%.qcow2
INSTALLONLY=1
MAX_JOB_TIME=14400
QEMUCPUS=4
QEMURAM=4096
START_AFTER_TEST=create_hdd_textmode
TCM=1

Command to trigger the test suite

# aarch64
script/client jobs post ARCH=aarch64 BACKEND=qemu BIOS=qemu-uefi-aarch64.bin BOOT_HDD_IMAGE=1 BUILD=0473 BUILD_HA=0214 BUILD_HA_GEO=0163 BUILD_SDK=0263 BUILD_SLE=0473 BUILD_WE=0168 DESKTOP=textmode DISTRI=sle FLAVOR=Server-DVD HDDMODEL=virtio-blk-device HDDSIZEGB=20 HDD_1=sle-12-SP3-aarch64-0473-textmode@aarch64.qcow2 INSTALLONLY=1 ISO=SLE-12-SP3-Server-DVD-aarch64-Build0473-Media1.iso ISO_MAXSIZE=4700372992 MACHINE=aarch64 MAX_JOB_TIME=14400 NAME=01058303-sle-12-SP3-Server-DVD-aarch64-Build0473-toolchain_zypper@aarch64 QA_HEAD_REPO=http://dist.nue.suse.com/ibs/QA:/Head/SLE-12-SP3 QA_WEB_REPO=http://dist.suse.de/install/SLP/SLE-12-Module-Web-Scripting-LATEST/aarch64/CD1/ QEMUCPU=aarch64 QEMUCPU=host QEMUCPUS=4 QEMUMACHINE=virt,usb=off,gic-version=host QEMURAM=4096 REPO_0=SLE-12-SP3-Server-DVD-aarch64-Build0473-Media1 SCC_REGCODE=XXX SCC_URL=http://Server-0473.proxy.scc.suse.de SERIALDEV=ttyAMA0 SHUTDOWN_NEEDS_AUTH=1 SLENKINS_TESTSUITES_REPO=http://download.suse.de/ibs/Devel:/SLEnkins:/testsuites/SLE_12_SP3/ START_AFTER_TEST=create_hdd_textmode TCM=1 TEST=sergio_toolchain_zypper UEFI=1 VERSION=12-SP3 VGA=std VNC_TYPING_LIMIT=10 WORKER_CLASS=qemu_aarch64

# ppc64le
script/client jobs post ARCH=ppc64le BACKEND=qemu BOOT_HDD_IMAGE=1 BUILD=0473 BUILD_HA=0214 BUILD_HA_GEO=0163 BUILD_SDK=0263 BUILD_SLE=0473 BUILD_WE=0168 DESKTOP=textmode DISTRI=sle FLAVOR=Server-DVD HDDSIZEGB=20 HDD_1=sle-12-SP3-ppc64le-0473-textmode@ppc64le.qcow2 INSTALLONLY=1 ISO=SLE-12-SP3-Server-DVD-ppc64le-Build0473-Media1.iso ISO_MAXSIZE=4700372992 MACHINE=ppc64le MAX_JOB_TIME=14400 NAME=01058303-sle-12-SP3-Server-DVD-ppc64le-Build0473-toolchain_zypper@ppc64le QA_HEAD_REPO=http://dist.nue.suse.com/ibs/QA:/Head/SLE-12-SP3 QA_WEB_REPO=http://dist.suse.de/install/SLP/SLE-12-Module-Web-Scripting-LATEST/ppc64le/CD1/ QEMUCPU=qemu64 QEMUCPUS=4 QEMURAM=4096 REPO_0=SLE-12-SP3-Server-DVD-ppc64le-Build0473-Media1 SCC_REGCODE=XXX SCC_URL=http://Server-0473.proxy.scc.suse.de SHUTDOWN_NEEDS_AUTH=1 SLENKINS_TESTSUITES_REPO=http://download.suse.de/ibs/Devel:/SLEnkins:/testsuites/SLE_12_SP3/ START_AFTER_TEST=create_hdd_textmode TCM=1 TEST=sergio_toolchain_zypper VERSION=12-SP3 WORKER_CLASS=remote-worker_ppc64

# s390x
script/client jobs post ARCH=s390x BACKEND=qemu BOOT_HDD_IMAGE=1 BUILD=0473 BUILD_HA=0214 BUILD_HA_GEO=0163 BUILD_SDK=0263 BUILD_SLE=0473 BUILD_WE=0168 DESKTOP=textmode DISTRI=sle FLAVOR=Server-DVD HDDSIZEGB=20 HDD_1=sle-12-SP3-s390x-0473-textmode@zkvm.qcow2 INSTALLONLY=1 ISO=SLE-12-SP3-Server-DVD-s390x-Build0473-Media1.iso ISO_MAXSIZE=4700372992 MACHINE=zkvm MAX_JOB_TIME=14400 NAME=01058303-sle-12-SP3-Server-DVD-s390x-Build0473-toolchain_zypper@zkvm QA_HEAD_REPO=http://dist.nue.suse.com/ibs/QA:/Head/SLE-12-SP3 QA_WEB_REPO=http://dist.suse.de/install/SLP/SLE-12-Module-Web-Scripting-LATEST/s390x/CD1/ QEMUCPU=qemu64 QEMUCPUS=4 QEMURAM=4096 REPO_0=SLE-12-SP3-Server-DVD-s390x-Build0473-Media1 SCC_REGCODE=XXX SCC_URL=http://Server-0473.proxy.scc.suse.de SHUTDOWN_NEEDS_AUTH=1 SLENKINS_TESTSUITES_REPO=http://download.suse.de/ibs/Devel:/SLEnkins:/testsuites/SLE_12_SP3/ START_AFTER_TEST=create_hdd_textmode TCM=1 TEST=sergio_toolchain_zypper VERSION=12-SP3 WORKER_CLASS=svirt

# x86_64
script/client jobs post ARCH=x86_64 BACKEND=qemu BOOT_HDD_IMAGE=1 BUILD=0473 BUILD_HA=0214 BUILD_HA_GEO=0163 BUILD_SDK=0263 BUILD_SLE=0473 BUILD_WE=0168 DESKTOP=textmode DISTRI=sle FLAVOR=Server-DVD HDDSIZEGB=20 HDD_1=sle-12-SP3-x86_64-0473-textmode@64bit.qcow2 INSTALLONLY=1 ISO=SLE-12-SP3-Server-DVD-x86_64-Build0473-Media1.iso ISO_MAXSIZE=4700372992 MACHINE=64bit-smp MAX_JOB_TIME=14400 NAME=01058303-sle-12-SP3-Server-DVD-x86_64-Build0473-toolchain_zypper@64bit-smp QA_HEAD_REPO=http://dist.nue.suse.com/ibs/QA:/Head/SLE-12-SP3 QA_WEB_REPO=http://dist.suse.de/install/SLP/SLE-12-Module-Web-Scripting-LATEST/x86_64/CD1/ QEMUCPU=qemu64 QEMUCPUS=4 QEMURAM=4096 REPO_0=SLE-12-SP3-Server-DVD-x86_64-Build0473-Media1 SCC_REGCODE=XXX SCC_URL=http://Server-0473.proxy.scc.suse.de SHUTDOWN_NEEDS_AUTH=1 SLENKINS_TESTSUITES_REPO=http://download.suse.de/ibs/Devel:/SLEnkins:/testsuites/SLE_12_SP3/ START_AFTER_TEST=create_hdd_textmode TCM=1 TEST=sergio_toolchain_zypper VERSION=12-SP3 WORKER_CLASS=remote_worker-x86_64

Related issues 1 (0 open — 1 closed)

Blocked by openQA Tests (public) - action #29405: [sle][functional] test fails in partitioning_togglehome - No proposal for separated home partition on s390xResolvedSLindoMansilla2017-12-14

Actions
Actions
Copy link
 #1

Updated by okurz about 7 years ago

  • Due date set to 2017-12-19
Actions
Copy link
 #2

Updated by SLindoMansilla about 7 years ago

  • Subject changed from [sle][functional][hard][story] Adapt test suite toolchain_zypper to boot from a hdd with an already installed system to [sle][functional][story][hard] Adapt test suite toolchain_zypper to boot from a hdd with an already installed system
  • Description updated (diff)
Actions
Copy link
 #3

Updated by SLindoMansilla about 7 years ago

  • Description updated (diff)
Actions
Copy link
 #4

Updated by SLindoMansilla about 7 years ago

Fixed the settings HDD_1 for toolchain_zypper to match both SLE 12-SP3 and SLE 15:

HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2
Actions
Copy link
 #5

Updated by SLindoMansilla about 7 years ago

  • Description updated (diff)
Actions
Copy link
 #6

Updated by SLindoMansilla about 7 years ago

  • Description updated (diff)
Actions
Copy link
 #7

Updated by SLindoMansilla about 7 years ago

  • Description updated (diff)

SLE 12-SP3

Actions
Copy link
 #8

Updated by JERiveraMoya about 7 years ago

SLE 12-SP4

SLE 15

  • x86_64: http://dhcp227/tests/650#step/install/8 (failing) @Sergio we can use Development Tools Module 15 to avoid not finding devel_basis pattern. Initially I was using sdk as image to boot (START_AFTER_TEST=create_hdd_minimal_base+sdk) containing tools for development.
Actions
Copy link
 #9

Updated by JERiveraMoya about 7 years ago

Verification run for SLE15 aarch64 with the same error now fixed than the one for x86_64 below: http://dhcp227/tests/665

Actions
Copy link
 #10

Updated by okurz about 7 years ago

  • Priority changed from High to Urgent

I am pretty sure one of you added "toolchain_zypper@zkvm" which now incompletes within the functional job group. It does not look like you tested that in before: https://openqa.suse.de/tests/1305366 Please use the development group for that when not trying to trigger it once manually . Please get rid of that incomplete urgently!

Actions
Copy link
 #11

Updated by SLindoMansilla about 7 years ago

Machine zkvm removed from job groups for SLE 12-SP3, 12-SP4 and 15.
So there will be no more incompletes there.

Actions
Copy link
 #13

Updated by SLindoMansilla about 7 years ago

  • Status changed from In Progress to Resolved
Actions
Copy link
 #14

Updated by SLindoMansilla about 7 years ago

  • Status changed from Resolved to In Progress

Waiting for verification on s390x

Actions
Copy link
 #15

Updated by SLindoMansilla about 7 years ago

  • Status changed from In Progress to Resolved

s390x also verified on OSD: https://openqa.suse.de/tests/1311359

Actions
Copy link
 #16

Updated by okurz about 7 years ago

  • Status changed from Resolved to In Progress

the job you referenced is a hdd creation job, not the toolchain job booting the harddisk image itself. https://openqa.suse.de/tests/1317143 is the most recent example of s390x failing as incomplete. Please compare the test schedule for that scenario with another one on zkvm booting a HDD image, e.g. see https://openqa.suse.de/tests/1317091 scheduling additionally the modules "bootloader_zkvm" and "boot_to_desktop". They should be needed. Probably needs an update to main.pm. I suggest to test locally with just isotovideo, simulate s390x by downloading the vars.json file and set the additional parameter _EXIT_AFTER_SCHEDULE to only evaluate the schedule.

Actions
Copy link
 #17

Updated by SLindoMansilla about 7 years ago

  • Blocked by action #29405: [sle][functional] test fails in partitioning_togglehome - No proposal for separated home partition on s390x added
Actions
Copy link
 #18

Updated by okurz about 7 years ago

  • Target version set to Milestone 13
Actions
Copy link
 #19

Updated by SLindoMansilla about 7 years ago

  • Status changed from In Progress to Feedback

Blocked by https://progress.opensuse.org/issues/29405 and by missing assets in OSD, what doesn't allow verification runs.

Actions
Copy link
 #21

Updated by SLindoMansilla about 7 years ago

  • Status changed from Feedback to In Progress
Actions
Copy link
 #22

Updated by SLindoMansilla about 7 years ago

  • Status changed from In Progress to Resolved

Verified on OSD:

SLE 12-SP4

SLE 15

Actions
Copy link

Also available in: Atom PDF