action #42230
closedcoordination #40481: [functional][y][epic] Use boot into images for all scenarios, where possible and run extra tests after installation on OSD
[functional][y] Split "default" test suite with installation part and remaining
0%
Description
See motivation in the parent ticket.
Acceptance criteria¶
- Test scenario is creating image and booting into it for all supported architectures/machines
- Full installation is conducted for bare-metal machines and the ones which are not supporting images (e.g. zVM, ipmi)
Further points¶
main.pm changes will be required. We need some design, get it running, get feedback and apply for other test suites.
Updated by okurz over 6 years ago
- Category set to Enhancement to existing tests
- Target version set to Milestone 20
Updated by okurz over 6 years ago
I see two options regarding the naming: Either we keep test suites like "default" and it is only creating an image on disk-image capable backends and not on others or we only keep "default" for the backends which do not support disk-images and instead only have the "create_hdd_…" ones and then "console" and "x11" as the scenarios booting the images created by the "create_hdd_…" ones.
Updated by okurz over 6 years ago
Just to make you aware: This has impact on basically all products and teams using openQA so we should keep this in mind for risk mitigation, e.g. also involve QAM, openSUSE, etc., early in the process to get feedback, e.g. in a "WIP-PR" with verification runs showing how QAM scenarios would look different or unchanged and still working.
Updated by oorlov over 6 years ago
- Status changed from Workable to In Progress
- Assignee set to oorlov
Updated by oorlov over 6 years ago
AC1: The solution for the AC1 (which do not require main.pm changing, only configuring in openQA):
Add new Test Suite for the installation:
- Go to Test Suites;
- Press "New test suite" button;
- Set "Name" to default_installation;
- Set "Settings" to the following:
INSTALLONLY=1 PUBLISH_HDD_1=SLES-%VERSION%-%ARCH%-Build%BUILD%@%MACHINE%-default.qcow2
Update "Settings" column for default Test Suite with the following:
BOOT_HDD_IMAGE=1 HDD_1=SLES-%VERSION%-%ARCH%-Build%BUILD%@%MACHINE%-default.qcow2 START_AFTER_TEST=default_installation
Add new Job Template for the installation:
- Go to Jobs for Functional: Server;
- Press "+" button in "Test" column's header of sle-12-SP4-Server-DVD table;
- Select default_installation from dropdown list;
- Set the following:
aarch64 column -> aarch64
ppc64le column -> ppc64le
s390x column -> s390x-kvm-sle12
64bit column -> 64bit, 64bit-smp, svirt-xen-hvm, svirt-xen-pv, uefi
Disable booting from the installation image for bare-metal machines and the ones which are not supporting images:
- Go to Machines;
- Add the following variables to the Settings of 64bit-ipmi and s390x-zVM-vswitch-l2 machines:
+BOOT_HDD_IMAGE= +HDD_1= +START_AFTER_TEST=
That will override the settings, that were specified in Test Suite for the certain Machine types.
AC2: Regarding the bare-metal machines and the ones which are not supporting images it is decided to leave them as is (in default) for now.
Updated by riafarov over 6 years ago
- Status changed from Feedback to Resolved
As discussed, we resolve this one and not introducing split, will be done in https://progress.opensuse.org/issues/42494 after we make up our mind if we split it and how exactly.