Project

General

Profile

Actions

action #42230

closed

coordination #40481: [functional][y][epic] Use boot into images for all scenarios, where possible and run extra tests after installation on OSD

[functional][y] Split "default" test suite with installation part and remaining

Added by riafarov over 5 years ago. Updated over 5 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Enhancement to existing tests
Target version:
SUSE QA - Milestone 20
Start date:
2018-10-09
Due date:
2018-10-23
% Done:

0%

Estimated time:
8.00 h
Difficulty:

Description

See motivation in the parent ticket.

Acceptance criteria

  1. Test scenario is creating image and booting into it for all supported architectures/machines
  2. Full installation is conducted for bare-metal machines and the ones which are not supporting images (e.g. zVM, ipmi)

Further points

main.pm changes will be required. We need some design, get it running, get feedback and apply for other test suites.

Actions #1

Updated by okurz over 5 years ago

  • Category set to Enhancement to existing tests
  • Target version set to Milestone 20
Actions #2

Updated by okurz over 5 years ago

  • Description updated (diff)
Actions #3

Updated by okurz over 5 years ago

I see two options regarding the naming: Either we keep test suites like "default" and it is only creating an image on disk-image capable backends and not on others or we only keep "default" for the backends which do not support disk-images and instead only have the "create_hdd_…" ones and then "console" and "x11" as the scenarios booting the images created by the "create_hdd_…" ones.

Actions #4

Updated by okurz over 5 years ago

Just to make you aware: This has impact on basically all products and teams using openQA so we should keep this in mind for risk mitigation, e.g. also involve QAM, openSUSE, etc., early in the process to get feedback, e.g. in a "WIP-PR" with verification runs showing how QAM scenarios would look different or unchanged and still working.

Actions #5

Updated by riafarov over 5 years ago

  • Estimated time set to 8.00 h
Actions #6

Updated by oorlov over 5 years ago

  • Status changed from Workable to In Progress
  • Assignee set to oorlov
Actions #7

Updated by oorlov over 5 years ago

AC1: The solution for the AC1 (which do not require main.pm changing, only configuring in openQA):

  1. Add new Test Suite for the installation:

    1. Go to Test Suites;
    2. Press "New test suite" button;
    3. Set "Name" to default_installation;
    4. Set "Settings" to the following:
    INSTALLONLY=1
    PUBLISH_HDD_1=SLES-%VERSION%-%ARCH%-Build%BUILD%@%MACHINE%-default.qcow2
    
  2. Update "Settings" column for default Test Suite with the following:

    BOOT_HDD_IMAGE=1
    HDD_1=SLES-%VERSION%-%ARCH%-Build%BUILD%@%MACHINE%-default.qcow2
    START_AFTER_TEST=default_installation
    
  3. Add new Job Template for the installation:

    1. Go to Jobs for Functional: Server;
    2. Press "+" button in "Test" column's header of sle-12-SP4-Server-DVD table;
    3. Select default_installation from dropdown list;
    4. Set the following:
 aarch64 column -> aarch64
 ppc64le column -> ppc64le
 s390x column -> s390x-kvm-sle12
 64bit column -> 64bit, 64bit-smp, svirt-xen-hvm, svirt-xen-pv, uefi
  1. Disable booting from the installation image for bare-metal machines and the ones which are not supporting images:

    1. Go to Machines;
    2. Add the following variables to the Settings of 64bit-ipmi and s390x-zVM-vswitch-l2 machines:
    +BOOT_HDD_IMAGE=
    +HDD_1=
    +START_AFTER_TEST=
    

    That will override the settings, that were specified in Test Suite for the certain Machine types.

AC2: Regarding the bare-metal machines and the ones which are not supporting images it is decided to leave them as is (in default) for now.

Actions #8

Updated by oorlov over 5 years ago

  • Status changed from In Progress to Resolved
Actions #9

Updated by oorlov over 5 years ago

  • Status changed from Resolved to Feedback
Actions #10

Updated by riafarov over 5 years ago

  • Status changed from Feedback to Resolved

As discussed, we resolve this one and not introducing split, will be done in https://progress.opensuse.org/issues/42494 after we make up our mind if we split it and how exactly.

Actions

Also available in: Atom PDF