Project

General

Profile

Actions

coordination #95935

open

[epic][qe-core] Limit installation tests by depending more on the create_hdd_* jobs.

Added by szarate almost 3 years ago. Updated about 2 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Enhancement to existing tests
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

For a while we've seen that there are jobs that do a full installation (including the reboot) only to run couple of extra tests post installation, the problem with this approach is that if a test happens to fail during the installation, or a module that is not the one needed (say consoletest_setup) the time spent during the installation is basically lost.

It's better to identify those scenarios, leaving only default in a state where it runs a very limited subset of tests right after the install without any workarounds that we apply to carry on with testing

Suggestions

  • Take a look at the jobs in sle functional jobgroup see which jobs are doing installation + extra work, try to change that to Boot to desktop + extra work in the schedule
  • Repeat above step (if makes sense) on TW.
  • Cleanup Development 15, job group

Caveats:

  • PPC (powerKVM) supports qcow images too, those can be considered
  • For powerVM, spvm this is not possible unless START_AFTER_TEST is used (but can only be used once, or with a good chain of tests)
  • This is also not possible for z/VM, but possibly can be done with START_AFTER_TEST
  • Possibly job group storage will need to be updated.

Related issues 4 (1 open3 closed)

Related to openQA Tests - action #98814: [qe-core] test fails in wireshark - Wireshark test needs to be simplifiedResolveddvenkatachala

Actions
Related to openQA Tests - action #98817: [qe-core] Tomcat test is running a full blown installation Resolvedzluo

Actions
Related to openQA Tests - action #102224: [qe-core] test fails in network_hostname - incorrect hostname + test runs in full blown installationResolvedzluo

Actions
Related to openQA Tests - action #102227: [qe-core] test fails in zypper_lifecycle - Move zypper related tests out of the current scenarios to a gnome only scenarioIn Progress2021-11-10

Actions
Actions

Also available in: Atom PDF