Project

General

Profile

Actions

coordination #95935

open

[epic][qe-core] Limit installation tests by depending more on the create_hdd_* jobs.

Added by szarate over 2 years ago. Updated almost 2 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Enhancement to existing tests
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

For a while we've seen that there are jobs that do a full installation (including the reboot) only to run couple of extra tests post installation, the problem with this approach is that if a test happens to fail during the installation, or a module that is not the one needed (say consoletest_setup) the time spent during the installation is basically lost.

It's better to identify those scenarios, leaving only default in a state where it runs a very limited subset of tests right after the install without any workarounds that we apply to carry on with testing

Suggestions

  • Take a look at the jobs in sle functional jobgroup see which jobs are doing installation + extra work, try to change that to Boot to desktop + extra work in the schedule
  • Repeat above step (if makes sense) on TW.
  • Cleanup Development 15, job group

Caveats:

  • PPC (powerKVM) supports qcow images too, those can be considered
  • For powerVM, spvm this is not possible unless START_AFTER_TEST is used (but can only be used once, or with a good chain of tests)
  • This is also not possible for z/VM, but possibly can be done with START_AFTER_TEST
  • Possibly job group storage will need to be updated.

Related issues 4 (1 open3 closed)

Related to openQA Tests - action #98814: [qe-core] test fails in wireshark - Wireshark test needs to be simplifiedResolveddvenkatachala

Actions
Related to openQA Tests - action #98817: [qe-core] Tomcat test is running a full blown installation Resolvedzluo

Actions
Related to openQA Tests - action #102224: [qe-core] test fails in network_hostname - incorrect hostname + test runs in full blown installationResolvedzluo

Actions
Related to openQA Tests - action #102227: [qe-core] test fails in zypper_lifecycle - Move zypper related tests out of the current scenarios to a gnome only scenarioIn Progress2021-11-10

Actions
Actions #1

Updated by szarate over 2 years ago

  • Tracker changed from coordination to action
  • Subject changed from [qe-core] Rely more on installation tests by extracting unnecesary modules to [qe-core] Limit installation tests by depending more on the create_hdd_* jobs.
  • Description updated (diff)
  • Status changed from New to Workable
  • Target version set to QE-Core: Ready
Actions #2

Updated by szarate over 2 years ago

  • Related to action #98814: [qe-core] test fails in wireshark - Wireshark test needs to be simplified added
Actions #3

Updated by szarate over 2 years ago

  • Description updated (diff)
Actions #4

Updated by szarate over 2 years ago

  • Related to action #98817: [qe-core] Tomcat test is running a full blown installation added
Actions #5

Updated by szarate over 2 years ago

  • Related to action #102224: [qe-core] test fails in network_hostname - incorrect hostname + test runs in full blown installation added
Actions #6

Updated by szarate over 2 years ago

  • Assignee deleted (szarate)
Actions #7

Updated by szarate over 2 years ago

  • Related to action #102227: [qe-core] test fails in zypper_lifecycle - Move zypper related tests out of the current scenarios to a gnome only scenario added
Actions #8

Updated by tjyrinki_suse over 2 years ago

  • Tracker changed from action to coordination
  • Subject changed from [qe-core] Limit installation tests by depending more on the create_hdd_* jobs. to [qe-core][epic] Limit installation tests by depending more on the create_hdd_* jobs.
  • Status changed from Workable to In Progress

Setting coordination tickets visible in sprint goals to In Progress so that it doesn't look like a ticket to pick directly.

Actions #9

Updated by tjyrinki_suse over 2 years ago

  • Subject changed from [qe-core][epic] Limit installation tests by depending more on the create_hdd_* jobs. to [epic][qe-core] Limit installation tests by depending more on the create_hdd_* jobs.
Actions #10

Updated by szarate almost 2 years ago

  • Status changed from In Progress to New
Actions #11

Updated by szarate almost 2 years ago

  • Target version deleted (QE-Core: Ready)
Actions

Also available in: Atom PDF