Project

General

Profile

Actions

coordination #95935

open

[epic][qe-core] Limit installation tests by depending more on the create_hdd_* jobs.

Added by szarate over 2 years ago. Updated 26 days ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Enhancement to existing tests
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

For a while we've seen that there are jobs that do a full installation (including the reboot) only to run couple of extra tests post installation, the problem with this approach is that if a test happens to fail during the installation, or a module that is not the one needed (say consoletest_setup) the time spent during the installation is basically lost.

It's better to identify those scenarios, leaving only default in a state where it runs a very limited subset of tests right after the install without any workarounds that we apply to carry on with testing

Suggestions

  • Take a look at the jobs in sle functional jobgroup see which jobs are doing installation + extra work, try to change that to Boot to desktop + extra work in the schedule
  • Repeat above step (if makes sense) on TW.
  • Cleanup Development 15, job group

Caveats:

  • PPC (powerKVM) supports qcow images too, those can be considered
  • For powerVM, spvm this is not possible unless START_AFTER_TEST is used (but can only be used once, or with a good chain of tests)
  • This is also not possible for z/VM, but possibly can be done with START_AFTER_TEST
  • Possibly job group storage will need to be updated.

Related issues 4 (1 open3 closed)

Related to openQA Tests - action #98814: [qe-core] test fails in wireshark - Wireshark test needs to be simplifiedResolveddvenkatachala

Actions
Related to openQA Tests - action #98817: [qe-core] Tomcat test is running a full blown installation Resolvedzluo

Actions
Related to openQA Tests - action #102224: [qe-core] test fails in network_hostname - incorrect hostname + test runs in full blown installationResolvedzluo

Actions
Related to openQA Tests - action #102227: [qe-core] test fails in zypper_lifecycle - Move zypper related tests out of the current scenarios to a gnome only scenarioIn Progress2021-11-10

Actions
Actions #1

Updated by szarate over 2 years ago

  • Tracker changed from coordination to action
  • Subject changed from [qe-core] Rely more on installation tests by extracting unnecesary modules to [qe-core] Limit installation tests by depending more on the create_hdd_* jobs.
  • Description updated (diff)
  • Status changed from New to Workable
  • Target version set to QE-Core: Ready
Actions #2

Updated by szarate over 2 years ago

  • Related to action #98814: [qe-core] test fails in wireshark - Wireshark test needs to be simplified added
Actions #3

Updated by szarate over 2 years ago

  • Description updated (diff)
Actions #4

Updated by szarate over 2 years ago

  • Related to action #98817: [qe-core] Tomcat test is running a full blown installation added
Actions #5

Updated by szarate over 2 years ago

  • Related to action #102224: [qe-core] test fails in network_hostname - incorrect hostname + test runs in full blown installation added
Actions #6

Updated by szarate over 2 years ago

  • Assignee deleted (szarate)
Actions #7

Updated by szarate over 2 years ago

  • Related to action #102227: [qe-core] test fails in zypper_lifecycle - Move zypper related tests out of the current scenarios to a gnome only scenario added
Actions #8

Updated by tjyrinki_suse over 2 years ago

  • Tracker changed from action to coordination
  • Subject changed from [qe-core] Limit installation tests by depending more on the create_hdd_* jobs. to [qe-core][epic] Limit installation tests by depending more on the create_hdd_* jobs.
  • Status changed from Workable to In Progress

Setting coordination tickets visible in sprint goals to In Progress so that it doesn't look like a ticket to pick directly.

Actions #9

Updated by tjyrinki_suse over 2 years ago

  • Subject changed from [qe-core][epic] Limit installation tests by depending more on the create_hdd_* jobs. to [epic][qe-core] Limit installation tests by depending more on the create_hdd_* jobs.
Actions #10

Updated by szarate about 2 years ago

  • Status changed from In Progress to New
Actions #11

Updated by szarate about 2 years ago

  • Target version deleted (QE-Core: Ready)
Actions #12

Updated by slo-gin 26 days ago

This ticket was set to Normal priority but was not updated within the SLO period. Please consider picking up this ticket or just set the ticket to the next lower priority.

Actions

Also available in: Atom PDF