Project

General

Profile

coordination #95935

[epic][qe-core] Limit installation tests by depending more on the create_hdd_* jobs.

Added by szarate 11 months ago. Updated 3 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Enhancement to existing tests
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

For a while we've seen that there are jobs that do a full installation (including the reboot) only to run couple of extra tests post installation, the problem with this approach is that if a test happens to fail during the installation, or a module that is not the one needed (say consoletest_setup) the time spent during the installation is basically lost.

It's better to identify those scenarios, leaving only default in a state where it runs a very limited subset of tests right after the install without any workarounds that we apply to carry on with testing

Suggestions

  • Take a look at the jobs in sle functional jobgroup see which jobs are doing installation + extra work, try to change that to Boot to desktop + extra work in the schedule
  • Repeat above step (if makes sense) on TW.
  • Cleanup Development 15, job group

Caveats:

  • PPC (powerKVM) supports qcow images too, those can be considered
  • For powerVM, spvm this is not possible unless START_AFTER_TEST is used (but can only be used once, or with a good chain of tests)
  • This is also not possible for z/VM, but possibly can be done with START_AFTER_TEST
  • Possibly job group storage will need to be updated.

Related issues

Related to openQA Tests - action #98814: [qe-core] test fails in wireshark - Wireshark test needs to be simplifiedResolved

Related to openQA Tests - action #98817: [qe-core] Tomcat test is running a full blown installation Resolved

Related to openQA Tests - action #102224: [qe-core] test fails in network_hostname - incorrect hostname + test runs in full blown installationWorkable

Related to openQA Tests - action #102227: [qe-core] test fails in zypper_lifecycle - Move zypper related tests out of the current scenarios to a gnome only scenarioIn Progress2021-11-10

History

#1 Updated by szarate 11 months ago

  • Tracker changed from coordination to action
  • Subject changed from [qe-core] Rely more on installation tests by extracting unnecesary modules to [qe-core] Limit installation tests by depending more on the create_hdd_* jobs.
  • Description updated (diff)
  • Status changed from New to Workable
  • Target version set to QE-Core: Ready

#2 Updated by szarate 10 months ago

  • Related to action #98814: [qe-core] test fails in wireshark - Wireshark test needs to be simplified added

#3 Updated by szarate 10 months ago

  • Description updated (diff)

#4 Updated by szarate 10 months ago

  • Related to action #98817: [qe-core] Tomcat test is running a full blown installation added

#5 Updated by szarate 8 months ago

  • Related to action #102224: [qe-core] test fails in network_hostname - incorrect hostname + test runs in full blown installation added

#6 Updated by szarate 8 months ago

  • Assignee deleted (szarate)

#7 Updated by szarate 8 months ago

  • Related to action #102227: [qe-core] test fails in zypper_lifecycle - Move zypper related tests out of the current scenarios to a gnome only scenario added

#8 Updated by tjyrinki_suse 7 months ago

  • Tracker changed from action to coordination
  • Subject changed from [qe-core] Limit installation tests by depending more on the create_hdd_* jobs. to [qe-core][epic] Limit installation tests by depending more on the create_hdd_* jobs.
  • Status changed from Workable to In Progress

Setting coordination tickets visible in sprint goals to In Progress so that it doesn't look like a ticket to pick directly.

#9 Updated by tjyrinki_suse 6 months ago

  • Subject changed from [qe-core][epic] Limit installation tests by depending more on the create_hdd_* jobs. to [epic][qe-core] Limit installation tests by depending more on the create_hdd_* jobs.

#10 Updated by szarate 3 months ago

  • Status changed from In Progress to New

#11 Updated by szarate 3 months ago

  • Target version deleted (QE-Core: Ready)

Also available in: Atom PDF