action #44252

action #15132: [saga][epic] Better structure of test plans in main.pm

[functional][u] Make more tests booting from HDD image "extratests" following the model of https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/6232

Added by okurz over 1 year ago. Updated about 1 year ago.

Status:ResolvedStart date:22/11/2018
Priority:NormalDue date:
Assignee:dheidler% Done:

0%

Category:Enhancement to existing tests
Target version:SUSE QA tests - Milestone 22
Difficulty:
Duration:

Description

Motivation

https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/6232 shows a good example of how we can prevent duplication by treating all tests that just boot from an HDD image as "extratests" which we can extend to others

Acceptance criteria

  • AC1: All duplicated sections in products/sle/main.pm and products/opensuse/main.pm including booting from hdd image and then custom test are only showing up once

Suggestions

  • Compare products/sle/main.pm and products/opensuse/main.pm
  • Identify duplicated sections and move them to to lib/main_common as "extratests"
  • Change testsuites on osd+o3 accordingly

Related issues

Related to openQA Tests - action #46109: [qam] test fails in addon_products_via_SCC_yast2 Resolved 14/01/2019

History

#1 Updated by dheidler over 1 year ago

  • Assignee set to dheidler

#3 Updated by mgriessmeier over 1 year ago

  • Status changed from Workable to Feedback

waiting for PR

#4 Updated by okurz about 1 year ago

  • Priority changed from High to Urgent
  • Target version changed from Milestone 21 to Milestone 22

median cycle time exceeded -> bumping prio and target version to current milestone

#5 Updated by dheidler about 1 year ago

  • Priority changed from Urgent to Normal

PR merged.

#6 Updated by dheidler about 1 year ago

  • Status changed from Feedback to Resolved

#7 Updated by okurz about 1 year ago

  • Status changed from Resolved to Feedback

okurz wrote:

  • AC1: All duplicated sections in products/sle/main.pm and products/opensuse/main.pm including booting from hdd image and then custom test are only showing up once

You did a great job already but I don't think this is covered. I can find some examples easily that look really similar in opensuse/main.pm and sle/main.pm, e.g. WICKED, SYSCONTAINER_IMAGE_TEST, Y2UITEST_NCURSES, Y2UITEST_GUI

#8 Updated by dimstar about 1 year ago

The work done here causes failures like https://openqa.opensuse.org/tests/827847# - where prepare_data is no longer scheduled

#9 Updated by dheidler about 1 year ago

todo FILESYSTEM_TEST as EXTRATEST

#11 Updated by okurz about 1 year ago

PR merged. Did you find any more occurrences of "extratest-like" or should we call this done? I would resolve it now. The rest I could find is not really for the "extratest"-approach

#12 Updated by pcervinka about 1 year ago

  • Related to action #46109: [qam] test fails in addon_products_via_SCC_yast2 added

#13 Updated by dheidler about 1 year ago

  • Status changed from Feedback to Resolved

Also available in: Atom PDF