Project

General

Profile

Actions

action #57290

closed

coordination #47003: [qe-core][epic][functional][ppc64le] test runs into MAX_JOB_TIME - split extra_tests_in_textmode

[qe-core][functional] Move module specific test modules from extra_tests_* scenarios to its respective scenario

Added by SLindoMansilla over 4 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
Normal
Category:
Bugs in existing tests
Target version:
SUSE QA - Milestone 30
Start date:
2019-09-19
Due date:
% Done:

100%

Estimated time:
(Total: 42.00 h)
Difficulty:

Description

Observation

Case machinery and sssd

The test module sssd is failing due to a problem refreshing the package hub repository. The repository was broken and was added in module machinery, but sssd also relies on this module.

Package Hub should have its own scenario.


Subtasks 4 (0 open4 closed)

action #58745: [functional][u] test fails in libqt5_qtbase - Move libqt5_qtbase from extra_tests_on_gnome to extra_tests_on_gnome_sdkResolvedjorauch2019-10-28

Actions
action #57101: [qam][functional][u] test fails in gdb - Missing module development toolsResolvedSLindoMansilla2019-09-19

Actions
action #58193: [functional][u] test fails in wavpackRejectedokurz2019-10-15

Actions
action #64045: [functional][u] test fails in libvorbis - test fails in command_not_found - Those test modules should be moved to a dedicated scenario extra_tests_textmode_desktopResolveddheidler2020-03-02

Actions

Related issues 3 (1 open2 closed)

Related to openQA Tests - action #57215: [functional][u] test fails in sssd - Failed to start SSSDResolvedszarate2019-09-23

Actions
Related to openQA Tests - action #68314: [qe-core][functional] Move setting YAML_SCHEDULE from QSF-U job group schedule to openQA test suite definitionFeedbackszarate2020-06-26

Actions
Has duplicate openQA Tests - action #62303: [functional][u][qam] extra_tests_in_textmode run into MAX_JOB_TIME if some modules failRejectedSLindoMansilla2020-01-19

Actions
Actions #1

Updated by SLindoMansilla over 4 years ago

  • Description updated (diff)

PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/8524

Actions #2

Updated by SLindoMansilla over 4 years ago

  • Related to action #57215: [functional][u] test fails in sssd - Failed to start SSSD added
Actions #3

Updated by SLindoMansilla over 4 years ago

  • Checklist item changed from to [ ] package hub, [ ] SDK, [ ] Containers, [ ] Web and Scripting
  • Parent task set to #47003
Actions #4

Updated by SLindoMansilla over 4 years ago

  • Related to action #57101: [qam][functional][u] test fails in gdb - Missing module development tools added
Actions #5

Updated by SLindoMansilla over 4 years ago

  • Status changed from New to Workable
  • Priority changed from High to Normal
  • Target version set to Milestone 28
  • Estimated time set to 42.00 h
Actions #6

Updated by okurz over 4 years ago

  • Checklist item changed from [ ] package hub, [ ] SDK, [ ] Containers, [ ] Web and Scripting to

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: extra_tests_package_hub
https://openqa.suse.de/tests/3613852

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed
Actions #8

Updated by SLindoMansilla over 4 years ago

PR for enabling package hub YAML in job group: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/11 (merged)

Actions #9

Updated by SLindoMansilla over 4 years ago

Waiting for verification of YAML schedule in OSD.

Actions #10

Updated by SLindoMansilla over 4 years ago

  • Related to deleted (action #57101: [qam][functional][u] test fails in gdb - Missing module development tools)
Actions #11

Updated by SLindoMansilla over 4 years ago

Verification went ok: https://openqa.suse.de/tests/3699670

But, I forgot to name the test suite properly: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/16/diffs (merged)

Actions #12

Updated by SLindoMansilla over 4 years ago

PR for cleaning up old main.pm schedule: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9185 (merged)

Actions #13

Updated by mgriessmeier over 4 years ago

  • Target version changed from Milestone 28 to Milestone 30

so i assume this is done?
anyway waiting for feedback in offline discussion

Actions #14

Updated by SLindoMansilla over 4 years ago

mgriessmeier wrote:

so i assume this is done?
anyway waiting for feedback in offline discussion

There is still work to be done (see sub tasks). We have only started scheduling the modules in dedicated test suites, but they are not yet verified properly and other modules still need to be split. I will create more sub-task each time I see a modules that should be moved out from extra_tests_* scenarios.

Actions #15

Updated by SLindoMansilla over 4 years ago

Test suite extra_tests_in_textmode_phub verified on OSD: https://openqa.suse.de/tests/3766991

Now it is time to remove those modules from extra_tests_in_textmode

Actions #16

Updated by SLindoMansilla over 4 years ago

Move passing test suites to main job group: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/20 (merged)

Actions #17

Updated by SLindoMansilla over 4 years ago

Waiting for verification run on OSD

Actions #18

Updated by SLindoMansilla over 4 years ago

Created new test suite extra_tests_in_textmode_cont

BOOT_HDD_IMAGE=1
DESKTOP=textmode
EXTRATEST=cont
HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2
START_AFTER_TEST=create_hdd_textmode
UEFI_PFLASH_VARS=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%-uefi-vars.qcow2
Actions #19

Updated by SLindoMansilla over 4 years ago

PR for extra_tests_in_textmode_cont: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9341 (merged)

Actions #20

Updated by SLindoMansilla about 4 years ago

  • Status changed from Workable to Feedback

Waiting for verification run on OSD

Actions #21

Updated by SLindoMansilla about 4 years ago

PR cleanup old extra_tests_on_gnome (ppc, x86): https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/33
PR rename extra_tests_in_textmode_sdk to extra_tests_textmode_sdk: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/34
PR rename extra_tests_in_textmode_cont to extra_tests_textmode_containers: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/35

Actions #22

Updated by SLindoMansilla about 4 years ago

  • Status changed from Feedback to In Progress
Actions #23

Updated by SLindoMansilla about 4 years ago

Unschedule container tests from textmode suite: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9925

Actions #25

Updated by SLindoMansilla almost 4 years ago

  • Due date set to 2020-06-22

due to changes in a related task: #68314

Actions #26

Updated by SLindoMansilla almost 4 years ago

  • Has duplicate action #62303: [functional][u][qam] extra_tests_in_textmode run into MAX_JOB_TIME if some modules fail added
Actions #27

Updated by zluo almost 4 years ago

  • Due date set to 2020-06-26

Grund: Änderung an zugehörigem Ticket: #68314

Actions #28

Updated by tjyrinki_suse over 3 years ago

  • Subject changed from [functional][u] Move module specific test modules from extra_tests_* scenarios to its respective scenario to [qe-core][functional] Move module specific test modules from extra_tests_* scenarios to its respective scenario
Actions #29

Updated by SLindoMansilla about 3 years ago

  • Related to action #68314: [qe-core][functional] Move setting YAML_SCHEDULE from QSF-U job group schedule to openQA test suite definition added
Actions

Also available in: Atom PDF