Project

General

Profile

action #57290

coordination #47003: [qe-core][epic][functional][ppc64le] test runs into MAX_JOB_TIME - split extra_tests_in_textmode

[qe-core][functional] Move module specific test modules from extra_tests_* scenarios to its respective scenario

Added by SLindoMansilla almost 3 years ago. Updated over 1 year ago.

Status:
Resolved
Priority:
Normal
Category:
Bugs in existing tests
Target version:
SUSE QA - Milestone 30
Start date:
2019-09-19
Due date:
% Done:

100%

Estimated time:
(Total: 42.00 h)
Difficulty:

Description

Observation

Case machinery and sssd

The test module sssd is failing due to a problem refreshing the package hub repository. The repository was broken and was added in module machinery, but sssd also relies on this module.

Package Hub should have its own scenario.


Subtasks

action #58745: [functional][u] test fails in libqt5_qtbase - Move libqt5_qtbase from extra_tests_on_gnome to extra_tests_on_gnome_sdkResolvedjorauch

action #57101: [qam][functional][u] test fails in gdb - Missing module development toolsResolvedSLindoMansilla

action #58193: [functional][u] test fails in wavpackRejectedokurz

action #64045: [functional][u] test fails in libvorbis - test fails in command_not_found - Those test modules should be moved to a dedicated scenario extra_tests_textmode_desktopResolveddheidler


Related issues

Related to openQA Tests - action #57215: [functional][u] test fails in sssd - Failed to start SSSDResolved2019-09-23

Related to openQA Tests - action #68314: [qe-core][functional] Move setting YAML_SCHEDULE from QSF-U job group schedule to openQA test suite definitionFeedback2020-06-26

Has duplicate openQA Tests - action #62303: [functional][u][qam] extra_tests_in_textmode run into MAX_JOB_TIME if some modules failRejected2020-01-19

History

#1 Updated by SLindoMansilla almost 3 years ago

  • Description updated (diff)

PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/8524

#2 Updated by SLindoMansilla almost 3 years ago

  • Related to action #57215: [functional][u] test fails in sssd - Failed to start SSSD added

#3 Updated by SLindoMansilla almost 3 years ago

  • Checklist item changed from to [ ] package hub, [ ] SDK, [ ] Containers, [ ] Web and Scripting
  • Parent task set to #47003

#4 Updated by SLindoMansilla almost 3 years ago

  • Related to action #57101: [qam][functional][u] test fails in gdb - Missing module development tools added

#5 Updated by SLindoMansilla almost 3 years ago

  • Status changed from New to Workable
  • Priority changed from High to Normal
  • Target version set to Milestone 28
  • Estimated time set to 42.00 h

#6 Updated by okurz over 2 years ago

  • Checklist item changed from [ ] package hub, [ ] SDK, [ ] Containers, [ ] Web and Scripting to

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: extra_tests_package_hub
https://openqa.suse.de/tests/3613852

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#8 Updated by SLindoMansilla over 2 years ago

PR for enabling package hub YAML in job group: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/11 (merged)

#9 Updated by SLindoMansilla over 2 years ago

Waiting for verification of YAML schedule in OSD.

#10 Updated by SLindoMansilla over 2 years ago

  • Related to deleted (action #57101: [qam][functional][u] test fails in gdb - Missing module development tools)

#11 Updated by SLindoMansilla over 2 years ago

Verification went ok: https://openqa.suse.de/tests/3699670

But, I forgot to name the test suite properly: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/16/diffs (merged)

#12 Updated by SLindoMansilla over 2 years ago

PR for cleaning up old main.pm schedule: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9185 (merged)

#13 Updated by mgriessmeier over 2 years ago

  • Target version changed from Milestone 28 to Milestone 30

so i assume this is done?
anyway waiting for feedback in offline discussion

#14 Updated by SLindoMansilla over 2 years ago

mgriessmeier wrote:

so i assume this is done?
anyway waiting for feedback in offline discussion

There is still work to be done (see sub tasks). We have only started scheduling the modules in dedicated test suites, but they are not yet verified properly and other modules still need to be split. I will create more sub-task each time I see a modules that should be moved out from extra_tests_* scenarios.

#15 Updated by SLindoMansilla over 2 years ago

Test suite extra_tests_in_textmode_phub verified on OSD: https://openqa.suse.de/tests/3766991

Now it is time to remove those modules from extra_tests_in_textmode

#16 Updated by SLindoMansilla over 2 years ago

Move passing test suites to main job group: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/20 (merged)

#17 Updated by SLindoMansilla over 2 years ago

Waiting for verification run on OSD

#18 Updated by SLindoMansilla over 2 years ago

Created new test suite extra_tests_in_textmode_cont

BOOT_HDD_IMAGE=1
DESKTOP=textmode
EXTRATEST=cont
HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2
START_AFTER_TEST=create_hdd_textmode
UEFI_PFLASH_VARS=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%-uefi-vars.qcow2

#19 Updated by SLindoMansilla over 2 years ago

PR for extra_tests_in_textmode_cont: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9341 (merged)

#20 Updated by SLindoMansilla over 2 years ago

  • Status changed from Workable to Feedback

Waiting for verification run on OSD

#21 Updated by SLindoMansilla over 2 years ago

PR cleanup old extra_tests_on_gnome (ppc, x86): https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/33
PR rename extra_tests_in_textmode_sdk to extra_tests_textmode_sdk: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/34
PR rename extra_tests_in_textmode_cont to extra_tests_textmode_containers: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/35

#22 Updated by SLindoMansilla over 2 years ago

  • Status changed from Feedback to In Progress

#23 Updated by SLindoMansilla over 2 years ago

Unschedule container tests from textmode suite: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9925

#25 Updated by SLindoMansilla about 2 years ago

  • Due date set to 2020-06-22

due to changes in a related task: #68314

#26 Updated by SLindoMansilla about 2 years ago

  • Has duplicate action #62303: [functional][u][qam] extra_tests_in_textmode run into MAX_JOB_TIME if some modules fail added

#27 Updated by zluo about 2 years ago

  • Due date set to 2020-06-26

Grund: Änderung an zugehörigem Ticket: #68314

#28 Updated by tjyrinki_suse almost 2 years ago

  • Subject changed from [functional][u] Move module specific test modules from extra_tests_* scenarios to its respective scenario to [qe-core][functional] Move module specific test modules from extra_tests_* scenarios to its respective scenario

#29 Updated by SLindoMansilla over 1 year ago

  • Related to action #68314: [qe-core][functional] Move setting YAML_SCHEDULE from QSF-U job group schedule to openQA test suite definition added

Also available in: Atom PDF