Project

General

Profile

action #57290

action #47003: [epic][functional][u][ppc64le] test runs into MAX_JOB_TIME - split extra_tests_in_textmode

[functional][u] Move module specific test modules from extra_tests_* scenarios to its respective scenario

Added by SLindoMansilla 10 months ago. Updated 15 days ago.

Status:
In Progress
Priority:
Normal
Category:
Bugs in existing tests
Target version:
SUSE QA tests - Milestone 30
Start date:
2019-09-19
Due date:
% Done:

73%

Estimated time:
(Total: 126.00 h)
Difficulty:
Duration:

Description

Observation

Case machinery and sssd

The test module sssd is failing due to a problem refreshing the package hub repository. The repository was broken and was added in module machinery, but sssd also relies on this module.

Package Hub should have its own scenario.


Subtasks

action #58745: [functional][u] test fails in libqt5_qtbase - Move libqt5_qtbase from extra_tests_on_gnome to extra_tests_on_gnome_sdkResolvedjorauch

action #57101: [qam][functional][u] test fails in gdb - Missing module development toolsResolvedSLindoMansilla

action #58193: [functional][u] test fails in wavpackRejectedokurz

action #64045: [functional][u] test fails in libvorbis - test fails in command_not_found - Those test modules should be moved to a dedicated scenario extra_tests_textmode_desktopResolveddheidler

action #68314: [functional][u] Move setting YAML_SCHEDULE from QSF-U job group schedule to openQA test suite definitionIn Progresszluo

action #68467: [sle][functional][u] set YAML_SCHEDULE= in openQA definition for extra_tests_* and remove it from job group YAML scheduleIn Progresszluo


Related issues

Related to openQA Tests - action #57215: [functional][u] test fails in sssd - Failed to start SSSDResolved2019-09-23

Has duplicate openQA Tests - action #62303: [functional][u][qam] extra_tests_in_textmode run into MAX_JOB_TIME if some modules failRejected2020-01-19

History

#1 Updated by SLindoMansilla 10 months ago

  • Description updated (diff)

PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/8524

#2 Updated by SLindoMansilla 9 months ago

  • Related to action #57215: [functional][u] test fails in sssd - Failed to start SSSD added

#3 Updated by SLindoMansilla 9 months ago

  • Checklist set to [ ] package hub, [ ] SDK, [ ] Containers, [ ] Web and Scripting
  • Parent task set to #47003

#4 Updated by SLindoMansilla 9 months ago

  • Related to action #57101: [qam][functional][u] test fails in gdb - Missing module development tools added

#5 Updated by SLindoMansilla 9 months ago

  • Status changed from New to Workable
  • Priority changed from High to Normal
  • Target version set to Milestone 28
  • Estimated time set to 42.00 h

#6 Updated by okurz 8 months ago

  • Checklist deleted ([ ] package hub, [ ] SDK, [ ] Containers, [ ] Web and Scripting)

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: extra_tests_package_hub
https://openqa.suse.de/tests/3613852

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#8 Updated by SLindoMansilla 7 months ago

PR for enabling package hub YAML in job group: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/11 (merged)

#9 Updated by SLindoMansilla 7 months ago

Waiting for verification of YAML schedule in OSD.

#10 Updated by SLindoMansilla 7 months ago

  • Related to deleted (action #57101: [qam][functional][u] test fails in gdb - Missing module development tools)

#11 Updated by SLindoMansilla 7 months ago

Verification went ok: https://openqa.suse.de/tests/3699670

But, I forgot to name the test suite properly: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/16/diffs (merged)

#12 Updated by SLindoMansilla 7 months ago

PR for cleaning up old main.pm schedule: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9185 (merged)

#13 Updated by mgriessmeier 6 months ago

  • Target version changed from Milestone 28 to Milestone 30

so i assume this is done?
anyway waiting for feedback in offline discussion

#14 Updated by SLindoMansilla 6 months ago

mgriessmeier wrote:

so i assume this is done?
anyway waiting for feedback in offline discussion

There is still work to be done (see sub tasks). We have only started scheduling the modules in dedicated test suites, but they are not yet verified properly and other modules still need to be split. I will create more sub-task each time I see a modules that should be moved out from extra_tests_* scenarios.

#15 Updated by SLindoMansilla 6 months ago

Test suite extra_tests_in_textmode_phub verified on OSD: https://openqa.suse.de/tests/3766991

Now it is time to remove those modules from extra_tests_in_textmode

#16 Updated by SLindoMansilla 6 months ago

Move passing test suites to main job group: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/20 (merged)

#17 Updated by SLindoMansilla 6 months ago

Waiting for verification run on OSD

#18 Updated by SLindoMansilla 6 months ago

Created new test suite extra_tests_in_textmode_cont

BOOT_HDD_IMAGE=1
DESKTOP=textmode
EXTRATEST=cont
HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2
START_AFTER_TEST=create_hdd_textmode
UEFI_PFLASH_VARS=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%-uefi-vars.qcow2

#19 Updated by SLindoMansilla 6 months ago

PR for extra_tests_in_textmode_cont: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9341 (merged)

#20 Updated by SLindoMansilla 5 months ago

  • Status changed from Workable to Feedback

Waiting for verification run on OSD

#21 Updated by SLindoMansilla 5 months ago

PR cleanup old extra_tests_on_gnome (ppc, x86): https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/33
PR rename extra_tests_in_textmode_sdk to extra_tests_textmode_sdk: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/34
PR rename extra_tests_in_textmode_cont to extra_tests_textmode_containers: https://gitlab.suse.de/qsf-u/qa-sle-functional-userspace/merge_requests/35

#22 Updated by SLindoMansilla 5 months ago

  • Status changed from Feedback to In Progress

#23 Updated by SLindoMansilla 3 months ago

Unschedule container tests from textmode suite: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9925

#25 Updated by SLindoMansilla 18 days ago

  • Due date set to 2020-06-22

due to changes in a related task: #68314

#26 Updated by SLindoMansilla 16 days ago

  • Has duplicate action #62303: [functional][u][qam] extra_tests_in_textmode run into MAX_JOB_TIME if some modules fail added

#27 Updated by zluo 15 days ago

  • Due date set to 2020-06-26

Grund: Änderung an zugehörigem Ticket: #68314

Also available in: Atom PDF