Project

General

Profile

Actions

action #23752

closed

[sle][functional] refactor scc_allmodules in one test suite

Added by jorauch over 7 years ago. Updated about 7 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Bugs in existing tests
Start date:
Due date:
2017-10-25
% Done:

100%

Estimated time:
Difficulty:

Description

Observation

Suggestions

  • DONE: Combine the scc+all_modules test suites for all architectures in one suite by adapting the parameters in the main.pm -> gh#os-autoinst/os-autoinst-distri-opensuse#3486
  • handle the setting of PATTERNS like we did for SCC_ADDONS
  • remove setting PATTERNS in the test suite
  • DONE: enable all other modules for SLE15
  • check textmode where we don't use assert_and_click

Further details

Always latest result in this scenario: latest


Related issues 1 (0 open1 closed)

Copied from openQA Tests (public) - action #23506: [sle][functional]test fails in addon_products_sle, trying to continue with empty regcodeResolvedokurz2017-08-25

Actions
Actions #1

Updated by jorauch over 7 years ago

  • Copied from action #23506: [sle][functional]test fails in addon_products_sle, trying to continue with empty regcode added
Actions #2

Updated by jorauch over 7 years ago

  • Priority changed from High to Normal

PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3479
Delete the aarch64 test suite and add aarch64 to the scc+allmodules test suite

Actions #3

Updated by jorauch over 7 years ago

  • Assignee set to jorauch
Actions #4

Updated by jorauch over 7 years ago

Clone verification run for SP12 on each architecture, TEST="Verfication poo#23752"

Actions #6

Updated by okurz over 7 years ago

  • Description updated (diff)

gh#os-autoinst/os-autoinst-distri-opensuse#3486

I deleted the testsuite "gnome+proxy_SCC+allmodules_aarch64" and added "gnome+proxy_SCC+allmodules@aarch64" to the schedules of SLE 12 SP3 (for reference) and SLE 15. I added the parameter ENABLE_ALL_SCC_MODULES=1 to the test suite and deleted the setting of SCC_ADDONS.

I triggered tests for x86_64 and aarch64:

openqa_clone_job_osd 1130770 ENABLE_ALL_SCC_MODULES=1 SCC_ADDONS=

-> https://openqa.suse.de/t1134927 now failing in product bug (license can not be downloaded)

openqa_clone_job_osd 1130492 ENABLE_ALL_SCC_MODULES=1 SCC_ADDONS= TEST=gnome+proxy_SCC+allmodules

-> https://openqa.suse.de/t1134932 still failing in bsc#1054375

IMHO we still need to care about PATTERNS=default,asmm,pcm which is set in the testsuite which is architecture and version specific, @jorauch: Can you handle the setting of PATTERNS like we did for SCC_ADDONS?

I added more tasks to the ticket description.

Actions #7

Updated by okurz over 7 years ago

  • Description updated (diff)

https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3489 should handle all modules, triggered test as https://openqa.suse.de/tests/1134952 on production (still running)

Actions #8

Updated by okurz over 7 years ago

  • Target version set to Milestone 11
Actions #9

Updated by okurz about 7 years ago

  • Due date set to 2017-10-25
Actions #10

Updated by jorauch about 7 years ago

Looks like the textmode suite is not run anymore, can we consider this task as completed then?
Patterns need further investigation

Actions #11

Updated by jorauch about 7 years ago

  • Status changed from In Progress to Resolved

Deleted PATTERNS in SCC+allmodules test suite because it is already handled in main.pm for all versions.

Actions

Also available in: Atom PDF