Project

General

Profile

Actions

action #177528

closed

[qe-core] New testsuite - System Management TestSuite

Added by mgrifalconi about 2 months ago. Updated 19 days ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
New test
Start date:
2025-02-19
Due date:
% Done:

0%

Estimated time:
Difficulty:
Sprint:
QE-Core: March Sprint 25 (Mar 03 - Mar 28)

Description

Context:
https://jira.suse.com/browse/PED-11904
https://jira.suse.com/browse/PED-11906

Salt and Ansible will be provided in this new free "System Management Module".
The idea is also to remove in future Salt and Ansible from the main distribution.
In future additional packages may come there.

Idea:

  • Create new "System Management" testsuite
  • Create new perl module to add the new module
  • Schedule: Boot from desktop, add "System Management" (if present), test Ansible, test Salt
  • Make sure that ansible/salt tests use the packages from the module (if installed) and not the one of the base distro (if different)
  • Schedule it for both Functional and maintenance in place of current salt/ansible in mau-extratest or other places.

If other ways or ideas comes up, let's chat about it!

AC:

  • Validation runs green
  • PR merged
Actions #1

Updated by mgrifalconi about 2 months ago

  • Subject changed from [qe-core] System Management TestSuite to [qe-core] New Test - System Management TestSuite
Actions #2

Updated by mgrifalconi about 2 months ago

  • Subject changed from [qe-core] New Test - System Management TestSuite to [qe-core] New testsuite - System Management TestSuite
Actions #4

Updated by mgrifalconi about 1 month ago

  • Project changed from 46 to openQA Tests (public)
  • Category set to New test
Actions #5

Updated by Xiaojing_liu about 1 month ago

  • Assignee set to Xiaojing_liu
Actions #6

Updated by Xiaojing_liu about 1 month ago

  • Status changed from New to In Progress
Actions #8

Updated by Xiaojing_liu 27 days ago

  • Status changed from In Progress to Feedback

PR and MR have been merged. For build 77.5, the results are expected.

Actions #9

Updated by mgrifalconi 26 days ago

Thank you for the hard work! That's great to have the new module available by default!

Right now, functional tests run ansible in "extra_tests_textmode_phub" but the Ansible tested is from System Management module and not PackageHub is this is not very intuitive. Also the test is still adding packagehub, is it really needed for 15SP7?

Could you please try the following?

  • check if we can run ansible and salt test without phub and with just the system management module. If all works fine, put the addition of packagehub in a condition only for older SLE versions
  • move ansible from "extra_tests_textmode_phub" to a new schedule/test-suite "extra_tests_textmode_sysmm" (or whatever short version of system management module you like the most :) )
  • in this new testsuite I would also run console/salt if it works out
Actions #10

Updated by Xiaojing_liu 26 days ago

  • Status changed from Feedback to In Progress
Actions #11

Updated by Xiaojing_liu 22 days ago

PR for moving ansible out of packagehub test: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/21553

Actions #12

Updated by Xiaojing_liu 22 days ago

  • Status changed from In Progress to Feedback
Actions #13

Updated by mgrifalconi 20 days ago

Hello, I think something is still missing from the previous message, or did I miss some other PR?
Ansible was removed from "extra_tests_textmode_phub" but the new test suite to run ansible and salt is still missing, right? So ansible and salt are not scheduled anymore now in functional?

Actions #14

Updated by Xiaojing_liu 20 days ago

mgrifalconi wrote in #note-13:

Hello, I think something is still missing from the previous message, or did I miss some other PR?
Ansible was removed from "extra_tests_textmode_phub" but the new test suite to run ansible and salt is still missing, right? So ansible and salt are not scheduled anymore now in functional?

I move ansible to the place where salt already there: https://openqa.suse.de/tests/17169335

Here my reasons:

  1. salt is already these jobs, and ansible only runtime is less than 1 min, so put them together doesn't make the job runtime much more longer.
  2. systems-management is default enabled when installing 15-SP7, so I think it don't need to split a single job for it.

I change that in above PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/21553, there is no other pr.

We discussed it in the daily meeting, seems there is some misunderstanding here. But if this solution doesn't make sense, feel free to ping me. I can adjust it :)

Actions #15

Updated by mgrifalconi 20 days ago

I missed the part about cryptlvm_minimal_x, sorry!
I would still have ansible and salt into extratests_textmode. "cryptlvm_minimal_x" is for a very special case and would like to have them also in the 'main place' for all generic tests.

About the issue on 15-SP7 still adding desktop, maybe you can try to change is_sle('<15.7') with is_sle('<15-SP7'). I think the dot only works for Leap.

Actions #16

Updated by mgrifalconi 19 days ago

  • Status changed from Feedback to Resolved

Allright, clarified in the chat. The fix for the sle version is done and we can keep the current scheduling! I might create a PR later to add it on extratests too but it is already running in lots of jobs because of main.pm scheduling!

Thank you!

Actions

Also available in: Atom PDF