Project

General

Profile

coordination #73627

[epic][qe-core][migration][functional] Move common-criteria pattern out of allpatterns tests

Added by fcrozat over 2 years ago. Updated about 1 year ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
Infrastructure
Target version:
-
Start date:
2020-10-21
Due date:
% Done:

100%

Estimated time:
(Total: 16.00 h)
Difficulty:

Description

Currently, test which install "all patterns" will also install common criteria pattern (patterns-certification-common-criteria).

This pattern is changing drastically how SLES system behaves regarding obtaining root privileges, using "su" or "polkit". This is causing test failures in openQA (https://bugzilla.suse.com/show_bug.cgi?id=1177446 and https://bugzilla.suse.com/show_bug.cgi?id=1177445 )

I would suggest to ensure patterns-certification-common-criteria pattern is NOT installed in the "all patterns" case (because it causes a change in default behaviour) and have a specific set of tests where patterns-certification-common-criteria is installed and tests are adapted to detected those "behaviour" changes. This would ensure CC pattern is really doing what it is supposed to do, without causing side effects on the "all patterns" testcase.


Subtasks

action #73645: [sle][migration][SLE15SP3] Remove common-criteria pattern for all patterns test Resolvedleli

action #75100: [functional][u] Remove post installation jobs from allpatterns scenariosResolvedszarate

History

#1 Updated by maritawerner over 2 years ago

@weigao, I guess that will aslo affect migration tests.

#2 Updated by szarate over 2 years ago

  • Subject changed from Move common-criteria pattern out of allpatterns tests to [u][migration][functional] Move common-criteria pattern out of allpatterns tests
  • Priority changed from Normal to High

#3 Updated by leli over 2 years ago

  • Related to action #73645: [sle][migration][SLE15SP3] Remove common-criteria pattern for all patterns test added

#4 Updated by szarate over 2 years ago

As this is kind of a legacy test scenario, and the real objective seems to be ensuring that packages don't conflict with each other, I just created: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/11252

I'll propose in the next grooming meeting of my functional team to move away from installation, and boot an installed system instead, enable all the modules and install all patterns where applicable, as this would be faster, than adapting the installation workflow to exclude CC pattern and the end result would be the same.

#5 Updated by coolgw over 2 years ago

maritawerner wrote:

@weigao, I guess that will aslo affect migration tests.

@Marita we will check it and 73645 is for tracking this. Thanks for notification.

#6 Updated by szarate over 2 years ago

  • Status changed from New to In Progress
  • Assignee set to szarate

#7 Updated by szarate over 2 years ago

  • Status changed from In Progress to New
  • Assignee deleted (szarate)

Working on subtask, unasigning from this one.

#8 Updated by tjyrinki_suse about 2 years ago

  • Subject changed from [u][migration][functional] Move common-criteria pattern out of allpatterns tests to [qe-core][migration][functional] Move common-criteria pattern out of allpatterns tests

#9 Updated by leli about 2 years ago

Hi szarate, will function team modify select_patterns related functions to support method to remove common-criteria pattern out of all patterns scenario? Currently it will make us hard to create SLES15SP2 qcow2 without common-criteria pattern for all patterns. Thanks.

#10 Updated by tjyrinki_suse almost 2 years ago

  • Status changed from New to Workable

#11 Updated by tjyrinki_suse almost 2 years ago

  • Category set to Infrastructure

#12 Updated by JERiveraMoya over 1 year ago

seen recently here (checking the video): https://openqa.suse.de/tests/7387546#step/first_boot/11

#13 Updated by openqa_review over 1 year ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: select_modules_and_patterns
https://openqa.suse.de/tests/7508325

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

#14 Updated by leli about 1 year ago

We have finished migration related subtask https://progress.opensuse.org/issues/73645

#15 Updated by tjyrinki_suse about 1 year ago

  • Tracker changed from action to coordination
  • Subject changed from [qe-core][migration][functional] Move common-criteria pattern out of allpatterns tests to [epic][qe-core][migration][functional] Move common-criteria pattern out of allpatterns tests

#16 Updated by tjyrinki_suse about 1 year ago

  • Status changed from Workable to Resolved

#17 Updated by apappas about 1 year ago

This seems to have been resolved by both the migration and the security team.

Also available in: Atom PDF