Project

General

Profile

Actions

coordination #73627

closed

[epic][qe-core][migration][functional] Move common-criteria pattern out of allpatterns tests

Added by fcrozat over 3 years ago. Updated about 2 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
Infrastructure
Target version:
-
Start date:
2020-10-21
Due date:
% Done:

100%

Estimated time:
(Total: 16.00 h)
Difficulty:

Description

Currently, test which install "all patterns" will also install common criteria pattern (patterns-certification-common-criteria).

This pattern is changing drastically how SLES system behaves regarding obtaining root privileges, using "su" or "polkit". This is causing test failures in openQA (https://bugzilla.suse.com/show_bug.cgi?id=1177446 and https://bugzilla.suse.com/show_bug.cgi?id=1177445 )

I would suggest to ensure patterns-certification-common-criteria pattern is NOT installed in the "all patterns" case (because it causes a change in default behaviour) and have a specific set of tests where patterns-certification-common-criteria is installed and tests are adapted to detected those "behaviour" changes. This would ensure CC pattern is really doing what it is supposed to do, without causing side effects on the "all patterns" testcase.


Subtasks 2 (0 open2 closed)

action #73645: [sle][migration][SLE15SP3] Remove common-criteria pattern for all patterns test Resolvedleli2020-10-21

Actions
action #75100: [functional][u] Remove post installation jobs from allpatterns scenariosResolvedszarate2020-10-22

Actions
Actions #1

Updated by maritawerner over 3 years ago

@weigao, I guess that will aslo affect migration tests.

Actions #2

Updated by szarate over 3 years ago

  • Subject changed from Move common-criteria pattern out of allpatterns tests to [u][migration][functional] Move common-criteria pattern out of allpatterns tests
  • Priority changed from Normal to High
Actions #3

Updated by leli over 3 years ago

  • Related to action #73645: [sle][migration][SLE15SP3] Remove common-criteria pattern for all patterns test added
Actions #4

Updated by szarate over 3 years ago

As this is kind of a legacy test scenario, and the real objective seems to be ensuring that packages don't conflict with each other, I just created: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/11252

I'll propose in the next grooming meeting of my functional team to move away from installation, and boot an installed system instead, enable all the modules and install all patterns where applicable, as this would be faster, than adapting the installation workflow to exclude CC pattern and the end result would be the same.

Actions #5

Updated by coolgw over 3 years ago

maritawerner wrote:

@weigao, I guess that will aslo affect migration tests.

@Marita we will check it and 73645 is for tracking this. Thanks for notification.

Actions #6

Updated by szarate over 3 years ago

  • Status changed from New to In Progress
  • Assignee set to szarate
Actions #7

Updated by szarate over 3 years ago

  • Status changed from In Progress to New
  • Assignee deleted (szarate)

Working on subtask, unasigning from this one.

Actions #8

Updated by tjyrinki_suse over 3 years ago

  • Subject changed from [u][migration][functional] Move common-criteria pattern out of allpatterns tests to [qe-core][migration][functional] Move common-criteria pattern out of allpatterns tests
Actions #9

Updated by leli over 3 years ago

Hi @szarate, will function team modify select_patterns related functions to support method to remove common-criteria pattern out of all patterns scenario? Currently it will make us hard to create SLES15SP2 qcow2 without common-criteria pattern for all patterns. Thanks.

Actions #10

Updated by tjyrinki_suse about 3 years ago

  • Status changed from New to Workable
Actions #11

Updated by tjyrinki_suse almost 3 years ago

  • Category set to Infrastructure
Actions #12

Updated by JERiveraMoya over 2 years ago

seen recently here (checking the video): https://openqa.suse.de/tests/7387546#step/first_boot/11

Actions #13

Updated by openqa_review over 2 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: select_modules_and_patterns
https://openqa.suse.de/tests/7508325

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #14

Updated by leli over 2 years ago

We have finished migration related subtask https://progress.opensuse.org/issues/73645

Actions #15

Updated by tjyrinki_suse about 2 years ago

  • Tracker changed from action to coordination
  • Subject changed from [qe-core][migration][functional] Move common-criteria pattern out of allpatterns tests to [epic][qe-core][migration][functional] Move common-criteria pattern out of allpatterns tests
Actions #16

Updated by tjyrinki_suse about 2 years ago

  • Status changed from Workable to Resolved
Actions #17

Updated by apappas about 2 years ago

This seems to have been resolved by both the migration and the security team.

Actions

Also available in: Atom PDF