Project

General

Profile

Actions
Copy link

action #92614

closed

[Tumbleweed][security] test fails in 4_[+]_Boot_and_services

Added by dimstar over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
High
Assignee:
llzhao
Category:
Bugs in existing tests
Target version:
-
Start date:
2021-05-12
Due date:
% Done:

100%

Estimated time:
8.00 h
Difficulty:

Description

Observation

openQA test in scenario opensuse-Tumbleweed-DVD-x86_64-lynis_gnome@64bit fails in
4_[+]_Boot_and_services

Test fails since the latest lynis upgrade:
https://build.opensuse.org/request/show/892267

Test suite description

Reproducible

Fails since (at least) Build 20210511 (current job)

Expected result

Last good: 20210510 (or more recent)

Further details

Always latest result in this scenario: latest

Related issues 1 (0 open — 1 closed)

Related to openQA Tests (public) - coordination #91383: [security][epic] tracker poo for "Lynis test cases softfails in OpenQA"Resolved2021-04-20

Actions
Actions
Copy link
 #1

Updated by llzhao over 3 years ago

  • Subject changed from test fails in 4_[+]_Boot_and_services to [Tumbleweed][security] test fails in 4_[+]_Boot_and_services
  • Assignee set to llzhao
  • Priority changed from Normal to High
  • Estimated time set to 8.00 h

Compared the baseline with current ouputs, baseline needs to be updated.

Actions
Copy link
 #2

Updated by llzhao over 3 years ago

  • Related to coordination #91383: [security][epic] tracker poo for "Lynis test cases softfails in OpenQA" added
Actions
Copy link
 #3

Updated by llzhao over 3 years ago

  • Status changed from New to In Progress
Actions
Copy link
 #4

Updated by llzhao over 3 years ago

  • % Done changed from 0 to 90

The baseline need to be revised according to new out put of "lynis" if the changes are safe.
PR Sent out: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/12527

Actions
Copy link
 #5

Updated by llzhao over 3 years ago

For the baseline changes please see https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/12527/files for more details.
e.g., version changes of Lynis
[ Lynis 3.0.3 ]
[ Lynis 3.0.4 ]

e.g., status changed form [ OK ] to [ PROTECTED ]
8C- systemd-journald.service: [ OK ]
- systemd-logind.service: [ OK ]
- systemd-journald.service: [ PROTECTED ]
- systemd-logind.service: [ PROTECTED ]

etc.

Actions
Copy link
 #6

Updated by llzhao over 3 years ago

Actions
Copy link
 #7

Updated by llzhao over 3 years ago

llzhao wrote:

There are random fails:
On latest build: https://openqa.opensuse.org/tests/1748514#step/4_[+]_Boot_and_services/4

Sent out another PR to fix the random fail: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/12552

Actions
Copy link
 #8

Updated by llzhao over 3 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 90 to 100

All PRs are merged and test case passed in O3: https://openqa.opensuse.org/tests/1748850#step/4_[+]_Boot_and_services/6

Actions
Copy link
 #9

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.opensuse.org/tests/1824153

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions
Copy link

Also available in: Atom PDF