Project

General

Profile

Actions

coordination #91383

closed

[security][epic] tracker poo for "Lynis test cases softfails in OpenQA"

Added by llzhao over 3 years ago. Updated 7 days ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
Enhancement to existing tests
Target version:
-
Start date:
2021-04-20
Due date:
% Done:

100%

Estimated time:
(Total: 80.00 h)
Difficulty:

Description

Since the implementation of Lynis (poo#78224 - [sle][security][sle15sp3] Integrate the Lynis scanner into OpenQA)
there will be some softfails (warnings and similar status in the outputs of lynis).
So open this parent poo to track those issues.
Open sub poos to enhance test code if needed.

Set it to low priority.


Subtasks 6 (0 open6 closed)

action #91386: [sle][security][sle15sp3] Lynis: update the softfail poo since it is resolvedResolvedllzhao2021-04-20

Actions
action #92473: [sle][security][sle15sp3] Lynis: fix softfailure on "Software_firewalls"Resolvedllzhao2021-05-11

Actions
action #104851: [Tumbleweed][security][backlog] test fails in 4_[+]_Boot_and_services: baselines need updateResolvedllzhao2022-01-13

Actions
action #104854: [Tumbleweed][security][backlog] test fails in 39_[+]_File_Permissions: baselines need updateResolvedllzhao2022-01-13

Actions
action #104859: [Tumbleweed][security][backlog] test fails in 45_[+]_Binary_integrity: test code need enhance to ignore executables' changeable numberResolvedllzhao2022-01-13

Actions
action #108314: [sle][security][sle15sp4] Lynis: update the baselines accordingly to bsc#1193804 (lynis updated from "2.6.1" to "3.0.6")Resolvedllzhao2022-03-15

Actions

Related issues 1 (0 open1 closed)

Related to openQA Tests (public) - action #92614: [Tumbleweed][security] test fails in 4_[+]_Boot_and_servicesResolvedllzhao2021-05-12

Actions
Actions #1

Updated by llzhao over 3 years ago

  • Status changed from New to In Progress
Actions #2

Updated by llzhao over 3 years ago

  • Related to action #92614: [Tumbleweed][security] test fails in 4_[+]_Boot_and_services added
Actions #3

Updated by llzhao over 3 years ago

  • Subject changed from [sle][security][sle15sp3] tracker poo for "Lynis test cases softfails in OpenQA" to [sle][security][sle15sp4] tracker poo for "Lynis test cases softfails in OpenQA"
Actions #4

Updated by okurz over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_textmode
https://openqa.opensuse.org/tests/1769064

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed
Actions #5

Updated by okurz over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.opensuse.org/tests/1769066

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed
Actions #6

Updated by llzhao over 3 years ago

  • Status changed from In Progress to Feedback
Actions #7

Updated by okurz over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.opensuse.org/tests/1803649

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions #8

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.suse.de/tests/6305532

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions #9

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.opensuse.org/tests/1854600

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions #10

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.suse.de/tests/6305532

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions #12

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.opensuse.org/tests/1897764

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions #13

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.opensuse.org/tests/1919545

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #14

Updated by okurz over 3 years ago

@Lili Zhao hi, do you need help to understand the openqa-review reminder comments here ?

Actions #15

Updated by llzhao over 3 years ago

@oliver:
This poo is a parent and tracker poo to track soft failures in Lynis testings:

I opened this poo aim to use this parent poo to track the soft failure in the future for convenience,
and will open new sub poo(s) to fix the soft failure if needed/confirmed.

Lynis scanner/testing might output some "WARNING,EXPOSED,SUGGESTION" status (distinct with "ERROR,UNSAFE,WEAK", these status will report "failed" directly in openQA code) I marked this as "record_soft_failure" in code for a "Heads up".

Actions #16

Updated by okurz over 3 years ago

I understand. This does not prevent reminder comments though

Actions #17

Updated by llzhao over 3 years ago

okurz wrote:

I understand. This does not prevent reminder comments though

Yes, but we are OK with the reminders as we know what we are doing.
Thanks Oliver for your reminder :).

Actions #18

Updated by openqa_review about 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.suse.de/tests/7274344

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #19

Updated by openqa_review about 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.opensuse.org/tests/1981628

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #20

Updated by openqa_review about 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.opensuse.org/tests/2014085

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #21

Updated by openqa_review about 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.suse.de/tests/7655556

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #22

Updated by openqa_review about 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.suse.de/tests/7757080

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #23

Updated by openqa_review about 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.opensuse.org/tests/2087189

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #24

Updated by openqa_review almost 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.opensuse.org/tests/2115752

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #25

Updated by openqa_review almost 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.opensuse.org/tests/2158678

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #26

Updated by llzhao over 2 years ago

  • Subject changed from [sle][security][sle15sp4] tracker poo for "Lynis test cases softfails in OpenQA" to [sle][security][backlog] tracker poo for "Lynis test cases softfails in OpenQA"
Actions #27

Updated by rfan1 over 2 years ago

  • Assignee changed from llzhao to pstivanin
Actions #28

Updated by pstivanin over 2 years ago

  • Assignee deleted (pstivanin)
Actions #29

Updated by openqa_review over 2 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.suse.de/tests/8751978

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

Expect the next reminder at the earliest in 28 days if nothing changes in this ticket.

Actions #30

Updated by openqa_review over 2 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_textmode
https://openqa.suse.de/tests/9370665

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

Expect the next reminder at the earliest in 56 days if nothing changes in this ticket.

Actions #31

Updated by openqa_review about 2 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_textmode
https://openqa.suse.de/tests/9755675

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

Expect the next reminder at the earliest in 112 days if nothing changes in this ticket.

Actions #32

Updated by openqa_review almost 2 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_gnome
https://openqa.suse.de/tests/10445216

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

Expect the next reminder at the earliest in 224 days if nothing changes in this ticket.

Actions #33

Updated by tjyrinki_suse over 1 year ago

  • Tracker changed from action to coordination
Actions #34

Updated by tjyrinki_suse about 1 year ago

  • Subject changed from [sle][security][backlog] tracker poo for "Lynis test cases softfails in OpenQA" to [security][epic] tracker poo for "Lynis test cases softfails in OpenQA"
Actions #35

Updated by openqa_review about 1 year ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_textmode
https://openqa.suse.de/tests/13093742

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

Expect the next reminder at the earliest in 136 days if nothing changes in this ticket.

Actions #36

Updated by openqa_review 8 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: lynis_textmode
https://openqa.suse.de/tests/14183506

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

Expect the next reminder at the earliest in 272 days if nothing changes in this ticket.

Actions #37

Updated by tjyrinki_suse 7 days ago

  • Status changed from Feedback to Resolved
Actions

Also available in: Atom PDF