Project

General

Profile

Actions

action #116872

closed

[security] test fails sporadically in manually_add_profile

Added by punkioudi over 1 year ago. Updated over 1 year ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
Bugs in existing tests
Target version:
-
Start date:
2022-09-20
Due date:
% Done:

100%

Estimated time:
Difficulty:

Description

This tests fails sporadically here:

# Scan systemlog
send_key "alt-s";
assert_screen("AppArmor-Scan-system-log");

It seems that s is not being sent in all the cases properly, so it would be helpful to add a retry here.

Acceptance criteria

  1. Investigate the sporadic failure and check if a workaround can be applied
  2. Run multiple verification runs to make sure that this failure doesn't happen any more

Observation

openQA test in scenario sle-15-SP4-Server-DVD-Updates-x86_64-yast2_apparmor@64bit fails in
manually_add_profile

Test suite description

Testsuite maintained at https://gitlab.suse.de/qe-security/osd-sle15-security.

Reproducible

Fails since (at least) Build 20220919-2 (current job)

Expected result

Last good: 20220919-1 (or more recent)

Further details

Always latest result in this scenario: latest


Related issues 1 (0 open1 closed)

Related to openQA Tests - action #116764: [security] test fails in manually_add_profileResolvedpstivanin2022-09-19

Actions
Actions #1

Updated by punkioudi over 1 year ago

  • Priority changed from Normal to Urgent
Actions #2

Updated by pstivanin over 1 year ago

  • Assignee set to pstivanin
Actions #3

Updated by pstivanin over 1 year ago

The test has been really shaky. Looking at its history, it doesn't seem to fail always on the same point though.
This seems to be some slowness related issue. Looking into it.

Actions #5

Updated by pstivanin over 1 year ago

  • Related to action #116764: [security] test fails in manually_add_profile added
Actions #6

Updated by pstivanin over 1 year ago

  • % Done changed from 0 to 50
Actions #7

Updated by pstivanin over 1 year ago

I'm testing some changes. So far the run has been stable.

Actions #8

Updated by pstivanin over 1 year ago

  • % Done changed from 50 to 80

Test is running fine so far.

Actions #9

Updated by pstivanin over 1 year ago

  • Priority changed from Urgent to High

Lowering prio since the test has been stable.

Actions #10

Updated by pstivanin over 1 year ago

  • Status changed from New to In Progress
Actions #11

Updated by pstivanin over 1 year ago

The test failed again. What's weird is that the test is very shaky only on 15-SP4, on 15-SP3 it runs stable.

Actions #12

Updated by pstivanin over 1 year ago

  • % Done changed from 80 to 50

The same test in the devel space (https://openqa.suse.de/tests/9619790) has been running great so far. Could be some load related issue in prod?
I think the best solution here would be to move from the QT to the Ncurses ui.

Actions #13

Updated by pstivanin over 1 year ago

  • % Done changed from 50 to 90

I've rewritten the test. I'll let it run a couple of days in the devel project. After that, we'll move it to secmaint.

Actions #15

Updated by pstivanin over 1 year ago

  • Status changed from In Progress to Resolved
  • % Done changed from 90 to 100
Actions

Also available in: Atom PDF