Project

General

Profile

Actions

action #119620

closed

[security][QU] test fails in scap_workbench

Added by punkioudi over 1 year ago. Updated about 1 year ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
Bugs in existing tests
Target version:
-
Start date:
2022-10-31
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Test fails when it is waiting for the needle: assert_and_click('scap-workbench-Diagnostics-Close', timeout => 300);
In the previous build (168.1) this needle was there: https://openqa.suse.de/tests/9815387#step/scap_workbench/71

In the investigation tab, it seems that a retry passed: https://openqa.suse.de/tests/9843079

Acceptance criteria

  1. Investigate if it is a regression or not
  2. Open a bug if it's not an expected behavior, or correct the test if needed

Observation

openQA test in scenario sle-15-SP4-Online-QR-x86_64-scap_workbench@64bit fails in
scap_workbench

Test suite description

Testsuite maintained at https://gitlab.suse.de/qe-security/osd-sle15-security.

Reproducible

Fails since (at least) Build 170.2

Expected result

Last good: 168.1 (or more recent)

Further details

Always latest result in this scenario: latest


Files

Screenshot from 2023-04-24 11-43-48.png (353 KB) Screenshot from 2023-04-24 11-43-48.png comparison of successful - failed run amanzini, 2023-04-24 09:44
Actions #1

Updated by punkioudi over 1 year ago

  • Description updated (diff)
Actions #2

Updated by amanzini over 1 year ago

  • Assignee set to amanzini
Actions #3

Updated by amanzini over 1 year ago

  • Status changed from New to Feedback

fixed needle, now passing https://openqa.suse.de/tests/9892660

Actions #4

Updated by amanzini over 1 year ago

  • Status changed from Feedback to Resolved
Actions #5

Updated by openqa_review about 1 year ago

  • Status changed from Resolved to Feedback

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: scap_workbench
https://openqa.suse.de/tests/10463365#step/scap_workbench/1

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

Expect the next reminder at the earliest in 28 days if nothing changes in this ticket.

Actions #7

Updated by amanzini about 1 year ago

  • Status changed from Feedback to Resolved
Actions #8

Updated by openqa_review about 1 year ago

  • Status changed from Resolved to Feedback

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: scap_workbench
https://openqa.suse.de/tests/10958769#step/scap_workbench/1

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

Expect the next reminder at the earliest in 28 days if nothing changes in this ticket.

Actions #10

Updated by amanzini about 1 year ago

according to diagnostic logs, SUT is lacking of memory resources. Will increase "QEMURAM" from 1024 to 2048 and check

free -h
              total        used        free      shared  buff/cache   available
Mem:          962Mi       759Mi        61Mi       8.0Mi       287Mi       203Mi
Swap:         2.0Gi       596Mi       1.4Gi
Actions #11

Updated by amanzini about 1 year ago

  • Status changed from Feedback to In Progress
Actions #12

Updated by amanzini about 1 year ago

with QEMURAM=3072 it looks promising:


https://openqa.suse.de/tests/10985247              passed
https://openqa.suse.de/tests/10985248              passed
https://openqa.suse.de/tests/10985249              passed
https://openqa.suse.de/tests/10985250              passed
https://openqa.suse.de/tests/10985251              passed
https://openqa.suse.de/tests/10985252              passed
https://openqa.suse.de/tests/10985253              passed
https://openqa.suse.de/tests/10985254              passed
https://openqa.suse.de/tests/10985255              passed
https://openqa.suse.de/tests/10985256              passed
https://openqa.suse.de/tests/10985292              passed
https://openqa.suse.de/tests/10985293              passed
https://openqa.suse.de/tests/10985294              passed
https://openqa.suse.de/tests/10985295              passed
https://openqa.suse.de/tests/10985296              passed
https://openqa.suse.de/tests/10985297              passed
https://openqa.suse.de/tests/10985298              passed
https://openqa.suse.de/tests/10985299              passed
https://openqa.suse.de/tests/10985300              passed
https://openqa.suse.de/tests/10985301              passed
https://openqa.suse.de/tests/10985302              passed
https://openqa.suse.de/tests/10985303              passed
https://openqa.suse.de/tests/10985304              passed
https://openqa.suse.de/tests/10985305              passed
https://openqa.suse.de/tests/10985306              passed
https://openqa.suse.de/tests/10985307              passed
https://openqa.suse.de/tests/10985308              passed
https://openqa.suse.de/tests/10985309              passed
https://openqa.suse.de/tests/10985310              passed
https://openqa.suse.de/tests/10985311              passed

Actions #14

Updated by amanzini about 1 year ago

  • Status changed from In Progress to Feedback
Actions #15

Updated by amanzini about 1 year ago

  • Status changed from Feedback to Resolved
Actions

Also available in: Atom PDF