Project

General

Profile

Actions
Copy link

action #173860

closed

[security][maint] test fails in misc

Added by amanzini 13 days ago. Updated 8 days ago.

Status:
Resolved
Priority:
High
Assignee:
pstivanin
Category:
Bugs in existing tests
Target version:
-
Start date:
2024-12-06
Due date:
% Done:

100%

Estimated time:
6.00 h
Difficulty:

Description

Observation

openQA test in scenario sle-15-SP5-Server-DVD-Updates-x86_64-cc_audit-test@64bit fails in
misc

Test suite description

Testsuite maintained at https://gitlab.suse.de/qe-security/osd-sle15-security.

Reproducible

Fails since (at least) Build 20241205-1

Expected result

Last good: 20241204-1 (or more recent)

Further details

Always latest result in this scenario: latest

on latest build, cc_audit-test consistently failing on the "misc" module (15SP3, 15SP4, 15SP5). Please investigate and report any product bug

Actions
Copy link
 #1

Updated by amanzini 13 days ago

  • Subject changed from [securitytest fails in misc to [security][maint] test fails in misc
  • Description updated (diff)
  • Priority changed from Normal to High
Actions
Copy link
 #2

Updated by pstivanin 10 days ago

  • Status changed from New to In Progress
  • Assignee set to pstivanin
Actions
Copy link
 #3

Updated by pstivanin 10 days ago

  • % Done changed from 0 to 20
  • Estimated time set to 16.00 h

It's happening only on 15-SP{3,4,5} and only on aarch64 and x86_64.

I couldn't find any SR that could have caused the issue.

Still investigating what has happened on the 5th of December.

Actions
Copy link
 #4

Updated by pstivanin 10 days ago ยท Edited

  • Status changed from In Progress to Resolved
  • % Done changed from 20 to 100
  • Estimated time changed from 16.00 h to 4.00 h
Actions
Copy link
 #5

Updated by pstivanin 10 days ago

  • Status changed from Resolved to In Progress
  • % Done changed from 100 to 20
  • Estimated time changed from 4.00 h to 16.00 h
Actions
Copy link
 #6

Updated by pstivanin 10 days ago

The issue is within select_console. Don't know yet why this is happening though. On the module (crypto) before that, we can see that select_console is working as intented:

[2024-12-09T07:38:55.361911Z] [debug] [pid:12411] ||| starting crypto tests/security/cc/crypto.pm
[2024-12-09T07:38:55.362853Z] [debug] [pid:12411] tests/security/cc/crypto.pm:20 called testapi::select_console
[2024-12-09T07:38:55.362991Z] [debug] [pid:12411] <<< testapi::select_console(testapi_console="root-console")
[2024-12-09T07:38:55.767391Z] [debug] [pid:12411] activate_console, console: root-console, type: console
[2024-12-09T07:38:55.767839Z] [debug] [pid:12411] tests/security/cc/crypto.pm:20 called testapi::select_console -> lib/susedistribution.pm:872 called testapi::wait_still_screen
[2024-12-09T07:38:55.768029Z] [debug] [pid:12411] <<< testapi::wait_still_screen(stilltime=6, timeout=30, similarity_level=47)
[2024-12-09T07:39:02.403785Z] [debug] [pid:12411] >>> testapi::wait_still_screen: detected same image for 6 seconds (6.62766408920288 s elapsed), last detected similarity is 1000000
[2024-12-09T07:39:02.404039Z] [debug] [pid:12411] tests/security/cc/crypto.pm:20 called testapi::select_console -> lib/susedistribution.pm:877 called testapi::assert_screen
[2024-12-09T07:39:02.404301Z] [debug] [pid:12411] <<< testapi::assert_screen(mustmatch=[
    "tty6-selected",
    "text-logged-in-root"
  ], timeout=60)
[2024-12-09T07:39:02.628004Z] [debug] [pid:12411] >>> testapi::_handle_found_needle: found text-login-20230404, similarity 1.00 @ 72/129

while on the misc module, it is not:

[2024-12-09T07:57:18.982820Z] [debug] [pid:12411] ||| starting misc tests/security/cc/misc.pm
[2024-12-09T07:57:18.983909Z] [debug] [pid:12411] tests/security/cc/misc.pm:20 called testapi::select_console
[2024-12-09T07:57:18.984037Z] [debug] [pid:12411] <<< testapi::select_console(testapi_console="root-console")
[2024-12-09T07:57:19.396389Z] [debug] [pid:12411] tests/security/cc/misc.pm:20 called testapi::select_console -> lib/susedistribution.pm:1012 called testapi::assert_screen
[2024-12-09T07:57:19.396667Z] [debug] [pid:12411] <<< testapi::assert_screen(mustmatch="root-console", no_wait=1, timeout=30)
Actions
Copy link
 #7

Updated by pstivanin 10 days ago

  • Status changed from In Progress to Resolved
  • % Done changed from 20 to 100
  • Estimated time changed from 16.00 h to 6.00 h

Issue presented because the console was activated and reused, but we restore a snapshot so we need to reset the console in order to trigger the active_console sub.

PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/20761

Actions
Copy link

Also available in: Atom PDF