action #125705
closed[security] test fails in firefox_nss
100%
Description
Observation¶
The needle with tag "firefox-confirm-fips_enabled" is looking for a greyed-out "disable" option, while on the actual screen it is active (black).
openQA test in scenario sle-15-SP4-Server-DVD-Updates-s390x-fips_env_mode_Firefox@s390x-kvm-sle12 fails in
firefox_nss
Test suite description¶
Testsuite maintained at https://gitlab.suse.de/qe-security/osd-sle15-security.
Reproducible¶
Fails since (at least) Build 20230308-1
Expected result¶
Last good: 20230307-1 (or more recent)
Further details¶
Always latest result in this scenario: latest
Files
| Screenshot from 2023-03-09 17-05-47.png (102 KB) Screenshot from 2023-03-09 17-05-47.png | |||
| Screenshot from 2023-03-09 17-00-33.png (104 KB) Screenshot from 2023-03-09 17-00-33.png |
Updated by tjyrinki_suse over 1 year ago
- Priority changed from Normal to High
- Start date deleted (
2023-03-09)
Updated by amanzini over 1 year ago
- File Screenshot from 2023-03-09 17-05-47.png Screenshot from 2023-03-09 17-05-47.png added
- File Screenshot from 2023-03-09 17-00-33.png Screenshot from 2023-03-09 17-00-33.png added
first observation¶
run the test manually step-by-step, seems the entries in the "Security Modules and Devices" have a strange coloring issue, so likely the needle comparison isn't going to catch them (see screenshot)
Updated by amanzini over 1 year ago
Updated by amanzini over 1 year ago
- Status changed from New to Feedback
Updated by pstivanin over 1 year ago
- Status changed from Resolved to Feedback
the test seems to be shaky also on x86_64: https://openqa.suse.de/tests/10738794#next_previous
Updated by amanzini over 1 year ago
- Assignee deleted (
amanzini)
unassigning myself because I have too many opened tickets to handle at this time
Updated by amanzini over 1 year ago
- Status changed from Feedback to Workable
on some occasions seems firefox does not pick up the inserted password, need further investigation (see video for details)
Updated by pstivanin over 1 year ago
- Priority changed from High to Normal
lowering prio since it's not currently blocking maint updates
Updated by amanzini over 1 year ago
- Related to action #117010: [security] test fails in firefox_nss (fips_env_mode_Firefox_powervm) added
Updated by pstivanin over 1 year ago
- Status changed from Workable to In Progress
- Assignee set to pstivanin
Updated by pstivanin over 1 year ago
- % Done changed from 0 to 20
Test failed again on 15-SPx.
On 15-SP4, it seems that it's accepting a weak password when it shouldn't.
On <=15-SP3, it's just a matter of updating the needles.
Updated by pstivanin over 1 year ago
- % Done changed from 20 to 80
Updated by pstivanin over 1 year ago
- Status changed from In Progress to Resolved
- % Done changed from 80 to 100
Updated by pstivanin over 1 year ago
- Status changed from Resolved to In Progress
- % Done changed from 100 to 90
Updated by pstivanin over 1 year ago
for 15-sp4+, it's a bug that Firefox accepts any password when in env mode: https://bugzilla.suse.com/show_bug.cgi?id=1210078
Updated by pstivanin over 1 year ago
- Status changed from In Progress to Resolved
- % Done changed from 90 to 100
I'm quoting Dennis here:
env mode is mainly with application testing and setting single applications to fips mode. at the moment we officially support ONLY systems with kernel mode in fips, but we try to enable all the applications so that they work also with env/filesystem/userspace-fips-mode.
therefore I'm unscheduling (https://gitlab.suse.de/qe-security/osd-sle15-security/-/merge_requests/85/diffs) fips_env_mode_Firefox on 15-SP4 maintenance until the bug on the previous post is fixed.