[sle][functional][y][medium] test fails in snapper_undochange - console screen is not clear and it leads to problem with needle match
|Category:||Bugs in existing tests|
|Target version:||QA - future|
compare with previous successful test run, I found needle snapper-emergency-shell cannot be matched because on top of console still remains some lines.
https://openqa.suse.de/tests/1679964#step/snapper_undochange/21 shows correct match.
openQA test in scenario sle-15-Installer-DVD-x86_64-extra_tests_filesystem@64bit fails in
Fails since (at least) Build 617.5
Last good: 611.1 (or more recent)
Always latest result in this scenario: latest
Investigate enabling of audit.d and see if we can disable it.
Instead of asserting the needle, look for the string in the serial output as pattern.
#3 Updated by mloviska almost 2 years ago
#5 Updated by JERiveraMoya over 1 year ago
- Subject changed from [sle][functional][u] test fails in snapper_undochange - console screen is not clear and it leads to problem with needle match to [sle][functional][u][medium] test fails in snapper_undochange - console screen is not clear and it leads to problem with needle match
- Description updated (diff)
- Difficulty set to medium
#9 Updated by clanig over 1 year ago
My progress so far:
1. The issue is located at the btrfs_test.pm which is used by several test cases.
2. I have been able to shift the check whether the correct shell spawns to the virtual serial console on the test machine. But testing continues on this serial console so I can't just switch back somewhere and everything is fine.
3. That causes another issue that the color tag isn't interpreted anymore so it's just passed through and waiting for the console, it can't match with "# " anymore so I had to add an alternative matching pattern in distribution.pm of the os-autoinst project on the test machine. When it turns out that this is a general issue with the serial console there should be all cases of patterns covered that can happen. I will investigate this later.
4. Switching to the serial console also broke some other checks. I am going to address these issues firstly.
Generally I hugely prefer matching patterns on the serial output instead of using needles whenever possible. Even for those needles that are currently working acceptably.
#11 Updated by clanig over 1 year ago
I have created a pull request and it would be nice to get some feedback. For the automated serial console login there is already covered that the PS1-String is printed with ascii formatting chars. But this standard subroutine didn't work with the rescue.target shell so I target this only in the btrfs_test.pm. In case more tests need to switch to this shell it would make sense to make the standard login procedure capable to login there as well. That's just my opinion on it.
#18 Updated by okurz about 1 year ago
- Subject changed from [sle][functional][u][medium] test fails in snapper_undochange - console screen is not clear and it leads to problem with needle match to [sle][functional][y][medium] test fails in snapper_undochange - console screen is not clear and it leads to problem with needle match
I think "snapper" is more fitting for QSF-y
#19 Updated by riafarov about 1 year ago
- Status changed from New to Rejected
- Assignee set to riafarov
Seems that this got solved by some other changes: https://openqa.suse.de/tests/2419634#step/snapper_undochange/1
Looks pretty stable.