action #49751
Updated by mgriessmeier about 5 years ago
## Observation openQA test in scenario sle-15-SP1-Installer-DVD-aarch64-textmode@aarch64 fails in [grub_test](https://openqa.suse.de/tests/2741749/modules/grub_test/steps/5) ## Test suite description Maintainer: okurz Installation in textmode and selecting the textmode "desktop" during installation. ## Acceptance criteria - **AC1:** The test module doesn't fail if we miss the grub or tianocore menu - **AC2:** There is better visualization for the reviewer if we miss one of those screens ## Suggestions * Wrap that assert_screeen inside an eval so that if it fails, we can still "try" to know if the system already booted by checking if the login string is already present in the serial console, if it is... either softfail or fail the grub_test ### early investigation This is an easy one, as in the logs the following messages can be seen, so basically the SUT was able to boot but isotovideo was not fast enough... ``` [2019-03-27T08:17:11.067 UTC] [debug] /var/lib/openqa/cache/openqa.suse.de/tests/sle/tests/installation/grub_test.pm:73 called utils::assert_screen_with_soft_timeout [2019-03-27T08:17:11.068 UTC] [debug] <<< testapi::check_screen(mustmatch='grub2', timeout=90) [2019-03-27T08:17:12.871 UTC] [debug] WARNING: check_asserted_screen took 1.80 seconds for 42 candidate needles - make your needles more specific [2019-03-27T08:17:12.871 UTC] [debug] no match: 89.9s, best candidate: bootmenu-SLE-HPC-20180603 (0.00) [2019-03-27T08:17:14.279 UTC] [debug] WARNING: check_asserted_screen took 1.33 seconds for 42 candidate needles - make your needles more specific [2019-03-27T08:17:14.279 UTC] [debug] no match: 88.1s, best candidate: bootmenu-SLE-HPC-20180603 (0.00) [2019-03-27T08:17:14.310 UTC] [debug] no change: 86.7s [2019-03-27T08:17:50.564 UTC] [debug] WARNING: check_asserted_screen took 35.28 seconds for 42 candidate needles - make your needles more specific [2019-03-27T08:17:50.565 UTC] [debug] no match: 85.7s, best candidate: bootmenu-SLE-HPC-20180603 (0.00) [2019-03-27T08:17:50.624 UTC] [debug] WARNING: There is some problem with your environment, we detected a stall for 35.7843849658966 seconds [2019-03-27T08:18:13.902 UTC] [debug] WARNING: check_asserted_screen took 23.24 seconds for 42 candidate needles - make your needles more specific [2019-03-27T08:18:13.914 UTC] [debug] no match: 50.4s, best candidate: bootmenu-SLE-HPC-20180603 (0.00) [2019-03-27T08:18:13.937 UTC] [debug] WARNING: There is some problem with your environment, we detected a stall for 23.3489730358124 seconds [2019-03-27T08:18:15.429 UTC] [debug] WARNING: check_asserted_screen took 1.45 seconds for 42 candidate needles - make your needles more specific [2019-03-27T08:18:15.429 UTC] [debug] no match: 27.0s, best candidate: bootmenu-SLE-HPC-20180603 (0.00) [2019-03-27T08:18:38.475 UTC] [debug] WARNING: check_asserted_screen took 23.00 seconds for 42 candidate needles - make your needles more specific [2019-03-27T08:18:38.488 UTC] [debug] no match: 25.5s, best candidate: bootmenu-SLE-HPC-20180603 (0.00) [2019-03-27T08:18:38.517 UTC] [debug] WARNING: There is some problem with your environment, we detected a stall for 23.0587909221649 seconds [2019-03-27T08:18:39.363 UTC] [debug] WARNING: check_asserted_screen took 0.80 seconds for 42 candidate needles - make your needles more specific [2019-03-27T08:18:39.364 UTC] [debug] no match: 2.5s, best candidate: bootmenu-SLE-HPC-20180603 (0.00) [2019-03-27T08:18:39.491 UTC] [debug] no change: 1.5s [2019-03-27T08:19:00.836 UTC] [debug] WARNING: check_asserted_screen took 20.34 seconds for 42 candidate needles - make your needles more specific [2019-03-27T08:19:00.849 UTC] [debug] no match: 0.5s, best candidate: bootmenu-SLE-HPC-20180603 (0.00) [2019-03-27T08:19:00.863 UTC] [debug] WARNING: There is some problem with your environment, we detected a stall for 20.4782309532166 seconds [2019-03-27T08:19:21.408 UTC] [debug] WARNING: check_asserted_screen took 20.52 seconds for 42 candidate needles - make your needles more specific [2019-03-27T08:19:22.816 UTC] [debug] >>> testapi::_check_backend_response: match=grub2 timed out after 90 (check_screen) ``` ## Reproducible Fails since (at least) Build [198.1](https://openqa.suse.de/tests/2741749) (current job) ## Expected result Last good: [196.1](https://openqa.suse.de/tests/2733909) (or more recent) ## Suggestions * Wrap that assert_screeen inside an eval so that if it fails, we can still "try" to know if the system already booted by checking if the login string is already present in the serial console, if it is... either softfail or fail the grub_test ## Further details Always latest result in this scenario: [latest](https://openqa.suse.de/tests/latest?flavor=Installer-DVD&arch=aarch64&distri=sle&test=textmode&version=15-SP1&machine=aarch64)