Project

General

Profile

Actions
Copy link

action #169414

closed

coordination #169657: [epic] Handle test fixes and adjustments

Fix sporadic fails in disable_boot_menu_timeout

Added by rainerkoenig about 1 month ago. Updated 11 days ago.

Status:
Resolved
Priority:
Normal
Assignee:
lmanfredi
Target version:
-
Start date:
2024-11-06
Due date:
% Done:

0%

Estimated time:
Tags:
qe-yam-nov-sprint

Description

Motivation

openQA test in scenario sle-15-SP7-Online-x86_64-lvm+RAID1@64bit fails in
disable_boot_menu_timeout

Additional info

Comparing the yui-log.txt beetween good and fail shows one intesting difference:

Good yui-log.txt

[2024-10-31T15:17:04.145055Z] [info] [pid:4907] disable_boot_menu_timeout test module started
270 [2024-10-31T15:17:04.145921Z] [debug] [pid:4907] Finding widget by url: http://localhost:39124/v1/widgets?id=proposal
271 [2024-10-31T15:17:05.149971Z] [debug] [pid:4907] Sending action to widget by url: http://localhost:39124/v1/widgets?action=select&id=proposal&value=bootloader_stuff
272 [2024-10-31T15:17:06.172149Z] [error] [pid:4907] Widget not found by url: http://localhost:39124/v1/widgets?action=select&id=proposal&value=bootloader_stuff
273 [2024-10-31T15:17:08.176762Z] [debug] [pid:4907] Finding widget by url: http://localhost:39124/v1/widgets
274 [2024-10-31T15:17:09.180816Z] [debug] [pid:4907] Finding widget by url: http://localhost:39124/v1/widgets?id=%22Bootloader%3A%3ALoaderTypeWidget%22
275 [2024-10-31T15:17:10.183594Z] [debug] [pid:4907] Finding widget by url: http://localhost:39124/v1/widgets?id=%22CWM%3A%3ADumbTabPager%22
276 [2024-10-31T15:17:11.186422Z] [debug] [pid:4907] Sending action to widget by url: http://localhost:39124/v1/widgets?action=select&id=%22CWM%3A%3ADumbTabPager%22&value=Boo%26tloader+Options

Bad yui-log.txt

[2024-11-05T13:03:38.398279Z] [info] [pid:40042] disable_boot_menu_timeout test module started
270 [2024-11-05T13:03:38.399043Z] [debug] [pid:40042] Finding widget by url: http://localhost:39105/v1/widgets?id=proposal
271 [2024-11-05T13:03:39.401598Z] [debug] [pid:40042] Sending action to widget by url: http://localhost:39105/v1/widgets?action=select&id=proposal&value=bootloader_stuff
272 [2024-11-05T13:03:40.408439Z] [debug] [pid:40042] Finding widget by url: http://localhost:39105/v1/widgets
273 [2024-11-05T13:03:41.411789Z] [debug] [pid:40042] Finding widget by url: http://localhost:39105/v1/widgets
274 [2024-11-05T13:03:42.415015Z] [debug] [pid:40042] Finding widget by url: http://localhost:39105/v1/widgets?id=%22CWM%3A%3ADumbTabPager%22
275 [2024-11-05T13:03:43.417584Z] [error] [pid:40042] Widget not found by url: http://localhost:39105/v1/widgets?id=%22CWM%3A%3ADumbTabPager%22

See the difference in line 273 and 274. In the failed log we don't see Finding widget by url: http://localhost:39124/v1/widgets?id=%22Bootloader%3A%3ALoaderTypeWidget%22.
This log entry should be created when the YaST::Bootloader::BootCodeOptionsPage::is_shown() method is executed, so if we don't see this messages something is definitely off track.

Acceptance critera

  • AC1: Root cause identified and fixed.
Actions
Copy link
 #1

Updated by JERiveraMoya about 1 month ago

  • Tags set to qe-yam-nov-sprint
  • Project changed from openQA Tests (public) to qe-yam
  • Category deleted (Bugs in existing tests)
  • Status changed from New to Workable
  • Parent task set to #151816
Actions
Copy link
 #2

Updated by JERiveraMoya about 1 month ago

  • Subject changed from Investigate sporadic fails in disable_boot_menu_timeout to Fix sporadic fails in disable_boot_menu_timeout
Actions
Copy link
 #3

Updated by lmanfredi about 1 month ago

  • Status changed from Workable to In Progress
  • Assignee set to lmanfredi
Actions
Copy link
 #4

Updated by JERiveraMoya about 1 month ago

  • Parent task changed from #151816 to #169657
Actions
Copy link
 #5

Updated by lmanfredi about 1 month ago

There is a rate of ~ 8% of failures.
By increase RAM to 4 / 6 GB the rate go down to 1-2%
See VRs

Actions
Copy link
 #6

Updated by JERiveraMoya about 1 month ago

the failure also appears here:
https://openqa.suse.de/tests/15928209#step/disable_boot_menu_timeout/1
As mentioned in the daily, let's try to narrow the scope of the fix in the automation instead of trying to boost resources as good practice.
The rate of failure should 0 in verification runs but when fixed properly you don't even need to calculate any rate of course.

Actions
Copy link
 #7

Updated by lmanfredi about 1 month ago ยท Edited

Created WIP PR#20626
For some tests, even after 30 minutes the Tab " Bootloader Options " is not displayed:
The strange is that during this time, the openQA "Live View" doesn't show anything, no image from SUT

Actions
Copy link
 #8

Updated by leli about 1 month ago

It seems there are still several failures in the VRs of this PR. I think just wait may couldn't fix this issue. The Tab " Bootloader Options " is shown very slow of never shown even wait 1800s. I guess it maybe a refresh issue, so could we try the workaround to make it stable, ex: send alt-h key to show the help dialog and close it to force the refreshment.

Actions
Copy link
 #9

Updated by lmanfredi 30 days ago

The problem seems located in $testapi::distri->get_bootloader_settings()->disable_grub_timeout();.
Also by apply the workaround of alt-h/alt-c to refresh, the Tab "Bootloader Options" is not shown.
It seems that the link Booting is not triggered.

Actions
Copy link
 #10

Updated by lmanfredi 29 days ago

Removed WIP in PR#20626. No failures in VRs.

Actions
Copy link
 #11

Updated by JERiveraMoya 11 days ago

  • Status changed from In Progress to Resolved
Actions
Copy link

Also available in: Atom PDF