Project

General

Profile

Actions
Copy link

action #169519

closed

coordination #154768: [saga][epic][ux] State-of-art user experience for openQA

coordination #166556: [epic] Improved test reviewer user experience - Restart filtered jobs from /tests/overview

[sporadic] t/ui/10-tests_overview.t fails with `Unable to locate element` size:S

Added by robert.richardson 11 days ago. Updated 4 days ago.

Status:
Resolved
Priority:
High
Assignee:
okurz
Category:
Regressions/Crashes
Target version:
Ready
Start date:
2024-11-07
Due date:
% Done:

0%

Estimated time:

Description

Observation

The test t/ui/10-tests_overview.t can sporadically fail, throwing the following error 

[15:54:50] t/ui/10-tests_overview.t ................... 26/? 
#   Failed test 'no (unexpected) warnings (via done_testing)'
#   at t/ui/10-tests_overview.t line 628.
# Got the following unexpected warnings:
#   1: findElement: no such element: Unable to locate element: {"method":"id","selector":"res_DVD_x86_64_doc"} at /home/squamata/project/t/ui/../lib/OpenQA/SeleniumTest.pm:78 at /home/squamata/project/t/ui/../lib/OpenQA/SeleniumTest.pm line 81.
#       OpenQA::SeleniumTest::__ANON__(Test::Selenium::Chrome=HASH(0x555d84fe50a8), "Error while executing command: findElement: no such element: "..., HASH(0x555d852f3038), HASH(0x555d852f3188)) called at /usr/lib/perl5/vendor_perl/5.26.1/Selenium/Remote/Driver.pm line 356
…
#       Selenium::Remote::Finders::__ANON__(Test::Selenium::Chrome=HASH(0x555d84fe50a8), "res_DVD_x86_64_doc") called at t/ui/10-tests_overview.t line 136
#  at /usr/lib/perl5/vendor_perl/5.26.1/Selenium/Remote/Finders.pm line 26.
# Looks like you failed 1 test of 26.
[15:54:50] t/ui/10-tests_overview.t ................... Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/26 subtests

So far i was not able to reproduce locally

Acceptance Criteria

  • AC1: t/ui/10-tests_overview.t is consistently stable within circleCI

Suggestions

  • rrichardson saw this failing at least twice once in post-merge CI checks
  • Try if this can be reproduced at all with a reasonably sized sample size, otherwise reject
Actions
Copy link
 #1

Updated by robert.richardson 11 days ago

  • Subject changed from [sporadic] t/ui/10-tests_overview.t to [sporadic] t/ui/10-tests_overview.t fails with `Unable to locate element`
Actions
Copy link
 #2

Updated by okurz 11 days ago

  • Priority changed from Normal to High
Actions
Copy link
 #3

Updated by mkittler 7 days ago

This ran on commit https://github.com/os-autoinst/openQA/commit/817cdacb160d2536e08764a6e5fac08e3d08b756 so changes to that test were moved out after and https://github.com/os-autoinst/openQA/commit/25b7bc0c8c99c18fd1a5466048058b2ad4907beb has already been merged. So it seems like this should have been working, indeed.

Actions
Copy link
 #4

Updated by okurz 7 days ago

  • Parent task set to #166556
Actions
Copy link
 #5

Updated by okurz 7 days ago

  • Subject changed from [sporadic] t/ui/10-tests_overview.t fails with `Unable to locate element` to [sporadic] t/ui/10-tests_overview.t fails with `Unable to locate element` size:S
  • Description updated (diff)
  • Status changed from New to In Progress
  • Assignee set to okurz
Actions
Copy link
 #6

Updated by robert.richardson 7 days ago · Edited

rrichardson saw this failing at least twice in post-merge CI checks

i was wrong here, the second failure i saw was unrelated. So happened only once so far.

Actions
Copy link
 #7

Updated by okurz 7 days ago

  • Description updated (diff)

Running on ok1.qe.nue2.suse.org

zypper -n in openQA-devel retry
cd ~/local/
git clone https://github.com/os-autoinst/openQA
cd openQA
runs=10000 count-fail-ratio make coverage KEEP_DB=1 TESTS=t/ui/10-tests_overview.t
Actions
Copy link
 #8

Updated by okurz 7 days ago

  • Status changed from In Progress to Feedback
Actions
Copy link
 #9

Updated by okurz 6 days ago

So far

## count-fail-ratio: Run: 1056. Fails: 107. Fail ratio 10.13±1.82%
## mean runtime: 75798±239710.30 ms

but failures that I found are due to temporary decrease of performance of the VM causing timeouts. Running again with

OPENQA_TEST_TIMEOUT_SCALE_FACTOR=10 runs=10000 count-fail-ratio make coverage KEEP_DB=1 TESTS=t/ui/10-tests_overview.t
Actions
Copy link
 #10

Updated by okurz 4 days ago

  • Status changed from Feedback to Resolved

Now fails persistently with

Could not obtain new session: session not created
from chrome not reachable
  (Driver info: chromedriver=130.0.6723.116 (0000000000000000000000000000000000000000-0000000000000000000000000000000000000000),platform=Linux 6.11.6-2-default x86_64) at /home/okurz/local/openQA/t/ui/../lib/OpenQA/SeleniumTest.pm line 93.

will trigger a reboot. Reboot helped. Another 584 runs without failure. That is a computed failure probability < .51%

Actions
Copy link

Also available in: Atom PDF