QA (public) » openQA Project (public)

Motivation¶

While working on #134840, i've noticed t/ui/18-tests-details.t sporadically failing, throwing the error

isElementEnabled: stale element reference: stale element not found in the current frame

It seems to not find the candidate needles menu

ok 19 - test candidate list
isElementEnabled: stale element reference: stale element not found in the current frame at /home/rrichardson/Code/oqa/basedir/repos/openQA/t/ui/../lib/OpenQA/SeleniumTest.pm:78 at /home/rrichardson/Code/oqa/basedir/repos/openQA/t/ui/../lib/OpenQA/SeleniumTest.pm line 81.
    OpenQA::SeleniumTest::__ANON__(Test::Selenium::Chrome=HASH(0x55c65bc554e8), "Error while executing command: isElementEnabled: stale elemen"..., HASH(0x55c65cf74b08)) called at /usr/lib/perl5/vendor_perl/5.40.0/Selenium/Remote/Driver.pm line 356
    Selenium::Remote::Driver::catch {...} ("Error while executing command: isElementEnabled: stale elemen"...) called at /usr/lib/perl5/vendor_perl/5.40.0/Try/Tiny.pm line 123
    Try::Tiny::try(CODE(0x55c65cee6a68), Try::Tiny::Catch=REF(0x55c65cc8ac20)) called at /usr/lib/perl5/vendor_perl/5.40.0/Selenium/Remote/Driver.pm line 361
    Selenium::Remote::Driver::__ANON__(CODE(0x55c65b7dc240), Test::Selenium::Chrome=HASH(0x55c65bc554e8), HASH(0x55c65cf74b08)) called at (eval 1617) line 1
    Selenium::Remote::Driver::__ANON__(Test::Selenium::Chrome=HASH(0x55c65bc554e8), HASH(0x55c65cf74b08)) called at (eval 1619) line 2
    Selenium::Remote::Driver::_execute_command(Test::Selenium::Chrome=HASH(0x55c65bc554e8), HASH(0x55c65cf74b08)) called at (eval 1589) line 17
    Selenium::Remote::WebElement::_execute_command(Test::Selenium::Remote::WebElement=HASH(0x55c65cf13988), HASH(0x55c65cf74b08)) called at /usr/lib/perl5/vendor_perl/5.40.0/Selenium/Remote/WebElement.pm line 180


    Selenium::Remote::WebElement::is_enabled(Test::Selenium::Remote::WebElement=HASH(0x55c65cf13988)) called at t/ui/18-tests-details.t line 84
    main::find_candidate_needles() called at t/ui/18-tests-details.t line 612
    main::test_with_error(0, 0, ARRAY(0x55c65cdd6e28), HASH(0x55c65cea2b10), "100%, 100%") called at t/ui/18-tests-details.t line 635
    main::__ANON__() called at /usr/lib/perl5/5.40.0/Test/Builder.pm line 374
    eval {...} called at /usr/lib/perl5/5.40.0/Test/Builder.pm line 374
    Test::Builder::subtest(Test::Builder=HASH(0x55c6525d2a90), "test candidate list", CODE(0x55c65c763540)) called at /usr/lib/perl5/5.40.0/Test/More.pm line 831
    Test::More::subtest("test candidate list", CODE(0x55c65c763540)) called at t/ui/18-tests-details.t line 664
ok 20 - no (unexpected) warnings (via END block)
# Tests were run but no plan was declared and done_testing() was not seen.
Dubious, test returned 254 (wstat 65024, 0xfe00)
All 20 subtests passed 

Test Summary Report
-------------------
t/ui/18-tests-details.t (Wstat: 65024 (exited 254) Tests: 20 Failed: 0)
  Non-zero exit status: 254
  Parse errors: No plan found in TAP output
Files=1, Tests=20, 20 wallclock secs ( 0.07 usr  0.01 sys +  3.78 cusr  0.38 csys =  4.24 CPU)
Result: FAIL
make[1]: *** [Makefile:229: test-unit-and-integration] Error 1
make[1]: Leaving directory '/home/rrichardson/Code/oqa/basedir/repos/openQA'
make: *** [Makefile:224: test-with-database] Error 2

To reproduce the issue, simply run the test in a loop until the failure occurs.
make test RETRY=50 STABILITY_TEST=1 OPENQA_TEST_TIMEOUT_DISABLE=1 EXTRA_PROVE_ARGS="-v" TESTS=t/ui/18-tests-details.t
(If it succeeds, bump the RETRY counter and run again, the failure should show up after a while)