QA » openQA Project » openQA Tests

over 60 test runs on O3 and found following sporadic performance issue:
https://openqa.opensuse.org/tests/1936596#step/tomcat/180 (often)

and https://openqa.opensuse.org/tests/1936603#step/tomcat/49

except network issue on remote worker it looks goods for over 200 test runs:
http://10.162.30.85/tests/3719#next_previous

So prepare PR with following changes:

diff --git a/lib/Tomcat/JspTest.pm b/lib/Tomcat/JspTest.pm
index 96ab58c9f..a1b0469dc 100644
--- a/lib/Tomcat/JspTest.pm
+++ b/lib/Tomcat/JspTest.pm
@@ -262,13 +262,14 @@ sub form() {
     send_key('down');
     for (1 .. 2) { send_key('ret'); }

-    if (check_screen('tomcat-click-save-login', 10)) {
+    if (check_screen('tomcat-click-save-login', 60)) {
         assert_and_click('tomcat-click-save-login', TIMEOUT);
     }

     send_key('tab');
     type_string('tomcat');
     send_key('ret');
+    wait_still_screen;
     assert_screen('tomcat-form-example-result', TIMEOUT);
 }

recently test run looks good, but wait for some more test run to be sure that this sporadic issue got fixed really.

looks like we have also sporadic issue on OSD:
https://openqa.suse.de/tests/7369657#

On my local worker looks good, same build for tomcat.

https://openqa.suse.de/tests/7377544 looks good with another worker.

what I found is that test failed at different stages of needle match 'tomcat-servlet-fallback' and other place like 'tomcat-snake-example-loaded':
https://openqa.suse.de/tests/7379285#step/tomcat/203

see https://openqa.suse.de/tests/7379285#next_previous

the problem is that firefox_open_url doesn't work from time to time, this is clearly a performance issue.

lib/Tomcat/ServletTest.pm

# access the tomcat servlets examples page
    if ($mod_jk) {
        $self->firefox_open_url('localhost/examples/servlets');
    } else {
        $self->firefox_open_url('localhost:8080/examples/servlets');
    }
    send_key_until_needlematch('tomcat-servlet-examples-page', 'ret');

    # Navigate with keyboard to each example and test it
    for my $i (0 .. $#servlet_examples) {
        Tomcat::Utils->browse_with_keyboard('tomcat-servlet-fallback', $servlet_examples[$i][0], $servlet_examples[$i][1]);
    }

lib/x11test.pm

sub firefox_open_url {
    my ($self, $url, $do_not_check_loaded_url) = @_;
    my $counter = 1;
    while (1) {
        # make sure firefox window is focused
        assert_and_click 'firefox_titlebar' if check_screen('firefox_titlebar', 2);
        wait_still_screen 1, 2;
        send_key 'alt-d';
        send_key 'delete';
        send_key 'alt-d';
        send_key 'delete';
        last if check_screen('firefox-empty-bar', 3);
        if ($counter++ > 5) {
            assert_screen('firefox-empty-bar', 0);
            last;    # in case it worked
        }
    }
    enter_cmd_slow "$url";
    wait_still_screen 2, 4;
    # this is because of adobe flash, screensaver will activate sooner than the page
    unless ($do_not_check_loaded_url) {
        assert_screen 'firefox-url-loaded', 300;
    }
}

WIP: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/13436

it should look like:
http://10.162.30.85/tests/4302#step/tomcat/205

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: tomcat
https://openqa.opensuse.org/tests/2026895

To prevent further reminder comments one of the following options should be followed:

1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234