QA » openQA Project » openQA Tests

Ah, I see the problem now. The security check part was already present in the test before, but it was occurring needlessly before the click on the "Verify Java version" button, when there was actually nothing to check for.

The error was not revealed before because the test used to pass in previous builds.
This was due to a bug in the IcedTea/Java OpenJDK plugin (bsc#982622), which was previously throwing an exception during the Verify Java version stage, therefore the test couldn't effectively proceed to the security check part and happily passed anyway.
(Example: https://openqa.suse.de/tests/827859#step/firefox_java/19)

An update fixing this bug has now been submitted, which revealed that the security check should occur after clicking the Verify Java version button.

Passing now on my OpenQA instance: http://dreamyhamster.suse.cz/tests/147#step/firefox_java/18

The pull request has been submitted: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/2601

Your test run was lucky not to get the cookie popup. The problem is that the order of dialogs depends when the function is called, so coding the full workflow requires some more needle matches: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/2605