QA » openQA Project » openQA Tests

Observation¶

openQA test in scenario sle-12-SP2-Desktop-DVD-Updates-x86_64-qam-regression-gnome@64bit fails in
change_password

Reproducible¶

Fails at least out out of 10 times.

Problem¶

H1 The textbox for the new password is not focused - REJECTED by E1-1
H2 The sentence type_string $newpwd; is sometimes not sending the keys properly
H2.1 The function type_string is the problem
H2.2 The speed of typing by function type_string is the problem
H3 The textbox for new password is sometimes not receiving keyboard input properly.
H4 The SUT does not behave always at the same speed. For this reason the test fails sporadically at different states: needles match but the windows is not ready to accept clicks or type inputs.

Suggestion¶

E1-1 Inspect the video result of https://openqa.suse.de/tests/811321/file/video.ogv to see if the textbox for the new password is focused.
R1-1 The textbox is focused at time 1:14

E2.2-1 Use function type_string_slow to type the new password

E2.2-2 Use function type_string_very_slow to type the new password

E4-1 Execute the same module at least 10 consecutive times inside the test suite to observe different test failures and error reproducibility.
R4-1
Because of needle timeout, the 10 executions are not executed; the job dies and become "incomplete".
See here openQA:copland#84 and here openQA:copland#87
The earlier possible test failure observed happens because the sentence os-autoinst-distri-opensuse/lib/x11regressiontest.pm:502
assert_and_click "settings"; not always make the click when the menu item is ready to be clicked.
Follow with E4-2, E4-3, E4-4.

E4-2 Try to make the needles with tag "settings" match only when the menu item is ready to be clicked, by selecting more areas.
R4-2

• MR:os-autoinst-needles-sles#327 -> openQA:copland#91
• MR:os-autoinst-needles-sles#331, PR:os-autoinst-distri-opensuse#2557 -> openQA:copland#100

E4-3 Try to make the needles with tag "gnome-settings" match only when the menu item is ready to be clicked, by selecting more areas.

E4-4 Try to make the needles with tag "settings-users-selected" match only when the menu item is ready to be clicked, by selecting more areas.