action #13598
Updated by mkravec about 7 years ago
Results Investigation of job sles+extratests are very inconsistent. Usually 2-8 modules fail, this number failing extra tests is different needed for every job run. This issue is parent ppc64le and x86_64 (0-5 failed tests). Either results should be more consistent or tests should be marked with bugs for separate failures which should help spread work. expected failures. Failures are usually caused by test modules expecting openqa snapper_cleanup -> bsc#998360 btrfs_qgroups -> bsc#993841 yast2_ftp -> bsc#975538 == TODO == OpenSUSE yast2_ui_gnome tests: https://openqa.opensuse.org/tests/289660 yast2_tftp -> https://openqa.suse.de/tests/600998#step/yast2_tftp/9 yast2_apparmor -> https://openqa.suse.de/tests/610729#step/yast2_apparmor/16 yast2_lan_restart -> https://openqa.suse.de/tests/524303#step/btrfs_qgroups/62 - bsc#993666 - fixed? vnc_two_passwords -> https://openqa.suse.de/tests/540846#step/vnc_two_passwords/17 - happens during load, maybe vnc server did not under load - or opposite. Typical failure is yast test modules pressing keys before screen is loaded. (missing or wrong assert_screen) start in time Every failing task should have bug or progress issue assigned, we should avoid restarting jobs for better results. == DONE == yast2_ftp -> https://openqa.suse.de/tests/553884#step/yast2_ftp/23 https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/1838 yast2_ftp -> https://openqa.suse.de/tests/588138#step/yast2_ftp/19 https://gitlab.suse.de/openqa/os-autoinst-needles-sles/merge_requests/219 yast2_ftp -> https://openqa.suse.de/tests/594885#step/yast2_ftp/14 https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/1884 yast2_proxy -> https://openqa.suse.de/tests/586698#step/yast2_proxy/75 https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/1844 https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/1853 yast2_proxy -> https://openqa.suse.de/tests/603565#step/yast2_proxy/50 https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/1922 yast2_apparmor -> https://openqa.suse.de/tests/553884#step/yast2_apparmor/14 https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/1856 yast2_samba -> https://openqa.suse.de/tests/540846#step/yast2_samba/25 https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/1860 yast2_ntpclient -> https://openqa.suse.de/tests/588769#step/yast2_ntpclient/21 https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/1859