QA » openQA Project » openQA Tests

https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/6614

one test was fine but did not trigger the actual workaround (I have not even created the needle to detect the bug situation).

Retriggered a custom scenario for statistical investigation:

for i in {001..001}; do openqa-clone-job --within-instance https://openqa.opensuse.org --skip-chained-deps 835553 _GROUP="Development Tumbleweed" TEST="update_Leap_42.3_gnome@okurz__os-autoinst-distri-opensuse_fix_vlc_$i" EXCLUDE_MODULES=keymap_or_locale,textinfo,hostname,xorg_vt,ncurses,yast2_lan,curl_https,salt,glibc_sanity,zypper_in,yast2_i,yast2_bootloader,vim,firewall_enabled,sshd,ssh_cleanup,sshfs,mtab,orphaned_packages_check,user_gui_login,desktop_runner,xterm,sshxterm,gnome_control_center,gnome_tweak_tool,gnome_terminal,gedit,firefox,firefox_audio,thunderbird,chromium,ooffice,oomath,oocalc,glxgears,nautilus,gnome_music,evolution,desktop_mainmenu,inkscape,gimp,hexchat,reboot_gnome,cleanup_before_shutdown,shutdown; done

-> Created job #835900: opensuse-Tumbleweed-DVD-x86_64-Buildokurz_os-autoinst-distri-opensuse_6614-update_Leap_42.3_gnome@okurz__os-autoinst-distri-opensuse_fix_vlc@64bit -> https://openqa.opensuse.org/t835900

passed. Let's trigger more

for i in {002..040}; do openqa-clone-job --within-instance https://openqa.opensuse.org --skip-chained-deps 835553 _GROUP="Development Tumbleweed" TEST="update_Leap_42.3_gnome@okurz__os-autoinst-distri-opensuse_fix_vlc_$i" EXCLUDE_MODULES=keymap_or_locale,textinfo,hostname,xorg_vt,ncurses,yast2_lan,curl_https,salt,glibc_sanity,zypper_in,yast2_i,yast2_bootloader,vim,firewall_enabled,sshd,ssh_cleanup,sshfs,mtab,orphaned_packages_check,user_gui_login,desktop_runner,xterm,sshxterm,gnome_control_center,gnome_tweak_tool,gnome_terminal,gedit,firefox,firefox_audio,thunderbird,chromium,ooffice,oomath,oocalc,glxgears,nautilus,gnome_music,evolution,desktop_mainmenu,inkscape,gimp,hexchat,reboot_gnome,cleanup_before_shutdown,shutdown; done

-> https://openqa.opensuse.org/tests/overview?build=okurz%2Fos-autoinst-distri-opensuse%236614&version=Tumbleweed&groupid=38&distri=opensuse

One failed in force_scheduled_tasks for what is another ticket, one incompleted, reported as #46556, others passed. So ignoring other failures we can see 40/40 passed meaning that I can not reproduce the error. This might be due to excluding too many modules which might have an impact so I will include them back and let the tests run again.

for i in {001..040}; do openqa-clone-job --within-instance https://openqa.opensuse.org --skip-chained-deps 835553 _GROUP="Development Tumbleweed" TEST="update_Leap_42.3_gnome@okurz__os-autoinst-distri-opensuse_fix_vlc_$i" BUILD=okurz/os-autoinst-distri-opensuse#6614_all_modules EXCLUDE_MODULES=reboot_gnome,cleanup_before_shutdown,shutdown; done

-> https://openqa.opensuse.org/tests/overview?distri=opensuse&version=Tumbleweed&build=okurz%2Fos-autoinst-distri-opensuse%236614_all_modules&groupid=38

this will most likely take until tomorrow – or fail fast early ;)

Unexpectedly 1/40 failed. I guess I need to trigger some more to have good statistics?

waiting … (same link)

EDIT: So 3/80 failed, that is 3.8%. Not much but ok for reproducability I guess.

ok, I think I will play it safe and create an explicit new needle tag and created a needle "vlc-stuck-never-played-boo1102838-20190125" for that already. Updated code, retriggering …

for i in {001..080}; do openqa-clone-job --within-instance https://openqa.opensuse.org --skip-chained-deps 835553 _GROUP="Development Tumbleweed" TEST="update_Leap_42.3_gnome@okurz__os-autoinst-distri-opensuse_fix_vlc_$i" BUILD=okurz/os-autoinst-distri-opensuse#6614_all_modules_with_workaround EXCLUDE_MODULES=reboot_gnome,cleanup_before_shutdown,shutdown; done

-> https://openqa.opensuse.org/tests/overview?build=okurz%2Fos-autoinst-distri-opensuse%236614_all_modules_with_workaround&version=Tumbleweed&groupid=38&distri=opensuse

stupid me. This can not work because still we need to pass first the step of "done-playing". Well, let's look for the alternative explicitly but earlier then?

adapted, pushed, retriggered:

for i in {001..080}; do openqa-clone-job --within-instance https://openqa.opensuse.org --skip-chained-deps 838337 _GROUP="Development Tumbleweed" TEST="update_Leap_42.3_gnome@okurz_os-autoinst-distri-opensuse_fix_vlc_$i" BUILD=okurz/os-autoinst-distri-opensuse#6614_all_modules_with_workaround2 EXCLUDE_MODULES=reboot_gnome,cleanup_before_shutdown,shutdown; done

-> https://openqa.opensuse.org/tests/overview?distri=opensuse&version=Tumbleweed&build=okurz%2Fos-autoinst-distri-opensuse%236614_all_modules_with_workaround2&groupid=38

Made a mistake by using a "latest" job but not specifying CASEDIR again

https://github.com/okurz/os-autoinst-distri-opensuse.git#fix/vlc

for i in {001..100}; do openqa-clone-job --within-instance https://openqa.opensuse.org --skip-chained-deps 838337 _GROUP="Development Tumbleweed" TEST="update_Leap_42.3_gnome@okurz_os-autoinst-distri-opensuse_fix_vlc_$i" BUILD=okurz/os-autoinst-distri-opensuse#6614_all_modules_with_workaround2 EXCLUDE_MODULES=reboot_gnome,cleanup_before_shutdown,shutdown CASEDIR=https://github.com/okurz/os-autoinst-distri-opensuse.git#fix/vlc; done

-> https://openqa.opensuse.org/tests/overview?version=Tumbleweed&distri=opensuse&groupid=38&build=okurz%2Fos-autoinst-distri-opensuse%236614_all_modules_with_workaround2

All failed in zypper_ref because apparently the older snapshot (it's actually just HEAD~1) is gone already. Retriggering based on latest, job https://openqa.opensuse.org/tests/839882

for i in {001..100}; do openqa-clone-job --within-instance https://openqa.opensuse.org --skip-chained-deps 839882 _GROUP="Development Tumbleweed" TEST="update_Leap_42.3_gnome@okurz_os-autoinst-distri-opensuse_fix_vlc_$i" BUILD=okurz/os-autoinst-distri-opensuse#6614_all_modules_with_workaround2 EXCLUDE_MODULES=reboot_gnome,cleanup_before_shutdown,shutdown CASEDIR=https://github.com/okurz/os-autoinst-distri-opensuse.git#fix/vlc; done

-> https://openqa.opensuse.org/tests/overview?version=Tumbleweed&groupid=38&distri=opensuse&build=okurz%2Fos-autoinst-distri-opensuse%236614_all_modules_with_workaround2&flavor=NET

based on NET now
https://openqa.opensuse.org/tests/840423#step/vlc/27
Searching over https://openqa.opensuse.org/admin/needles for the needle tag "vlc-stuck-never-played" reveals the last match https://openqa.opensuse.org/tests/840423#step/vlc/27 with the workaround of "killall -9 vlc" triggered in https://openqa.opensuse.org/tests/840423#step/vlc/31 so the workaround is effective.

https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/6614 merged