QA (public) » openQA Project (public) » openQA Tests (public)

Observation¶

DimStar made the effort to record what tests he retriggered that he identified as "sporadic, not-important test failures":

Retriggered for snapshot 0417:

• DVD/kde-wayland: shutdown not triggered, on rerun, klauncher input issues (existing bug): https://openqa.opensuse.org/tests/658854#step/shutdown/16
• DVD/lxde: chromium load performance: https://openqa.opensuse.org/tests/658833
• DVD/splitusr: https://openqa.opensuse.org/tests/658840#step/partitioning_splitusr/28
• DVD/uefi-os: https://openqa.opensuse.org/tests/659100#step/first_boot/21

• DVD/update-leap-42.2-gnome: -> boo#0 tagged:

  • https://openqa.opensuse.org/tests/658866 (gnucash)
  • https://openqa.opensuse.org/tests/659185 (gnucash)
  • https://openqa.opensuse.org/tests/659359 (shutdown failure)

• DVD/update-leap-42.3-gnome: https://openqa.opensuse.org/tests/658942 (gnucash and chromium)

• LIVE/GNOME:

  • https://openqa.opensuse.org/tests/658974#step/evolution/5 (evolution failed)
  • https://openqa.opensuse.org/tests/659124#step/firefox/1 (on rerun: firefox and ooffice failed)

• NET/update-leap-42.2-kde: xterm failed to start: https://openqa.opensuse.org/tests/658809

• NET/ZDUP13.1-gnome: gnucash kills session: https://openqa.opensuse.org/tests/658790#step/gnucash/49 . gnucash tearing down a GNOME session is something DimStar has seen happen more often already (which he is looking into. That will likely result as a product bug, but was not yet able to ever reproduce it)

• NET/ZDUP13.2: xterm not started (in the xterm test): https://openqa.opensuse.org/tests/658791

• NET/ZDUP42.2-gnome:inkscape: https://openqa.opensuse.org/tests/658802#step/inkscape/13

• Rescue: shutdown:

  • https://openqa.opensuse.org/tests/658987#step/shutdown/2
  • https://openqa.opensuse.org/tests/659121#step/shutdown/2

Acceptance criteria¶

• AC1: DimStar can not identify any test module as regurlarly failing anymore :)
• AC2: All of the mentioned scenarios/modules have been reviewed

Tasks¶

• DONE: Ensure robustness of test module "gnucash"
• Ensure robustness of test module "firefox"
• DONE: Ensure robustness of test module "chromium"
• Ensure robustness of test module "splitusr"
• Ensure robustness of test module "evolution"
• Ensure robustness of test module "ooffice"
• Ensure robustness of test module "xterm" in scenario net/zdup13.2
• DONE: Ensure robustness of test module "shutdown"
• DONE: Ensure robustness of test module "inkscape"
• Find out why QSF has not seen these issues in our review approach -> to be adressed in retro