Project

General

Profile

coordination #35302

Updated by okurz almost 6 years ago

## Observation 

 DimStar made the effort to record what tests he retriggered that he identified as "sporadic, not-important test failures": 

 Retriggered for snapshot 0417: 

 * DVD/kde-wayland: shutdown not triggered, on rerun, klauncher input issues (existing bug): https://openqa.opensuse.org/tests/658854#step/shutdown/16 
 * DVD/lxde: chromium load performance: https://openqa.opensuse.org/tests/658833 
 * DVD/splitusr: https://openqa.opensuse.org/tests/658840#step/partitioning_splitusr/28 
 * DVD/uefi-os: https://openqa.opensuse.org/tests/659100#step/first_boot/21 
 * DVD/update-leap-42.2-gnome: -> boo#0 tagged: 
   * https://openqa.opensuse.org/tests/658866 (gnucash) 
   * https://openqa.opensuse.org/tests/659185 (gnucash) 
   * https://openqa.opensuse.org/tests/659359 (shutdown failure) 

 * DVD/update-leap-42.3-gnome: https://openqa.opensuse.org/tests/658942 (gnucash and chromium) 
 * LIVE/GNOME: 
   * https://openqa.opensuse.org/tests/658974#step/evolution/5 (evolution failed) 
   * https://openqa.opensuse.org/tests/659124#step/firefox/1     (on rerun: firefox and ooffice failed) 

 * NET/update-leap-42.2-kde: xterm failed to start: https://openqa.opensuse.org/tests/658809 
 * NET/ZDUP13.1-gnome: gnucash kills session: https://openqa.opensuse.org/tests/658790#step/gnucash/49 . gnucash tearing down a GNOME session is something DimStar has seen happen more often already (which he is looking into. That will likely result as a product bug, but was not yet able to ever reproduce it) 
 * NET/ZDUP13.2: xterm not started (in the xterm test): https://openqa.opensuse.org/tests/658791 
 * NET/ZDUP42.2-gnome:inkscape: https://openqa.opensuse.org/tests/658802#step/inkscape/13 
 * Rescue: shutdown: 
   * https://openqa.opensuse.org/tests/658987#step/shutdown/2 
   * https://openqa.opensuse.org/tests/659121#step/shutdown/2 


 ## Acceptance criteria 

 * **AC1:** DimStar can not identify any test module as regurlarly failing anymore :) 
 * **AC2:** All of the mentioned scenarios/modules have been reviewed 


 ## Tasks 

 * DONE: <del>[Ensure [Ensure robustness of test module "gnucash"](https://progress.opensuse.org/issues/35685)</del> "gnucash"](https://progress.opensuse.org/issues/35685) 
 * Ensure robustness of test module "firefox" 
 * DONE: <del>[Ensure [Ensure robustness of test module "chromium"](https://progress.opensuse.org/issues/36304)</del> "chromium"](https://progress.opensuse.org/issues/36304) 
 * Ensure robustness of test module "splitusr" 
 * Ensure robustness of test module "evolution" 
 * Ensure robustness of test module "ooffice" 
 * Ensure robustness of test module "xterm" in scenario net/zdup13.2 
 * DONE: <del>[Ensure [Ensure robustness of test module "shutdown"](https://progress.opensuse.org/issues/35215)</del> "shutdown"](https://progress.opensuse.org/issues/35215) 
 * DONE: <del>[Ensure [Ensure robustness of test module "inkscape"](https://progress.opensuse.org/issues/35688)</del> "inkscape"](https://progress.opensuse.org/issues/35688) 
 * Find out why QSF has not seen these issues in our review approach -> to be adressed in [retro](https://etherpad.nue.suse.com/qa_sles_functional_retrospective)

Back