coordination #35302
closed[qe-core][opensuse][functional][epic][sporadic] Various unstable tests on o3
100%
Description
Observation¶
DimStar made the effort to record what tests he retriggered that he identified as "sporadic, not-important test failures":
Retriggered for snapshot 0417:
- DVD/kde-wayland: shutdown not triggered, on rerun, klauncher input issues (existing bug): https://openqa.opensuse.org/tests/658854#step/shutdown/16
- DVD/lxde: chromium load performance: https://openqa.opensuse.org/tests/658833
- DVD/splitusr: https://openqa.opensuse.org/tests/658840#step/partitioning_splitusr/28
- DVD/uefi-os: https://openqa.opensuse.org/tests/659100#step/first_boot/21
DVD/update-leap-42.2-gnome: -> boo#0 tagged:
- https://openqa.opensuse.org/tests/658866 (gnucash)
- https://openqa.opensuse.org/tests/659185 (gnucash)
- https://openqa.opensuse.org/tests/659359 (shutdown failure)
DVD/update-leap-42.3-gnome: https://openqa.opensuse.org/tests/658942 (gnucash and chromium)
LIVE/GNOME:
- https://openqa.opensuse.org/tests/658974#step/evolution/5 (evolution failed)
- https://openqa.opensuse.org/tests/659124#step/firefox/1 (on rerun: firefox and ooffice failed)
NET/update-leap-42.2-kde: xterm failed to start: https://openqa.opensuse.org/tests/658809
NET/ZDUP13.1-gnome: gnucash kills session: https://openqa.opensuse.org/tests/658790#step/gnucash/49 . gnucash tearing down a GNOME session is something DimStar has seen happen more often already (which he is looking into. That will likely result as a product bug, but was not yet able to ever reproduce it)
NET/ZDUP13.2: xterm not started (in the xterm test): https://openqa.opensuse.org/tests/658791
NET/ZDUP42.2-gnome:inkscape: https://openqa.opensuse.org/tests/658802#step/inkscape/13
Rescue: shutdown:
Acceptance criteria¶
- AC1: DimStar can not identify any test module as regurlarly failing anymore :)
- AC2: All of the mentioned scenarios/modules have been reviewed
Tasks¶
- DONE: Ensure robustness of test module "gnucash"
- Ensure robustness of test module "firefox"
- DONE: Ensure robustness of test module "chromium"
- Ensure robustness of test module "splitusr"
- Ensure robustness of test module "evolution"
- Ensure robustness of test module "ooffice"
- Ensure robustness of test module "xterm" in scenario net/zdup13.2
- DONE: Ensure robustness of test module "shutdown"
- DONE: Ensure robustness of test module "inkscape"
- Find out why QSF has not seen these issues in our review approach -> to be adressed in retro
Updated by okurz about 6 years ago
- Due date set to 2018-05-22
- Target version set to Milestone 16
Setting to "Urgent" as we only have individual test runs available for reference so we should not waste time waiting as we need to take at each issue before the jobs are pruned.
Updated by okurz almost 6 years ago
- Description updated (diff)
- Status changed from New to Workable
Updated by okurz almost 6 years ago
- Related to coordination #35215: [functional][u][epic][medium] test fails on shutdown module added
Updated by okurz almost 6 years ago
- Due date changed from 2018-05-22 to 2018-06-05
due to changes in a related task
Updated by JERiveraMoya almost 6 years ago
- Related to action #35778: [opensuse][functional][y] test fails in keyboard_selection - lost "alt-n" added
Updated by okurz almost 6 years ago
- Related to action #36117: [functional][u][sporadic] test fails in xterm to show "xterm" (needle tag desktop-runner-plasma-suggestions) in krunner - system slower just after login? added
Updated by okurz almost 6 years ago
This is an autogenerated message for openQA integration by the openqa_review script:
This bug is still referenced in a failing openQA test: kde@64bit-2G
https://openqa.opensuse.org/tests/676015
Updated by JERiveraMoya almost 6 years ago
- Related to action #36304: [opensuse][functional]sporadic][u] chromium test is unstable added
Updated by lnussel almost 6 years ago
The random failures are a nuisance to maintenance as well, currently eg. chromium holding off https://build.opensuse.org/request/show/612644
Updated by mgriessmeier almost 6 years ago
- Due date changed from 2018-06-05 to 2018-06-19
due to changes in a related task
Updated by okurz almost 6 years ago
- Target version changed from Milestone 16 to Milestone 18
whatever you say I would like to see this done earlier but I don't see it done now so we should be done by M18
Updated by okurz almost 6 years ago
- Due date changed from 2018-06-19 to 2018-07-03
due to changes in a related task
Updated by JERiveraMoya almost 6 years ago
- Related to action #37354: [opensuse][functional][u][sporadic][medium] test fails in desktop_runner is unstable added
Updated by mloviska almost 6 years ago
- Related to action #37309: [opensuse][functional][u][fast] test fails in vlc - URL needle is hardly to match added
Updated by okurz almost 6 years ago
- Target version changed from Milestone 18 to Milestone 18
Updated by SLindoMansilla almost 6 years ago
- Related to action #31351: [functional][u][medium] force_cron_run does not actually run any crons (occasionally) added
Updated by okurz almost 6 years ago
- Status changed from Workable to Blocked
- Assignee set to okurz
I have the suspicion that most if not all unstable test modules fail due background maintenance tasks which are triggered during random time when test modules are executed so we should do #31351 first.
Updated by okurz almost 6 years ago
- Due date changed from 2018-07-03 to 2018-07-31
due to changes in a related task
Updated by okurz almost 6 years ago
- Blocked by action #38702: [functional][u] apply workaround for bsc#1096401 "snapper terminates with core dump" added
Updated by okurz over 5 years ago
- Target version changed from Milestone 18 to Milestone 19
Updated by mgriessmeier over 5 years ago
- Due date changed from 2018-09-25 to 2018-08-10
due to changes in a related task
Updated by okurz over 5 years ago
- Due date changed from 2018-07-31 to 2018-12-18
due to changes in a related task
Updated by okurz over 5 years ago
- Target version changed from Milestone 19 to Milestone 21
Updated by okurz over 5 years ago
This is an autogenerated message for openQA integration by the openqa_review script:
This bug is still referenced in a failing openQA test: gnome@64bit-2G
https://openqa.opensuse.org/tests/773162
Updated by okurz over 5 years ago
This is an autogenerated message for openQA integration by the openqa_review script:
This bug is still referenced in a failing openQA test: gnome@64bit-2G
https://openqa.opensuse.org/tests/781739
Updated by okurz over 5 years ago
This is an autogenerated message for openQA integration by the openqa_review script:
This bug is still referenced in a failing openQA test: zdup-Leap-42.3-gnome@64bit-2G
https://openqa.opensuse.org/tests/791030
Updated by okurz over 5 years ago
- Target version changed from Milestone 21 to Milestone 22
Updated by okurz about 5 years ago
- Due date changed from 2018-12-18 to 2019-03-12
due to changes in a related task
Updated by okurz about 5 years ago
- Status changed from Blocked to Workable
- Assignee deleted (
okurz) - Target version changed from Milestone 22 to Milestone 24
More tasks to pick up for others
Updated by okurz about 5 years ago
- Assignee set to okurz
After discussion in the planning meeting I will refine.
Updated by okurz about 5 years ago
- Due date changed from 2019-03-12 to 2019-06-30
due to changes in a related task
Updated by okurz about 5 years ago
- Status changed from Workable to Blocked
- Target version changed from Milestone 24 to Milestone 25
Hm, looking at the latest snapshot I could not find obvious test instabilities for now except maybe ooffice which is currently blocked by https://bugzilla.suse.com/show_bug.cgi?id=1127895
With this we can actually wait for the still open subtasks about vlc and kontact first as well as above bug. Then revisit.
Updated by okurz almost 5 years ago
- Assignee changed from okurz to mgriessmeier
Move to new QSF-u PO after I moved to the "tools"-team. I mainly checked the subject line so in individual instances you might not agree to take it over completely into QSF-u. Feel free to discuss with me or reassign to me or someone else in this case. Thanks.
Updated by mgriessmeier almost 5 years ago
- Target version changed from Milestone 25 to Milestone 26
Updated by mgriessmeier over 4 years ago
- Target version changed from Milestone 26 to Milestone 28
revisit in M28
Updated by mgriessmeier over 4 years ago
removed due date to prevent email spam
Updated by mgriessmeier over 4 years ago
- Due date changed from 2019-06-30 to 2018-08-17
due to changes in a related task
Updated by mgriessmeier over 4 years ago
- Target version changed from Milestone 28 to Milestone 35+
Updated by okurz about 4 years ago
- Related to action #63334: [functional][u][sporadic] test fails in chromium to go to "about/version" page in adress bar added
Updated by SLindoMansilla about 4 years ago
- Status changed from Blocked to New
- Assignee changed from mgriessmeier to SLindoMansilla
Updated by SLindoMansilla almost 4 years ago
- Due date changed from 2018-07-31 to 2018-08-17
due to changes in a related task: #35685
Updated by SLindoMansilla almost 4 years ago
- Due date changed from 2018-07-31 to 2018-08-17
due to changes in a related task: #35688
Updated by szarate over 3 years ago
- Tracker changed from action to coordination
Updated by szarate over 3 years ago
See for the reason of tracker change: http://mailman.suse.de/mailman/private/qa-sle/2020-October/002722.html
Updated by tjyrinki_suse over 3 years ago
- Subject changed from [opensuse][functional][u][epic][sporadic] Various unstable tests on o3 to [qe-core][opensuse][functional][epic][sporadic] Various unstable tests on o3