action #35685
closedcoordination #35302: [qe-core][opensuse][functional][epic][sporadic] Various unstable tests on o3
[opensuse][functional][u][sporadic][medium] Various unstable tests on o3 - user_gui_login + gnucash
0%
Description
Observation¶
gnucash fails from time to time in various scenarios, mainly upgrade scenarios, e.g. see
DVD/update-leap-42.2-gnome
DVD/update-leap-42.3-gnome
The SUT locks the screen before finishing the test
All examples are update tests, we should keep that in mind
Acceptance criteria¶
AC1: Tests do not end in lockscreen anymore
Suggestions¶
- Evaluate test failures from #35685#note-37
- Crosscheck with 100 tests on local worker
- If more tests fail on production than on local worker make sure that production workers are more stable, e.g. #38150
Updated by okurz almost 6 years ago
- Related to action #34717: [functional][u][easy][fast] adjust gnucash test per gnucash 3.0 update added
Updated by okurz almost 6 years ago
- Due date changed from 2018-05-22 to 2018-06-05
Should follow #34717
Updated by okurz almost 6 years ago
- Related to action #35604: [opensuse][functional][u] test fails in gnucash, not closing correctly added
Updated by okurz almost 6 years ago
- Related to action #25032: enable openQA maintenance testing added
Updated by SLindoMansilla almost 6 years ago
- Subject changed from [opensuse][functional][u][sporadic] Various unstable tests on o3 - gnucash to [opensuse][functional][u][sporadic][medium] Various unstable tests on o3 - gnucash
Updated by jorauch almost 6 years ago
- Status changed from Workable to In Progress
- Assignee set to jorauch
Recent failure:
https://openqa.opensuse.org/tests/679623#step/gnucash/46
Updated by jorauch almost 6 years ago
- Description updated (diff)
How was this even workable without AC and description?
Updated by okurz almost 6 years ago
jorauch wrote:
How was this even workable without AC and description?
For the category "Bugs in existing tests" we normally do not specify ACs additional to the DoD. Therefore the implicit ACs are something like "Test passes or fails in valid product bugs"
Updated by jorauch almost 6 years ago
Latest failure
https://openqa.opensuse.org/tests/679623#step/gnucash/48
We have a black screen before the SUT locks itself, is this normal behavior?
https://openqa.opensuse.org/tests/679623/file/video.ogv#t=287.42,287.46
Updated by jorauch almost 6 years ago
Not really sporadic, happens quite often:
https://openqa.opensuse.org/tests/684294#step/gnucash/49
Updated by mgriessmeier almost 6 years ago
- Due date changed from 2018-06-05 to 2018-06-19
- Status changed from In Progress to Workable
- Assignee deleted (
jorauch) - Target version changed from Milestone 16 to Milestone 17
Updated by okurz almost 6 years ago
keep in mind that zluo is working on #34717 atm
Updated by dheidler almost 6 years ago
The question is why the screensaver kicks in, if less than one minute ago the some programm was started using keyboard commands.
Updated by dheidler almost 6 years ago
Could not reproduce locally - started 100 jobs on o3: https://openqa.opensuse.org/tests/overview?distri=opensuse&version=Tumbleweed&build=2018060%3Apoo35685&groupid=38
Updated by dheidler almost 6 years ago
- Status changed from Workable to In Progress
Updated by dheidler almost 6 years ago
Only one of the 100 tests that I scheduled had the problem: https://openqa.opensuse.org/tests/690596#step/gnucash/47
Updated by okurz almost 6 years ago
Make it fail less than 1/1000 and we can close it.
Updated by dheidler almost 6 years ago
Do you want me to schedule 1000 jobs on o3?
Updated by okurz almost 6 years ago
Yes please. Especially because it is just before the weekend and there is less load on the system on a weekend anyway. Moreover, maxlin is probably already done with his work day and DimStar on holiday and the last TW snapshots have bigger problems and most likely will not be released soon, perfect timing :-)
Updated by okurz almost 6 years ago
- Target version changed from Milestone 17 to Milestone 17
Updated by dheidler almost 6 years ago
- Target version deleted (
Milestone 17)
Out of 1000 Jobs roughly 40% were canceled for some reason.
From the rest I found the following five jobs that had the gnucash screensaver issue:
https://openqa.opensuse.org/t692009
https://openqa.opensuse.org/t692052
https://openqa.opensuse.org/t692055
https://openqa.opensuse.org/t692195
https://openqa.opensuse.org/t692271
Updated by okurz almost 6 years ago
- Subject changed from [opensuse][functional][u][sporadic][medium] Various unstable tests on o3 - gnucash to [opensuse][functional][u][sporadic][medium] Various unstable tests on o3 - user_gui_login + gnucash
- Description updated (diff)
- Due date changed from 2018-06-19 to 2018-07-03
- Status changed from In Progress to Workable
- Assignee deleted (
dheidler)
from the test statistics the observation from #35685#note-14 still holds. By the way, of 1k jobs none passed, most if not all failed in "zypper_ar", many in "user_gui_login", e.g. see https://openqa.opensuse.org/tests/692009#step/user_gui_login/13. The latter could be related because the problem in gnucash is about the display manager or screen saver as well. This should be addressed first. I see no point in not relying on the information we have here so I extended the summary to mention "user_gui_login" as well. The acceptance criterion still holds true.
Updated by okurz almost 6 years ago
- Has duplicate action #37555: [opensuse][functional][u] test fails in user_gui_login - relogin doesn't reach display manager added
Updated by okurz almost 6 years ago
From duplicate:
openQA test in scenario opensuse-Tumbleweed-NET-x86_64-update_Leap_42.3_gnome@64bit fails in
user_gui_login
Always latest result in this scenario: latest
Updated by SLindoMansilla almost 6 years ago
- Status changed from Workable to In Progress
- Assignee set to SLindoMansilla
Updated by SLindoMansilla almost 6 years ago
Some of the failures I can see are caused by a dependency error like this: https://openqa.opensuse.org/tests/693346#step/gnucash/12
This error was handle on https://progress.opensuse.org/issues/37450
Updated by SLindoMansilla almost 6 years ago
- Related to action #37450: gnucash test fails to work due to gnucash 3.1 uninstallable added
Updated by okurz almost 6 years ago
I have the suspicion that most if not all unstable test modules fail due background maintenance tasks which are triggered during random time when test modules are executed so we should do #31351 first. Feel free to set to "Blocked", keep assigned or assign to me and set to sprint 22, i.e. M18 with due date 2018-07-31
Updated by SLindoMansilla almost 6 years ago
- Status changed from In Progress to Blocked
- Assignee deleted (
SLindoMansilla)
Let's avoid people work on or waste time re investigating/refining this ticket until this issue get solved: force_cron_run does not actually run any crons https://progress.opensuse.org/issues/31351
Updated by okurz almost 6 years ago
- Assignee set to okurz
@SLindoMansilla please don't keep unassigned blocked tickets. It's ok if you want to assign to me. Blocked by parent ticket which is blocked by #31351
Updated by mgriessmeier almost 6 years ago
- Due date changed from 2018-07-03 to 2018-07-17
Updated by okurz almost 6 years ago
- Status changed from Blocked to Workable
#31351 done, we should check stability over time. I guess I can do that next sprint.
Updated by okurz almost 6 years ago
- Status changed from Workable to In Progress
for i in {001..100} ; do openqa_clone_job_o3 --skip-chained-deps 700435 TEST=okurz_poo35685_$i BUILD=20180701:poo35685 _GROUP="Development Tumbleweed" ; done
Updated by okurz almost 6 years ago
Updated by okurz almost 6 years ago
- Related to action #38114: [functional][u] GnuCash does not close on LXDE added
Updated by okurz almost 6 years ago
- Status changed from In Progress to Resolved
Conducted a test run with 20 kde jobs with 1/20 failures in reboot_plasma5 which is handled in #37000. Tests on o3 seem to be more stable now