action #31954
closedcoordination #31972: [qe-core][opensuse][functional][epic][userspace][medium]Harmonize openSUSE/SLE test module schedule
[functional][y][medium]harmonize updating handling in openSUSE/SLE schedule
0%
Description
Motivation¶
The test schedule for applying updates during the functional validation tests differ among openSUSE and SLE. This should be harmonized.
Acceptance criteria¶
- AC1: The same schedule is applied for both openSUSE/SLE or differences are explained with good comments
Suggestions¶
SLE has:
if (gnomestep_is_applicable()) {
loadtest "update/updates_packagekit_gpk" unless is_staging;
loadtest "x11/gnome_control_center";
loadtest "x11/gnome_terminal";
loadtest "x11/gedit";
}
in load_x11tests
, and
if (!gnomestep_is_applicable()) {
loadtest "update/zypper_up";
}
in load_consoletests
whereas openSUSE has a helper function load_system_update_tests
including both above parts at one common location which I think makes more sense. With https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/4432/files this deviation becomes more apparent and could be solved after that.
- Take a look on git log who has added individual parts which introduce different behavior
- Test on different scenarios if we can use same approach for all of them (which may different from current)
- Leaving some scheduling parts as they are with comment in the code why it is so
Checklist
- Refcator code
- Apply same schedule for all distribution with least possible number of exceptions
- All not obvious exceptions are explained with the comment
Updated by okurz about 7 years ago
- Subject changed from [functional]harmonize updating handling in openSUSE/SLE schedule to [functional][medium]harmonize updating handling in openSUSE/SLE schedule
- Due date changed from 2018-03-27 to 2018-04-10
- Status changed from In Progress to Workable
- Assignee deleted (
okurz)
https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/4432 merged. Now the next step could be conducted to check for a common way to handle updates in both openSUSE+SLE cases.
Updated by okurz about 7 years ago
- Subject changed from [functional][medium]harmonize updating handling in openSUSE/SLE schedule to [functional][u][medium]harmonize updating handling in openSUSE/SLE schedule
- Due date changed from 2018-04-10 to 2018-04-24
not enough capacity in S14, moving, sigh
Updated by okurz about 7 years ago
- Due date changed from 2018-04-24 to 2018-06-05
- Priority changed from Normal to Low
- Target version changed from Milestone 15 to Milestone 16
not enough capacity in S15-S17.
Updated by mgriessmeier almost 7 years ago
- Due date changed from 2018-06-05 to 2018-06-19
Updated by mgriessmeier almost 7 years ago
- Subject changed from [functional][u][medium]harmonize updating handling in openSUSE/SLE schedule to [functional][y][medium]harmonize updating handling in openSUSE/SLE schedule
[y] team has more capacity
Updated by JERiveraMoya almost 7 years ago
- Status changed from Workable to Feedback
Updated by okurz almost 7 years ago
- Target version changed from Milestone 16 to Milestone 17
M17 by now
Updated by okurz almost 7 years ago
- Target version changed from Milestone 17 to Milestone 17
Updated by riafarov almost 7 years ago
- Due date changed from 2018-06-19 to 2018-07-03
Updated by riafarov almost 7 years ago
- Related to action #37979: [SLE] test fails in updates_packagekit_gpk - gpk-update-viewer doesn't start added
Updated by okurz almost 7 years ago
- Status changed from Feedback to In Progress
We had to revert the PR with https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/5308 (riafarov convinced me)
https://openqa.suse.de/tests/1790992# really looks strange. The x11 test module "updates_packagekit_gpk" definitely should not be scheduled somewhere in the middle of console tests. Please try to fix that and I suggest to test multiple scenarios without needing openQA itself but just evaluate the schedule and provide that in the PR as text output, e.g. download vars.json files from all the relevant scenarios and call
isotovideo -d _exit_after_schedule=1
in each directory where you prepared the vars.json file.
Updated by riafarov almost 7 years ago
- Due date changed from 2018-07-03 to 2018-07-17
Updated by riafarov almost 7 years ago
- Estimated time changed from 5.00 h to 8.00 h
Updated by JERiveraMoya almost 7 years ago
- Status changed from In Progress to Feedback
Updated by riafarov over 6 years ago
- Due date changed from 2018-07-17 to 2018-07-31
Updated by okurz over 6 years ago
- Related to action #38393: [functional][u] updates_packagekit_kde must not be scheduled before zypper_clear_repos added
Updated by okurz over 6 years ago
- Target version changed from Milestone 17 to Milestone 18
Updated by riafarov over 6 years ago
- Due date changed from 2018-07-31 to 2018-08-14
Updated by riafarov over 6 years ago
- Status changed from Feedback to Workable
- Assignee deleted (
JERiveraMoya)
jrivera did a great job to refactor the code, so now we have problem isolated and concentrated in one place.
Remaining questions,
why do we need
loadtest "update/prepare_system_for_update_tests" if !is_sle;
loadtest "update/check_system_is_updated" if !is_sle;
How is it done in sle?
Why we have issue for sle && staging, and not for staging in general?
Updated by riafarov over 6 years ago
- Checklist item changed from to [x] Refcator code, [ ] Apply same schedule for all distribution with least possible number of exceptions, [ ] All not obvious exceptions are explained with the comment
Updated by riafarov over 6 years ago
- Due date changed from 2018-08-14 to 2018-09-25
- Target version changed from Milestone 18 to Milestone 19
Updated by riafarov over 6 years ago
- Status changed from Workable to Feedback
Updated by riafarov over 6 years ago
- Due date changed from 2018-09-25 to 2018-10-09
Updated by okurz over 6 years ago
PR is merged, seems to work. Thanks for your work. I guess we still have the two questions https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/5826/files#r220340942 and https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/5826/files#r220341144 open so that we could cross off the next two points on the checklist?
Updated by riafarov over 6 years ago
I've replied to both questions. If you feel brave, I would simply remove that change to zypper. As for the first case, problem is that next test either expects root-console or x11, which is tricky to detect. Simply adding select-console('x11') in the next one did't help, and I believe may break quite some tests too. Therefore I would not proceed with these 2 considering risks, efforts and gain we get.
Updated by riafarov over 6 years ago
- Checklist item changed from [x] Refcator code, [ ] Apply same schedule for all distribution with least possible number of exceptions, [ ] All not obvious exceptions are explained with the comment to [x] Refcator code, [x] Apply same schedule for all distribution with least possible number of exceptions, [x] All not obvious exceptions are explained with the comment