action #9496
closedStaging Upgrade Tests
Added by RBrownSUSE over 8 years ago. Updated over 7 years ago.
0%
Description
As upgrade tests are considered blocker bugs, we need to test them in stagings - ironically we do for factory stagings, but not in sp1
Updated by RBrownSUSE over 8 years ago
- Checklist item changed from to [ ] TW, [ ] Leap, [ ] SLE
- Target version deleted (
154)
Updated by maritawerner over 7 years ago
- Assignee set to RBrownSUSE
From my understanding Stefan Behlert does not want that, so can I close that ticket?
Updated by RBrownSUSE over 7 years ago
Stefan Behlert is not the only SLE release manager, and regardless I would strongly recommend at least one upgrade test for both SP3 and SLE 13 staging
I think we should discuss it with Anja and Frederic re: SP3 and I'd happily re-discuss it with Stefan if he truely dislikes the idea
Updated by maritawerner over 7 years ago
- Priority changed from Normal to High
Ok, so let's discuss. I move it to high to not forget.
Updated by okurz over 7 years ago
- Status changed from New to In Progress
- Assignee changed from RBrownSUSE to okurz
- Target version set to Milestone 4
Working on it. As discussed with coolo and RM, staging:Y should be used for that to convince RM that it works and helps.
I created the test suite migration_zdup_offline_sle12sp2_staging with
DESKTOP=gnome
HDD_1=%DISTRI%-12-SP2-Server-DVD-%ARCH%-gnome.qcow2
ZDUP=1
We could not reuse the non-staging test_suites as they have the %FLAVOR% variable included and that would not match for FLAVOR=Server-DVD-Staging:Y unless we would create a symlink in /var/lib/openqa/share/factory/hdd/fixed.
https://openqa.suse.de/tests/655082 was triggered, fails now in https://openqa.suse.de/tests/655082#step/zdup/14 not being able to find the cd drive.
couldn't get the interactive mode to work to come up with a grub needle. So In the end I didn't care anymore about all this version checking. I created a generic needle for grub valid for all SLES versions. We could mark it as "workaround" so that we can just catch that instance and create a version specific needle then but then the workaround needle would always match with precedence.
Updated by okurz over 7 years ago
Updated by okurz over 7 years ago
SLE considered done with https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/2180 merged, verification run (not finished at time of writing): https://openqa.suse.de/tests/655127
Minor fixes might be necessary, let's see.
@lnussel, @dimstar: Now, for openSUSE, should I add the same and try it out?
Updated by okurz over 7 years ago
- Status changed from In Progress to Resolved
staging test might take a bit long with all tests enabled.
I set INSTALLONLY=1 on the test suite on osd now.
For openSUSE we already have proper update(/upgrade) tests, e.g. see https://openqa.opensuse.org/tests/latest?flavor=Staging2-DVD&arch=x86_64&machine=64bit&distri=opensuse&test=update_staging
I just assume the same also applies for Leap, at least the test suite is there and it should be used.