action #25032
closedenable openQA maintenance testing
100%
Description
openQA and the bot needs to be set up to also test maintenance updates for the new release
Updated by lnussel over 6 years ago
- Copied from action #16996: enable openQA maintenance testing added
Updated by lnussel about 6 years ago
- Due date changed from 2018-03-02 to 2018-04-15
- Start date changed from 2018-02-16 to 2018-04-01
Updated by lnussel about 6 years ago
- Category changed from QA to QA
- Assignee set to okurz
Not sure who would take care of this nowadays but it makes sense to look into setting this up early.
Updated by okurz about 6 years ago
I don't think anyone has done anything here yet. I wanted to talk to coolo personally, then I forgot about it, then I missed the opportunity again, then … sorry :(
Will address in daily jangouts call.
Updated by lnussel about 6 years ago
- Due date changed from 2018-04-15 to 2018-04-19
- Priority changed from Normal to High
Updated by okurz about 6 years ago
- Status changed from New to Feedback
coolo is reworking openSUSE maintenance tests, plan to have leap 15.0 maintenance tests after 42.3 calmed down. SLE had a "new" approach since 2017-07 which will also be applied to openSUSE tests now. Maint.+QAM plans to drive the work on the tests to have them ready for SLE15+Leap15.0
Updated by okurz about 6 years ago
I created openQA job groups openSUSE Leap 15.0 Updates and … Incidents with the test plan taken over from Leap 42.3 for now:
for i in Incidents Updates ; do openqa-dump-templates --host https://openqa.opensuse.org --group "openSUSE Leap 42.3 $i" --full | sed -e 's/42\.3/15.0/g' > leap_15.0_$i && openqa-load-templates --host https://openqa.opensuse.org leap_15.0_$i ; done
And manually using the webui on https://openqa.opensuse.org/admin/groups put the job group in the right position as subgroup to openSUSE Leap behind the other openSUSE Leap 15.0 jobs.
Now, how to ensure the maintenance bot can make use of these? And where can I monitor the bot operating, e.g. tail logfile or screen session to attach to?
Updated by okurz about 6 years ago
- Related to action #35377: dump-templates renders versions not always as string added
Updated by okurz almost 6 years ago
coolo and tacit setup the openqa-maintenance bot to work aligned with the SLE workflow. test-updates are triggered, openQA tests fail due to necessary test adaption. I understood that SUSE QAM confirmed that they would take responsibility for the necessary openQA test adaptions but I have not seen effects of this so far. I would adress the question again about the current state to coolo latest on next RM call, e.g. next Monday or Wednesday.
Updated by okurz almost 6 years ago
- Related to action #35694: [qam] test fails in welcome - Tests not adapted for "beta warning" on Leap 15 with updates added
Updated by okurz almost 6 years ago
Incidents and Updates tests are in place, tests can work in principle, e.g. see textmode passing. tacit wanted to clarify who are the responsibles persons from maintenance/QAM for adapting the openQA tests as well as regular test review. QSF (QA SLE functional) would stand ready for support but only for exceptional handling.
Updated by lnussel almost 6 years ago
Looks like for install_with_updates the installation/setup_online_repos test needs to be called earlier. Could you just fix that? We really need that setup up ASAP.
other tests fail in gnucash due to low disk space and in applying online updates. Not sure why that happens given that the same test works in the main project.
The kde test fails in applying online updates due to outdated disk images which results in too many updates installed. Could you move the symlink on openqa.o.o forward please?
Updated by okurz almost 6 years ago
- Status changed from Feedback to In Progress
Ok, let's see what we can do.
lnussel wrote:
The kde test fails in applying online updates due to outdated disk images which results in too many updates installed. Could you move the symlink on openqa.o.o forward please?
Done.
As root on o3:
cd /var/lib/openqa/share/factory/iso/fixed/
rm openSUSE-Leap-15.0-DVD-x86_64.iso
rm openSUSE-Leap-15.0-Build213.2-DVD-x86_64.iso
ln ../openSUSE-Leap-15.0-DVD-x86_64-Build235.2-Media.iso openSUSE-Leap-15.0-DVD-x86_64.iso
Updated by okurz almost 6 years ago
- Related to action #35604: [opensuse][functional][u] test fails in gnucash, not closing correctly added
Updated by okurz almost 6 years ago
- Related to action #34717: [functional][u][easy][fast] adjust gnucash test per gnucash 3.0 update added
Updated by okurz almost 6 years ago
- Related to action #35685: [opensuse][functional][u][sporadic][medium] Various unstable tests on o3 - user_gui_login + gnucash added
Updated by okurz almost 6 years ago
- Related to action #35994: [functional][opensuse][y][leap15.0][fast] adapt maintenance tests for install_with_updates - test fails in setup_online_repos added
Updated by okurz almost 6 years ago
- Status changed from In Progress to Resolved
- % Done changed from 70 to 100
incident tests are fine, update tests are also all ok with https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.0&build=20180508-4&groupid=55 so I guess we are done here
Updated by lnussel over 5 years ago
- Copied to action #39449: enable openQA maintenance testing added
Updated by szarate over 3 years ago
- Related to action #72202: [qe-core] setup openSUSE Leap 15.3 openQA added