Project

General

Profile

Actions

action #25032

closed

enable openQA maintenance testing

Added by lnussel about 7 years ago. Updated over 6 years ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
QA
Target version:
Start date:
2018-04-01
Due date:
2018-04-19
% Done:

100%

Estimated time:

Description

openQA and the bot needs to be set up to also test maintenance updates for the new release


Related issues 9 (0 open9 closed)

Related to openQA Project (public) - action #35377: dump-templates renders versions not always as stringRejected2018-04-23

Actions
Related to openQA Tests (public) - action #35694: [qam] test fails in welcome - Tests not adapted for "beta warning" on Leap 15 with updatesClosed2018-04-30

Actions
Related to openQA Tests (public) - action #35604: [opensuse][functional][u] test fails in gnucash, not closing correctlyResolvedzluo2018-04-262018-07-17

Actions
Related to openQA Tests (public) - action #34717: [functional][u][easy][fast] adjust gnucash test per gnucash 3.0 updateResolvedzluo2018-04-112018-06-19

Actions
Related to openQA Tests (public) - action #35685: [opensuse][functional][u][sporadic][medium] Various unstable tests on o3 - user_gui_login + gnucashResolvedokurz2018-04-30

Actions
Related to openQA Tests (public) - action #35994: [functional][opensuse][y][leap15.0][fast] adapt maintenance tests for install_with_updates - test fails in setup_online_reposResolvedokurz2018-05-082018-05-22

Actions
Related to openQA Tests (public) - action #72202: [qe-core] setup openSUSE Leap 15.3 openQAResolvedszarate2021-09-222022-04-08

Actions
Copied from openSUSE Leap 42.3 Release - action #16996: enable openQA maintenance testingResolvedriafarov2017-06-022017-06-16

Actions
Copied to openSUSE Leap 15.1 - action #39449: enable openQA maintenance testingResolvedpcervinka2019-03-112019-04-05

Actions
Actions #1

Updated by lnussel about 7 years ago

  • Copied from action #16996: enable openQA maintenance testing added
Actions #2

Updated by lnussel almost 7 years ago

  • Due date changed from 2018-03-02 to 2018-04-15
  • Start date changed from 2018-02-16 to 2018-04-01
Actions #3

Updated by lnussel over 6 years ago

  • Category changed from QA to QA
  • Assignee set to okurz

Not sure who would take care of this nowadays but it makes sense to look into setting this up early.

Actions #4

Updated by lnussel over 6 years ago

does this work meanwhile?

Actions #5

Updated by okurz over 6 years ago

I don't think anyone has done anything here yet. I wanted to talk to coolo personally, then I forgot about it, then I missed the opportunity again, then … sorry :(

Will address in daily jangouts call.

Actions #6

Updated by lnussel over 6 years ago

  • Due date changed from 2018-04-15 to 2018-04-19
  • Priority changed from Normal to High
Actions #7

Updated by okurz over 6 years ago

  • Status changed from New to Feedback

coolo is reworking openSUSE maintenance tests, plan to have leap 15.0 maintenance tests after 42.3 calmed down. SLE had a "new" approach since 2017-07 which will also be applied to openSUSE tests now. Maint.+QAM plans to drive the work on the tests to have them ready for SLE15+Leap15.0

Actions #8

Updated by okurz over 6 years ago

I created openQA job groups openSUSE Leap 15.0 Updates and … Incidents with the test plan taken over from Leap 42.3 for now:

for i in Incidents Updates ; do openqa-dump-templates --host https://openqa.opensuse.org --group "openSUSE Leap 42.3 $i" --full | sed -e 's/42\.3/15.0/g' > leap_15.0_$i && openqa-load-templates --host https://openqa.opensuse.org leap_15.0_$i ; done

And manually using the webui on https://openqa.opensuse.org/admin/groups put the job group in the right position as subgroup to openSUSE Leap behind the other openSUSE Leap 15.0 jobs.

Now, how to ensure the maintenance bot can make use of these? And where can I monitor the bot operating, e.g. tail logfile or screen session to attach to?

Actions #9

Updated by okurz over 6 years ago

  • Related to action #35377: dump-templates renders versions not always as string added
Actions #11

Updated by lnussel over 6 years ago

what is the status here?

Actions #12

Updated by okurz over 6 years ago

coolo and tacit setup the openqa-maintenance bot to work aligned with the SLE workflow. test-updates are triggered, openQA tests fail due to necessary test adaption. I understood that SUSE QAM confirmed that they would take responsibility for the necessary openQA test adaptions but I have not seen effects of this so far. I would adress the question again about the current state to coolo latest on next RM call, e.g. next Monday or Wednesday.

Actions #13

Updated by okurz over 6 years ago

  • Related to action #35694: [qam] test fails in welcome - Tests not adapted for "beta warning" on Leap 15 with updates added
Actions #14

Updated by lnussel over 6 years ago

what is the status here?

Actions #15

Updated by okurz over 6 years ago

Incidents and Updates tests are in place, tests can work in principle, e.g. see textmode passing. tacit wanted to clarify who are the responsibles persons from maintenance/QAM for adapting the openQA tests as well as regular test review. QSF (QA SLE functional) would stand ready for support but only for exceptional handling.

Actions #16

Updated by lnussel over 6 years ago

Looks like for install_with_updates the installation/setup_online_repos test needs to be called earlier. Could you just fix that? We really need that setup up ASAP.

other tests fail in gnucash due to low disk space and in applying online updates. Not sure why that happens given that the same test works in the main project.

The kde test fails in applying online updates due to outdated disk images which results in too many updates installed. Could you move the symlink on openqa.o.o forward please?

Actions #17

Updated by lnussel over 6 years ago

  • % Done changed from 0 to 70
Actions #18

Updated by okurz over 6 years ago

  • Status changed from Feedback to In Progress

Ok, let's see what we can do.

lnussel wrote:

The kde test fails in applying online updates due to outdated disk images which results in too many updates installed. Could you move the symlink on openqa.o.o forward please?

Done.

As root on o3:

cd /var/lib/openqa/share/factory/iso/fixed/
rm openSUSE-Leap-15.0-DVD-x86_64.iso
rm openSUSE-Leap-15.0-Build213.2-DVD-x86_64.iso
ln ../openSUSE-Leap-15.0-DVD-x86_64-Build235.2-Media.iso openSUSE-Leap-15.0-DVD-x86_64.iso
Actions #19

Updated by okurz over 6 years ago

  • Related to action #35604: [opensuse][functional][u] test fails in gnucash, not closing correctly added
Actions #20

Updated by okurz over 6 years ago

  • Related to action #34717: [functional][u][easy][fast] adjust gnucash test per gnucash 3.0 update added
Actions #21

Updated by okurz over 6 years ago

  • Related to action #35685: [opensuse][functional][u][sporadic][medium] Various unstable tests on o3 - user_gui_login + gnucash added
Actions #22

Updated by okurz over 6 years ago

  • Related to action #35994: [functional][opensuse][y][leap15.0][fast] adapt maintenance tests for install_with_updates - test fails in setup_online_repos added
Actions #23

Updated by okurz over 6 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 70 to 100

incident tests are fine, update tests are also all ok with https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.0&build=20180508-4&groupid=55 so I guess we are done here

Actions #24

Updated by lnussel over 6 years ago

  • Copied to action #39449: enable openQA maintenance testing added
Actions #25

Updated by szarate about 4 years ago

  • Related to action #72202: [qe-core] setup openSUSE Leap 15.3 openQA added
Actions

Also available in: Atom PDF