Project

General

Profile

action #94853

[qe-core] new testruns added to leap 15.3 which are RED

Added by msmeissn 3 months ago. Updated about 2 months ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
Bugs in existing tests
Target version:
Start date:
2021-07-02
Due date:
% Done:

100%

Estimated time:
Difficulty:

Description

Observation

openQA test in scenario opensuse-15.3-DVD-Updates-x86_64-extra_tests_textmode@64bit-2G fails in
zypper_extend

Test suite description

Maintainer: slindomansilla@suse.de.
Mainly post-installation console extra tests.

Reproducible

Fails since (at least) Build 20210628-2 (current job)

Expected result

Last good: (unknown) (or more recent)

Further details

Always latest result in this scenario: latest


Related issues

Related to openQA Tests - action #93089: [qe-core][opensuse] Leap 15.3 test fails in zypper_extendResolved

Related to openQA Tests - action #95036: [Leap 15.3 Updates] Jobs are being restarted often, not allowing the previous jobs to finishResolved2021-07-02

History

#1 Updated by msmeissn 3 months ago

hi, new testruns where added in RED state to Leap 15.3 Maintenance.

pelase either fix them immediately or remove them

#2 Updated by maritawerner 3 months ago

  • Subject changed from new testruns added to leap 15.3 which are RED to [qe-core] new testruns added to leap 15.3 which are RED

#3 Updated by tjyrinki_suse 3 months ago

  • Status changed from New to Workable
  • Target version set to QE-Core: Ready

#4 Updated by punkioudi 3 months ago

This is the current state of the jobs running in Leap 15.3 Updates : https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=20210630-2&groupid=80

I have already fixed some configurations and some tests,done re-needling, added labels for progress tickets and bugs.
My question here is (as there is no PO for these tests + no specific squad responsible for the tests), should I just remove the failing tests, till they are fixed?

#5 Updated by szarate 3 months ago

  • Related to action #93089: [qe-core][opensuse] Leap 15.3 test fails in zypper_extend added

#6 Updated by szarate 3 months ago

Anna, for now unscheduled the test for the time being, until responsibilities are clearer.

#7 Updated by szarate 3 months ago

Marcus, does this block maintenance updates on the leap side? (I mean, failing tests in openQA's leap jobs)

#8 Updated by punkioudi 3 months ago

szarate, I will do the following : soft-fail the tests with the bugs and remove the others that need changes in the code. Is it ok like this?

#9 Updated by punkioudi 3 months ago

  • Status changed from Workable to In Progress
  • Assignee set to punkioudi

#10 Updated by geor 3 months ago

Can someone explain to me why it is a problem to keep the failing tests visible in the leap runs?

#11 Updated by punkioudi 3 months ago

Small update, the following testcases have been removed from the runs (https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=20210701-1&groupid=80):

  • extra_tests_gnome
  • extra_tests_textmode
  • kde
  • yast2_gui

There are already progress issues created for the tests that are failing.

#12 Updated by szarate 3 months ago

punkioudi wrote:

szarate, I will do the following : soft-fail the tests with the bugs and remove the others that need changes in the code. Is it ok like this?

Sounds good

#13 Updated by punkioudi 3 months ago

  • Related to action #95036: [Leap 15.3 Updates] Jobs are being restarted often, not allowing the previous jobs to finish added

#15 Updated by punkioudi 3 months ago

  • Status changed from In Progress to Resolved
  • % Done changed from 0 to 100

Also available in: Atom PDF