Project

General

Profile

Actions

action #94853

closed

[qe-core] new testruns added to leap 15.3 which are RED

Added by msmeissn over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
Bugs in existing tests
Target version:
QA (public, currently private due to #173521) - QE-Core: Ready
Start date:
2021-07-02
Due date:
% Done:

100%

Estimated time:
Difficulty:

Description

Observation

openQA test in scenario opensuse-15.3-DVD-Updates-x86_64-extra_tests_textmode@64bit-2G fails in
zypper_extend

Test suite description

Maintainer: slindomansilla@suse.de.
Mainly post-installation console extra tests.

Reproducible

Fails since (at least) Build 20210628-2 (current job)

Expected result

Last good: (unknown) (or more recent)

Further details

Always latest result in this scenario: latest


Related issues 2 (0 open2 closed)

Related to openQA Tests (public) - action #93089: [qe-core][opensuse] Leap 15.3 test fails in zypper_extendResolvedpunkioudi

Actions
Related to openQA Tests (public) - action #95036: [Leap 15.3 Updates] Jobs are being restarted often, not allowing the previous jobs to finishResolvedpunkioudi2021-07-02

Actions
Actions #1

Updated by msmeissn over 3 years ago

hi, new testruns where added in RED state to Leap 15.3 Maintenance.

pelase either fix them immediately or remove them

Actions #2

Updated by maritawerner over 3 years ago

  • Subject changed from new testruns added to leap 15.3 which are RED to [qe-core] new testruns added to leap 15.3 which are RED
Actions #3

Updated by tjyrinki_suse over 3 years ago

  • Status changed from New to Workable
  • Target version set to QE-Core: Ready
Actions #4

Updated by punkioudi over 3 years ago

This is the current state of the jobs running in Leap 15.3 Updates : https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=20210630-2&groupid=80

I have already fixed some configurations and some tests,done re-needling, added labels for progress tickets and bugs.
My question here is (as there is no PO for these tests + no specific squad responsible for the tests), should I just remove the failing tests, till they are fixed?

Actions #5

Updated by szarate over 3 years ago

  • Related to action #93089: [qe-core][opensuse] Leap 15.3 test fails in zypper_extend added
Actions #6

Updated by szarate over 3 years ago

Anna, for now unscheduled the test for the time being, until responsibilities are clearer.

Actions #7

Updated by szarate over 3 years ago

Marcus, does this block maintenance updates on the leap side? (I mean, failing tests in openQA's leap jobs)

Actions #8

Updated by punkioudi over 3 years ago

@szarate, I will do the following : soft-fail the tests with the bugs and remove the others that need changes in the code. Is it ok like this?

Actions #9

Updated by punkioudi over 3 years ago

  • Status changed from Workable to In Progress
  • Assignee set to punkioudi
Actions #10

Updated by geor over 3 years ago

Can someone explain to me why it is a problem to keep the failing tests visible in the leap runs?

Actions #11

Updated by punkioudi over 3 years ago

Small update, the following testcases have been removed from the runs (https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=20210701-1&groupid=80):

  • extra_tests_gnome
  • extra_tests_textmode
  • kde
  • yast2_gui

There are already progress issues created for the tests that are failing.

Actions #12

Updated by szarate over 3 years ago

punkioudi wrote:

@szarate, I will do the following : soft-fail the tests with the bugs and remove the others that need changes in the code. Is it ok like this?

Sounds good

Actions #13

Updated by punkioudi over 3 years ago

  • Related to action #95036: [Leap 15.3 Updates] Jobs are being restarted often, not allowing the previous jobs to finish added
Actions #15

Updated by punkioudi over 3 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 0 to 100
Actions

Also available in: Atom PDF