Project

General

Profile

Actions

action #40331

closed

[functional][y] select_patterns_and_packages ignores dependency issues

Added by riafarov over 5 years ago. Updated over 5 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
Bugs in existing tests
Target version:
SUSE QA - Milestone 22
Start date:
2018-08-28
Due date:
2019-01-29
% Done:

0%

Estimated time:
8.00 h
Difficulty:

Description

Observation

In the create HDD test suite we have dependency issue which is ignored and pattern is not selected in the end, we should not hide such issues and fail the test unless it's a workaround.

openQA test in scenario sle-15-SP1-Installer-DVD-x86_64-create_hdd_pcm_azure@64bit fails in
select_patterns_and_packages

Suggestion

Cross-check with what we do for conflicts in Summary screen, leaving the possibility to work dependency issues around, but never hide them. For example, pass bug reference in the setting for workaround and use bug specific needles.

Reproducible

Fails since (at least) Build 24.13 (current job)

Acceptance criteria

  1. Test fails in case of dependency issues if not explicitly enable workaround where expect issues

Further details

Always latest result in this scenario: latest


Related issues 2 (0 open2 closed)

Related to openQA Tests - action #44948: [functional][y] Simplify PCM tests further with EXIT_AFTER_START_INSTALL and no publishing of imagesResolvedJERiveraMoya2018-12-102019-01-15

Actions
Related to openQA Tests - action #37985: [functional][y][hard] Make installation_overview page processing consistent (installation_overview and installation_overview_before are either unified or serve single purpose)Resolvedybonatakis2018-06-282019-04-09

Actions
Actions #1

Updated by okurz over 5 years ago

  • Target version set to Milestone 20
Actions #2

Updated by okurz over 5 years ago

  • Due date set to 2018-11-20
Actions #3

Updated by riafarov over 5 years ago

  • Status changed from New to Workable
Actions #4

Updated by riafarov over 5 years ago

  • Due date changed from 2018-11-20 to 2018-11-06

Having capacity in S28

Actions #5

Updated by riafarov over 5 years ago

  • Description updated (diff)
  • Estimated time set to 8.00 h
Actions #6

Updated by riafarov over 5 years ago

  • Due date deleted (2018-11-06)
  • Priority changed from Normal to Low
Actions #7

Updated by okurz over 5 years ago

  • Target version changed from Milestone 20 to Milestone 22
Actions #8

Updated by riafarov over 5 years ago

  • Due date set to 2019-01-22
  • Priority changed from Low to High

Increasing priority as again we got issues with public cloud patterns, where only child test suite was showing the issue, installation tests do not expose any of the issues.

Actions #9

Updated by JERiveraMoya over 5 years ago

  • Related to action #44948: [functional][y] Simplify PCM tests further with EXIT_AFTER_START_INSTALL and no publishing of images added
Actions #10

Updated by okurz over 5 years ago

  • Due date changed from 2019-01-22 to 2019-01-29

I think you meant the next sprint, sprint 35, ending 2019-01-29

Actions #11

Updated by okurz over 5 years ago

  • Related to action #37985: [functional][y][hard] Make installation_overview page processing consistent (installation_overview and installation_overview_before are either unified or serve single purpose) added
Actions #12

Updated by riafarov over 5 years ago

  • Assignee set to riafarov
Actions #13

Updated by riafarov over 5 years ago

  • Status changed from Workable to Feedback
Actions #15

Updated by okurz over 5 years ago

great! :)

Actions #16

Updated by riafarov over 5 years ago

  • Status changed from Resolved to In Progress
Actions #18

Updated by okurz over 5 years ago

  • Priority changed from High to Urgent

Unfortunately it's more severe now. On openSUSE Tumbleweed we have about 10 jobs failing what I all assume is about the same issue: Please also look into https://openqa.opensuse.org/tests/835452#step/select_patterns_and_packages/208 and https://openqa.opensuse.org/tests/835354#step/select_patterns_and_packages/208 and more in the same build.

Actions #19

Updated by dimstar over 5 years ago

okurz wrote:

Unfortunately it's more severe now. On openSUSE Tumbleweed we have about 10 jobs failing what I all assume is about the same issue: Please also look into https://openqa.opensuse.org/tests/835452#step/select_patterns_and_packages/208 and https://openqa.opensuse.org/tests/835354#step/select_patterns_and_packages/208 and more in the same build.

Created new matching needles for TW - which made the test pass again in e.g https://openqa.opensuse.org/tests/835855

Actions #20

Updated by dimstar over 5 years ago

https://openqa.opensuse.org/tests/835903#step/select_patterns_and_packages/211 is a real error: the pattern selection there is "-wayland", which seems to stand for 'ensure the wayland pattern is unselected'; the code seems not to understand that and looks for a pattern -wayland

Actions #21

Updated by riafarov over 5 years ago

Yep, that's a bug in comparison mechanism, will provide patch ASAP

Actions #22

Updated by riafarov over 5 years ago

  • Status changed from In Progress to Feedback

https://openqa.opensuse.org/tests/836125# additional needle was required as unselecting gnome wayland, also unselects gnome x11. Good outcome of this is that before we were not processing wayland pattern properly and it was not unselected (otherwise we would see the issue I've described).

Actions #23

Updated by riafarov over 5 years ago

  • Status changed from Feedback to Resolved

Should be fine by now.

Actions

Also available in: Atom PDF