Project

General

Profile

Actions

action #29366

closed

coordination #25380: [sle][functional][epic] test fails in install - tries to install SLE12 packages -> update test for sle15

[functional][easy][bsc#1073238] Add toolchain test for openSUSE

Added by okurz over 6 years ago. Updated about 6 years ago.

Status:
Resolved
Priority:
Normal
Category:
New test
Start date:
2017-12-13
Due date:
2018-02-27
% Done:

0%

Estimated time:
Difficulty:

Description

Acceptance criteria

  • AC1: The toolchain tests are scheduled for openSUSE Tumbleweed
  • AC2: Same for openSUSE Leap 15.0

Job groups


Related issues 2 (0 open2 closed)

Related to openQA Tests - action #28854: [sle][functional][easy]test fails in kdump_and_crash -> enable dev-tools module in scenario or create new oneResolvedriafarov2017-12-052018-02-27

Actions
Related to openQA Tests - coordination #17436: [tools][functional][y][epic] tests must not have access to published repos, e.g. download.o.o on Tumbleweed -> remove all references to download.o.o from repos during installation and afterwardsResolvedriafarov2018-02-122019-02-26

Actions
Actions #1

Updated by JERiveraMoya over 6 years ago

Created in OOO Toolchain test suite, scheduled for x86_64 for Tumbleweed and Leap 15.0 (with help of @SLindoMansilla's permissions, requesting mine for second time in factory channel).

Actions #2

Updated by SLindoMansilla over 6 years ago

  • Subject changed from [functional]Add toolchain test for openSUSE to [functional][easy] Add toolchain test for openSUSE
  • Description updated (diff)
  • Status changed from New to In Progress
  • Assignee set to SLindoMansilla
Actions #3

Updated by okurz over 6 years ago

wow, did you just add the testsuite to TW and Leap 15.0 without testing? Also, I don't see it in the Leap 15.0 schedule

Actions #4

Updated by JERiveraMoya over 6 years ago

For Leap 15.0, fails in install test due to pattern devel_basis doesn't work: http://dhcp227/tests/800 (if openSUSE should share the same code base, probably a bug?)
For Tumbleweed succeeded: http://dhcp227/tests/798
PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/4084

Actions #5

Updated by SLindoMansilla over 6 years ago

test suite disabled for Leap 15 on O3

Actions #6

Updated by SLindoMansilla over 6 years ago

Verification run of test suite on O3: https://openqa.opensuse.org/tests/560613

Changes from PR needed to fully test on Leap 15.

Actions #7

Updated by SLindoMansilla over 6 years ago

gh#PR/4084 was merged.
Waiting for verification run on OSD

Actions #9

Updated by SLindoMansilla over 6 years ago

  • Status changed from In Progress to Feedback
Actions #10

Updated by okurz over 6 years ago

Leap 15 failed in what looks like a product bug about patterns: https://openqa.opensuse.org/tests/560909#step/install/10

I see that the change to products/opensuse/main.pm is a near duplication of the SLE code which I consider suboptimal. I am proposing a change to the main.pm files but I wonder why you did not schedule "kdump_and_crash" for openSUSE. Does it not work for a specific reason? That should be included or at least properly reasoned.

https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/4089 for the simplification.

Actions #11

Updated by JERiveraMoya over 6 years ago

https://bugzilla.opensuse.org/show_bug.cgi?id=1073238
Refactoring the code as you propose does not make it more optimal, it is just nicer. I am wondering why you didn't use another ticket to enhance the main.pm in openSUSE (anyway you didn't mention this ticket in your PR).
Same answer for kdump_and_crash, good that you noticed, but it was not include on purpose, because the test was not yet in openSUSE scheduled, and we can create another ticket to verify that. Also you know that this test is not scheduled always in sle15 and there is a known bug for it, so better put aside for a while.

Actions #12

Updated by SLindoMansilla over 6 years ago

  • Related to action #28854: [sle][functional][easy]test fails in kdump_and_crash -> enable dev-tools module in scenario or create new one added
Actions #13

Updated by SLindoMansilla over 6 years ago

  • Related to coordination #17436: [tools][functional][y][epic] tests must not have access to published repos, e.g. download.o.o on Tumbleweed -> remove all references to download.o.o from repos during installation and afterwards added
Actions #14

Updated by SLindoMansilla over 6 years ago

  • Due date set to 2018-01-16
  • Status changed from Feedback to In Progress

Blocker Bug was resolved (bsc#1073238#c3). Ticket workable again.

Pre-planning for sprint 8

Actions #15

Updated by JERiveraMoya over 6 years ago

Bug reopened: testing in my local openQA instance (before scheduling it in O3 or trying to clone with _GROUP_0, which I can't because I don't have API keys in O3) and using latest image and iso, the problem persists: http://dhcp227/tests/819.

Actions #16

Updated by JERiveraMoya over 6 years ago

  • Status changed from In Progress to Feedback
Actions #17

Updated by JERiveraMoya over 6 years ago

Verification in o3 ooo#573267#10 & bug updated bsc#1073238#c7

Actions #18

Updated by JERiveraMoya over 6 years ago

  • Status changed from Feedback to Blocked
Actions #19

Updated by okurz over 6 years ago

  • Subject changed from [functional][easy] Add toolchain test for openSUSE to [functional][easy][bsc#1073238] Add toolchain test for openSUSE
  • Due date changed from 2018-01-16 to 2018-01-30

mass-shift of tickets to next sprint due to training on sprint review day

Actions #20

Updated by riafarov about 6 years ago

  • Due date changed from 2018-01-30 to 2018-02-13

Revisit in next sprint, should be workable

Actions #22

Updated by riafarov about 6 years ago

  • Due date changed from 2018-02-13 to 2018-02-27

Sergio, please check if can be worked on in the upcoming sprint, or should move further.

Actions #23

Updated by SLindoMansilla about 6 years ago

If lnussel doesn't answer in https://bugzilla.suse.com/show_bug.cgi?id=1073238#c7 before the planning, move to next sprint.

Actions #24

Updated by okurz about 6 years ago

Not quite sure what you expect from lnussel to answer. It seems there is no "toolchain_zypper" testsuite enabled for openSUSE Leap 15.0 so you can not that easily check if it works by now. One would need to trigger a test manually based on customized parameters.

Actions #25

Updated by SLindoMansilla about 6 years ago

  • Status changed from Blocked to In Progress

Triggering job post for Leap 15

Actions #27

Updated by SLindoMansilla about 6 years ago

Test soft-failed.

Verifying on O3. Waiting for: https://openqa.opensuse.org/tests/610701

Actions #28

Updated by SLindoMansilla about 6 years ago

  • Status changed from In Progress to Resolved

Test passes. Test suite toolchain_zypper enabled for Leap 15 on x86_64: https://openqa.opensuse.org/admin/job_templates/50

Actions

Also available in: Atom PDF