Project

General

Profile

action #29366

coordination #25380: [sle][functional][epic] test fails in install - tries to install SLE12 packages -> update test for sle15

[functional][easy][bsc#1073238] Add toolchain test for openSUSE

Added by okurz almost 4 years ago. Updated almost 4 years ago.

Status:
Resolved
Priority:
Normal
Category:
New test
Start date:
2017-12-13
Due date:
2018-02-27
% Done:

0%

Estimated time:
Difficulty:

Description

Acceptance criteria

  • AC1: The toolchain tests are scheduled for openSUSE Tumbleweed
  • AC2: Same for openSUSE Leap 15.0

Job groups


Related issues

Related to openQA Tests - action #28854: [sle][functional][easy]test fails in kdump_and_crash -> enable dev-tools module in scenario or create new oneResolved2017-12-052018-02-27

Related to openQA Tests - coordination #17436: [tools][functional][y][epic] tests must not have access to published repos, e.g. download.o.o on Tumbleweed -> remove all references to download.o.o from repos during installation and afterwardsResolved2018-02-122019-02-26

History

#1 Updated by JERiveraMoya almost 4 years ago

Created in OOO Toolchain test suite, scheduled for x86_64 for Tumbleweed and Leap 15.0 (with help of @SLindoMansilla's permissions, requesting mine for second time in factory channel).

#2 Updated by SLindoMansilla almost 4 years ago

  • Subject changed from [functional]Add toolchain test for openSUSE to [functional][easy] Add toolchain test for openSUSE
  • Description updated (diff)
  • Status changed from New to In Progress
  • Assignee set to SLindoMansilla

#3 Updated by okurz almost 4 years ago

wow, did you just add the testsuite to TW and Leap 15.0 without testing? Also, I don't see it in the Leap 15.0 schedule

#4 Updated by JERiveraMoya almost 4 years ago

For Leap 15.0, fails in install test due to pattern devel_basis doesn't work: http://dhcp227/tests/800 (if openSUSE should share the same code base, probably a bug?)
For Tumbleweed succeeded: http://dhcp227/tests/798
PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/4084

#5 Updated by SLindoMansilla almost 4 years ago

test suite disabled for Leap 15 on O3

#6 Updated by SLindoMansilla almost 4 years ago

Verification run of test suite on O3: https://openqa.opensuse.org/tests/560613

Changes from PR needed to fully test on Leap 15.

#7 Updated by SLindoMansilla almost 4 years ago

gh#PR/4084 was merged.
Waiting for verification run on OSD

#9 Updated by SLindoMansilla almost 4 years ago

  • Status changed from In Progress to Feedback

#10 Updated by okurz almost 4 years ago

Leap 15 failed in what looks like a product bug about patterns: https://openqa.opensuse.org/tests/560909#step/install/10

I see that the change to products/opensuse/main.pm is a near duplication of the SLE code which I consider suboptimal. I am proposing a change to the main.pm files but I wonder why you did not schedule "kdump_and_crash" for openSUSE. Does it not work for a specific reason? That should be included or at least properly reasoned.

https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/4089 for the simplification.

#11 Updated by JERiveraMoya almost 4 years ago

https://bugzilla.opensuse.org/show_bug.cgi?id=1073238
Refactoring the code as you propose does not make it more optimal, it is just nicer. I am wondering why you didn't use another ticket to enhance the main.pm in openSUSE (anyway you didn't mention this ticket in your PR).
Same answer for kdump_and_crash, good that you noticed, but it was not include on purpose, because the test was not yet in openSUSE scheduled, and we can create another ticket to verify that. Also you know that this test is not scheduled always in sle15 and there is a known bug for it, so better put aside for a while.

#12 Updated by SLindoMansilla almost 4 years ago

  • Related to action #28854: [sle][functional][easy]test fails in kdump_and_crash -> enable dev-tools module in scenario or create new one added

#13 Updated by SLindoMansilla almost 4 years ago

  • Related to coordination #17436: [tools][functional][y][epic] tests must not have access to published repos, e.g. download.o.o on Tumbleweed -> remove all references to download.o.o from repos during installation and afterwards added

#14 Updated by SLindoMansilla almost 4 years ago

  • Due date set to 2018-01-16
  • Status changed from Feedback to In Progress

Blocker Bug was resolved (bsc#1073238#c3). Ticket workable again.

Pre-planning for sprint 8

#15 Updated by JERiveraMoya almost 4 years ago

Bug reopened: testing in my local openQA instance (before scheduling it in O3 or trying to clone with _GROUP_0, which I can't because I don't have API keys in O3) and using latest image and iso, the problem persists: http://dhcp227/tests/819.

#16 Updated by JERiveraMoya almost 4 years ago

  • Status changed from In Progress to Feedback

#17 Updated by JERiveraMoya almost 4 years ago

Verification in o3 ooo#573267#10 & bug updated bsc#1073238#c7

#18 Updated by JERiveraMoya almost 4 years ago

  • Status changed from Feedback to Blocked

#19 Updated by okurz almost 4 years ago

  • Subject changed from [functional][easy] Add toolchain test for openSUSE to [functional][easy][bsc#1073238] Add toolchain test for openSUSE
  • Due date changed from 2018-01-16 to 2018-01-30

mass-shift of tickets to next sprint due to training on sprint review day

#20 Updated by riafarov almost 4 years ago

  • Due date changed from 2018-01-30 to 2018-02-13

Revisit in next sprint, should be workable

#22 Updated by riafarov almost 4 years ago

  • Due date changed from 2018-02-13 to 2018-02-27

Sergio, please check if can be worked on in the upcoming sprint, or should move further.

#23 Updated by SLindoMansilla almost 4 years ago

If lnussel doesn't answer in https://bugzilla.suse.com/show_bug.cgi?id=1073238#c7 before the planning, move to next sprint.

#24 Updated by okurz almost 4 years ago

Not quite sure what you expect from lnussel to answer. It seems there is no "toolchain_zypper" testsuite enabled for openSUSE Leap 15.0 so you can not that easily check if it works by now. One would need to trigger a test manually based on customized parameters.

#25 Updated by SLindoMansilla almost 4 years ago

  • Status changed from Blocked to In Progress

Triggering job post for Leap 15

#27 Updated by SLindoMansilla almost 4 years ago

Test soft-failed.

Verifying on O3. Waiting for: https://openqa.opensuse.org/tests/610701

#28 Updated by SLindoMansilla almost 4 years ago

  • Status changed from In Progress to Resolved

Test passes. Test suite toolchain_zypper enabled for Leap 15 on x86_64: https://openqa.opensuse.org/admin/job_templates/50

Also available in: Atom PDF