coordination #25380: [sle][functional][epic] test fails in install - tries to install SLE12 packages -> update test for sle15 - openQA Tests (public) - openSUSE Project Management Tool

Custom queries

All open Feature tests
openQA Infrastructure Project
openqa-review - Closed tickets last updated by openqa-review, last 30 days
QA roadmap long-term
QA SLE functional
QA SLE Functional - closed in last 14 days
QA SLE Functional - High, need to be refined
QA SLE Functional - over cycle time median
QA SLE u
QA SLE y
QA tools (tag not necessary in openQA and subprojects)
QA tools tag (tag not necessary in openQA and subprojects; excluding tickets in "Ready" version as they are already on the backlog)
QAC - Backlog
QAM
QE tools team - backlog (dev)
QE tools team - backlog (ready issues)
QE tools team - backlog SLA high
QE tools team - backlog SLA immediate
QE tools team - backlog SLA no immediate/urgent in feedback/blocked
QE tools team - backlog SLA normal
QE tools team - backlog SLA urgent
QE tools team - backlog SLO high
QE tools team - backlog SLO normal
QE tools team - backlog SLO urgent
QE tools team - backlog, high-level view (epics and higher)
QE tools team - backlog, non-reactive work, needs parent
QE tools team - backlog, top-level view (all sagas)
QE tools team - closed within last 14 days
QE tools team - closed within last 60 days
QE tools team - closed yesterday
QE Tools Team - Collaborative Session
QE tools team - due date forecast
QE tools team - exceeding due-date
QE tools team - infrastructure backlog
QE tools team - next - sorted by update time
QE tools team - next issues
QE tools team - non-estimated (unblocked) issues (dev)
QE tools team - non-estimated (unblocked) issues (infra)
QE tools team - ready issues - Workable
QE tools team - ready, not assigned/blocked/low
QE tools team - SLO high forecast
QE tools team - update forecast
QE tools team - updated by priority
QE tools team - what members of the team are working on - Feedback (not-low)
QE Tools Team Backlog By Assignee
SLE15 Migration Open Tickets
SLE15 SP1 Migration Open Tickets
SLE15SP3 Migration open ticket
SLE15SP3 Security open ticket
Tools Team Retrospective
Tools Team Retrospective (not estimated or assigned)

Actions

Copy link

coordination #25380

closed

[sle][functional][epic] test fails in install - tries to install SLE12 packages -> update test for sle15

Added by jorauch about 7 years ago. Updated about 4 years ago.

Status:

Resolved

Priority:

Urgent

Assignee:

JERiveraMoya

Category:

Bugs in existing tests

Target version:

openQA Project (public) - Milestone 14

Start date:

2017-12-05

Due date:

2018-02-27

% Done:

100%

Estimated time:

(Total: 0.00 h)

Difficulty:

Description

Observation¶

The test adds repos for SLE12 and therefore it fails on SLE15.
To make this work the test needs to distinguish for which system it is run.

Related bug: bsc#1070151

openQA test in scenario sle-15-Leanos-DVD-aarch64-toolchain_zypper@aarch64 fails in
install

Reproducible¶

Fails since (at least) Build 96.4

Expected result¶

Last good: https://openqa.suse.de/tests/1058303#

Should install GCC on SLE 15

Acceptance criteria¶

AC: The sub tasks are resolved

Further details¶

These settings should be use:

BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDDSIZEGB=20
HDD_1=sle-%VERSION%-%ARCH%-%BUILD%-textmode@%MACHINE%.qcow2
INSTALLONLY=1
MAX_JOB_TIME=14400
QEMUCPUS=4
QEMURAM=4096
START_AFTER_TEST=create_hdd_textmode
TCM=1

Github repo with current changes by jrauch: https://github.com/DrMullings/os-autoinst-distri-opensuse/tree/FIX_Toolchain

Always latest result in this scenario: latest

Subtasks 4 (0 open — 4 closed)

action #28893: [sle][functional][story][hard] Adapt test suite toolchain_zypper to boot from a hdd with an already installed system

Resolved

SLindoMansilla

2017-12-05

2017-12-19

Actions

action #28896: [sle][functional][story][hard] Adapt the test suite toolchain_zypper to install the right patterns and packages for SLE 12-SP4 and 15

Resolved

JERiveraMoya

2017-12-05

2017-12-19

Actions

action #29235: [sle][functional][12sp4][easy] test fails in partitioning_togglehome - There is no proposal for separated home partition

Resolved

2017-12-11

Actions

action #29366: [functional][easy][bsc#1073238] Add toolchain test for openSUSE

Resolved

SLindoMansilla

2017-12-13

2018-02-27

Actions

Related issues 2 (0 open — 2 closed)

Related to openQA Project (public) - action #28328: job was triggered trying to download HDD image but it's already gone

Rejected

okurz

2017-11-24

Actions

Has duplicate openQA Tests (public) - action #25720: [sle][functional] test fails in installation of gcc5 because of wrong repository

Rejected

2017-10-02

Actions

Issue # Delay: days Cancel

History
Notes
Property changes

Actions

Copy link

Updated by okurz about 7 years ago

Status changed from New to In Progress
Priority changed from Normal to High

workable item, should be easy to find the corresponding module/repos and add these for the toolchain test. It wasn't done properly in before anyway also for SLE12 by adding custom repos which are not synchronized to osd instead of using assets on osd and proxy-SCC

Actions

Copy link

Updated by okurz about 7 years ago

Target version set to Milestone 11

Actions

Copy link

Updated by okurz about 7 years ago

Has duplicate action #25720: [sle][functional] test fails in installation of gcc5 because of wrong repository added

Actions

Copy link

Updated by okurz about 7 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: toolchain_zypper
https://openqa.suse.de/tests/1192449

Actions

Copy link

Updated by jorauch about 7 years ago

Still fails in: https://openqa.suse.de/tests/1212999#step/install/13
IBS directory for toolchain does not contain a version for SLE15
Next steps:

Find out where/when/how to get access to the IBS directory for SLE15 -> softfail the module if not possible
Implement the distinction between SLE12 and SLE15 in the test code

Actions

Copy link

Updated by jorauch about 7 years ago

Assignee set to jorauch

Actions

Copy link

Updated by okurz about 7 years ago

Due date set to 2017-11-08

Actions

Copy link

Updated by jorauch about 7 years ago

The new location of gcc:
http://download.suse.de/ibs/SUSE/Products/SLE-Module-Development-Tools/15/
Test Suite has to be adapted to install the Development Tools module

Actions

Copy link

Updated by okurz about 7 years ago

IMHO the testsuite could boot an already installed image and either add the correct repo (e.g. for SLE12) or module (e.g. for SLE15) for the right packages.

http://download.suse.de/ibs/SUSE/Products/SLE-Module-Development-Tools/15/ is not the right location because it is not build specific.

Actions

Copy link

#10

Updated by jorauch about 7 years ago

Description updated (diff)

Actions

Copy link

#11

Updated by jorauch about 7 years ago

Description updated (diff)

Actions

Copy link

#12

Updated by jorauch about 7 years ago

Description updated (diff)

Having problems with boot_to_desktop

Actions

Copy link

#13

Updated by jorauch about 7 years ago

Assignee deleted (~~jorauch~~)

Actions

Copy link

#14

Updated by jorauch about 7 years ago

Assignee set to jorauch

Actions

Copy link

#15

Updated by jorauch about 7 years ago

Description updated (diff)

Actions

Copy link

#16

Updated by jorauch about 7 years ago

Description updated (diff)

Actions

Copy link

#17

Updated by okurz about 7 years ago

Due date deleted (~~2017-11-08~~)
Target version deleted (~~Milestone 11~~)

not done, needs re-evaluation

Actions

Copy link

#18

Updated by jorauch about 7 years ago

Target version set to Milestone 11

Very important point when evaluating:
Should we keep the gcc5-fortran test for SLE15?

Actions

Copy link

#19

Updated by okurz about 7 years ago

Due date set to 2017-11-22
Target version changed from Milestone 11 to Milestone 12

I thought I wrote a comment already: Generalize the test to use the default gcc version of whatever product we test on. Yes, a fortran compile test is important.

Actions

Copy link

#20

Updated by jorauch about 7 years ago

Description updated (diff)
Target version deleted (~~Milestone 12~~)

Actions

Copy link

#21

Updated by jorauch about 7 years ago

Subject changed from [sle][functional] test fails in install - tries to install SLE12 packages -> update test for sle15 to [sle][functional][hard] test fails in install - tries to install SLE12 packages -> update test for sle15
Description updated (diff)
Due date deleted (~~2017-11-22~~)
Assignee deleted (~~jorauch~~)
Target version set to Milestone 12

removed from sprint after estimating as "hard" together with okurz

Actions

Copy link

#22

Updated by okurz about 7 years ago

Due date set to 2017-12-06

failing in current tests, let's try to handle in next sprint

Actions

Copy link

#23

Updated by JERiveraMoya about 7 years ago

Currently cloning parent & children job, as discussed with Sergio, it needs some tricky way to do it due to is a new children and clone_job does not recognize it out-of-the-box.

Actions

Copy link

#24

Updated by SLindoMansilla about 7 years ago

Related to action #28328: job was triggered trying to download HDD image but it's already gone added

Actions

Copy link

#25

Updated by SLindoMansilla about 7 years ago

jrivera, here the reason why the childs don't have the qcow2: https://progress.opensuse.org/issues/28328

Actions

Copy link

#26

Updated by JERiveraMoya about 7 years ago

Not even in the parent openQA, the qcow2 is not found, neither in previous job runs. But in my local test, clonning the parent I can see the image but there is a 404 when downloading. I retriggered the job https://openqa.suse.de/tests/1274100#downloads and now I can see the qcow2 before is cleanned wrongly by openQA as described in the bug you mentioned. I am going to try to use it.

Actions

Copy link

#27

Updated by SLindoMansilla about 7 years ago

Description updated (diff)
Assignee set to JERiveraMoya

jrivera, if you are working on this ticket, please assign it to you.

Actions

Copy link

#28

Updated by JERiveraMoya about 7 years ago

AC2 and AC4 achieved in my local tests.
Created bug related with missing pattern: https://bugzilla.suse.com/show_bug.cgi?id=1070151

Actions

Copy link

#29

Updated by JERiveraMoya about 7 years ago

PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3965/files
Pending to complete verification for SLE-15 and SLE-12 SP3.

Actions

Copy link

#30

Updated by SLindoMansilla about 7 years ago

Description updated (diff)

Actions

Copy link

#31

Updated by okurz about 7 years ago

Description updated (diff)

As stated in #25380#note-9 I suggest to boot an existing image and enable modules on top and not reconduct a whole installation just to enable one module. This was previously mainly done for historical reason when we could not existing images on all architectures. And as we should look at the product from the customers perspective I don't see a need to handle SLE12 different from SLE15 except for the module/addon names. Sorry if that was not clear in before. That means that I don't see a reason why we should only boot from an existing HDD on SLE15. I deleted AC4 therefore from this ticket. It is my suggestion to boot from an existing HDD but it's not an AC for the ticket to be done. If not done then please extract a ticket with this optional task for later. I recommended to boot from an existing HDD to make it easier for you to be done but it's not a necessity.

Now for some more specific task suggestions:

Test manual how the current situation on SLE15 looks like and report bugs!
Change existing test flow for SLE12+SLE15 to boot existing HDD
Make it work for SLE12
Make it work for SLE15 unless blocked by bugs
Make sure we have a PR at this point even if SLE15 test fails on bugs
optional: Add soft fails and workarounds for the SLE15 bugs

And as we identified this ticket as hard, don't try to solve it on your own.

Actions

Copy link

#32

Updated by JERiveraMoya about 7 years ago

Added information to the bug, it seems that a new toolchain pattern could be added to Development Tools module for SLE15, but still in discussion: https://bugzilla.suse.com/show_bug.cgi?id=1070151
In the meantime added verification run only including the boot for existing HDD for sle15:
http://dhcp227/tests/594

Actions

Copy link

#33

Updated by SLindoMansilla about 7 years ago

Test run for SLE 12-SP3:

copland+loewe#1688

Command used:

script/client jobs post ARCH=x86_64 BACKEND=qemu BOOT_HDD_IMAGE=1 BUILD=0473 BUILD_HA=0214 BUILD_HA_GEO=0163 BUILD_SDK=0263 BUILD_SLE=0473 BUILD_WE=0168 DESKTOP=textmode DISTRI=sle FLAVOR=Server-DVD HDDSIZEGB=20 HDD_1=sle-12-SP3-x86_64-0473-textmode@64bit.qcow2 INSTALLONLY=1 ISO=SLE-12-SP3-Server-DVD-x86_64-Build0473-Media1.iso ISO_MAXSIZE=4700372992 MACHINE=64bit-smp MAX_JOB_TIME=14400 NAME=01058303-sle-12-SP3-Server-DVD-x86_64-Build0473-toolchain_zypper@64bit-smp QA_HEAD_REPO=http://dist.nue.suse.com/ibs/QA:/Head/SLE-12-SP3 QA_WEB_REPO=http://dist.suse.de/install/SLP/SLE-12-Module-Web-Scripting-LATEST/x86_64/CD1/ QEMUCPU=qemu64 QEMUCPUS=4 QEMURAM=4096 REPO_0=SLE-12-SP3-Server-DVD-x86_64-Build0473-Media1 SCC_REGCODE=XXX SCC_URL=http://Server-0473.proxy.scc.suse.de SHUTDOWN_NEEDS_AUTH=1 SLENKINS_TESTSUITES_REPO=http://download.suse.de/ibs/Devel:/SLEnkins:/testsuites/SLE_12_SP3/ START_AFTER_TEST=create_hdd_textmode TCM=1 TEST=sergio_toolchain_zypper VERSION=12-SP3 WORKER_CLASS=remote_worker-x86_64

Actions

Copy link

#34

Updated by SLindoMansilla about 7 years ago

Test run for SLE 15:

copland+loewe#1690

Command used:

script/client jobs post ARCH=x86_64 BACKEND=qemu BOOT_HDD_IMAGE=1 BUILD=360.1 BUILD_HA=360.1 BUILD_SDK=360.1 BUILD_SLE=360.1 DESKTOP=textmode DISTRI=sle FLAVOR=Server-DVD HDDSIZEGB=20 HDD_1=sle-15-x86_64-360.1-textmode@64bit.qcow2 INSTALLONLY=1 ISO=SLE-15-Installer-DVD-x86_64-Build360.1-Media1.iso ISO_MAXSIZE=4700372992 MACHINE=64bit-smp MAX_JOB_TIME=14400 MIRROR_FTP=ftp://openqa.suse.de/SLE-15-Installer-DVD-x86_64-Build360.1-Media1 MIRROR_HTTP=http://openqa.suse.de/assets/repo/SLE-15-Installer-DVD-x86_64-Build360.1-Media1 MIRROR_NFS=nfs://openqa.suse.de/var/lib/openqa/share/factory/repo/SLE-15-Installer-DVD-x86_64-Build360.1-Media1 MIRROR_SMB=smb://openqa.suse.de/inst/SLE-15-Installer-DVD-x86_64-Build360.1-Media1 NAME=01058303-sle-15-Server-DVD-x86_64-Build360.1-toolchain_zypper@64bit-smp QA_HEAD_REPO=http://dist.nue.suse.com/ibs/QA:/Head/SLE-15 QA_WEB_REPO=http://dist.suse.de/install/SLP/SLE-12-Module-Web-Scripting-LATEST/x86_64/CD1/ QEMUCPU=qemu64 QEMUCPUS=4 QEMURAM=4096 REPO_0=SLE-15-Installer-DVD-x86_64-Build360.1-Media1 REPO_10=SLE-15-Module-Desktop-Productivity-POOL-x86_64-Build360.1-Media1 REPO_11=SLE-15-Module-Development-Tools-POOL-x86_64-Build360.1-Media1 REPO_12=SLE-15-Module-HA-POOL-x86_64-Build360.1-Media1 REPO_13=SLE-15-Module-Legacy-POOL-x86_64-Build360.1-Media1 REPO_14=SLE-15-Module-SAP-Applications-POOL-x86_64-Build360.1-Media1 REPO_15=SLE-15-Module-Server-Applications-POOL-x86_64-Build360.1-Media1 REPO_16=SLE-15-Module-Public-Cloud-POOL-x86_64-Build360.1-Media1 REPO_17=SLE-15-Product-SLES-POOL-x86_64-Build360.1-Media1 REPO_18=SLE-15-Product-SLED-POOL-x86_64-Build360.1-Media1 REPO_8=SLE-15-Module-Basesystem-POOL-x86_64-Build360.1-Media1 REPO_9=SLE-15-Module-Desktop-Applications-POOL-x86_64-Build360.1-Media1 REPO_SLE15_MODULE_BASESYSTEM=SLE-15-Module-Basesystem-POOL-x86_64-Build360.1-Media1 REPO_SLE15_MODULE_DESKTOP_APPLICATIONS=SLE-15-Module-Desktop-Applications-POOL-x86_64-Build360.1-Media1 REPO_SLE15_MODULE_DESKTOP_PRODUCTIVITY=SLE-15-Module-Desktop-Productivity-POOL-x86_64-Build360.1-Media1 REPO_SLE15_MODULE_DEVELOPMENT_TOOLS=SLE-15-Module-Development-Tools-POOL-x86_64-Build360.1-Media1 REPO_SLE15_MODULE_HA=SLE-15-Module-HA-POOL-x86_64-Build360.1-Media1 REPO_SLE15_MODULE_LEGACY=SLE-15-Module-Legacy-POOL-x86_64-Build360.1-Media1 REPO_SLE15_MODULE_PUBLIC_CLOUD=SLE-15-Module-Public-Cloud-POOL-x86_64-Build360.1-Media1 REPO_SLE15_MODULE_SAP_APPLICATIONS=SLE-15-Module-SAP-Applications-POOL-x86_64-Build360.1-Media1 REPO_SLE15_MODULE_SERVER_APPLICATIONS=SLE-15-Module-Server-Applications-POOL-x86_64-Build360.1-Media1 REPO_SLE15_PRODUCT_SLED=SLE-15-Product-SLED-POOL-x86_64-Build360.1-Media1 REPO_SLE15_PRODUCT_SLES=SLE-15-Product-SLES-POOL-x86_64-Build360.1-Media1 SCC_REGCODE=XXX SCC_URL=http://Server-360.1.proxy.scc.suse.de SHUTDOWN_NEEDS_AUTH=1 SLENKINS_TESTSUITES_REPO=http://download.suse.de/ibs/Devel:/SLEnkins:/testsuites/SLE_12_SP3/ START_AFTER_TEST=create_hdd_textmode TCM=1 TEST=sergio_toolchain_zypper VERSION=15 WORKER_CLASS=remote_worker-x86_64

Actions

Copy link

#35

Updated by SLindoMansilla about 7 years ago

Description updated (diff)

Actions

Copy link

#36

Updated by SLindoMansilla about 7 years ago

Test suite toolchain_zypper updated in osd to not perform an installation, but to boot from an existing hdd (qcow2) with a textmode installation.

Old settings:

DESKTOP=gnome
HDDSIZEGB=20
INSTALLONLY=1
MAX_JOB_TIME=14400
QEMUCPUS=4
QEMURAM=4096
TCM=1

New settings:

BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDDSIZEGB=20
HDD_1=SLES-%VERSION%-%ARCH%-%BUILD%@%MACHINE%-minimal_with_sdk%BUILD_SDK%_installed.qcow2
INSTALLONLY=1
MAX_JOB_TIME=14400
QEMUCPUS=4
QEMURAM=4096
START_AFTER_TEST=create_hdd_textmode
TCM=1

The next build should trigger the new settings.¶

Actions

Copy link

#37

Updated by JERiveraMoya about 7 years ago

According to bug resolution, it is the right approach to add the packages, given that pattern is correct that is not available (yet). Updated PR.
Pending to test this code after finishing hdd booting.

Actions

Copy link

#38

Updated by okurz about 7 years ago

@Sergio please don't put any SCC regcodes in public p.o.o .

I am not sure, is %BUILD_SDK% defined for SLE15 or are you not using the same test suite for SLE15?

Actions

Copy link

#39

Updated by okurz about 7 years ago

Priority changed from High to Urgent

your actions have caused incompletes because you don't reference the right qcow image that is published by the parent: https://openqa.suse.de/tests/1293186, https://openqa.suse.de/tests/1293561, https://openqa.suse.de/tests/1293281

Please fix that urgently

Actions

Copy link

#40

Updated by JERiveraMoya about 7 years ago

Retriggered with the right images: https://openqa.suse.de/tests/1294203# https://openqa.suse.de/tests/1294204#

Actions

Copy link

#41

Updated by SLindoMansilla about 7 years ago

Description updated (diff)

okurz wrote:

your actions have caused incompletes because you don't reference the right qcow image that is published by the parent: https://openqa.suse.de/tests/1293186, https://openqa.suse.de/tests/1293561, https://openqa.suse.de/tests/1293281

Please fix that urgently

Fixed to: sle-%VERSION%-%ARCH%-%BUILD%-textmode@%MACHINE%.qcow2

Sorry about the regcode.

Job cloned with proper value:

aarch64 https://openqa.suse.de/tests/1294243
ppc64le https://openqa.suse.de/tests/1294239
64bit-smp https://openqa.suse.de/tests/1294244

Actions

Copy link

#42

Updated by okurz about 7 years ago

Due date changed from 2017-12-06 to 2017-12-19

during SR: we are on good track, move to next sprint suggested

Actions

Copy link

#43

Updated by SLindoMansilla about 7 years ago

Subject changed from [sle][functional][hard] test fails in install - tries to install SLE12 packages -> update test for sle15 to [sle][functional][epic] test fails in install - tries to install SLE12 packages -> update test for sle15

Please see sub tasks

Actions

Copy link

#44