Project

General

Profile

Actions

coordination #18602

closed

[sles][functional][epic]review existing autoyast tests (was: test fails in repos because ip and tar is not installed)

Added by asmorodskyi over 7 years ago. Updated about 4 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Enhancement to existing tests
Start date:
2017-07-26
Due date:
2017-10-11
% Done:

100%

Estimated time:
(Total: 0.00 h)
Difficulty:

Description

Acceptance criteria

  • AC1 all autoyast tests are in a job group which has a proper review workflow (e.g. the job group does not exist anymore, all tests must be either in "SLE functional", "test development" or within the existing "autoyast" job group but properly reviewed or deleted)

Problem

Also there are two kind of autoyast tests, autoyast tests self-contained within os-autoinst-distri-opensuse (1) and a "AY framework created by APAC colleagues" (2).

The following approach is suggested:

  • DONE: find existing stable and passing jobs from job group Regression: Autoyast and move them to sles functional as long as they are of type (1)
  • DONE: review remaining failing jobs from (1), triage them and either delete if unimportant or fix and move to sles functional job group
  • DONE: delete all "aytests" as it seems there are no stakeholders in these
  • find reviewers (more than one)
  • discuss with QA PM (mawerner) how test results should be communication and also who can act as "coordinator"
  • document review workflow changes within https://wiki.microfocus.net/index.php/RD-OPS_QA/openQA_review#Functional.2Bautoyast.2Bstaging

As a reminder: The tests were added for a reason (which I don't know) and by topic they belong to sles functional (they are not about kernel, virtualization, migration, etc.) so it's in the domain of sles functional. https://wiki.microfocus.net/index.php?title=RD-OPS_QA/openQA_review#SLES.2BHA.2Bautoyast.2Bstaging also mentions the responsibility covering autoyast

Further details

Always latest result in this scenario: latest

old information

Observation

openQA test in scenario sle-12-SP3-Server-DVD-x86_64-autoyast_aytests_sles12_minimal+supportserver@64bit fails in
repos

Need to pre-install ip and tar binaries

Reproducible

Fails since (at least) Build 0333 (current job)

Expected result

Last good: 0328 (or more recent)


Subtasks 3 (0 open3 closed)

action #20798: [sle][functional] Move autoyast regression test profiles and verification scripts to aytests-tests repoResolvedriafarov2017-07-26

Actions
action #23736: [sle][functional] Adjust autoinst profiles for sle 15Resolvedriafarov2017-08-28

Actions
action #25604: [sle][functional] job group and review workflow for autoyast testsResolvedmgriessmeier2017-09-272017-10-11

Actions

Related issues 2 (0 open2 closed)

Related to openQA Tests (public) - action #20064: [sles][functional][yast] Bring peace and order to autoyast profilesResolvedriafarov2017-06-26

Actions
Related to openQA Tests (public) - action #23722: [sle][functional][sle15] Update autoyast profiles to be compatible with SLE15Resolvedriafarov2017-08-282017-12-19

Actions
Actions

Also available in: Atom PDF