Project

General

Profile

Actions

action #66031

closed

coordination #66028: [epic][functional][u] Automatic test for podman in Tumbleweed and SLE15-SP2

[functional][u] Add test suite extra_tests_textmode_containers in Tumbleweed

Added by SLindoMansilla almost 4 years ago. Updated almost 4 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Refactor/Code Improvements
Target version:
SUSE QA - Milestone 30
Start date:
2020-04-23
Due date:
% Done:

0%

Estimated time:
42.00 h
Difficulty:

Description

Motivation

There was a split of test suite extra_tests_in_textmode in openqa.suse.de in order to reduce the number of test modules executed and reduce the time per job.
One of those new test suite was extra_tests_textmode_containers.

Tasks

  1. Create test suite extra_tests_textmode_containers in openqa.opensuse.org
  2. Move all container related test modules to extra_tests_textmode_containers

Related issues 1 (0 open1 closed)

Related to openQA Tests - action #67018: test fails in docker_compose since the test has been updated Resolvedpdostal2020-05-19

Actions
Actions #1

Updated by SLindoMansilla almost 4 years ago

  • Status changed from New to Workable
  • Target version set to Milestone 30
  • Estimated time set to 42.00 h
Actions #2

Updated by dheidler almost 4 years ago

  • Status changed from Workable to In Progress
  • Assignee set to dheidler
Actions #3

Updated by dheidler almost 4 years ago

  • Status changed from In Progress to Feedback

Added testsuite to o3:

@@ -298,6 +298,9 @@
           UEFI_PFLASH_VARS: '%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%-uefi-vars.qcow2'
           YAML_SCHEDULE: schedule/vagrant.yaml
         testsuite: null
+    - extra_tests_textmode_containers:
+        settings:
+            YAML_SCHEDULE: schedule/functional/extra_tests_textmode_containers.yaml
     - extra_tests_rstudio
     - extra_tests_ai_ml
     - zdup-Leap-42.2-gnome:
Actions #7

Updated by dheidler almost 4 years ago

  • Status changed from Feedback to Resolved

@sergio: please reopen if you want this on arm/power TW as well.

Actions #8

Updated by dheidler almost 4 years ago

  • Status changed from Resolved to In Progress

Edit: just saw your comment in RC.

Actions #9

Updated by SLindoMansilla almost 4 years ago

Also keep in mind that there are two tasks:

  1. Create test suite extra_tests_textmode_containers in openqa.opensuse.org
  2. Move all container related test modules to extra_tests_textmode_containers

Notice move, which means that the modules scheduled in extra_tests_textmode_containers should not be on extra_tests_in_textmode

Actions #12

Updated by dheidler almost 4 years ago

TW AARCH64:

@@ -154,6 +154,9 @@
     - extra_tests_on_xfce
     - gnome-ext4
     - extra_tests_in_textmode
+    - extra_tests_textmode_containers:
+        settings:
+            YAML_SCHEDULE: schedule/functional/extra_tests_textmode_containers.yaml
     - autoyast_gnome
     - autoyast_minimal
     - package-dependency:
Actions #13

Updated by dheidler almost 4 years ago

TW ppc64le:

@@ -67,6 +67,9 @@
     - boot_to_snapshot
     - extra_tests_on_gnome
     - extra_tests_in_textmode
+    - extra_tests_textmode_containers:
+        settings:
+            YAML_SCHEDULE: schedule/functional/extra_tests_textmode_containers.yaml
     - extra_tests_filesystem
     - yast2_ncurses
     - toolchain_zypper
Actions #15

Updated by dheidler almost 4 years ago

  • Status changed from In Progress to Resolved
Actions #16

Updated by SLindoMansilla almost 4 years ago

  • Status changed from Resolved to Workable

Sorry, you missed again point 2.
Move all container related test modules to extra_tests_textmode_containers

https://openqa.opensuse.org/tests/overview?arch=&machine=&modules=docker&distri=microos&distri=opensuse&version=Tumbleweed&build=20200517&groupid=1

Actions #17

Updated by dheidler almost 4 years ago

  • Status changed from Workable to In Progress
Actions #18

Updated by dheidler almost 4 years ago

2do: state in #67018 that the module docker_compose will be moved from extra_tests_in_textmode to extra_tests_textmode_containers

Actions #19

Updated by SLindoMansilla almost 4 years ago

  • Related to action #67018: test fails in docker_compose since the test has been updated added
Actions #20

Updated by dheidler almost 4 years ago

Removed docker_image from:

  • openSUSE Tumbleweed
  • openSUSE Tumbleweed AArch64
  • openSUSE Tumbleweed PowerPC

as all modules are now contained in extra_tests_containers.

Actions #21

Updated by dheidler almost 4 years ago

Enabled extra_tests_textmode_containers for Leap15.2 jobgroup.

Actions #22

Updated by dheidler almost 4 years ago

Enabled extra_tests_textmode_containers for Leap15.2 ppc64le jobgroup.

Actions #23

Updated by dheidler almost 4 years ago

Enabled extra_tests_textmode_containers for Leap15.2 aarch64 jobgroup.

Actions #25

Updated by dheidler almost 4 years ago

Removed docker_image from leap15.2 aarch64 jobgroup and deleted that testsuite as it is not used anywhere anymore.

Actions #26

Updated by dheidler almost 4 years ago

As I didn't find any other jobgroups where the old extra_tests_in_textmode is scheduled, I will now remove docker from that testsuite (via EXTRATEST test var).

Actions #27

Updated by dheidler almost 4 years ago

Added extra_tests_textmode_containers to the following jobgroups to make the docker extratests in jeos-extra redundant:

  • openSUSE Leap 15.1 Images
  • openSUSE Leap 15.1 AArch64 Images
  • openSUSE Leap 15.2 Images
  • openSUSE Leap 15.2 AArch64 Images
Actions #28

Updated by dheidler almost 4 years ago

JeOS needs some special modules (like firstboot) - should we cover this case in extra_tests_textmode_containers?
Sergio: WDYT?

Actions #29

Updated by dheidler almost 4 years ago

  • Status changed from In Progress to Feedback

Let's wait for feedback from QA-C team regarding JeOS.

Actions #31

Updated by SLindoMansilla almost 4 years ago

  • Status changed from Feedback to Resolved

So, I think QSF-U has finished here. QA-C will continue on #60644

Actions

Also available in: Atom PDF