Project

General

Profile

action #66031

action #66028: [epic][functional][u] Automatic test for podman in Tumbleweed and SLE15-SP2

[functional][u] Add test suite extra_tests_textmode_containers in Tumbleweed

Added by SLindoMansilla about 1 month ago. Updated about 15 hours ago.

Status:
In Progress
Priority:
Normal
Assignee:
Category:
Refactor/Code Improvements
Target version:
SUSE QA tests - Milestone 30
Start date:
2020-04-23
Due date:
% Done:

0%

Estimated time:
42.00 h
Difficulty:
Duration:

Description

Motivation

There was a split of test suite extra_tests_in_textmode in openqa.suse.de in order to reduce the number of test modules executed and reduce the time per job.
One of those new test suite was extra_tests_textmode_containers.

Tasks

  1. Create test suite extra_tests_textmode_containers in openqa.opensuse.org
  2. Move all container related test modules to extra_tests_textmode_containers

Related issues

Related to openQA Tests - action #67018: test fails in docker_compose since the test has been updated Resolved2020-05-19

History

#1 Updated by SLindoMansilla 23 days ago

  • Status changed from New to Workable
  • Target version set to Milestone 30
  • Estimated time set to 42.00 h

#2 Updated by dheidler 20 days ago

  • Status changed from Workable to In Progress
  • Assignee set to dheidler

#3 Updated by dheidler 17 days ago

  • Status changed from In Progress to Feedback

Added testsuite to o3:

@@ -298,6 +298,9 @@
           UEFI_PFLASH_VARS: '%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%-uefi-vars.qcow2'
           YAML_SCHEDULE: schedule/vagrant.yaml
         testsuite: null
+    - extra_tests_textmode_containers:
+        settings:
+            YAML_SCHEDULE: schedule/functional/extra_tests_textmode_containers.yaml
     - extra_tests_rstudio
     - extra_tests_ai_ml
     - zdup-Leap-42.2-gnome:

#7 Updated by dheidler 15 days ago

  • Status changed from Feedback to Resolved

@sergio: please reopen if you want this on arm/power TW as well.

#8 Updated by dheidler 15 days ago

  • Status changed from Resolved to In Progress

Edit: just saw your comment in RC.

#9 Updated by SLindoMansilla 15 days ago

Also keep in mind that there are two tasks:

  1. Create test suite extra_tests_textmode_containers in openqa.opensuse.org
  2. Move all container related test modules to extra_tests_textmode_containers

Notice move, which means that the modules scheduled in extra_tests_textmode_containers should not be on extra_tests_in_textmode

#12 Updated by dheidler 14 days ago

TW AARCH64:

@@ -154,6 +154,9 @@
     - extra_tests_on_xfce
     - gnome-ext4
     - extra_tests_in_textmode
+    - extra_tests_textmode_containers:
+        settings:
+            YAML_SCHEDULE: schedule/functional/extra_tests_textmode_containers.yaml
     - autoyast_gnome
     - autoyast_minimal
     - package-dependency:

#13 Updated by dheidler 14 days ago

TW ppc64le:

@@ -67,6 +67,9 @@
     - boot_to_snapshot
     - extra_tests_on_gnome
     - extra_tests_in_textmode
+    - extra_tests_textmode_containers:
+        settings:
+            YAML_SCHEDULE: schedule/functional/extra_tests_textmode_containers.yaml
     - extra_tests_filesystem
     - yast2_ncurses
     - toolchain_zypper

#15 Updated by dheidler 9 days ago

  • Status changed from In Progress to Resolved

#16 Updated by SLindoMansilla 9 days ago

  • Status changed from Resolved to Workable

Sorry, you missed again point 2.
Move all container related test modules to extra_tests_textmode_containers

https://openqa.opensuse.org/tests/overview?arch=&machine=&modules=docker&distri=microos&distri=opensuse&version=Tumbleweed&build=20200517&groupid=1

#17 Updated by dheidler 9 days ago

  • Status changed from Workable to In Progress

#18 Updated by dheidler 8 days ago

2do: state in #67018 that the module docker_compose will be moved from extra_tests_in_textmode to extra_tests_textmode_containers

#19 Updated by SLindoMansilla 8 days ago

  • Related to action #67018: test fails in docker_compose since the test has been updated added

#20 Updated by dheidler 3 days ago

Removed docker_image from:

  • openSUSE Tumbleweed
  • openSUSE Tumbleweed AArch64
  • openSUSE Tumbleweed PowerPC

as all modules are now contained in extra_tests_containers.

#21 Updated by dheidler 3 days ago

Enabled extra_tests_textmode_containers for Leap15.2 jobgroup.

#22 Updated by dheidler 3 days ago

Enabled extra_tests_textmode_containers for Leap15.2 ppc64le jobgroup.

#23 Updated by dheidler 3 days ago

Enabled extra_tests_textmode_containers for Leap15.2 aarch64 jobgroup.

#25 Updated by dheidler about 16 hours ago

Removed docker_image from leap15.2 aarch64 jobgroup and deleted that testsuite as it is not used anywhere anymore.

#26 Updated by dheidler about 16 hours ago

As I didn't find any other jobgroups where the old extra_tests_in_textmode is scheduled, I will now remove docker from that testsuite (via EXTRATEST test var).

#27 Updated by dheidler about 15 hours ago

Added extra_tests_textmode_containers to the following jobgroups to make the docker extratests in jeos-extra redundant:

  • openSUSE Leap 15.1 Images
  • openSUSE Leap 15.1 AArch64 Images
  • openSUSE Leap 15.2 Images
  • openSUSE Leap 15.2 AArch64 Images

Also available in: Atom PDF