Project

General

Profile

action #71032

coordination #71029: [qe-core][epic] Rename extra_tests_* test suites on openqa.opensuse.org

[u] Rename extra_tests_in_textmode to extra_tests_textmode

Added by SLindoMansilla about 1 year ago. Updated 11 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Refactor/Code Improvements
Target version:
-
Start date:
2020-09-07
Due date:
% Done:

0%

Estimated time:
42.00 h
Difficulty:

Description

Acceptance criteria

  • AC1: A test suite extra_tests_textmode is schedule on openqa.opensuse.org for Tumbleweed x86_64
  • AC2: extra_tests_textmode is scheduled on openqa.opensuse.org for Tumbleweed x86_64 on the main job group only after 2 consecutive green jobs.
  • AC3: extra_tests_in_textmode is unscheduled from openqa.opensuse.org for Tumbleweed x86_64 after a green job of extra_tests_textmode on the main job group.

Exit criteria

  • AC2.EC: In case the scenario extra_tests_in_textmode has failing modules, it is possible to consider the move of extra_tests_textmode from dev job group to main job group after two consecutive jobs with at least the same number of passing test modules.
  • AC3.EC: In case the scenario extra_tests_in_textmode has failing modules, it is possible to consider the remove of extra_tests_in_textmode from main job group after one run of extra_tests_textmode with at least the same number of passing test modules on the main job group.

Tasks

  1. Create test suite definition on openqa.opensuse.org
  2. Add via conditional schedule to extra_tests_textmode.yaml the modules present in extra_tests_in_textmode that are not included in extra_tests_textmode.yaml
  3. Schedule extra_tests_textmode in Development Tumbleweed on x86_64
  4. After two consecutive green jobs in Development Tumbleweed, move it to openSUSE Tumbleweed
  5. After one green job in openSUSE Tumbleweed, unscheduled extra_tests_in_textmode from x86_64

Test suite definition

Description

Maintainer: slindomansilla@suse.de
Mainly post-installation console extra tests.

Settings

BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2
MAX_JOB_TIME=18000
NUMDISKS=2
REPO_9=%REPO_0_DEBUGINFO%
START_AFTER_TEST=create_hdd_textmode
SYSAUTHTEST=1
UEFI_PFLASH_VARS=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%-uefi-vars.qcow2
YAML_SCHEDULE=schedule/functional/extra_tests_textmode.yaml

Related issues

Related to openQA Tests - action #72244: [functional][u] test fails in ntp_clientResolved2020-10-05

Related to openQA Tests - action #71503: [functional][u] disabling cups service, but not path/socket does not shut down cups (reliably)Resolved2020-09-18

History

#1 Updated by SLindoMansilla about 1 year ago

  • Description updated (diff)

#2 Updated by szarate about 1 year ago

  • Estimated time set to 42.00 h

We did the same for osd, we just forgot to do it for tw

#3 Updated by szarate about 1 year ago

  • Status changed from New to Workable

#4 Updated by dheidler about 1 year ago

  • Status changed from Workable to In Progress
  • Assignee set to dheidler

#6 Updated by dheidler 12 months ago

PR merged.
Scheduled in tw dev jobgroup: https://openqa.opensuse.org/admin/job_templates/38

@@ -259,6 +259,7 @@
     - gnome+do_not_import_ssh_keys
     - external_iso
     - suse_patches-systemd_testsuite
+    - extra_tests_textmode
     - desktopapps-message-wayland:
         machine: 64bit_virtio
     - repo_inst

#7 Updated by dheidler 12 months ago

  • Status changed from In Progress to Feedback

Waiting for results in devel jobgroup.

#8 Updated by SLindoMansilla 12 months ago

  • Description updated (diff)

Please, add a "latest" link to extra_tests_in_textmode in the description of extra_tests_textmode to make review of "last good" easier.
https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=opensuse&flavor=DVD&machine=64bit&test=extra_tests_in_textmode&version=Tumbleweed#live

#9 Updated by SLindoMansilla 12 months ago

  • Description updated (diff)

#10 Updated by SLindoMansilla 12 months ago

  • Description updated (diff)

#11 Updated by dheidler 12 months ago

  • Related to action #72244: [functional][u] test fails in ntp_client added

#12 Updated by dheidler 12 months ago

  • Related to action #71503: [functional][u] disabling cups service, but not path/socket does not shut down cups (reliably) added

#13 Updated by dheidler 11 months ago

  • Status changed from Feedback to Resolved
@@ -285,7 +285,6 @@
         priority: 46
     - extra_tests_on_kde
     - extra_tests_on_xfce
-    - extra_tests_in_textmode
     - extra_tests_textmode
     - create_hdd_transactional_server
     - extra_tests_transactional_server

Also available in: Atom PDF