Project

General

Profile

Actions
Copy link

action #71032

closed

coordination #71029: [qe-core][epic] Rename extra_tests_* test suites on openqa.opensuse.org

[u] Rename extra_tests_in_textmode to extra_tests_textmode

Added by SLindoMansilla over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
dheidler
Category:
Refactor/Code Improvements
Target version:
-
Start date:
2020-09-07
Due date:
% Done:

0%

Estimated time:
42.00 h
Difficulty:

Description

Acceptance criteria

  • AC1: A test suite extra_tests_textmode is schedule on openqa.opensuse.org for Tumbleweed x86_64
  • AC2: extra_tests_textmode is scheduled on openqa.opensuse.org for Tumbleweed x86_64 on the main job group only after 2 consecutive green jobs.
  • AC3: extra_tests_in_textmode is unscheduled from openqa.opensuse.org for Tumbleweed x86_64 after a green job of extra_tests_textmode on the main job group.

Exit criteria

  • AC2.EC: In case the scenario extra_tests_in_textmode has failing modules, it is possible to consider the move of extra_tests_textmode from dev job group to main job group after two consecutive jobs with at least the same number of passing test modules.
  • AC3.EC: In case the scenario extra_tests_in_textmode has failing modules, it is possible to consider the remove of extra_tests_in_textmode from main job group after one run of extra_tests_textmode with at least the same number of passing test modules on the main job group.

Tasks

  1. Create test suite definition on openqa.opensuse.org
  2. Add via conditional schedule to extra_tests_textmode.yaml the modules present in extra_tests_in_textmode that are not included in extra_tests_textmode.yaml
  3. Schedule extra_tests_textmode in Development Tumbleweed on x86_64
  4. After two consecutive green jobs in Development Tumbleweed, move it to openSUSE Tumbleweed
  5. After one green job in openSUSE Tumbleweed, unscheduled extra_tests_in_textmode from x86_64

Test suite definition

Description

Maintainer: slindomansilla@suse.de
Mainly post-installation console extra tests.

Settings

BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2
MAX_JOB_TIME=18000
NUMDISKS=2
REPO_9=%REPO_0_DEBUGINFO%
START_AFTER_TEST=create_hdd_textmode
SYSAUTHTEST=1
UEFI_PFLASH_VARS=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%-uefi-vars.qcow2
YAML_SCHEDULE=schedule/functional/extra_tests_textmode.yaml

Related issues 2 (0 open — 2 closed)

Related to openQA Tests - action #72244: [functional][u] test fails in ntp_clientResolveddheidler2020-10-05

Actions
Related to openQA Tests - action #71503: [functional][u] disabling cups service, but not path/socket does not shut down cups (reliably)Resolveddheidler2020-09-18

Actions
Actions
Copy link
 #1

Updated by SLindoMansilla over 3 years ago

  • Description updated (diff)
Actions
Copy link
 #2

Updated by szarate over 3 years ago

  • Estimated time set to 42.00 h

We did the same for osd, we just forgot to do it for tw

Actions
Copy link
 #3

Updated by szarate over 3 years ago

  • Status changed from New to Workable
Actions
Copy link
 #4

Updated by dheidler over 3 years ago

  • Status changed from Workable to In Progress
  • Assignee set to dheidler
Actions
Copy link
 #6

Updated by dheidler over 3 years ago

PR merged.
Scheduled in tw dev jobgroup: https://openqa.opensuse.org/admin/job_templates/38

@@ -259,6 +259,7 @@
     - gnome+do_not_import_ssh_keys
     - external_iso
     - suse_patches-systemd_testsuite
+    - extra_tests_textmode
     - desktopapps-message-wayland:
         machine: 64bit_virtio
     - repo_inst
Actions
Copy link
 #7

Updated by dheidler over 3 years ago

  • Status changed from In Progress to Feedback

Waiting for results in devel jobgroup.

Actions
Copy link
 #8

Updated by SLindoMansilla over 3 years ago

  • Description updated (diff)

Please, add a "latest" link to extra_tests_in_textmode in the description of extra_tests_textmode to make review of "last good" easier.
https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=opensuse&flavor=DVD&machine=64bit&test=extra_tests_in_textmode&version=Tumbleweed#live

Actions
Copy link
 #9

Updated by SLindoMansilla over 3 years ago

  • Description updated (diff)
Actions
Copy link
 #10

Updated by SLindoMansilla over 3 years ago

  • Description updated (diff)
Actions
Copy link
 #11

Updated by dheidler over 3 years ago

  • Related to action #72244: [functional][u] test fails in ntp_client added
Actions
Copy link
 #12

Updated by dheidler over 3 years ago

  • Related to action #71503: [functional][u] disabling cups service, but not path/socket does not shut down cups (reliably) added
Actions
Copy link
 #13

Updated by dheidler over 3 years ago

  • Status changed from Feedback to Resolved
@@ -285,7 +285,6 @@
         priority: 46
     - extra_tests_on_kde
     - extra_tests_on_xfce
-    - extra_tests_in_textmode
     - extra_tests_textmode
     - create_hdd_transactional_server
     - extra_tests_transactional_server
Actions
Copy link

Also available in: Atom PDF