Project

General

Profile

Actions

action #89569

closed

[qe-core] Unschedule suse_patches-systemd_testsuite from openqa.opensuse.org and openqa.suse.de

Added by SLindoMansilla over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Spike/Research
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

As a result of collaboration between "QA-SLE" and "System Boot & Init" team, "System Boot & Init" expressed the need to have aarch64, ppc64le and s390x machines. They only had x86_64 machines and Orthos machines weren't realiable.

To workaround that problem, tsaupe created an OBS project containing a modified version of the upstream systemd testsuite to be run on openQA. Being executed in openqa.opensuse.org and openqa.suse.de, we could verify at QA stage if systemd was ok for arch64, ppc64le and s390x.

Of course they needed to be able to execute those tests on DEV stage, before QA stage, so eventually they got aarch64, ppc64le and s390x machines and got help from "QE-SLE" to setup their team-wide openQA instance to run those tests.

By that time, the tests were running for so long on QA stage, that other QA teams were also using it and started making requests to maintain the test suites for already released products. In some discussion in a GitHub PR, Thomas accepted to do that. After some time Eli started contributing to fix the systemd test suite for openqa.opensuse.org and openqa.suse.de.

In a recent discussion with Eli, George and Sergio, we failed to find a reason to keep that test suite on openqa.opensuse.org and openqa.suse.de:

  • It is an upstream test suite that doesn't add value at QA stage, because it is already covered and maintained by "System Boot & Init"'s openQA instance.
  • "System Boot & Init" team seems to have stopped fixing the test suite for openqa.opensuse.org and openqa.suse.de.
  • The test suite is failing for a long time wasting resources.
  • There are already acceptance test modules in openqa.opensuse.org and openqa.suse.de that cover systemd.

Proposal

  • Unschedule from openqa.opensuse.org and openqa.suse.de?

Resources


Related issues 1 (0 open1 closed)

Related to openQA Tests - action #66352: [qe-core][opensuse] opensuse-Tumbleweed-DVD-aarch64-suse_patches-systemd_testsuite@aarch64 test fails in binary_tests, never completedRejected2020-05-03

Actions
Actions #1

Updated by eroca over 3 years ago

  • Related to action #66352: [qe-core][opensuse] opensuse-Tumbleweed-DVD-aarch64-suse_patches-systemd_testsuite@aarch64 test fails in binary_tests, never completed added
Actions #2

Updated by tjyrinki_suse over 3 years ago

  • Status changed from New to Workable
  • Start date deleted (2021-03-05)
Actions #3

Updated by dheidler over 3 years ago

  • Status changed from Workable to In Progress
  • Assignee set to dheidler

On OSD this seems to be scheduled in the following jobgroups:

https://openqa.suse.de/admin/job_templates/291 (this one seems to belong to sergio but since he left I think we can completely delete it)
https://openqa.suse.de/admin/job_templates/132

The YAML testsuite schedule should be this one: schedule/systemd/suse_patches-systemd_testsuite.yaml

Actions #5

Updated by dheidler over 3 years ago

BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2
ISO=
NUMDISKS=2
QEMURAM=2048
START_AFTER_TEST=create_hdd_textmode
SYSTEMD_TESTSUITE=noqemu
UEFI_PFLASH_VARS=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%-uefi-vars.qcow2
Actions #6

Updated by dheidler over 3 years ago

@@ -79,7 +79,6 @@
 scenarios:
   aarch64:
     sle-12-SP5-Server-DVD-aarch64:
-    - suse_patches-systemd_testsuite
     - cryptlvm+cancel_existing+force_recompute:
         priority: 90
     - lvm_thin_provisioning
@@ -87,7 +86,6 @@
   ppc64le:
     sle-12-SP5-Server-DVD-ppc64le:
     - extra_tests_filesystem
-    - suse_patches-systemd_testsuite
     - wicked_advanced_ref: &wicked_settings
         settings:
           DESKTOP: textmode

https://openqa.suse.de/admin/job_templates/132

Actions #7

Updated by dheidler over 3 years ago

@ -7,7 +7,4 @@
     distri: opensuse
     flavor: DVD
     version: '15.2'
-scenarios:
+scenarios: {}
-  x86_64:
-    opensuse-15.2-DVD-x86_64:
-    - suse_patches-systemd_testsuite

https://openqa.opensuse.org/admin/job_templates/39

Actions #8

Updated by dheidler over 3 years ago

@@ -112,7 +112,6 @@
         priority: 60
     - repo_inst
     - create_hdd_textmode_ext4
-    - suse_patches-systemd_testsuite
     - desktopapps-firefox-x11:
         settings:
           DESKTOP: gnome
@@ -245,7 +244,6 @@
     - samba_ncurses
     - gnome+do_not_import_ssh_keys
     - external_iso
-    - suse_patches-systemd_testsuite
     - desktopapps-message-wayland:
         machine: 64bit_virtio
     - repo_inst

https://openqa.opensuse.org/admin/job_templates/38

Actions #9

Updated by dheidler over 3 years ago

% openqa-client --host openqa.suse.de job_groups/291 DELETE
{ id => 291 }
Actions #11

Updated by dheidler over 3 years ago

  • Status changed from In Progress to Feedback
Actions #12

Updated by dheidler over 3 years ago

  • Status changed from Feedback to Resolved
Actions #13

Updated by szarate over 3 years ago

  • Target version set to Ready
Actions #14

Updated by szarate over 3 years ago

  • Target version changed from Ready to QE-Core: Ready
Actions

Also available in: Atom PDF