Project

General

Profile

action #89569

[qe-core] Unschedule suse_patches-systemd_testsuite from openqa.opensuse.org and openqa.suse.de

Added by SLindoMansilla 11 months ago. Updated 9 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Spike/Research
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

As a result of collaboration between "QA-SLE" and "System Boot & Init" team, "System Boot & Init" expressed the need to have aarch64, ppc64le and s390x machines. They only had x86_64 machines and Orthos machines weren't realiable.

To workaround that problem, tsaupe created an OBS project containing a modified version of the upstream systemd testsuite to be run on openQA. Being executed in openqa.opensuse.org and openqa.suse.de, we could verify at QA stage if systemd was ok for arch64, ppc64le and s390x.

Of course they needed to be able to execute those tests on DEV stage, before QA stage, so eventually they got aarch64, ppc64le and s390x machines and got help from "QE-SLE" to setup their team-wide openQA instance to run those tests.

By that time, the tests were running for so long on QA stage, that other QA teams were also using it and started making requests to maintain the test suites for already released products. In some discussion in a GitHub PR, Thomas accepted to do that. After some time Eli started contributing to fix the systemd test suite for openqa.opensuse.org and openqa.suse.de.

In a recent discussion with Eli, George and Sergio, we failed to find a reason to keep that test suite on openqa.opensuse.org and openqa.suse.de:

  • It is an upstream test suite that doesn't add value at QA stage, because it is already covered and maintained by "System Boot & Init"'s openQA instance.
  • "System Boot & Init" team seems to have stopped fixing the test suite for openqa.opensuse.org and openqa.suse.de.
  • The test suite is failing for a long time wasting resources.
  • There are already acceptance test modules in openqa.opensuse.org and openqa.suse.de that cover systemd.

Proposal

  • Unschedule from openqa.opensuse.org and openqa.suse.de?

Resources


Related issues

Related to openQA Tests - action #66352: [qe-core][opensuse] opensuse-Tumbleweed-DVD-aarch64-suse_patches-systemd_testsuite@aarch64 test fails in binary_tests, never completedRejected2020-05-03

History

#1 Updated by eroca 11 months ago

  • Related to action #66352: [qe-core][opensuse] opensuse-Tumbleweed-DVD-aarch64-suse_patches-systemd_testsuite@aarch64 test fails in binary_tests, never completed added

#2 Updated by tjyrinki_suse 11 months ago

  • Status changed from New to Workable
  • Start date deleted (2021-03-05)

#3 Updated by dheidler 10 months ago

  • Status changed from Workable to In Progress
  • Assignee set to dheidler

On OSD this seems to be scheduled in the following jobgroups:

https://openqa.suse.de/admin/job_templates/291 (this one seems to belong to sergio but since he left I think we can completely delete it)
https://openqa.suse.de/admin/job_templates/132

The YAML testsuite schedule should be this one: schedule/systemd/suse_patches-systemd_testsuite.yaml

#5 Updated by dheidler 10 months ago

BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2
ISO=
NUMDISKS=2
QEMURAM=2048
START_AFTER_TEST=create_hdd_textmode
SYSTEMD_TESTSUITE=noqemu
UEFI_PFLASH_VARS=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%-uefi-vars.qcow2

#6 Updated by dheidler 10 months ago

@@ -79,7 +79,6 @@
 scenarios:
   aarch64:
     sle-12-SP5-Server-DVD-aarch64:
-    - suse_patches-systemd_testsuite
     - cryptlvm+cancel_existing+force_recompute:
         priority: 90
     - lvm_thin_provisioning
@@ -87,7 +86,6 @@
   ppc64le:
     sle-12-SP5-Server-DVD-ppc64le:
     - extra_tests_filesystem
-    - suse_patches-systemd_testsuite
     - wicked_advanced_ref: &wicked_settings
         settings:
           DESKTOP: textmode

https://openqa.suse.de/admin/job_templates/132

#7 Updated by dheidler 10 months ago

@ -7,7 +7,4 @@
     distri: opensuse
     flavor: DVD
     version: '15.2'
-scenarios:
+scenarios: {}
-  x86_64:
-    opensuse-15.2-DVD-x86_64:
-    - suse_patches-systemd_testsuite

https://openqa.opensuse.org/admin/job_templates/39

#8 Updated by dheidler 10 months ago

@@ -112,7 +112,6 @@
         priority: 60
     - repo_inst
     - create_hdd_textmode_ext4
-    - suse_patches-systemd_testsuite
     - desktopapps-firefox-x11:
         settings:
           DESKTOP: gnome
@@ -245,7 +244,6 @@
     - samba_ncurses
     - gnome+do_not_import_ssh_keys
     - external_iso
-    - suse_patches-systemd_testsuite
     - desktopapps-message-wayland:
         machine: 64bit_virtio
     - repo_inst

https://openqa.opensuse.org/admin/job_templates/38

#9 Updated by dheidler 10 months ago

% openqa-client --host openqa.suse.de job_groups/291 DELETE
{ id => 291 }

#11 Updated by dheidler 10 months ago

  • Status changed from In Progress to Feedback

#12 Updated by dheidler 10 months ago

  • Status changed from Feedback to Resolved

#13 Updated by szarate 9 months ago

  • Target version set to Ready

#14 Updated by szarate 9 months ago

  • Target version changed from Ready to QE-Core: Ready

Also available in: Atom PDF