action #25190
closedcoordination #23798: [qe-core][sles][functional][epic] Add systemd test suite execution to openQA
[sles][functional][demo] Add test suite systemd_installation_media
0%
Description
User story¶
As a QA SLE functional openQA test reviewer I want to execute systemd testsuites against the systemd on each build for validation to find systemd-only related regressions early and be able to crosscheck with our system tests
Acceptance criteria¶
- AC1 the SUSE systemd testsuite is executed as part of build validation
- AC2 The test have to work for SLE15 and Tumbleweed
Tasks¶
- find the systemd test suite for openSUSE
- create new test module that executes the systemd test suite
- create new test schedule (main.pm) that executes the installation of the testsuite and execution
- add this test suite to o3
- find the systemd test suite for SLE
- add this test suite to osd
Further information¶
- Apply test to the systemd version included in the installation media (version after system installation).
- Install and execute the systemd-testsuite that matches the systemd version in the installation media.
Settings¶
Test suite name: suse_patches-systemd_testsuite
O3¶
BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2
QA_HEAD_REPO=https://download.opensuse.org/repositories/home:/tsaupe:/testsuites/openSUSE_Tumbleweed/
START_AFTER_TEST=create_hdd_textmode
SYSTEMD_TESTSUITE=1
OSD¶
BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2
QA_HEAD_REPO=http://download.suse.de/ibs/QA:/Head/SLE-15/
START_AFTER_TEST=create_hdd_textmode
SYSTEMD_TESTSUITE=1
Updated by okurz over 7 years ago
please split, add more details for ACs and tasks -> add the blocking information and don't work on it longer than tomorrow
Updated by SLindoMansilla over 7 years ago
- Subject changed from [sles][functional] Add systemd test suite for SLE15 and Tumbleweed to [sles][functional] Add systemd test suite systemd_installation_media
- Description updated (diff)
Updated by SLindoMansilla over 7 years ago
- Subject changed from [sles][functional] Add systemd test suite systemd_installation_media to [sles][functional] Add test suite systemd_installation_media
Updated by SLindoMansilla over 7 years ago
Blocked by btrfs quotas: http://copland.arch.suse.de/tests/1462#step/systemd_testsuite/19
Updated by okurz about 7 years ago
- Due date set to 2017-10-11
- Target version changed from Milestone 12 to Milestone 11
Updated by okurz about 7 years ago
Please try to add "user story" and also "tasks" with pointers where to start with, at best with time effort estimation for the tasks (pessimistic-optimistic)
Updated by SLindoMansilla about 7 years ago
Updated by SLindoMansilla about 7 years ago
- PR merged: Test for TW
- A new test suite should be configure on o3
- Waiting for testsuite to be available on ibs to add for sle
Updated by SLindoMansilla about 7 years ago
- Description updated (diff)
New test suite configured on o3.
The test suite is not yet on OSD because the testsuite package is missing on IBS. (https://build.suse.de/search?utf8=%E2%9C%93&search_text=systemd-v234-testsuite&commit=Submit&issue_tracker=bnc&issue=&project=0&project=1&package=0&package=1&name=0&name=1&title=0&description=0&attrib_type_id=)
Updated by SLindoMansilla about 7 years ago
- Status changed from In Progress to Feedback
Updated by SLindoMansilla about 7 years ago
Waiting for SR to be merged to have the testsuite on QA:HEAD: https://build.suse.de/request/show/143157
Updated by SLindoMansilla about 7 years ago
Updated by SLindoMansilla about 7 years ago
PR merged.
Test suite in OSD created: suse_patches-systemd_testsuite
Verified on O3: https://openqa.opensuse.org/tests/500864
Updated by binary_sequence about 7 years ago
Test failed on TW: https://openqa.opensuse.org/tests/501496#step/systemd_testsuite/24
PR to increase timeout: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3690
Updated by SLindoMansilla about 7 years ago
- Status changed from Feedback to Resolved
Verified on O3: https://openqa.opensuse.org/tests/501669
In OSD the test will fail because of missing packages:
Updated by SLindoMansilla about 7 years ago
- Subject changed from [sles][functional] Add test suite systemd_installation_media to [sles][functional][demo] Add test suite systemd_installation_media
Updated by SLindoMansilla about 7 years ago
- Description updated (diff)
Update: The repo for TW was changed to: https://download.opensuse.org/repositories/home:/tsaupe:/testsuites/openSUSE_Tumbleweed/
Settings in O3 updated.
Updated by okurz about 7 years ago
I recommend to find a non-home OBS project, e.g. tsaupe should create a development project, subproject of development project, etc.