action #25190
coordination #23798: [qe-core][sles][functional][epic] Add systemd test suite execution to openQA
[sles][functional][demo] Add test suite systemd_installation_media
0%
Description
User story¶
As a QA SLE functional openQA test reviewer I want to execute systemd testsuites against the systemd on each build for validation to find systemd-only related regressions early and be able to crosscheck with our system tests
Acceptance criteria¶
- AC1 the SUSE systemd testsuite is executed as part of build validation
- AC2 The test have to work for SLE15 and Tumbleweed
Tasks¶
- find the systemd test suite for openSUSE
- create new test module that executes the systemd test suite
- create new test schedule (main.pm) that executes the installation of the testsuite and execution
- add this test suite to o3
- find the systemd test suite for SLE
- add this test suite to osd
Further information¶
- Apply test to the systemd version included in the installation media (version after system installation).
- Install and execute the systemd-testsuite that matches the systemd version in the installation media.
Settings¶
Test suite name: suse_patches-systemd_testsuite
O3¶
BOOT_HDD_IMAGE=1 DESKTOP=textmode HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2 QA_HEAD_REPO=https://download.opensuse.org/repositories/home:/tsaupe:/testsuites/openSUSE_Tumbleweed/ START_AFTER_TEST=create_hdd_textmode SYSTEMD_TESTSUITE=1
OSD¶
BOOT_HDD_IMAGE=1 DESKTOP=textmode HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2 QA_HEAD_REPO=http://download.suse.de/ibs/QA:/Head/SLE-15/ START_AFTER_TEST=create_hdd_textmode SYSTEMD_TESTSUITE=1
History
#1
Updated by okurz over 5 years ago
please split, add more details for ACs and tasks -> add the blocking information and don't work on it longer than tomorrow
#2
Updated by SLindoMansilla over 5 years ago
- Subject changed from [sles][functional] Add systemd test suite for SLE15 and Tumbleweed to [sles][functional] Add systemd test suite systemd_installation_media
- Description updated (diff)
#3
Updated by SLindoMansilla over 5 years ago
- Subject changed from [sles][functional] Add systemd test suite systemd_installation_media to [sles][functional] Add test suite systemd_installation_media
#4
Updated by SLindoMansilla over 5 years ago
Blocked by btrfs quotas: http://copland.arch.suse.de/tests/1462#step/systemd_testsuite/19
#5
Updated by SLindoMansilla over 5 years ago
- Description updated (diff)
#6
Updated by SLindoMansilla over 5 years ago
- Description updated (diff)
#7
Updated by okurz over 5 years ago
- Target version set to Milestone 12
#8
Updated by okurz over 5 years ago
- Due date set to 2017-10-11
- Target version changed from Milestone 12 to Milestone 11
#9
Updated by okurz over 5 years ago
Please try to add "user story" and also "tasks" with pointers where to start with, at best with time effort estimation for the tasks (pessimistic-optimistic)
#10
Updated by okurz over 5 years ago
- Description updated (diff)
#11
Updated by SLindoMansilla over 5 years ago
- Description updated (diff)
#13
Updated by SLindoMansilla over 5 years ago
- PR merged: Test for TW
- A new test suite should be configure on o3
- Waiting for testsuite to be available on ibs to add for sle
#14
Updated by SLindoMansilla over 5 years ago
- Description updated (diff)
New test suite configured on o3.
The test suite is not yet on OSD because the testsuite package is missing on IBS. (https://build.suse.de/search?utf8=%E2%9C%93&search_text=systemd-v234-testsuite&commit=Submit&issue_tracker=bnc&issue=&project=0&project=1&package=0&package=1&name=0&name=1&title=0&description=0&attrib_type_id=)
#15
Updated by SLindoMansilla over 5 years ago
- Description updated (diff)
#16
Updated by SLindoMansilla over 5 years ago
- Status changed from In Progress to Feedback
#17
Updated by SLindoMansilla over 5 years ago
Waiting for SR to be merged to have the testsuite on QA:HEAD: https://build.suse.de/request/show/143157
#18
Updated by SLindoMansilla over 5 years ago
#19
Updated by SLindoMansilla over 5 years ago
PR merged.
Test suite in OSD created: suse_patches-systemd_testsuite
Verified on O3: https://openqa.opensuse.org/tests/500864
#20
Updated by SLindoMansilla over 5 years ago
- Description updated (diff)
#21
Updated by binary_sequence over 5 years ago
Test failed on TW: https://openqa.opensuse.org/tests/501496#step/systemd_testsuite/24
PR to increase timeout: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3690
#22
Updated by SLindoMansilla over 5 years ago
- Status changed from Feedback to Resolved
Verified on O3: https://openqa.opensuse.org/tests/501669
In OSD the test will fail because of missing packages:
#23
Updated by SLindoMansilla over 5 years ago
- Subject changed from [sles][functional] Add test suite systemd_installation_media to [sles][functional][demo] Add test suite systemd_installation_media
#24
Updated by SLindoMansilla over 5 years ago
- Description updated (diff)
Update: The repo for TW was changed to: https://download.opensuse.org/repositories/home:/tsaupe:/testsuites/openSUSE_Tumbleweed/
Settings in O3 updated.
#25
Updated by okurz over 5 years ago
I recommend to find a non-home OBS project, e.g. tsaupe should create a development project, subproject of development project, etc.
#26
Updated by SLindoMansilla over 2 years ago
- Due date deleted (
2017-10-11)