Project

General

Profile

coordination #34996

[qe-core][functional][opensuse][epic] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile

Added by SLindoMansilla almost 3 years ago. Updated about 1 month ago.

Status:
Rejected
Priority:
Low
Category:
Bugs in existing tests
Target version:
Start date:
2018-06-25
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Difficulty:

Description

The systemd test suite is tested in QA using the test suite suse_patches-systemd_testsuite:

The problem happens when the package systemd-qa-testsuite is built separated from systemd itself (tblume, could you elaborate here the technical reason why this happens?)

This issue affects only Factory/Tumbleweed, which uses systemd version 237.
It doesn't happen on SLE15 nor Leap 15, that use systemd version 234.

To fix this issue we should build systemd-qa-testsuite in the same OBS package. systemd-qa-testsuite has a lot of patches which are not in a acceptable state to be accepted into Factory. The patches has to follow the guidelines (https://en.opensuse.org/openSUSE:Packaging_Patches_guidelines) and the guidelines of https://github.com/openSUSE/systemd maintainers.

Acceptance criteria

  • AC1: systemd-qa-testsuite patches are acceptable for openSUSE Factory.
  • AC2: systemd-qa-testsuite is accepted to be built as a sub package of OBS package systemd.

Tasks

  1. Try to resolve one patch per Sprint. Upstream: https://github.com/systemd/systemd

Further details

Always latest result in this scenario: latest


Subtasks

action #37728: [functional][sle][u] Make the patch 0001-test-catalog-fix-catalog-source-directory acceptable for openSUSE FactoryRejected

action #37731: [functional][sle][u] Make the patch 0002-testsuite-fix-test-keymap-test acceptable for openSUSE FactoryRejected

action #37734: [functional][sle][u] Make the patch 0003-udev-test-textual-group-id-has-group-disk-on-SUSE acceptable for openSUSE FactoryRejected

action #37737: [functional][sle][u] Make the patch 0004-sysv-generator-test-multiple-LSB-macro-deps-add-Want acceptable for openSUSE FactoryRejected

action #37740: [functional][sle][u] Make the patch 0005-TEST-07-fix-directories acceptable for openSUSE FactoryRejected

action #37743: [functional][sle][u] Make the patch 0006-test-functions-adapt-for-QA-package acceptable for openSUSE FactoryRejected

action #37746: [functional][sle][u] Make the patch 0007-test-watchdog-include-pre-timeout-in-timeout-setting acceptable for openSUSE FactoryRejected

action #37749: [functional][sle][u] Make the patch 0008-TEST-08-set-rootfs-to-btrfs acceptable for openSUSE FactoryRejected

action #37752: [functional][sle][u] Make the patch 0009-TEST_13-systemd-nspawn-needs-to-bind-lib64 acceptable for openSUSE FactoryRejected

action #37755: [functional][sle][u] Make the patch 0010-TEST-13-fix-testcontainer-setup acceptable for openSUSE FactoryRejected

action #37758: [functional][sle][u] Make the patch 0011-TEST-21-adapt-sysuser-to-SUSE-settings acceptable for openSUSE FactoryRejected

action #37761: [functional][sle][u] Package systemd-qa-testsuite have to be built within systemd OBS packageRejected


Related issues

Related to openQA Tests - action #32614: [opensuse][functional][u][systemd] systemd_testsuite fails, as it does not cope with the split of systemd-containerResolved2018-03-012018-04-24

Related to openQA Tests - action #36754: [qe-core][functional][systemd][medium] test fails in systemd_testsuite - needs further investigationResolved2018-06-04

History

#1 Updated by SLindoMansilla almost 3 years ago

  • Description updated (diff)

#2 Updated by SLindoMansilla almost 3 years ago

  • Related to action #32614: [opensuse][functional][u][systemd] systemd_testsuite fails, as it does not cope with the split of systemd-container added

#3 Updated by SLindoMansilla almost 3 years ago

  • Description updated (diff)

#4 Updated by okurz almost 3 years ago

  • Due date set to 2018-05-22
  • Target version set to Milestone 16

#5 Updated by oorlov almost 3 years ago

  • Subject changed from [functional][opensuse][u] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile to [functional][opensuse][u][medium] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile
  • Description updated (diff)
  • Status changed from New to Workable
  • Difficulty set to medium

#6 Updated by okurz almost 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: suse_patches-systemd_testsuite
https://openqa.opensuse.org/tests/677208

#7 Updated by SLindoMansilla almost 3 years ago

  • Status changed from Workable to In Progress
  • Assignee set to SLindoMansilla

#8 Updated by SLindoMansilla almost 3 years ago

tblume told me that the initrd parameter is missing:

-initrd /boot/initrd-SVERSION
in the test-functions script this is here:
default_suse_initrd=/boot/initrd-${KERNEL_VER}

#9 Updated by SLindoMansilla almost 3 years ago

PR to fix missing initrd parameter:

#10 Updated by mgriessmeier almost 3 years ago

  • Due date changed from 2018-05-22 to 2018-06-05

#11 Updated by SLindoMansilla almost 3 years ago

PR was merged: https://github.com/systemd/systemd/pull/9029

Waiting for backport into Tumbleweed.

#12 Updated by SLindoMansilla almost 3 years ago

  • Related to action #36754: [qe-core][functional][systemd][medium] test fails in systemd_testsuite - needs further investigation added

#13 Updated by mgriessmeier almost 3 years ago

  • Due date changed from 2018-06-05 to 2018-06-19
  • Target version changed from Milestone 16 to Milestone 17

#14 Updated by okurz almost 3 years ago

SLindoMansilla wrote:

Waiting for backport into Tumbleweed.

where can we follow on with this? This ticket here hasn't moved since 14 days now

#15 Updated by SLindoMansilla almost 3 years ago

Well, actually I was working on this one for SLE15: https://progress.opensuse.org/issues/36754

This ticket about TW is not blocked, because I can apply the patch following the guidelines.

#17 Updated by okurz almost 3 years ago

  • Target version changed from Milestone 17 to Milestone 17

#18 Updated by mgriessmeier almost 3 years ago

  • Due date changed from 2018-06-19 to 2018-07-03

#19 Updated by SLindoMansilla almost 3 years ago

SR to organized patches on factory under factory first rule: https://build.opensuse.org/request/show/618101

#20 Updated by SLindoMansilla almost 3 years ago

SR to backport and reorganized systemd patches for Leap/SLE 15: https://build.opensuse.org/request/show/618533

#21 Updated by okurz almost 3 years ago

  • Priority changed from Normal to High

As discussed with SLindoMansilla: We should make sure that the systemd test scenario for openSUSE Tumbleweed does not show up as failure in the validation job group anymore, the least we can do – this is what we decided for – is to move the test scenario to the "test development" job group, make sure it's properly labeled and then continue with less urgency to provide fixes to the systemd+tests package. AFAIU that means providing patches to upstream systemd and waiting for their acceptance and then having these changes included in the upstream-pulled packages as on top of the openSUSE patches packaging policy the systemd team wants to avoid maintaining any upstream acceptable packages – even temporary – within the openSUSE packages.

#22 Updated by SLindoMansilla almost 3 years ago

  • Subject changed from [functional][opensuse][u][medium] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile to [functional][opensuse][u][epic] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile
  • Status changed from In Progress to Workable

This task will be split to handle patches separately.
How to handle patches: See https://en.opensuse.org/openSUSE:Packaging_Patches_guidelines

#23 Updated by SLindoMansilla almost 3 years ago

  • Description updated (diff)
  • Difficulty changed from medium to hard

#24 Updated by SLindoMansilla almost 3 years ago

  • Description updated (diff)

#25 Updated by SLindoMansilla almost 3 years ago

I have moved the test suite suse_patches-systemd_testsuite from Tumbleweed job group to Development Tumbleweed, because it fails since a long time and the expected "fix" is not expected before 6 weeks, maybe even longer.

#26 Updated by okurz over 2 years ago

  • Target version changed from Milestone 17 to Milestone 19

#27 Updated by okurz over 2 years ago

  • Target version changed from Milestone 19 to Milestone 21

@SLindoMansilla has the "expected fix" arrived by now or would this need your help?

#28 Updated by SLindoMansilla over 2 years ago

There is no fix coming. This task needs each individual subtask to be resolved (aka. patches put in a way that openSUSE Factory can take them) and then submitting this package to Factory.

#29 Updated by SLindoMansilla over 2 years ago

  • Related to action #45158: [systemd] Implement systemd testsuite as openQA perl module added

#30 Updated by SLindoMansilla over 2 years ago

  • Status changed from Workable to Blocked

Blocked by #45158

#31 Updated by SLindoMansilla over 2 years ago

  • Related to deleted (action #45158: [systemd] Implement systemd testsuite as openQA perl module)

#32 Updated by SLindoMansilla over 2 years ago

  • Blocked by action #45158: [systemd] Implement systemd testsuite as openQA perl module added

#33 Updated by okurz over 2 years ago

  • Target version changed from Milestone 21 to future

due to blocker

#34 Updated by mgriessmeier about 1 year ago

  • Blocked by deleted (action #45158: [systemd] Implement systemd testsuite as openQA perl module)

#35 Updated by szarate 6 months ago

  • Tracker changed from action to coordination
  • Status changed from Blocked to New
  • Difficulty deleted (hard)

#37 Updated by tjyrinki_suse 5 months ago

  • Subject changed from [functional][opensuse][u][epic] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile to [qe-core][functional][opensuse][epic] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile

#38 Updated by SLindoMansilla about 1 month ago

  • Status changed from New to Rejected

sub-tasks rejected

Also available in: Atom PDF