action #34996

[functional][opensuse][u][epic] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile

Added by SLindoMansilla almost 2 years ago. Updated about 1 year ago.

Status:BlockedStart date:25/06/2018
Priority:LowDue date:
Assignee:SLindoMansilla% Done:

0%

Category:Bugs in existing tests
Target version:QA - future
Difficulty:hard
Duration:

Description

The systemd test suite is tested in QA using the test suite suse_patches-systemd_testsuite:
- Scenario opensuse-Tumbleweed-DVD-x86_64-suse_patches-systemd_testsuite@64bit: osd#656311/modules/systemd_testsuite/steps/49

The problem happens when the package systemd-qa-testsuite is built separated from systemd itself (tblume, could you elaborate here the technical reason why this happens?)

This issue affects only Factory/Tumbleweed, which uses systemd version 237.
It doesn't happen on SLE15 nor Leap 15, that use systemd version 234.

To fix this issue we should build systemd-qa-testsuite in the same OBS package. systemd-qa-testsuite has a lot of patches which are not in a acceptable state to be accepted into Factory. The patches has to follow the guidelines (https://en.opensuse.org/openSUSE:Packaging_Patches_guidelines) and the guidelines of https://github.com/openSUSE/systemd maintainers.

Acceptance criteria

  • AC1: systemd-qa-testsuite patches are acceptable for openSUSE Factory.
  • AC2: systemd-qa-testsuite is accepted to be built as a sub package of OBS package systemd.

Tasks

  1. Try to resolve one patch per Sprint. Upstream: https://github.com/systemd/systemd

Further details

Always latest result in this scenario: latest


Subtasks

action #37728: [functional][sle][u] Make the patch 0001-test-catalog-fix...New

action #37731: [functional][sle][u] Make the patch 0002-testsuite-fix-te...New

action #37734: [functional][sle][u] Make the patch 0003-udev-test-textua...New

action #37737: [functional][sle][u] Make the patch 0004-sysv-generator-t...New

action #37740: [functional][sle][u] Make the patch 0005-TEST-07-fix-dire...New

action #37743: [functional][sle][u] Make the patch 0006-test-functions-a...New

action #37746: [functional][sle][u] Make the patch 0007-test-watchdog-in...New

action #37749: [functional][sle][u] Make the patch 0008-TEST-08-set-root...New

action #37752: [functional][sle][u] Make the patch 0009-TEST_13-systemd-...New

action #37755: [functional][sle][u] Make the patch 0010-TEST-13-fix-test...New

action #37758: [functional][sle][u] Make the patch 0011-TEST-21-adapt-sy...New

action #37761: [functional][sle][u] Package systemd-qa-testsuite have to...New


Related issues

Related to openQA Tests - action #32614: [opensuse][functional][u][systemd] systemd_testsuite fail... Resolved 01/03/2018 24/04/2018
Related to openQA Tests - action #36754: [functional][systemd][u][medium] test fails in systemd_te... Blocked 04/06/2018
Blocked by openQA Tests - action #45158: [systemd] Implement systemd testsuite as openQA perl module In Progress 18/01/2019

History

#1 Updated by SLindoMansilla almost 2 years ago

  • Description updated (diff)

#2 Updated by SLindoMansilla almost 2 years ago

  • Related to action #32614: [opensuse][functional][u][systemd] systemd_testsuite fails, as it does not cope with the split of systemd-container added

#3 Updated by SLindoMansilla almost 2 years ago

  • Description updated (diff)

#4 Updated by okurz almost 2 years ago

  • Due date set to 22/05/2018
  • Target version set to Milestone 16

#5 Updated by oorlov almost 2 years ago

  • Subject changed from [functional][opensuse][u] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile to [functional][opensuse][u][medium] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile
  • Description updated (diff)
  • Status changed from New to Workable
  • Difficulty set to medium

#6 Updated by okurz almost 2 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: suse_patches-systemd_testsuite
https://openqa.opensuse.org/tests/677208

#7 Updated by SLindoMansilla almost 2 years ago

  • Status changed from Workable to In Progress
  • Assignee set to SLindoMansilla

#8 Updated by SLindoMansilla almost 2 years ago

tblume told me that the initrd parameter is missing:

-initrd /boot/initrd-SVERSION

in the test-functions script this is here:

default_suse_initrd=/boot/initrd-${KERNEL_VER}

#9 Updated by SLindoMansilla almost 2 years ago

PR to fix missing initrd parameter:

#10 Updated by mgriessmeier over 1 year ago

  • Due date changed from 22/05/2018 to 05/06/2018

#11 Updated by SLindoMansilla over 1 year ago

PR was merged: https://github.com/systemd/systemd/pull/9029

Waiting for backport into Tumbleweed.

#12 Updated by SLindoMansilla over 1 year ago

  • Related to action #36754: [functional][systemd][u][medium] test fails in systemd_testsuite - needs further investigation added

#13 Updated by mgriessmeier over 1 year ago

  • Due date changed from 05/06/2018 to 19/06/2018
  • Target version changed from Milestone 16 to Milestone 17

#14 Updated by okurz over 1 year ago

SLindoMansilla wrote:

Waiting for backport into Tumbleweed.

where can we follow on with this? This ticket here hasn't moved since 14 days now

#15 Updated by SLindoMansilla over 1 year ago

Well, actually I was working on this one for SLE15: https://progress.opensuse.org/issues/36754

This ticket about TW is not blocked, because I can apply the patch following the guidelines.

#17 Updated by okurz over 1 year ago

  • Target version changed from Milestone 17 to Milestone 17

#18 Updated by mgriessmeier over 1 year ago

  • Due date changed from 19/06/2018 to 03/07/2018

#19 Updated by SLindoMansilla over 1 year ago

SR to organized patches on factory under factory first rule: https://build.opensuse.org/request/show/618101

#20 Updated by SLindoMansilla over 1 year ago

SR to backport and reorganized systemd patches for Leap/SLE 15: https://build.opensuse.org/request/show/618533

#21 Updated by okurz over 1 year ago

  • Priority changed from Normal to High

As discussed with SLindoMansilla: We should make sure that the systemd test scenario for openSUSE Tumbleweed does not show up as failure in the validation job group anymore, the least we can do – this is what we decided for – is to move the test scenario to the "test development" job group, make sure it's properly labeled and then continue with less urgency to provide fixes to the systemd+tests package. AFAIU that means providing patches to upstream systemd and waiting for their acceptance and then having these changes included in the upstream-pulled packages as on top of the openSUSE patches packaging policy the systemd team wants to avoid maintaining any upstream acceptable packages – even temporary – within the openSUSE packages.

#22 Updated by SLindoMansilla over 1 year ago

  • Subject changed from [functional][opensuse][u][medium] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile to [functional][opensuse][u][epic] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile
  • Status changed from In Progress to Workable

This task will be split to handle patches separately.
How to handle patches: See https://en.opensuse.org/openSUSE:Packaging_Patches_guidelines

#23 Updated by SLindoMansilla over 1 year ago

  • Description updated (diff)
  • Difficulty changed from medium to hard

#24 Updated by SLindoMansilla over 1 year ago

  • Description updated (diff)

#25 Updated by SLindoMansilla over 1 year ago

I have moved the test suite suse_patches-systemd_testsuite from Tumbleweed job group to Development Tumbleweed, because it fails since a long time and the expected "fix" is not expected before 6 weeks, maybe even longer.

#26 Updated by okurz over 1 year ago

  • Target version changed from Milestone 17 to Milestone 19

#27 Updated by okurz over 1 year ago

  • Target version changed from Milestone 19 to Milestone 21

@SLindoMansilla has the "expected fix" arrived by now or would this need your help?

#28 Updated by SLindoMansilla over 1 year ago

There is no fix coming. This task needs each individual subtask to be resolved (aka. patches put in a way that openSUSE Factory can take them) and then submitting this package to Factory.

#29 Updated by SLindoMansilla about 1 year ago

  • Related to action #45158: [systemd] Implement systemd testsuite as openQA perl module added

#30 Updated by SLindoMansilla about 1 year ago

  • Status changed from Workable to Blocked

Blocked by #45158

#31 Updated by SLindoMansilla about 1 year ago

  • Related to deleted (action #45158: [systemd] Implement systemd testsuite as openQA perl module)

#32 Updated by SLindoMansilla about 1 year ago

  • Blocked by action #45158: [systemd] Implement systemd testsuite as openQA perl module added

#33 Updated by okurz about 1 year ago

  • Target version changed from Milestone 21 to future

due to blocker

Also available in: Atom PDF