Project

General

Profile

Actions
Copy link

coordination #34996

closed

[qe-core][functional][opensuse][epic] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile

Added by SLindoMansilla over 6 years ago. Updated over 3 years ago.

Status:
Rejected
Priority:
Low
Assignee:
SLindoMansilla
Category:
Bugs in existing tests
Target version:
QA (public, currently private due to #173521) - future
Start date:
2018-06-25
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Difficulty:

Description

The systemd test suite is tested in QA using the test suite suse_patches-systemd_testsuite:

The problem happens when the package systemd-qa-testsuite is built separated from systemd itself (tblume, could you elaborate here the technical reason why this happens?)

This issue affects only Factory/Tumbleweed, which uses systemd version 237.
It doesn't happen on SLE15 nor Leap 15, that use systemd version 234.

To fix this issue we should build systemd-qa-testsuite in the same OBS package. systemd-qa-testsuite has a lot of patches which are not in a acceptable state to be accepted into Factory. The patches has to follow the guidelines (https://en.opensuse.org/openSUSE:Packaging_Patches_guidelines) and the guidelines of https://github.com/openSUSE/systemd maintainers.

Acceptance criteria

  • AC1: systemd-qa-testsuite patches are acceptable for openSUSE Factory.
  • AC2: systemd-qa-testsuite is accepted to be built as a sub package of OBS package systemd.

Tasks

  1. Try to resolve one patch per Sprint. Upstream: https://github.com/systemd/systemd

Further details

Always latest result in this scenario: latest

Subtasks 12 (0 open — 12 closed)

action #37728: [functional][sle][u] Make the patch 0001-test-catalog-fix-catalog-source-directory acceptable for openSUSE FactoryRejected2018-06-25

Actions
action #37731: [functional][sle][u] Make the patch 0002-testsuite-fix-test-keymap-test acceptable for openSUSE FactoryRejected2018-06-25

Actions
action #37734: [functional][sle][u] Make the patch 0003-udev-test-textual-group-id-has-group-disk-on-SUSE acceptable for openSUSE FactoryRejected2018-06-25

Actions
action #37737: [functional][sle][u] Make the patch 0004-sysv-generator-test-multiple-LSB-macro-deps-add-Want acceptable for openSUSE FactoryRejected2018-06-25

Actions
action #37740: [functional][sle][u] Make the patch 0005-TEST-07-fix-directories acceptable for openSUSE FactoryRejected2018-06-25

Actions
action #37743: [functional][sle][u] Make the patch 0006-test-functions-adapt-for-QA-package acceptable for openSUSE FactoryRejected2018-06-25

Actions
action #37746: [functional][sle][u] Make the patch 0007-test-watchdog-include-pre-timeout-in-timeout-setting acceptable for openSUSE FactoryRejected2018-06-25

Actions
action #37749: [functional][sle][u] Make the patch 0008-TEST-08-set-rootfs-to-btrfs acceptable for openSUSE FactoryRejected2018-06-25

Actions
action #37752: [functional][sle][u] Make the patch 0009-TEST_13-systemd-nspawn-needs-to-bind-lib64 acceptable for openSUSE FactoryRejected2018-06-25

Actions
action #37755: [functional][sle][u] Make the patch 0010-TEST-13-fix-testcontainer-setup acceptable for openSUSE FactoryRejected2018-06-25

Actions
action #37758: [functional][sle][u] Make the patch 0011-TEST-21-adapt-sysuser-to-SUSE-settings acceptable for openSUSE FactoryRejected2018-06-25

Actions
action #37761: [functional][sle][u] Package systemd-qa-testsuite have to be built within systemd OBS packageRejected2018-06-25

Actions

Related issues 2 (0 open — 2 closed)

Related to openQA Tests (public) - action #32614: [opensuse][functional][u][systemd] systemd_testsuite fails, as it does not cope with the split of systemd-containerResolvedSLindoMansilla2018-03-012018-04-24

Actions
Related to openQA Tests (public) - action #36754: [qe-core][functional][systemd][medium] test fails in systemd_testsuite - needs further investigationResolvedSLindoMansilla2018-06-04

Actions
Actions
Copy link
 #1

Updated by SLindoMansilla over 6 years ago

  • Description updated (diff)
Actions
Copy link
 #2

Updated by SLindoMansilla over 6 years ago

  • Related to action #32614: [opensuse][functional][u][systemd] systemd_testsuite fails, as it does not cope with the split of systemd-container added
Actions
Copy link
 #3

Updated by SLindoMansilla over 6 years ago

  • Description updated (diff)
Actions
Copy link
 #4

Updated by okurz over 6 years ago

  • Due date set to 2018-05-22
  • Target version set to Milestone 16
Actions
Copy link
 #5

Updated by oorlov over 6 years ago

  • Subject changed from [functional][opensuse][u] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile to [functional][opensuse][u][medium] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile
  • Description updated (diff)
  • Status changed from New to Workable
  • Difficulty set to medium
Actions
Copy link
 #6

Updated by okurz over 6 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: suse_patches-systemd_testsuite
https://openqa.opensuse.org/tests/677208

Actions
Copy link
 #7

Updated by SLindoMansilla over 6 years ago

  • Status changed from Workable to In Progress
  • Assignee set to SLindoMansilla
Actions
Copy link
 #8

Updated by SLindoMansilla over 6 years ago

tblume told me that the initrd parameter is missing:

-initrd /boot/initrd-SVERSION
in the test-functions script this is here:
default_suse_initrd=/boot/initrd-${KERNEL_VER}

Actions
Copy link
 #9

Updated by SLindoMansilla over 6 years ago

PR to fix missing initrd parameter:

Actions
Copy link
 #10

Updated by mgriessmeier over 6 years ago

  • Due date changed from 2018-05-22 to 2018-06-05
Actions
Copy link
 #11

Updated by SLindoMansilla over 6 years ago

PR was merged: https://github.com/systemd/systemd/pull/9029

Waiting for backport into Tumbleweed.

Actions
Copy link
 #12

Updated by SLindoMansilla over 6 years ago

  • Related to action #36754: [qe-core][functional][systemd][medium] test fails in systemd_testsuite - needs further investigation added
Actions
Copy link
 #13

Updated by mgriessmeier over 6 years ago

  • Due date changed from 2018-06-05 to 2018-06-19
  • Target version changed from Milestone 16 to Milestone 17
Actions
Copy link
 #14

Updated by okurz over 6 years ago

SLindoMansilla wrote:

Waiting for backport into Tumbleweed.

where can we follow on with this? This ticket here hasn't moved since 14 days now

Actions
Copy link
 #15

Updated by SLindoMansilla over 6 years ago

Well, actually I was working on this one for SLE15: https://progress.opensuse.org/issues/36754

This ticket about TW is not blocked, because I can apply the patch following the guidelines.

Actions
Copy link
 #17

Updated by okurz over 6 years ago

  • Target version changed from Milestone 17 to Milestone 17
Actions
Copy link
 #18

Updated by mgriessmeier over 6 years ago

  • Due date changed from 2018-06-19 to 2018-07-03
Actions
Copy link
 #19

Updated by SLindoMansilla over 6 years ago

SR to organized patches on factory under factory first rule: https://build.opensuse.org/request/show/618101

Actions
Copy link
 #20

Updated by SLindoMansilla over 6 years ago

SR to backport and reorganized systemd patches for Leap/SLE 15: https://build.opensuse.org/request/show/618533

Actions
Copy link
 #21

Updated by okurz over 6 years ago

  • Priority changed from Normal to High

As discussed with SLindoMansilla: We should make sure that the systemd test scenario for openSUSE Tumbleweed does not show up as failure in the validation job group anymore, the least we can do – this is what we decided for – is to move the test scenario to the "test development" job group, make sure it's properly labeled and then continue with less urgency to provide fixes to the systemd+tests package. AFAIU that means providing patches to upstream systemd and waiting for their acceptance and then having these changes included in the upstream-pulled packages as on top of the openSUSE patches packaging policy the systemd team wants to avoid maintaining any upstream acceptable packages – even temporary – within the openSUSE packages.

Actions
Copy link
 #22

Updated by SLindoMansilla over 6 years ago

  • Subject changed from [functional][opensuse][u][medium] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile to [functional][opensuse][u][epic] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile
  • Status changed from In Progress to Workable

This task will be split to handle patches separately.
How to handle patches: See https://en.opensuse.org/openSUSE:Packaging_Patches_guidelines

Actions
Copy link
 #23

Updated by SLindoMansilla over 6 years ago

  • Description updated (diff)
  • Difficulty changed from medium to hard
Actions
Copy link
 #24

Updated by SLindoMansilla over 6 years ago

  • Description updated (diff)
Actions
Copy link
 #25

Updated by SLindoMansilla over 6 years ago

I have moved the test suite suse_patches-systemd_testsuite from Tumbleweed job group to Development Tumbleweed, because it fails since a long time and the expected "fix" is not expected before 6 weeks, maybe even longer.

Actions
Copy link
 #26

Updated by okurz over 6 years ago

  • Target version changed from Milestone 17 to Milestone 19
Actions
Copy link
 #27

Updated by okurz about 6 years ago

  • Target version changed from Milestone 19 to Milestone 21

@SLindoMansilla has the "expected fix" arrived by now or would this need your help?

Actions
Copy link
 #28

Updated by SLindoMansilla about 6 years ago

There is no fix coming. This task needs each individual subtask to be resolved (aka. patches put in a way that openSUSE Factory can take them) and then submitting this package to Factory.

Actions
Copy link
 #29

Updated by SLindoMansilla almost 6 years ago

  • Related to action #45158: [systemd] Implement systemd testsuite as openQA perl module added
Actions
Copy link
 #30

Updated by SLindoMansilla almost 6 years ago

  • Status changed from Workable to Blocked

Blocked by #45158

Actions
Copy link
 #31

Updated by SLindoMansilla almost 6 years ago

  • Related to deleted (action #45158: [systemd] Implement systemd testsuite as openQA perl module)
Actions
Copy link
 #32

Updated by SLindoMansilla almost 6 years ago

  • Blocked by action #45158: [systemd] Implement systemd testsuite as openQA perl module added
Actions
Copy link
 #33

Updated by okurz almost 6 years ago

  • Target version changed from Milestone 21 to future

due to blocker

Actions
Copy link
 #34

Updated by mgriessmeier almost 5 years ago

  • Blocked by deleted (action #45158: [systemd] Implement systemd testsuite as openQA perl module)
Actions
Copy link
 #35

Updated by szarate about 4 years ago

  • Tracker changed from action to coordination
  • Status changed from Blocked to New
  • Difficulty deleted (hard)
Actions
Copy link
 #37

Updated by tjyrinki_suse about 4 years ago

  • Subject changed from [functional][opensuse][u][epic] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile to [qe-core][functional][opensuse][epic] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile
Actions
Copy link
 #38

Updated by SLindoMansilla over 3 years ago

  • Status changed from New to Rejected

sub-tasks rejected

Actions
Copy link

Also available in: Atom PDF