Project

General

Profile

Actions

action #13216

closed

[sles][functional][s390x] Run extratest on s390x

Added by michalnowak over 7 years ago. Updated over 6 years ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
Enhancement to existing tests
Start date:
2017-03-02
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Difficulty:

Description

I recently added console/openssl_alpn.pm test to EXTRATEST in main.pm. When investigating runs on OSD I noticed that EXTRATEST is not being run on s390x on OSD. I don't know why is it so other than limited capacity that architecture. I'd leave it for Matthias to decide whether we should run them or not.


Subtasks 1 (0 open1 closed)

action #17420: [sles][functional][s390x] Test fails in vnc_two_passwordsResolvedokurz2017-03-02

Actions

Related issues 3 (0 open3 closed)

Related to openQA Tests - action #25638: [sles][functional][s390x] test fails in shutdown: VNC stall detected, needs to be investigatedResolvedmgriessmeier2017-09-282017-10-25

Actions
Blocked by openQA Tests - action #9674: [sles][functional][s390x] test an existing installationResolvedriafarov2015-11-252017-11-08

Actions
Blocked by openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMResolvedokurz2017-03-27

Actions
Actions #1

Updated by okurz over 7 years ago

  • Blocked by action #9674: [sles][functional][s390x] test an existing installation added
Actions #2

Updated by okurz over 7 years ago

  • Assignee deleted (mgriessmeier)
  • Priority changed from Normal to Low

#9674 is the reason. We can not easily do this right now even though it would be a nice idea. This limitation applies in general to all setups where we don't have filesystem images to store and re-execute as necessary.

Actions #3

Updated by mgriessmeier about 7 years ago

  • Status changed from New to In Progress
  • Assignee set to mgriessmeier

working on it atm

Actions #4

Updated by mgriessmeier about 7 years ago

created two jobs in SP3 testdevelopment

  • create gnome hdd of sp3
  • use created hdd to run extratests_gnome

edit: PR makes no sense
related pull request needed:
https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/2480

Actions #5

Updated by mgriessmeier about 7 years ago

  • Subject changed from Run extratest on s390x to [sles][functional][s390x] Run extratest on s390x
Actions #6

Updated by mgriessmeier about 7 years ago

  • Blocked by action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVM added
Actions #7

Updated by mgriessmeier over 6 years ago

  • Assignee deleted (mgriessmeier)

@marita - what do you think about that?
apparently this ticket haven't had that much attention so maybe not that important?
maybe we should re-think that for sle15 when we have a clearer picture of resources available?

Actions #8

Updated by okurz over 6 years ago

IMHO extra tests get more and more important because extra tests allow to scale much better, e.g. we already have split out yast2 ui tests and file system tests from there. Also the changed architecture of SLE15 will mean that we need to rely more on generated images. #17420 should be not that hard to fix as a blocking ticket first

Actions #9

Updated by okurz over 6 years ago

subticket fixed but zkvm extra tests fail in user_defined_snapshot: https://openqa.suse.de/tests/1078008# . I guess we need to fix something special about booting here but I guess https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3343 for #18016 can also help here.

Actions #10

Updated by okurz over 6 years ago

  • Assignee set to okurz

I guess I should handle this user_defined_snapshot failure. I already prepared some test branch (on lord.arch) to make the custom reboot code within that test module more generic.

Actions #11

Updated by okurz over 6 years ago

  • Status changed from In Progress to Feedback

Since I wanted to work on this issue we are blocked by a broken SLE 15 product so we have to solve that first

Actions #12

Updated by okurz over 6 years ago

  • Assignee deleted (okurz)
Actions #13

Updated by okurz over 6 years ago

  • Target version set to Milestone 12
Actions #14

Updated by okurz over 6 years ago

  • Blocks action #18936: [tools][sles][functional] Enable 3 stress acceptance on s390x added
Actions #15

Updated by okurz over 6 years ago

  • Assignee set to riafarov

to unblock #18936 as requested by cachen.

Actions #16

Updated by riafarov over 6 years ago

  • Blocks deleted (action #18936: [tools][sles][functional] Enable 3 stress acceptance on s390x)
Actions #17

Updated by riafarov over 6 years ago

  • Related to action #25638: [sles][functional][s390x] test fails in shutdown: VNC stall detected, needs to be investigated added
Actions #18

Updated by riafarov over 6 years ago

Enabling tests should be fine, whereas we experience issues with accessing SUT when booting into the image. Hence we should resolve these issues first and the enabling extra tests, which is simple.

Actions #19

Updated by riafarov over 6 years ago

Tests boot into image normally on zkvm and x-kvm. There are issues with tests though, like aplay test module is triggered, etc. Please, check the results in the test development job group.

Actions #20

Updated by riafarov over 6 years ago

Can move to functional job group once PR is merged: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3810

Be aware that due to BUG: bsc#1058071 - No VNC server available in SUT, disabling X11 tests, gnome extra tests will not execute any x11 tests.

Actions #21

Updated by riafarov over 6 years ago

  • Status changed from Feedback to Resolved

Enabled extra_tests_textmode and extra_tests_on_gnome in Functional job group. Verification run on production: https://openqa.suse.de/tests/1237262
Test will fail with same issues, as other architectures have, hence should be resolved independently.

Actions

Also available in: Atom PDF