Project

General

Profile

Actions

action #34402

closed

[functional][u][s390x][medium] Revisit extra_tests_on_gnome@s390x (was: Do no run extra_tests_on_gnome on s390x)

Added by michalnowak about 6 years ago. Updated over 5 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Bugs in existing tests
Target version:
SUSE QA - Milestone 20
Start date:
2018-04-06
Due date:
2018-11-20
% Done:

0%

Estimated time:
Difficulty:

Description

Motivation

On s390x the extra_tests_on_gnome test suite is actually "textmode test suite" because DESKTOP is set to textmode.

main_common.pm:

    if (any_desktop_is_applicable()) {
        load_extra_tests_desktop;
    }
    else {
        load_extra_tests_textmode;
    }

I guess that the test suite should not be run as it's the same as extra_tests_in_textmode which is being scheduled in SLE:Functional.

Unless s390x can boot to some desktop :).

Acceptance criteria

  • AC1: extra_tests_on_gnome is only scheduled when it actually executes test modules within the gnome session as on the other architectures
  • AC2: extra_tests_on_gnome are still scheduled on SLE12 at least (because that worked in before)

Related issues 3 (0 open3 closed)

Related to openQA Tests - action #37820: [functional][sle][u][hard][ipmi][sporadic] test fails in first_boot - Lost connection to SUT on SLE12-SP4Resolvedzluo2018-06-262018-07-17

Actions
Related to openQA Tests - action #43658: [sle][functional][u][s390x] re-enable extra_tests_on_gnome@s390x (or: Get vnc session working for SLE15SP1)Resolvedzluo2018-11-12

Actions
Blocked by openQA Tests - action #36268: [sle][functional][u][hard][s390x] test fails in consoletest_finish - screen does not show desktop sessionResolvedoorlov2018-05-162018-09-11

Actions
Actions #1

Updated by okurz about 6 years ago

  • Subject changed from [functional][s390x] Do no run extra_tests_on_gnome on s390x to [functional][u][s390x] Do no run extra_tests_on_gnome on s390x
  • Target version set to Milestone 16

Yeah, that changed behaviour of vnc server started in installed system or not still bites us. But we are progressing with vnc@ipmi and bugs are still open so maybe we have a chance it will work

Actions #2

Updated by okurz almost 6 years ago

  • Due date set to 2018-07-03
  • Target version changed from Milestone 16 to Milestone 17
Actions #3

Updated by okurz almost 6 years ago

  • Subject changed from [functional][u][s390x] Do no run extra_tests_on_gnome on s390x to [functional][u][s390x] Revisit extra_tests_on_gnome@s390x (was: Do no run extra_tests_on_gnome on s390x)
  • Description updated (diff)
  • Status changed from New to Workable

We should revisit the current situation during this sprint and see what we can do to make it more clear what the scenarios should test. Also recheck SLE12SP4 please where we should have gnome available.

Actions #4

Updated by okurz almost 6 years ago

  • Target version changed from Milestone 17 to Milestone 17
Actions #5

Updated by riafarov almost 6 years ago

  • Subject changed from [functional][u][s390x] Revisit extra_tests_on_gnome@s390x (was: Do no run extra_tests_on_gnome on s390x) to [functional][u][s390x][medium] Revisit extra_tests_on_gnome@s390x (was: Do no run extra_tests_on_gnome on s390x)

We don't run gnome tests on SLE15 due to known issue, but should work for SLE 12. If tests do not work, create tickets to fix them.

Actions #6

Updated by mgriessmeier almost 6 years ago

  • Due date changed from 2018-07-03 to 2018-07-17

doable in next sprint I guess, even if there is hackweek

Actions #7

Updated by okurz almost 6 years ago

  • Related to action #37820: [functional][sle][u][hard][ipmi][sporadic] test fails in first_boot - Lost connection to SUT on SLE12-SP4 added
Actions #8

Updated by okurz almost 6 years ago

  • Description updated (diff)
  • Due date changed from 2018-07-17 to 2018-08-14
  • Target version changed from Milestone 17 to Milestone 18

riafarov wrote:

We don't run gnome tests on SLE15 due to known issue, but should work for SLE 12. If tests do not work, create tickets to fix them.

Your comment does not seem relate to the ticket description at all. This ticket is about the existing scenarios mentioning "gnome" but the tests on s390x actually do not do anything with gnome. That is at least very confusing.

I think we should work on #37820 first to make sure that IPMI on x86_64 works again reaching the desktop as worked still for SLE12SP3 and then we can revisit this. Could also be the other way around.

Anyone from u-team wants to pick up to track based on progress in #37820?

Actions #9

Updated by okurz almost 6 years ago

  • Blocked by action #36268: [sle][functional][u][hard][s390x] test fails in consoletest_finish - screen does not show desktop session added
Actions #10

Updated by okurz almost 6 years ago

  • Due date changed from 2018-08-14 to 2018-11-20
  • Target version changed from Milestone 18 to Milestone 20

due to blocker

Actions #11

Updated by zluo over 5 years ago

  • Assignee set to zluo

take over

Actions #12

Updated by zluo over 5 years ago

  • Status changed from Workable to In Progress
Actions #13

Updated by zluo over 5 years ago

https://openqa.suse.de/tests/2242997 shows green status, no issues on s390_kvm.

Actions #14

Updated by zluo over 5 years ago

https://openqa.suse.de/tests/2242989 shows also successful test run for s390_zkvm as well.

Actions #15

Updated by zluo over 5 years ago

  • Status changed from In Progress to Resolved

I think since we don't have issues on s390 at moment and issues which blocked this have been resolved, we can set it as resolved.
extra_tests_on_gnome is not enabled for s390 and ppc64le on osd.

Actions #16

Updated by okurz over 5 years ago

  • Status changed from Resolved to Workable

you seem to have missed the ACs. Also the jobs you referenced are not the extra_tests scenario

Actions #17

Updated by mgriessmeier over 5 years ago

So, this ticket is about to have extra_tests_on_gnome on s390x only running for 12-SP* because only there we actually have a gnome session
for SLE15* we don't have it.

What really confuses me right now, I cannot find any extra_test_on_gnome which was running for 12-SP* ever (maybe got deleted meanwhile)
On the other hand, it is scheduled for SLE-15 - so IMO, this should be vice versa - please correct me if I'm wrong here

So steps to do would be:

  • remove schedule for SLE15*
  • enable schedule for SLE12*
Actions #18

Updated by zluo over 5 years ago

  • Status changed from Workable to In Progress

trying enable extra_tests_on_gnome at first with https://openqa.suse.de/tests/2248802
in job group Development SLES 12 SP4

Actions #19

Updated by okurz over 5 years ago

mgriessmeier wrote:

So, this ticket is about to have extra_tests_on_gnome on s390x only running for 12-SP* because only there we actually have a gnome session
for SLE15* we don't have it.

What really confuses me right now, I cannot find any extra_test_on_gnome which was running for 12-SP* ever (maybe got deleted meanwhile)
On the other hand, it is scheduled for SLE-15 - so IMO, this should be vice versa - please correct me if I'm wrong here

That's part of the problem: https://openqa.suse.de/tests/2228784 shows an execution of it, it's actually like the "textmode" scenario because of the DESKTOP variable. The solution is not necessarily to remove the scenario but make sure we have the proper textmode scenario as well as gnome and do whatever we can do to have it working.

Actions #20

Updated by zluo over 5 years ago

https://openqa.suse.de/tests/2248802 shows tests with gnome on s390.

Actions #21

Updated by zluo over 5 years ago

https://openqa.suse.de/tests/2254167 shows gnome tests running on s390.

We need to remove extra_tests_on_gnome form s390 for now since we have issue with vnc connection issue on osd. This should be a follow-up ticket. I will create this later.

Actions #22

Updated by zluo over 5 years ago

  • Related to action #43658: [sle][functional][u][s390x] re-enable extra_tests_on_gnome@s390x (or: Get vnc session working for SLE15SP1) added
Actions #23

Updated by zluo over 5 years ago

  • Status changed from In Progress to Resolved

https://openqa.suse.de/admin/job_templates/110 extra_tests_on_gnome on s390x for sles 15 got removed for now.

Actions

Also available in: Atom PDF