Project

General

Profile

Actions

action #81685

closed

[s390x] test fails in installation_overview

Added by skriesch almost 4 years ago. Updated almost 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Bugs in existing tests
Target version:
-
Start date:
2020-12-31
Due date:
% Done:

100%

Estimated time:
Difficulty:

Description

Observation

openQA test in scenario opensuse-Tumbleweed-DVD-s390x-textmode-server@s390x-zVM-vswitch-l2 fails in
installation_overview

As mentioned in https://bugzilla.opensuse.org/show_bug.cgi?id=1178595#c9, this behavior in openQA is a test bug:

`TW is behaving as described by Stefan when selecting server role.

I suppose that desktop roles should be hidden/disabled for openSUSE on s390x.

Then, if SSH installation was done -> multi-user.target
and if VNC installation was done -> graphical.target

So, until new feedback, I consider TW behavior as expected and test should be fixed. So, test bug. I will wait a bit for feedback on the SLE bug.`

Test suite description

The base test suite is used for job templates defined in YAML documents. It has no settings of its own.

Reproducible

Fails since (at least) Build 20201110

Expected result

installation_overview should not show any failed tests because of graphical.target.
@Sergio Did you receive the required information?

Further details

Always latest result in this scenario: latest

Actions #1

Updated by SLindoMansilla over 3 years ago

  • Assignee changed from SLindoMansilla to binary_sequence
Actions #2

Updated by skriesch over 3 years ago

Did you receive feedback because of the SLE bug and the reason that the test is failing (now in Leap)?

Actions #3

Updated by okurz over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/1684566

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed
Actions #4

Updated by okurz over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/1693671

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed
Actions #5

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/1715763

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed
Actions #6

Updated by okurz over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/1737114

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed
Actions #7

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/1757541

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed
Actions #8

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/1757541

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed
Actions #9

Updated by okurz over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/1757541

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions #10

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/1757541

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions #11

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/1757541

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions #12

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/1757541

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions #13

Updated by AdaLovelace about 3 years ago

@binary_sequence: I know that you do not work for SUSE any more. This test bug exists continuously in our Leap release.
Can you give me some hints, how I can receive more SUSE internal information, what is going wrong here? Then I can fix it for my own.

Actions #14

Updated by binary_sequence about 3 years ago

Hi Sarah,

On Tumbleweed x86_64

An installation selecting a desktop on system role, should set systemd graphical.target.
https://openqa.opensuse.org/tests/2059915#step/installation_overview/4
An installation selecting a headless system role, should set systemd multi-user.target.
https://openqa.opensuse.org/tests/2059514#step/installation_overview/4

On Tumbleweed s390x, it is tricky

An installation selecting a headless system role, should set systemd multi-user.target
Remote SSH installation: https://openqa.opensuse.org/tests/2054786#step/installation_overview/5

But when installing via VNC
https://openqa.opensuse.org/tests/2054785#step/bootloader_s390/27
Even if a headless system role is selected, the default systemd target is graphical.target.
That is because it is expected that the user will also access the installed system via VNC, so VNC server needs to be started on system boot. In (open)SUSE, VNC server is started on boot by graphical target.
So, on s390x the graphical.target doesn't start Xserver or Wayland, it just starts VNC server.

The check of systemd target is skipped for tumbleweed
https://openqa.opensuse.org/tests/2054785#step/installation_overview/3
Because check just relied on DESKTOP setting to decide if target should be multi-user or graphical.
In that test, DESKTOP=textmode, so the check will expect multi-user.target, but installation is done via remote VNC, so graphical.target is actually set.
The check is skipped with setting BSC1167736=yes.

On Leap s390x

The installation is remove VNC
https://openqa.opensuse.org/tests/2054206#step/bootloader_s390/27
So, the systemd target is graphical.target as expected
https://openqa.opensuse.org/tests/2054206#step/installation_overview/5
But, the check is not taking this special case into account.

A quick 'fix'

for Leap would be to also add the setting BSC1167736=yes so the check is skipped.

To not interfere with other arquitectures, it should be put on the job group template for test suite textmode-server
https://openqa.opensuse.org/admin/job_templates/50

Similar to how it was done for the job group template for Tumbleweed (search textmode-server)
https://openqa.opensuse.org/admin/job_templates/34

A proper solution

would be to update the check to also take into account a remote VNC installtion on s390x and don't skip the check.

Since github is malfunctioning, I cannot show you the part where it is done. But, at least I could get:

I am still interested in openSUSE and s390x. So, do not hesitate to ask if you need my help.

Have fun!

Actions #15

Updated by binary_sequence about 3 years ago

Oh, the openQA modules links don't link to github anymore so: https://openqa.opensuse.org/tests/2054206/modules/installation_overview/steps/1/src

sub check_default_target {
     # Check the systemd target where scenario make it possible
     return if (is_microos || is_sle_micro || is_upgrade || is_hyperv ||
         get_var('REMOTE_CONTROLLER') || (get_var('BACKEND', '') =~ /spvm|pvm_hmc|ipmi/));
     # exclude non-desktop environment and scenarios with edition of package selection (bsc#1167736)
     return if (!get_var('DESKTOP') || get_var('PATTERNS'));
     return if (get_var 'BSC1167736');

     # Set expectations
     my $expected_target = check_var('DESKTOP', 'textmode') ? "multi-user" : "graphical";

     select_console 'install-shell';

     my $target_search = 'default target has been set';
     # default.target is not yet linked, so we parse logs and assert expectations
     if (my $log_line = script_output("grep '$target_search' /var/log/YaST2/y2log | tail -1",
             proceed_on_failure => 1)) {
         $log_line =~ /$target_search: (?<current_target>.*)/;
         assert_equals($expected_target, $+{current_target}, "Mismatch in default.target");
     }

     select_console 'installation';
 }
  • The check is skipped with: return if (get_var 'BSC1167736');
  • The check is: my $expected_target = check_var('DESKTOP', 'textmode') ? "multi-user" : "graphical";
Actions #16

Updated by openqa_review almost 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/2064455

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #17

Updated by openqa_review almost 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/2105660

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #18

Updated by openqa_review almost 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: textmode-server
https://openqa.opensuse.org/tests/2128930

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #19

Updated by AdaLovelace almost 3 years ago

I have added "BSC1167736: yes" to the Leap project config now. That did not help in the Leap config.
I have removed the line with the bug reference number, that it won't be skipped any more and expanded the expectations with a star as a regex:
my $expected_target = check_var('DESKTOP', 'textmode*') ? "multi-user" : "graphical";

Pull Request: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/14081

Actions #20

Updated by AdaLovelace almost 3 years ago

  • % Done changed from 0 to 90

These test configuration settings are succeeding in the test run:
https://openqa.opensuse.org/tests/2150725

:)

Actions #21

Updated by AdaLovelace almost 3 years ago

  • Status changed from New to Resolved
  • Assignee changed from binary_sequence to AdaLovelace
  • % Done changed from 90 to 100

It is fixed now.

Actions

Also available in: Atom PDF