Project

General

Profile

Actions

action #60566

closed

[qac][vnc][vmware|hyperv][sporadic] test fails in procps - review parsing

Added by mloviska over 5 years ago. Updated 5 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Target version:
-
Start date:
2019-12-03
Due date:
% Done:

0%

Estimated time:

Description

Observation

Again we seems to have an isolated problem with console/procps.pm on VMWare only.

validate_script_output("w",
         qr/\d+:\d+:\d+\sup\s+(\d+|:)+(\s\w+|),\s+\d\s\w+,\s+load average:.*USER\s+TTY\s+FROM\s+LOGIN@\s+IDLE\s+JCPU\s+PCPU\s+WHAT.*\w+/s);

https://openqa.suse.de/tests/5991033#step/procps/21

Actions #1

Updated by mloviska about 5 years ago

  • Status changed from New to In Progress
  • Assignee set to mloviska
Actions #2

Updated by mloviska about 5 years ago

[2020-01-24T12:01:28.382 CET] [debug] <<< testapi::wait_serial(no_regex=0, timeout=30, quiet=undef, record_output=1, expect_not_found=0, buffer_size=undef, regexp="SCRIPT_FINISHEDYkfXz-\\d+-")
YkfXz

procs -----------memory---------- ---swap-- -----io---- -system-- ------cpu-----

 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st

 2  0      0 1005340   2400 226076    0    0   207   192    4  325  4  3 93  0  0

SCRIPT_FINISHEDYkfXz-0-

Does not seems like an test issue, rather than HyperV serial console add extra newlines

Actions #3

Updated by mloviska about 5 years ago

I have copied the above to a file and run hexdump on it.

➜  _tests git:(hyperv_gpg_procps) ✗ cat test_file    
procs -----------memory---------- ---swap-- -----io---- -system-- ------cpu-----

 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st

 2  0      0 1005340   2400 226076    0    0   207   192    4  325  4  3 93  0  0
➜  hexdump -c test_file 
0000000   p   r   o   c   s       -   -   -   -   -   -   -   -   -   -
0000010   -   m   e   m   o   r   y   -   -   -   -   -   -   -   -   -
0000020   -       -   -   -   s   w   a   p   -   -       -   -   -   -
0000030   -   i   o   -   -   -   -       -   s   y   s   t   e   m   -
0000040   -       -   -   -   -   -   -   c   p   u   -   -   -   -   -
0000050  \n  \n       r           b               s   w   p   d        
0000060       f   r   e   e               b   u   f   f           c   a
0000070   c   h   e               s   i               s   o            
0000080       b   i                   b   o               i   n        
0000090       c   s       u   s       s   y       i   d       w   a    
00000a0   s   t  \n  \n       2           0                           0
00000b0       1   0   0   5   3   4   0               2   4   0   0    
00000c0   2   2   6   0   7   6                   0                   0
00000d0               2   0   7               1   9   2                
00000e0   4           3   2   5           4           3       9   3    
00000f0       0           0  \n  \n                                    
00000f7
Actions #5

Updated by mloviska about 5 years ago

  • Status changed from Feedback to Resolved
Actions #6

Updated by jlausuch about 4 years ago

  • Project changed from openQA Tests (public) to 208
  • Category deleted (Bugs in existing tests)
Actions #7

Updated by mloviska almost 4 years ago

  • Subject changed from [sle][jeos] test fails in procps - review parsing to [qac][jeos][vmware] test fails in procps - review parsing
  • Description updated (diff)
  • Status changed from Resolved to Workable
Actions #8

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest@svirt-vmware65
https://openqa.suse.de/tests/5991033

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions #9

Updated by jlausuch over 3 years ago

  • Tags set to bug
Actions #10

Updated by jlausuch over 3 years ago

  • Status changed from Workable to New

Let's wait for 15-SP4 to see how it behaves, but it might be a good idea to remove that test from VMWare as we did for Hyper-V.

Actions #11

Updated by jlausuch over 3 years ago

  • Assignee deleted (mloviska)
Actions #12

Updated by mloviska over 3 years ago

  • Status changed from New to Workable

jlausuch wrote:

Let's wait for 15-SP4 to see how it behaves, but it might be a good idea to remove that test from VMWare as we did for Hyper-V.

vmware failure, both hyperv jobs (gren{1,2}) seem fine.

Actions #13

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest@svirt-vmware65
https://openqa.suse.de/tests/6599438

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions #14

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest@svirt-vmware65
https://openqa.suse.de/tests/6951102

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed
Actions #15

Updated by openqa_review over 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest@svirt-vmware65
https://openqa.suse.de/tests/7240861

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234
Actions #16

Updated by mloviska over 3 years ago

The script output's temp bash script is missing w command. Basically it is empty for some reason compared to successful run.

Seemingly this part of the code is to be blamed https://github.com/os-autoinst/os-autoinst/blob/master/distribution.pm#L296.

    elsif ($args{type_command}) {
        my $cat = "cat - > $script_path;\n";
        testapi::type_string($cat);
        testapi::type_string($script . "\n");
        testapi::send_key('ctrl-d');
    }

testapi::type_string($script . "\n"); is only testapi::type_string("w\n"); and openQA for some reason show typing issues.

Actions #17

Updated by mloviska over 3 years ago

As Fabian has noticed:

That appears like the file ended up with w\r as content.
The \r moves the cursor back to the start of the line, and the w is then overwritten by the prompt -> ( thus the file is seemingly empty when cating it )

The problem is isolated to svirt especially to vmware and hyperv workers.

Stressing the same test object does not reveal any issue on xen nor qemu

Dumping VNC related code has not showed anything as well

+++ b/consoles/vnc_base.pm
@@ -128,7 +128,12 @@ sub type_string {
             "\b" => 'backspace',
             "\e" => 'esc'
         };
+        print "VNC_BASE ... got before charmap: " . Dumper($letter);
+        print "VNC_BASE ... ASCII num value: " . ord($letter) . "\n";
         $letter = $charmap->{$letter} || $letter;
+        use Data::Dumper;
+        print "VNC_BASE ... got: " . Dumper($letter);
+        print "VNC_BASE ... ASCII num value: " . ord($letter) . "\n";
         # 25% is spent hitting the key, 25% releasing it, 50% searching the next key
         $self->{vnc}->map_and_send_key($letter, undef, $seconds_per_keypress * 0.25);
         $self->{backend}->run_capture_loop($seconds_per_keypress * 0.5);
VNC_BASE ... got: 'ret'
VNC_BASE ... ASCII num value: 114

--- a/consoles/VNC.pm
+++ b/consoles/VNC.pm
@@ -727,12 +727,16 @@ sub map_and_send_key {
     my @events;

     for my $key (split('-', $keys)) {
+        use Data::Dumper;
+        print "map_and_send_key ... " . Dumper($key);
         if (defined($self->keymap->{$key})) {
             if (ref($self->keymap->{$key}) eq 'ARRAY') {
                 push(@events, @{$self->keymap->{$key}});
+                print "map_and_send_key events as array ... " . Dumper(@{$self->keymap->{$key}});
             }
             else {
                 push(@events, $self->keymap->{$key});
+                print "map_and_send_key events ... " . Dumper($self->keymap->{$key});
             }
             next;
         }

map_and_send_key  ... 'ret'
map_and_send_key events ... 65293
Actions #18

Updated by mloviska over 3 years ago

  • Subject changed from [qac][jeos][vmware] test fails in procps - review parsing to [qac][vnc][vmware|hyperv][sporadic] test fails in procps - review parsing
Actions #19

Updated by mloviska over 3 years ago

  • Status changed from Workable to In Progress
  • Assignee set to cfconrad
Actions #21

Updated by cfconrad over 3 years ago

Still fighting to get the PR approved!

Actions #22

Updated by jlausuch over 3 years ago

cfconrad wrote:

Still fighting to get the PR approved!

I see some comments in the PR to be addressed.

Actions #23

Updated by cfconrad over 3 years ago

on it this week!!

Actions #24

Updated by cfconrad over 3 years ago

Still fighting with getting this PR into os-autoinst... it's always hard to solve something with a sleep :(

Actions #25

Updated by cfconrad over 3 years ago

https://github.com/os-autoinst/os-autoinst/pull/1809 :party: was just merged... clothing this ticket

Actions #26

Updated by cfconrad over 3 years ago

  • Status changed from In Progress to Resolved
Actions #27

Updated by ph03nix 5 months ago

  • Tags changed from bug to MinimalVM
Actions #28

Updated by ph03nix 5 months ago

  • Project changed from 208 to Containers and images
Actions

Also available in: Atom PDF