Project

General

Profile

Actions

action #63853

closed

[tools] broken /etc/sysconfig/network/ifcfg-br1

Added by dzedro about 4 years ago. Updated about 4 years ago.

Status:
Resolved
Priority:
Low
Assignee:
Category:
Infrastructure
Target version:
-
Start date:
2020-02-26
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

openQA test in scenario sle-15-SP1-Server-DVD-Updates-x86_64-qam_wicked_advanced_ref@64bit fails in
before_test

Test suite description

I fixed openqaworker7, the thing is that it's not first time I had to fix /etc/sysconfig/network/ifcfg-br1
with less tap devices (OVS_BRIDGE_PORT_DEVICE) defined than default
I don't think that somebody changed it intentionally, so question is how did it happen ?

openqaworker7:~ # ps aux|grep 'script/worker'|sort -k14
root     10978  0.0  0.0   7432   940 pts/0    S+   02:36   0:00 grep --color=auto script/worker
_openqa+  2685  0.1  0.1 367584 290516 ?       Ss   Feb25   1:20 /usr/bin/perl /usr/share/openqa/script/worker --instance 1
_openqa+  2618  0.1  0.1 438096 360824 ?       Ss   Feb25   1:33 /usr/bin/perl /usr/share/openqa/script/worker --instance 10
_openqa+ 10743  1.7  0.1 438096 355896 ?       S    02:35   0:00 /usr/bin/perl /usr/share/openqa/script/worker --instance 10
_openqa+  2803  0.1  0.1 437160 359636 ?       Ss   Feb25   1:30 /usr/bin/perl /usr/share/openqa/script/worker --instance 11
_openqa+  2575  0.1  0.1 350580 272724 ?       Ss   Feb25   1:24 /usr/bin/perl /usr/share/openqa/script/worker --instance 12
_openqa+  2715  0.1  0.1 374076 295288 ?       Ss   Feb25   1:16 /usr/bin/perl /usr/share/openqa/script/worker --instance 13
_openqa+  2881  0.0  0.0 283828 206080 ?       Ss   Feb25   0:57 /usr/bin/perl /usr/share/openqa/script/worker --instance 14
_openqa+  2596  0.1  0.1 379412 302764 ?       Ss   Feb25   1:21 /usr/bin/perl /usr/share/openqa/script/worker --instance 15
_openqa+ 10975  6.6  0.1 379412 297652 ?       S    02:36   0:00 /usr/bin/perl /usr/share/openqa/script/worker --instance 15
_openqa+  2896  0.1  0.1 433612 357056 ?       Ss   Feb25   1:18 /usr/bin/perl /usr/share/openqa/script/worker --instance 16
_openqa+  2668  0.1  0.2 719260 641760 ?       Ss   Feb25   2:11 /usr/bin/perl /usr/share/openqa/script/worker --instance 17
_openqa+  2654  0.0  0.0 281684 204220 ?       Ss   Feb25   0:59 /usr/bin/perl /usr/share/openqa/script/worker --instance 18
_openqa+  2752  0.1  0.1 420904 344356 ?       Ss   Feb25   1:24 /usr/bin/perl /usr/share/openqa/script/worker --instance 19
_openqa+  4686  5.0  0.1 422652 341640 ?       R    02:23   0:39 /usr/bin/perl /usr/share/openqa/script/worker --instance 19
_openqa+  2843  0.1  0.0 314876 237220 ?       Ss   Feb25   1:32 /usr/bin/perl /usr/share/openqa/script/worker --instance 2
_openqa+  2822  0.1  0.1 361568 283616 ?       Ss   Feb25   1:24 /usr/bin/perl /usr/share/openqa/script/worker --instance 20
_openqa+  2700  0.1  0.0 335336 257848 ?       Ss   Feb25   1:17 /usr/bin/perl /usr/share/openqa/script/worker --instance 3
_openqa+  2731  0.2  0.3 1012536 935108 ?      Ss   Feb25   2:32 /usr/bin/perl /usr/share/openqa/script/worker --instance 4
_openqa+  2637  0.1  0.1 406248 329272 ?       Ss   Feb25   1:13 /usr/bin/perl /usr/share/openqa/script/worker --instance 5
_openqa+ 10747  1.7  0.1 406248 324376 ?       S    02:35   0:00 /usr/bin/perl /usr/share/openqa/script/worker --instance 5
_openqa+  2556  0.0  0.0 242432 165292 ?       Ss   Feb25   0:53 /usr/bin/perl /usr/share/openqa/script/worker --instance 6
_openqa+  2863  0.1  0.1 348188 271252 ?       Ss   Feb25   1:07 /usr/bin/perl /usr/share/openqa/script/worker --instance 7
_openqa+ 10926  2.7  0.1 348188 266284 ?       S    02:36   0:00 /usr/bin/perl /usr/share/openqa/script/worker --instance 7
_openqa+  2767  0.1  0.1 349836 273284 ?       Ss   Feb25   1:19 /usr/bin/perl /usr/share/openqa/script/worker --instance 8
_openqa+  9821  1.5  0.1 349836 268444 ?       S    02:34   0:01 /usr/bin/perl /usr/share/openqa/script/worker --instance 8
_openqa+  2782  0.1  0.0 260460 183656 ?       Ss   Feb25   1:12 /usr/bin/perl /usr/share/openqa/script/worker --instance 9
openqaworker7:~ #

https://openqa.suse.de/tests/3923836/file/autoinst-log.txt

[2020-02-26T02:36:28.129 CET] [debug] Failed to run dbus command 'unset_vlan' with arguments 'tap17 7' : 'tap17' is not connected to bridge 'br1'
[2020-02-26T02:36:28.139 CET] [debug] Failed to run dbus command 'unset_vlan' with arguments 'tap81 7' : 'tap81' is not connected to bridge 'br1'

openqaworker7:~ # cat /etc/sysconfig/network/ifcfg-br1
BOOTPROTO='static'
IPADDR='10.0.2.2/15'
STARTMODE='auto'
OVS_BRIDGE='yes'
OVS_BRIDGE_PORT_DEVICE_0='tap0'
OVS_BRIDGE_PORT_DEVICE_64='tap64'
OVS_BRIDGE_PORT_DEVICE_128='tap128'
OVS_BRIDGE_PORT_DEVICE_1='tap1'
OVS_BRIDGE_PORT_DEVICE_65='tap65'
OVS_BRIDGE_PORT_DEVICE_129='tap129'
OVS_BRIDGE_PORT_DEVICE_2='tap2'
OVS_BRIDGE_PORT_DEVICE_66='tap66'
OVS_BRIDGE_PORT_DEVICE_130='tap130'
OVS_BRIDGE_PORT_DEVICE_3='tap3'
OVS_BRIDGE_PORT_DEVICE_67='tap67'
OVS_BRIDGE_PORT_DEVICE_131='tap131'
OVS_BRIDGE_PORT_DEVICE_4='tap4'
OVS_BRIDGE_PORT_DEVICE_68='tap68'
OVS_BRIDGE_PORT_DEVICE_132='tap132'
OVS_BRIDGE_PORT_DEVICE_5='tap5'
OVS_BRIDGE_PORT_DEVICE_69='tap69'
OVS_BRIDGE_PORT_DEVICE_133='tap133'
OVS_BRIDGE_PORT_DEVICE_6='tap6'
OVS_BRIDGE_PORT_DEVICE_70='tap70'
OVS_BRIDGE_PORT_DEVICE_134='tap134'
OVS_BRIDGE_PORT_DEVICE_7='tap7'
OVS_BRIDGE_PORT_DEVICE_71='tap71'
OVS_BRIDGE_PORT_DEVICE_135='tap135'
OVS_BRIDGE_PORT_DEVICE_8='tap8'
OVS_BRIDGE_PORT_DEVICE_72='tap72'
OVS_BRIDGE_PORT_DEVICE_136='tap136'
OVS_BRIDGE_PORT_DEVICE_9='tap9'
OVS_BRIDGE_PORT_DEVICE_73='tap73'
OVS_BRIDGE_PORT_DEVICE_137='tap137'
PRE_UP_SCRIPT="wicked:gre_tunnel_preup.sh"

openqaworker7:~ # ovs-ofctl show br1
OFPT_FEATURES_REPLY (xid=0x2): dpid:0000baf98cde6e43
n_tables:254, n_buffers:0
capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
actions: output enqueue set_vlan_vid set_vlan_pcp strip_vlan mod_dl_src mod_dl_dst mod_nw_src mod_nw_dst mod_nw_tos mod_tp_src mod_tp_dst
 1(gre1): addr:16:73:42:32:c6:2d
     config:     0
     state:      STP_FORWARD
     speed: 0 Mbps now, 0 Mbps max
 2(gre2): addr:36:33:81:28:86:1c
     config:     0
     state:      STP_FORWARD
     speed: 0 Mbps now, 0 Mbps max
 3(gre3): addr:32:61:fa:75:1e:c6
     config:     0
     state:      STP_BLOCK
     speed: 0 Mbps now, 0 Mbps max
 4(gre4): addr:16:8b:1e:c7:4b:25
     config:     0
     state:      STP_FORWARD
     speed: 0 Mbps now, 0 Mbps max
 5(gre5): addr:e6:9d:46:a2:18:a6
     config:     0
     state:      STP_BLOCK
     speed: 0 Mbps now, 0 Mbps max
 6(gre6): addr:76:e1:e4:1b:b1:70
     config:     0
     state:      STP_FORWARD
     speed: 0 Mbps now, 0 Mbps max
 7(gre7): addr:26:47:35:2d:4c:3c
     config:     0
     state:      STP_FORWARD
     speed: 0 Mbps now, 0 Mbps max
 8(gre8): addr:3a:e3:97:6c:02:83
     config:     0
     state:      STP_BLOCK
     speed: 0 Mbps now, 0 Mbps max
 9(gre9): addr:62:b2:24:f9:16:7f
     config:     0
     state:      STP_BLOCK
     speed: 0 Mbps now, 0 Mbps max
 10(gre10): addr:7a:86:8d:7e:58:ea
     config:     0
     state:      STP_FORWARD
     speed: 0 Mbps now, 0 Mbps max
 11(gre11): addr:c2:48:06:09:0e:11
     config:     0
     state:      STP_BLOCK
     speed: 0 Mbps now, 0 Mbps max
 12(tap0): addr:f2:02:1e:ec:2e:46
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 13(tap1): addr:a6:db:bb:f6:3c:c1
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 14(tap128): addr:4a:b7:e6:93:53:0c
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 15(tap129): addr:2e:4f:fb:97:e2:cd
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 16(tap130): addr:92:27:36:bb:dd:f2
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 17(tap131): addr:d2:b3:4f:03:85:f9
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 18(tap132): addr:9a:f2:06:72:3c:fb
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 19(tap133): addr:26:d3:35:63:45:2e
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 20(tap134): addr:c6:11:93:de:ac:07
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 21(tap135): addr:ba:8c:b2:35:d6:47
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 22(tap136): addr:2a:87:c4:f1:1d:5a
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 23(tap137): addr:62:d6:c6:0c:5f:f9
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 24(tap2): addr:4e:52:09:f5:1b:4b
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 25(tap3): addr:b6:83:e7:51:6f:ec
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 26(tap4): addr:f2:cf:c3:b0:a8:e3
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 27(tap5): addr:76:81:39:c6:53:73
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 28(tap6): addr:c6:29:eb:59:be:c6
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 29(tap64): addr:4a:19:3a:eb:1b:44
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 30(tap65): addr:b2:a0:a7:a4:32:86
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 31(tap66): addr:6e:44:37:bf:13:0b
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 32(tap67): addr:26:f6:1c:ff:f2:d9
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 33(tap68): addr:0a:83:78:77:22:2f
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 34(tap69): addr:e2:a9:81:77:c7:25
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 35(tap7): addr:92:26:c6:ba:2f:1f
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 36(tap70): addr:8a:ed:17:61:f7:7a
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 37(tap71): addr:9e:a5:88:eb:fc:6b
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 38(tap72): addr:26:1a:a5:f5:f3:c0
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 39(tap73): addr:12:8a:76:e1:ee:4c
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 40(tap8): addr:72:e5:e1:d0:cc:6b
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 41(tap9): addr:fe:bf:22:e7:8c:a9
     config:     0
     state:      LINK_DOWN
     current:    10MB-FD COPPER
     speed: 10 Mbps now, 0 Mbps max
 LOCAL(br1): addr:ba:f9:8c:de:6e:43
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0
openqaworker7:~ #

Reproducible

Fails since (at least) Build 20200225-2 (current job)

Expected result

Last good: 20200225-1 (or more recent)

Further details

Always latest result in this scenario: latest


Related issues 3 (2 open1 closed)

Related to openQA Infrastructure - action #60962: Enable multi-machine capability for all configured workersNew2019-12-12

Actions
Related to openQA Project - action #64129: Set `$0` for upload process to something more explicit (was: Duplicate worker instances competing)New2020-03-03

Actions
Copied to openQA Infrastructure - action #63874: ensure openqa worker instances are disabled and stopped when "numofworkers" is reduced in salt pillars, e.g. causing non-obvious multi-machine failuresResolvedmkittler2020-02-26

Actions
Actions

Also available in: Atom PDF