openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842019-08-23T08:20:01ZopenSUSE Project Management Tool
Redmine openQA Infrastructure - action #55868 (Resolved): USB device is removed from gonzo.qa.suse.de.https://progress.opensuse.org/issues/558682019-08-23T08:20:01Zxlaixlai@suse.com
<p>We equipped on some servers some usb device to test virtualization pvusb feature. However today from a failure test <a href="https://openqa.suse.de/tests/3280807">https://openqa.suse.de/tests/3280807</a>, we noticed that the logitech mouse usb device on it was accidentally removed by someone and resulted in test failure.</p>
<p>SUT_IP: gonzo.qa.suse.de<br>
Missing USB device: <br>
Bus 003 Device 002: ID 046d:c001 Logitech, Inc. N48/M-BB48/M-UK96A [FirstMouse Plus]</p>
<p><a class="user active user-mention" href="https://progress.opensuse.org/users/24624">@nicksinger</a> Would you please help to find out who moved it and ask him/her to recover it? I know it is not easy since so many people have access to lab. If you can not find it, would you please help to remind people to not move our usb devices? Really appreciate if you can help paste some warning msg on these machines.</p>
<p>SUTs with usb device:<br>
21:<br>
WORKER_CLASS: virt-mm-64bit-ipmi,virt-pvusb-64bit-ipmi,64bit-ipmi<br>
IPMI_HOSTNAME: sp.kermit.qa.suse.de<br>
IPMI_PASSWORD: ADMIN<br>
IPMI_USER: ADMIN<br>
MAX_JOB_TIME: 32000<br>
SUT_IP: kermit.qa.suse.de<br>
PVUSB_DEVICE: Keyboard<br>
22: //missing now<br>
WORKER_CLASS: virt-mm-64bit-ipmi,virt-pvusb-64bit-ipmi,64bit-ipmi<br>
IPMI_HOSTNAME: sp.gonzo.qa.suse.de<br>
IPMI_PASSWORD: ADMIN<br>
IPMI_USER: ADMIN<br>
MAX_JOB_TIME: 32000<br>
SUT_IP: gonzo.qa.suse.de<br>
PVUSB_DEVICE: Logitech<br>
23:<br>
WORKER_CLASS: virt-mm-64bit-ipmi,virt-pvusb-64bit-ipmi,64bit-ipmi<br>
IPMI_HOSTNAME: sp.fozzie.qa.suse.de<br>
IPMI_PASSWORD: ADMIN<br>
IPMI_USER: ADMIN<br>
MAX_JOB_TIME: 32000<br>
SUT_IP: fozzie-1.qa.suse.de<br>
PVUSB_DEVICE: Logitech<br>
24:<br>
WORKER_CLASS: virt-mm-64bit-ipmi,virt-pvusb-64bit-ipmi,64bit-ipmi<br>
IPMI_HOSTNAME: sp.scooter.qa.suse.de<br>
IPMI_PASSWORD: ADMIN<br>
IPMI_USER: ADMIN<br>
MAX_JOB_TIME: 32000<br>
SUT_IP: scooter-1.qa.suse.de</p>
<pre><code> 16:
WORKER_CLASS: virt-pvusb-64bit-ipmi,64bit-ipmi
IPMI_HOSTNAME: 10.162.28.200
IPMI_PASSWORD: qatesting
IPMI_USER: admin
MAX_JOB_TIME: 32000
SUT_IP: 10.162.2.75
PVUSB_DEVICE: Winbond
17: # new worker quinn.qa.suse.de
WORKER_CLASS: virt-pvusb-64bit-ipmi,64bit-ipmi
IPMI_HOSTNAME: 10.162.3.87
IPMI_PASSWORD: ADMIN
IPMI_USER: ADMIN
SUT_IP: 10.162.2.87
MAX_JOB_TIME: 32000
PVUSB_DEVICE: Verbatim
</code></pre> openQA Infrastructure - action #55757 (Resolved): OSD ftp service has problem: NFS mount on qanet...https://progress.opensuse.org/issues/557572019-08-20T10:21:33Zxlaixlai@suse.com
<p>From around 4 hours ago, pxe installation on osd always fail at boot_from_pxe with error "Could not find kernel image xxx", <a href="https://openqa.suse.de/tests/3270212#step/boot_from_pxe/6" class="external">https://openqa.suse.de/tests/3270212#step/boot_from_pxe/6</a>.</p>
<p>We tested ftp service, it is not accessible for images, but http works well.</p>
<p>Please help recover. It blocks virtualization test for beta4 candidate.</p>
<a name="Log"></a>
<h1 >Log:<a href="#Log" class="wiki-anchor">¶</a></h1>
<p>FTP STATUS:<br>
'wget <a href="ftp://openqa.suse.de/assets/repo/fixed/SLE-12-SP4-Server-DVD-x86_64-GM-DVD1/boot/x86_64/loader/linux" class="external">ftp://openqa.suse.de/assets/repo/fixed/SLE-12-SP4-Server-DVD-x86_64-GM-DVD1/boot/x86_64/loader/linux</a><br>
--2019-08-20 06:15:32-- <a href="ftp://openqa.suse.de/assets/repo/fixed/SLE-12-SP4-Server-DVD-x86_64-GM-DVD1/boot/x86_64/loader/linux" class="external">ftp://openqa.suse.de/assets/repo/fixed/SLE-12-SP4-Server-DVD-x86_64-GM-DVD1/boot/x86_64/loader/linux</a><br>
=> ‘linux.1’<br>
Resolving openqa.suse.de (openqa.suse.de)... 10.160.0.207, 2620:113:80c0:8080:10:160:0:207 <br>
Connecting to openqa.suse.de (openqa.suse.de)|10.160.0.207|:21... connected. <br>
Logging in as anonymous ... Logged in!<br>
==> SYST ... done. ==> PWD ... done.<br>
==> TYPE I ... done. ==> CWD (1) /assets/repo/fixed/SLE-12-SP4-Server-DVD-x86_64-GM-DVD1/boot/x86_64/loader ...<br>
No such directory ‘assets/repo/fixed/SLE-12-SP4-Server-DVD-x86_64-GM-DVD1/boot/x86_64/loader’. <br>
'<br>
HTTP:<br>
'wget <a href="http://openqa.suse.de/assets/repo/fixed/SLE-12-SP4-Server-DVD-x86_64-GM-DVD1/boot/x86_64/loader/linux" class="external">http://openqa.suse.de/assets/repo/fixed/SLE-12-SP4-Server-DVD-x86_64-GM-DVD1/boot/x86_64/loader/linux</a><br>
--2019-08-20 06:16:35-- <a href="http://openqa.suse.de/assets/repo/fixed/SLE-12-SP4-Server-DVD-x86_64-GM-DVD1/boot/x86_64/loader/linux" class="external">http://openqa.suse.de/assets/repo/fixed/SLE-12-SP4-Server-DVD-x86_64-GM-DVD1/boot/x86_64/loader/linux</a><br>
Resolving openqa.suse.de (openqa.suse.de)... 10.160.0.207, 2620:113:80c0:8080:10:160:0:207 <br>
Connecting to openqa.suse.de (openqa.suse.de)|10.160.0.207|:80... connected. <br>
HTTP request sent, awaiting response... 200 OK<br>
Length: 6856480 (6.5M)<br>
Saving to: ‘linux.1’</p>
<p>100%[===============================================================>] 6,856,480 --.-K/s in 0.08s </p>
<p>2019-08-20 06:16:35 (80.0 MB/s) - ‘linux.1’ saved [6856480/6856480]<br>
'</p>
<p>'# curl <a href="ftp://openqa.suse.de/assets/repo/fixed/SLE-12-SP4-Server-DVD-x86_64-GM-DVD1/boot/x86_64/loader/linux" class="external">ftp://openqa.suse.de/assets/repo/fixed/SLE-12-SP4-Server-DVD-x86_64-GM-DVD1/boot/x86_64/loader/linux</a><br>
curl: (9) Server denied you to change to the given directory<br>
'</p>
openQA Infrastructure - action #54263 (Resolved): Please help to setup ipmi on openqaw5-xen.qa.su...https://progress.opensuse.org/issues/542632019-07-15T10:09:58Zxlaixlai@suse.com
<p>Hello,</p>
<p>This machine is for virtualization QA test in openqa. Please help to setup ipmi connection on it for remote control from beijing. Detailed info in <a href="https://racktables.nue.suse.com/index.php?page=object&tab=default&object_id=3468" class="external">https://racktables.nue.suse.com/index.php?page=object&tab=default&object_id=3468</a>.</p>
<p>Thank you in advance!</p>
openQA Project - action #53177 (Resolved): [openqa][worker] Can not start worker service after in...https://progress.opensuse.org/issues/531772019-06-17T09:25:40Zxlaixlai@suse.com
<p>I have a leap 42.3. On it, I install the latest openqa-* and os-autoinst. The webui can be started normally. But the workers can not be started.</p>
<a name="logs"></a>
<h3 >logs<a href="#logs" class="wiki-anchor">¶</a></h3>
<p>Worker setting:</p>
<pre><code>[global]
WORKER_HOSTNAME=10.67.18.220
[22]
WORKER_CLASS=multi-machine-job-dedicated-ipmi
BACKEND=ipmi
IPMI_HOSTNAME=10.67.135.2
IPMI_PASSWORD=susetesting
IPMI_USER=root
#WORKER_HOSTNAME=147.2.212.149
WORKER_HOSTNAME=10.67.18.220
TIMEOUT_SCALE=3
VNC_TYPING_LIMIT=10
SUT_IP=10.67.131.2
PVUSB_DEVICE=Seagate
</code></pre>
<p>Start worker failure output:</p>
<pre><code>linux-gepp:/usr/share/openqa/script # /usr/share/openqa/script/worker --instance 22
Bareword "DBD::SQLite::INSERT" not allowed while "strict subs" in use at /usr/lib/perl5/vendor_perl/5.18.2/Mojo/SQLite.pm line 93.
Compilation failed in require at /usr/share/openqa/script/../lib/OpenQA/Worker/Cache.pm line 28.
BEGIN failed--compilation aborted at /usr/share/openqa/script/../lib/OpenQA/Worker/Cache.pm line 28.
Compilation failed in require at /usr/share/openqa/script/../lib/OpenQA/Worker/Engines/isotovideo.pm line 31.
BEGIN failed--compilation aborted at /usr/share/openqa/script/../lib/OpenQA/Worker/Engines/isotovideo.pm line 31.
Compilation failed in require at /usr/share/openqa/script/../lib/OpenQA/Worker/Jobs.pm line 26.
BEGIN failed--compilation aborted at /usr/share/openqa/script/../lib/OpenQA/Worker/Jobs.pm line 26.
Compilation failed in require at /usr/share/openqa/script/../lib/OpenQA/Worker/Commands.pm line 24.
BEGIN failed--compilation aborted at /usr/share/openqa/script/../lib/OpenQA/Worker/Commands.pm line 24.
Compilation failed in require at /usr/share/openqa/script/../lib/OpenQA/Worker.pm line 31.
BEGIN failed--compilation aborted at /usr/share/openqa/script/../lib/OpenQA/Worker.pm line 31.
Compilation failed in require at /usr/share/openqa/script/worker line 106.
BEGIN failed--compilation aborted at /usr/share/openqa/script/worker line 106.
</code></pre>
<p>All installed openqa tool set:</p>
<pre><code>linux-gepp:/usr/share/openqa/script # rpm -qf /usr/share/openqa/script/../lib/OpenQA/Worker/Cache.pm
openQA-common-4.6.1560549641.c09044ae-1444.1.noarch
linux-gepp:/usr/share/openqa/script # zypper se -s openQA-common
Loading repository data...
Reading installed packages...
S | Name | Type | Version | Arch | Repository
---+---------------+---------+--------------------------------+--------+----------------
i+ | openQA-common | package | 4.6.1560549641.c09044ae-1444.1 | noarch | openqa_42.3
v | openQA-common | package | 4.4.1497257618.89b04ed8-1.1 | noarch | dependency-repo
linux-gepp:/usr/share/openqa/script # zypper ref
Repository 'dependency-repo' is up to date.
Repository 'language-perl-42.3' is up to date.
Repository 'language_perl' is up to date.
Repository 'openqa_42.3' is up to date.
Repository 'opensuse-42.3-install-repo' is up to date.
All repositories have been refreshed.
linux-gepp:/usr/share/openqa/script # rpm -qa | grep -i openqa
openQA-common-4.6.1560549641.c09044ae-1444.1.noarch
openQA-4.6.1560549641.c09044ae-1444.1.noarch
openQA-worker-4.6.1560549641.c09044ae-1444.1.noarch
openQA-client-4.6.1560549641.c09044ae-1444.1.noarch
openQA-local-db-4.6.1560549641.c09044ae-1444.1.noarch
linux-gepp:/usr/share/openqa/script # rpm -qa | grep os-autoinst
os-autoinst-4.5.1560548250.151bd110-120.1.x86_64
linux-gepp:/usr/share/openqa/script # zypper se -s os-autoinst
Loading repository data...
Reading installed packages...
S | Name | Type | Version | Arch | Repository
---+----------------------------------+------------+-------------------------------+--------+----------------
i+ | os-autoinst | package | 4.5.1560548250.151bd110-120.1 | x86_64 | openqa_42.3
v | os-autoinst | package | 4.4.1493206707.df989545-1.1 | x86_64 | dependency-repo
| os-autoinst | srcpackage | 4.5.1560548250.151bd110-120.1 | noarch | openqa_42.3
| os-autoinst-debuginfo | package | 4.5.1560548250.151bd110-120.1 | x86_64 | openqa_42.3
| os-autoinst-debugsource | package | 4.5.1560548250.151bd110-120.1 | x86_64 | openqa_42.3
| os-autoinst-distri-opensuse-deps | package | 1.1560758996.2a5be2f7b-201.1 | noarch | openqa_42.3
| os-autoinst-distri-opensuse-deps | srcpackage | 1.1560758996.2a5be2f7b-201.1 | noarch | openqa_42.3
| os-autoinst-openvswitch | package | 4.5.1560548250.151bd110-120.1 | x86_64 | openqa_42.3
| os-autoinst-openvswitch | package | 4.4.1493206707.df989545-1.1 | x86_64 | dependency-repo
| os-autoinst-test | srcpackage | 4.5.1560548250.151bd110-120.1 | noarch | openqa_42.3
</code></pre>
<p>Repo:</p>
<pre><code>linux-gepp:/usr/share/openqa/script # zypper lr -u
Repository priorities are without effect. All enabled repositories share the same priority.
# | Alias | Name | Enabled | GPG Check | Refresh | URI
---+----------------------------+-----------------------------------------+---------+-----------+---------+----------------------------------------------------------------------------------------------------------------------
1 | dependency-repo | dependency-repo | Yes | (r ) Yes | No | http://download.opensuse.org/distribution/leap/42.3/repo/oss/suse/
2 | language-perl-42.3 | language-perl-42.3 | Yes | (r ) Yes | No | https://download.opensuse.org/repositories/devel:/languages:/perl/openSUSE_Leap_42.3/
3 | language_perl | language_perl | Yes | (r ) Yes | Yes | http://download.opensuse.org/repositories/devel:/languages:/perl/openSUSE_Leap_42.3/
4 | latest-opensuse | latest-opensuse | No | ---- | ---- | https://download.opensuse.org/repositories/openSUSE:/Factory/images/repo/openSUSE-Factory-DVD-x86_64-Build0186-Media/
5 | openQA | openQA | No | ---- | ---- | http://download.opensuse.org/repositories/devel:/openQA/openSUSE_Leap_42.2
6 | openQA-perl-modules | openQA-perl-modules | No | ---- | ---- | http://download.opensuse.org/repositories/devel:/openQA:/Leap:/42.2/openSUSE_Leap_42.2
7 | openSUSE-42.2-0 | openSUSE-42.2-0 | No | ---- | ---- | http://mirror.bej.suse.com/dist/install/SLP/openSUSE-Leap-42.2-GM/x86_64/dvd1/
8 | openqa_42.3 | openqa_42.3 | Yes | (r ) Yes | No | https://download.opensuse.org/repositories/devel:/openQA/openSUSE_Leap_42.3/
9 | opensuse-42.3-install-repo | opensuse-42.3-install-repo | Yes | (r ) Yes | No | http://mirror.bej.suse.com/dist/install/SLP/openSUSE-Leap-42.3/x86_64/dvd1/
10 | repo-debug-non-oss | openSUSE-Leap-42.2-Debug-Non-Oss | No | ---- | ---- | http://download.opensuse.org/debug/distribution/leap/42.2/repo/non-oss/
11 | repo-debug-update | openSUSE-Leap-42.2-Update-Debug | No | ---- | ---- | http://download.opensuse.org/debug/update/leap/42.2/oss/
12 | repo-debug-update-non-oss | openSUSE-Leap-42.2-Update-Debug-Non-Oss | No | ---- | ---- | http://download.opensuse.org/debug/update/leap/42.2/non-oss/
13 | repo-non-oss | openSUSE-Leap-42.2-Non-Oss | No | ---- | ---- | http://download.opensuse.org/distribution/leap/42.2/repo/non-oss/
14 | repo-oss | openSUSE-Leap-42.2-Oss | No | ---- | ---- | http://download.opensuse.org/distribution/leap/42.2/repo/oss/
15 | repo-source | openSUSE-Leap-42.2-Source | No | ---- | ---- | http://download.opensuse.org/source/distribution/leap/42.2/repo/oss/
16 | repo-source-non-oss | openSUSE-Leap-42.2-Source-Non-Oss | No | ---- | ---- | http://download.opensuse.org/source/distribution/leap/42.2/repo/non-oss/
17 | repo-update | openSUSE-Leap-42.2-Update | No | ---- | ---- | http://download.opensuse.org/update/leap/42.2/oss/
18 | repo-update-non-oss | openSUSE-Leap-42.2-Update-Non-Oss | No | ---- | ---- | http://download.opensuse.org/update/leap/42.2/non-oss/
linux-gepp:/usr/share/openqa/script
</code></pre> openQA Infrastructure - action #51710 (Resolved): [openqa infra] Need 15sp1 repo under repo/fixedhttps://progress.opensuse.org/issues/517102019-05-21T03:21:09Zxlaixlai@suse.com
<p>In 12sp5 test plan, virtualization needs to cover tests on sle15sp1 host. So we need 15sp1 gmc repo under /var/lib/openqa/share/factory/repo/fixed just like other released products SLE12SP3. But I do not have permission to do so. Can anyone help to do it?</p>
<p><a class="user active user-mention" href="https://progress.opensuse.org/users/24624">@nicksinger</a>, please help to reassign if you find other more suitable one. Thanks!</p>
<p>Log:<br>
xlai@openqa:/var/lib/openqa/share/factory/repo/fixed> ln -s ../SLE-15-SP1-Installer-DVD-x86_64-Build227.1-Media1 ./SLE-15-SP1-Installer-DVD-x86_64-GM-DVD1<br>
ln: failed to create symbolic link './SLE-15-SP1-Installer-DVD-x86_64-GM-DVD1': Permission denied<br>
xlai@openqa:/var/lib/openqa/share/factory/repo/fixed> </p>
openQA Infrastructure - action #48029 (Resolved): [network failure] Can not access ipmi worker gr...https://progress.opensuse.org/issues/480292019-02-18T06:35:35Zxlaixlai@suse.com
<p>All recent triggered jobs were incomplete on this worker because not able to establish ipmitool connection. Local ping to that ip also failed.</p>
<p>Worker config:<br>
10:<br>
WORKER_CLASS: 64bit-ipmi<br>
IPMI_HOSTNAME: openqaipmi5-sp.qa.suse.de<br>
IPMI_PASSWORD: qatesting<br>
IPMI_USER: admin<br>
MAX_JOB_TIME: 32000<br>
SUT_IP: openqaipmi5.qa.suse.de</p>
<p>Ping from beijing failure:</p>
<p>linux-gepp:~ # ping openqaipmi5-sp.qa.suse.de<br>
PING openqaipmi5-sp.qa.suse.de (10.162.28.160) 56(84) bytes of data.<br>
<sup>C</sup><br>
--- openqaipmi5-sp.qa.suse.de ping statistics ---<br>
92 packets transmitted, 0 received, 100% packet loss, time 91728ms</p>
<p>linux-gepp:~ # </p>
openQA Infrastructure - action #44795 (Rejected): [tools] setup failure: Cache service not availa...https://progress.opensuse.org/issues/447952018-12-06T02:31:53Zxlaixlai@suse.com
<p>In latest build 108.1, most of virtualization jobs(several tens) fail as incomplete job with similar reason:</p>
<p>[2018-12-05T11:34:06.0806 CET] [info] +++ setup notes +++<br>
[2018-12-05T11:34:06.0806 CET] [info] start time: 2018-12-05 10:34:06<br>
[2018-12-05T11:34:06.0807 CET] [info] running on grenache-1:17 (Linux 4.4.138-94.39-default #1 SMP Mon Jun 18 13:27:26 UTC 2018 (baa07f9) ppc64le)<br>
[2018-12-05T11:34:06.0812 CET] [warn] job is missing files, releasing job<br>
[2018-12-05T11:34:06.0842 CET] [info] +++ worker notes +++<br>
[2018-12-05T11:34:06.0842 CET] [info] end time: 2018-12-05 10:34:06<br>
[2018-12-05T11:34:06.0842 CET] [info] result: setup failure: Cache service not available.<br>
[2018-12-05T11:34:06.0843 CET] [info] uploading autoinst-log.txt</p>
<p>Fail job link:<br>
<a href="https://openqa.suse.de/tests/2303781/file/autoinst-log.txt" class="external">https://openqa.suse.de/tests/2303781/file/autoinst-log.txt</a></p>
openQA Infrastructure - action #44498 (Resolved): [ipmi][grenache-1] Incomplete job due to no spa...https://progress.opensuse.org/issues/444982018-11-29T07:43:06Zxlaixlai@suse.com
<p>Key log:<br>
[2018-11-28T11:43:34.336 CET] [debug] Backend process died, backend errors are reported below in the following lines Can't write to log: No space left on device at /usr/lib/os-autoinst/bmwqemu.pm line 200.</p>
<p>XIO: fatal IO error 11 (Resource temporarily unavailable) on X server ":57369"<br>
after 15738 requests (15581 known processed) with 0 events remaining.<br>
[2018-11-28T11:43:34.660 CET] [debug] backend process exited: 200<br>
xterm: fatal IO error 11 (Resource temporarily unavailable) or KillClient on X server ":57369"<br>
[2018-11-28T11:43:34.740 CET] [debug] Driver backend collected unknown process with pid 477868 and exit status: 1<br>
[2018-11-28T11:43:34.740 CET] [debug] Driver backend collected unknown process with pid 477844 and exit status: 0<br>
[2018-11-28T11:43:34.740 CET] [debug] sysread failed: <br>
[2018-11-28T11:43:34.746 CET] [debug] Driver backend collected unknown process with pid 477870 and exit status: 84<br>
[2018-11-28T11:43:34.746 CET] [debug] Driver backend collected unknown process with pid 477880 and exit status: 0<br>
[2018-11-28T11:43:34.751 CET] [debug] commands process exited: 0<br>
[2018-11-28T11:43:37.0493 CET] [info] +++ worker notes +++<br>
[2018-11-28T11:43:37.0494 CET] [info] end time: 2018-11-28 10:43:37<br>
[2018-11-28T11:43:37.0495 CET] [info] result: died<br>
[2018-11-28T11:43:37.0496 CET] [info] uploading video.ogv<br>
[2018-11-28T11:43:37.0583 CET] [info] uploading vars.json<br>
[2018-11-28T11:43:37.0612 CET] [info] uploading serial0.txt</p>
<p>Failure job:<br>
grenache-1:16<br>
<a href="https://openqa.suse.de/tests/2285123/file/autoinst-log.txt" class="external">https://openqa.suse.de/tests/2285123/file/autoinst-log.txt</a></p>
<p>grenache-1:10<br>
<a href="https://openqa.suse.de/tests/2285129" class="external">https://openqa.suse.de/tests/2285129</a></p>
<p>grenache-1:17<br>
<a href="https://openqa.suse.de/tests/2285036/file/autoinst-log.txt" class="external">https://openqa.suse.de/tests/2285036/file/autoinst-log.txt</a></p>
openQA Infrastructure - action #44351 (Resolved): [ipmi] Workers/jobs stuck https://progress.opensuse.org/issues/443512018-11-26T10:20:30Zxlaixlai@suse.com
<p>Currently at least 4 ipmi workers (openqaworker2:23/24/25/26) are stuck. They can not finish jobs or take new jobs for over a day and some even several days.</p>
<p>Despite the misleading message from the developer mode, this issue has nothing to do with the developer mode. (The misleading message is also already fixed on latest master.)</p>
<p>This issue is likely tied to the latest refactoring of the worker cache. At least the <code>autoinst-log.txt</code> leads to that conclusion:</p>
<pre><code>tail -f /var/lib/openqa/pool/26/autoinst-log.txt
[2018-11-26T11:07:10.0806 CET] [info] +++ setup notes +++
[2018-11-26T11:07:10.0806 CET] [info] start time: 2018-11-26 10:07:10
[2018-11-26T11:07:10.0806 CET] [info] running on openqaworker2:26 (Linux 4.7.5-2.g02c4d35-default #1 SMP PREEMPT Mon Sep 26 08:11:45 UTC 2016 (02c4d35) x86_64)
[2018-11-26T11:07:10.0829 CET] [debug] Downloading SLE-15-SP1-Installer-DVD-x86_64-Build100.4-Media1.iso - request sent to Cache Service.
</code></pre>
<p>Since spvm jobs on grenache show the same symptom, this is likely also not ipmi-specific.</p>
<p>Job links: <a href="https://openqa.suse.de/tests/2272494" class="external">https://openqa.suse.de/tests/2272494</a> (openqaworker2), <a href="https://openqa.suse.de/tests/2278365" class="external">https://openqa.suse.de/tests/2278365</a> (grenache-1)</p>
openQA Infrastructure - action #44228 (Resolved): Need to deploy SLE12SP4 GM x86_64 repo to http:...https://progress.opensuse.org/issues/442282018-11-22T08:17:03Zxlaixlai@suse.com
<p>In SLE15SP1 test plan, virtualization will cover tests on sle12sp4 GM host. So like before, can anyone help to make it under <a href="http://openqa.suse.de/assets/repo/fixed/" class="external">http://openqa.suse.de/assets/repo/fixed/</a>, like other sle12sp3 or sle15 GM setup?</p>
openQA Infrastructure - action #43874 (Resolved): HDD in kermit.qa.suse.de has problems in combin...https://progress.opensuse.org/issues/438742018-11-16T08:12:55Zxlaixlai@suse.com
<p>OpenQA worker openqaworker2:23 relevant SUT, configuration:<br>
"IPMI_HOSTNAME" : "sp.kermit.qa.suse.de",<br>
"IPMI_PASSWORD" : "ADMIN",<br>
"IPMI_USER" : "ADMIN",</p>
<p>mkfs and fdisk operations on this disk fails (on sle12sp3 /15sp1 system), showing error of writing superblocks.</p>
<p>Please help to fix it.</p>
openQA Infrastructure - action #40544 (Resolved): [OpenQA][IPMI backend] IPMI worker can not surv...https://progress.opensuse.org/issues/405442018-09-04T07:29:51Zxlaixlai@suse.com
<p>We have two dell machines, vh003.qa2.suse.asia and vh004.qa2.suse.asia. When they are binded with ipmi worker, the jobs on those two machines can not survive reboot. For example, after host installation when it boots to the new os, the sol console can only get black screen, not reactive at all. So does any other simple reboot.</p>
<p>After debugging by john and jerry, it is found that the reset_console operation leads to this failure because the existing sol console connection is not properly cleaned up and result in failure in the new sol console setup.</p>
<p>John and jerry also have their 2 proposals as solutions which are open for discussions. I will let them describe in more details in later comments.</p>
openQA Project - action #39974 (Rejected): [openqa][PARALLEL_WITH] Child job failure makes parent...https://progress.opensuse.org/issues/399742018-08-20T06:32:20Zxlaixlai@suse.com
<p>I have two jobs with relationship of PARALLEL_WITH, when the child job finished as failed, parent job got TERM soon, and not finished the other codes left, which makes it impossible to upload failure logs on parent job.</p>
<p>Relationship of the two jobs: PARALLEL_WITH</p>
<p>Key code on parent job:<br>
mutex_create('DST_READY_TO_START'); // after this , child starts core test code<br>
wait_for_children;<br>
#upload logs<br>
script_run("xl dmesg > /tmp/xl-dmesg.log"); // got TERM from os-autoinst log, not finished following<br>
my $logs = "/var/log/libvirt /var/log/messages /var/log/xen /var/lib/xen/dump /tmp/xl-dmesg.log";<br>
&virt_autotest_base::upload_virt_logs($logs, "guest-migration-dst-logs");</p>
<p>Key log:<br>
CHILD JOB: <a href="http://10.67.18.220/tests/259">http://10.67.18.220/tests/259</a>, normally failed<br>
PARENT: <a href="http://10.67.18.220/tests/258/file/autoinst-log.txt">http://10.67.18.220/tests/258/file/autoinst-log.txt</a><br>
PARENT KEY LOG:<br>
[2018-08-17T18:40:18.0074 CST] [debug] Waiting for 1 jobs to finish<br>
[2018-08-17T18:40:19.0096 CST] [debug] Waiting for 1 jobs to finish<br>
[2018-08-17T18:40:20.0121 CST] [debug] Waiting for 0 jobs to finish<br>
[2018-08-17T18:40:20.0121 CST] [debug] /var/lib/openqa/share/tests/sle-12-SP4/tests/virt_autotest/guest_migration_dst.pm:49 called testapi::script_run<br>
[2018-08-17T18:40:20.0121 CST] [debug] <<< testapi::script_run(cmd='xl dmesg > /tmp/xl-dmesg.log', wait=undef)<br>
[2018-08-17T18:40:20.0121 CST] [debug] /var/lib/openqa/share/tests/sle-12-SP4/tests/virt_autotest/guest_migration_dst.pm:49 called testapi::script_run<br>
[2018-08-17T18:40:20.0122 CST] [debug] <<< testapi::type_string(string='xl dmesg > /tmp/xl-dmesg.log', max_interval=250, wait_screen_changes=0, wait_still_screen=0)<br>
BYTES {"json_cmd_token":"kCadcRoy","type_string":{"max_interval":250,"text":"xl dmesg > /tmp/xl-dmesg.log","json_cmd_token":"EGgaJsza"}}<br>
[2018-08-17T18:40:20.0615 CST] [debug] backend got TERM<br>
XIO: fatal IO error 11 (Resource temporarily unavailable) on X server ":39339"<br>
after 2679 requests (2522 known processed) with 0 events remaining.<br>
[2018-08-17T18:40:20.0617 CST] [info] Collected unknown process with pid 17212 and exit status: 1<br>
[2018-08-17T18:40:20.0617 CST] [debug] autotest received signal TERM, saving results of current test before exiting<br>
[2018-08-17T18:40:20.0618 CST] [debug] signalhandler got TERM - loop 1<br>
[2018-08-17T18:40:20.0618 CST] [debug] awaiting death of commands process<br>
XIO: fatal IO error 11 (Resource temporarily unavailable) on X server ":60734"<br>
after 2729 requests (2729 known processed) with 0 events remaining.<br>
[2018-08-17T18:40:20.0624 CST] [debug] tests died<br>
[2018-08-17T18:40:20.0624 CST] [info] Collected unknown process with pid 17309 and exit status: 1<br>
[2018-08-17T18:40:20.0625 CST] [info] Collected unknown process with pid 17311 and exit status: 15<br>
[2018-08-17T18:40:20.0625 CST] [info] Collected unknown process with pid 17313 and exit status: 0<br>
[2018-08-17T18:40:20.0625 CST] [info] Collected unknown process with pid 17314 and exit status: 255<br>
[2018-08-17T18:40:20.0626 CST] [debug] signalhandler got TERM - loop 0<br>
[2018-08-17T18:40:20.0626 CST] [debug] killing backend process 16929<br>
[2018-08-17T18:40:20.0626 CST] [info] Collected unknown process with pid 17214 and exit status: 15<br>
[2018-08-17T18:40:20.0627 CST] [info] Collected unknown process with pid 17216 and exit status: 0<br>
[2018-08-17T18:40:20.0970 CST] [info] Collected unknown process with pid 16930 and exit status: 0<br>
[2018-08-17T18:40:20.0970 CST] [info] Collected unknown process with pid 16963 and exit status: 0<br>
[2018-08-17T18:40:20.0970 CST] [info] Collected unknown process with pid 17076 and exit status: 0<br>
[2018-08-17T18:40:20.0971 CST] [info] Collected unknown process with pid 17204 and exit status: 0<br>
[2018-08-17T18:40:20.0971 CST] [info] Collected unknown process with pid 17301 and exit status: 0<br>
[2018-08-17T18:40:20.0972 CST] [info] Collected unknown process with pid 20001 and exit status: 0<br>
[2018-08-17T18:40:20.0975 CST] [debug] done with backend process<br>
[2018-08-17T18:40:20.0982 CST] [info] Isotovideo exit status: 1<br>
[2018-08-17T18:40:20.0983 CST] [info] +++ worker notes +++<br>
[2018-08-17T18:40:20.0983 CST] [info] end time: 2018-08-17 10:40:20<br>
[2018-08-17T18:40:20.0983 CST] [info] result: cancel</p>
openQA Project - action #16602 (Resolved): Comment with unicode characters do not work because of...https://progress.opensuse.org/issues/166022017-02-09T02:24:15Zxlaixlai@suse.com
<a name="observation"></a>
<h2 >observation<a href="#observation" class="wiki-anchor">¶</a></h2>
<p>An error message is reported when I updated result for a build on virtualization group on openqa.suse.de</p>
<p>What was typed on comment:</p>
<pre><code>**Date:** <2017-02-09>
**Build:** 0234
**Arch:** x86_64
**Status: <font color="red">Red</font>
**New Product bugs:**
* No
**Requirement:**
* one more ipmi machine: poo#15376
**Existing Product bugs:**
* sles12sp3 pv guest installation: bsc#1012005
* pvusb bug on sles12sp3 xen: bsc#1023948
**Existing openqa issues:**
* guest migration job fail/multi-machine: poo#15376
* ipmi ikvm unstable: poo#14338
* ipmi serial console unstable: poo#13914
* ipmi keyboard simulator unstable: poo#12982 poo#16088
</code></pre>
<a name="steps-to-reproduce"></a>
<h2 >steps to reproduce<a href="#steps-to-reproduce" class="wiki-anchor">¶</a></h2>
<ul>
<li>on an openQA instance with enabled rabbitmq plugin</li>
<li>type character '/' in any comment</li>
<li>observe reported error</li>
</ul>
<a name="problem"></a>
<h2 >problem<a href="#problem" class="wiki-anchor">¶</a></h2>
<p>H1. Mojo::RabbitMQ::Client does not handle unicode input correctly<br>
<a href="https://github.com/inway/mojo-rabbitmq-client/commit/c043447d4fa53a1456515c4def1c4d1367cd87b0#commitcomment-20829251" class="external">https://github.com/inway/mojo-rabbitmq-client/commit/c043447d4fa53a1456515c4def1c4d1367cd87b0#commitcomment-20829251</a><br>
H2. <code>lib/OpenQA/WebAPI/Plugin/AMQP.pm</code> does not forward unicode correctly to Mojo::RabbitMQ::Client</p>
<a name="workaround"></a>
<h2 >workaround<a href="#workaround" class="wiki-anchor">¶</a></h2>
<p>only type ascii within comments.</p>
openQA Infrastructure - action #16088 (Rejected): [ipmi] Do not respond to send_key.https://progress.opensuse.org/issues/160882017-01-19T06:02:20Zxlaixlai@suse.com
<p>In job <a href="https://openqa.suse.de/tests/716647#step/reboot_and_wait_up_normal2/3" class="external">https://openqa.suse.de/tests/716647#step/reboot_and_wait_up_normal2/3</a>, we use send_key_until_needle_match api to select xen grub menuentry, however after catching a not matching screen, and a send_key is sent, screen does not change.</p>