Project

General

Profile

action #78169

Updated by okurz over 1 year ago

## Observation

For example https://openqa.suse.de/tests/5020506 showing
"Reason: setup failure: No workers active in the cache service"

with autoinst-log.txt:

```
[2020-11-18T06:40:55.0106 CET] [info] [pid:12060] +++ setup notes +++
[2020-11-18T06:40:55.0106 CET] [info] [pid:12060] Running on openqaworker9:17 (Linux 4.12.14-lp151.28.79-default #1 SMP Wed Nov 11 08:17:16 UTC 2020 (472d149) x86_64)
[2020-11-18T06:40:55.0147 CET] [info] [pid:12060] +++ worker notes +++
[2020-11-18T06:40:55.0147 CET] [info] [pid:12060] End time: 2020-11-18 05:40:55
[2020-11-18T06:40:55.0147 CET] [info] [pid:12060] Result: setup failure
[2020-11-18T06:40:55.0152 CET] [info] [pid:13158] Uploading autoinst-log.txt
```

and worker-log.txt:

```
[2020-11-18T06:40:55.0106 CET] [debug] [pid:12060] Preparing Mojo::IOLoop::ReadWriteProcess::Session
[2020-11-18T06:40:55.0106 CET] [debug] [pid:12060] Job settings:
[2020-11-18T06:40:55.0106 CET] [debug] [pid:12060]
ARCH=x86_64
BACKEND=qemu
BOOT_HDD_IMAGE=1
BUILD=4.4.121-261.1.g13f6b6d
BUILD_SDK=GM
CACHEDIRECTORY=/var/lib/openqa/cache
COLLECT_COREDUMPS=1
DESKTOP=textmode
DISTRI=sle
FLAVOR=Server-DVD-Incidents-Kernel-KOTD
HDDSIZEGB=30
HDD_1=sle-12-SP2-x86_64-4.4.121-261.1.g13f6b6d-Server-DVD-Incidents-Kernel-KOTD@64bit-with-ltp.qcow2
ISO=SLE-12-SP2-Server-DVD-x86_64-GM-DVD1.iso
JOBTOKEN=wb7clBRKZi7z18vl
KOTD_REPO=http://download.suse.de/ibs/Devel:/Kernel:/SLE12-SP2-LTSS/standard/
LOG_LEVEL=debug
LTP_COMMAND_EXCLUDE=_16$|^(move_pages|msg(ctl|get|rcv|snd|stress)|sem(ctl|get|op|snd)|shm(at|ctl|dt|get)|syslog|inotify07|inotify08|fanotify07)
LTP_COMMAND_FILE=syscalls
LTP_KNOWN_ISSUES=http://qam.suse.de/media/downloads/ltp_known_issues.json
MACHINE=64bit
MAX_JOB_TIME=43200
NAME=05020506-sle-12-SP2-Server-DVD-Incidents-Kernel-KOTD-x86_64-Build4.4.121-261.1.g13f6b6d-ltp_syscalls_pre12sp4@64bit
NOVIDEO=1
OPENQA_HOSTNAME=openqa.suse.de
OPENQA_URL=openqa.suse.de
PRJDIR=/var/lib/openqa/share
QA_HEAD_REPO=http://dist.suse.de/ibs/QA:/Head/SLE-12-SP2/
QEMUCPU=qemu64
QEMUCPUS=2
QEMUPORT=20172
RETRY_DELAY=5
RETRY_DELAY_IF_WEBUI_BUSY=60
SHUTDOWN_NEEDS_AUTH=1
START_AFTER_TEST=install_ltp+sle+Server-DVD-Incidents-Kernel-KOTD
TEST=ltp_syscalls_pre12sp4
TEST_SUITE_NAME=ltp_syscalls_pre12sp4
UEFI_PFLASH_VARS=sle-12-SP2-x86_64-4.4.121-261.1.g13f6b6d-Server-DVD-Incidents-Kernel-KOTD@64bit-with-ltp-uefi-vars.qcow2
VERSION=12-SP2
VIRTIO_CONSOLE=1
VNC=107
WORKER_CLASS=caasp_x86_64,tap,qemu_x86_64,openqaworker9
WORKER_HOSTNAME=10.160.1.20
WORKER_ID=616
WORKER_INSTANCE=17
[2020-11-18T06:40:55.0111 CET] [error] [pid:12060] Unable to setup job 5020506: No workers active in the cache service
[2020-11-18T06:40:55.0111 CET] [debug] [pid:12060] Stopping job 5020506 from openqa.suse.de: 05020506-sle-12-SP2-Server-DVD-Incidents-Kernel-KOTD-x86_64-Build4.4.121-261.1.g13f6b6d-ltp_syscalls_pre12sp4@64bit - reason: setup failure
[2020-11-18T06:40:55.0112 CET] [debug] [pid:12060] REST-API call: POST http://openqa.suse.de/api/v1/jobs/5020506/status
[2020-11-18T06:40:55.0152 CET] [info] [pid:13158] Uploading autoinst-log.txt
[2020-11-18T06:40:55.0207 CET] [info] [pid:13158] Uploading worker-log.txt
```

## Steps to reproduce

Find jobs referencing this ticket with the help of
https://raw.githubusercontent.com/os-autoinst/scripts/master/openqa-query-for-job-label ,
for example to look this ticket #78169 call `openqa-query-for-job-label poo#78169`

##
Suggestions

* Crosscheck what the osd deployment 2020-11-18 could have brought in as changes explaining the problems
* Lookup in source code what this message could mean

Back