action #78169
Updated by okurz over 3 years ago
## Observation For example https://openqa.suse.de/tests/5020506 showing "Reason: setup failure: No workers active in the cache service" with autoinst-log.txt: ``` [2020-11-18T06:40:55.0106 CET] [info] [pid:12060] +++ setup notes +++ [2020-11-18T06:40:55.0106 CET] [info] [pid:12060] Running on openqaworker9:17 (Linux 4.12.14-lp151.28.79-default #1 SMP Wed Nov 11 08:17:16 UTC 2020 (472d149) x86_64) [2020-11-18T06:40:55.0147 CET] [info] [pid:12060] +++ worker notes +++ [2020-11-18T06:40:55.0147 CET] [info] [pid:12060] End time: 2020-11-18 05:40:55 [2020-11-18T06:40:55.0147 CET] [info] [pid:12060] Result: setup failure [2020-11-18T06:40:55.0152 CET] [info] [pid:13158] Uploading autoinst-log.txt ``` and worker-log.txt: ``` [2020-11-18T06:40:55.0106 CET] [debug] [pid:12060] Preparing Mojo::IOLoop::ReadWriteProcess::Session … [2020-11-18T06:40:55.0106 CET] [debug] [pid:12060] Job settings: [2020-11-18T06:40:55.0106 CET] [debug] [pid:12060] ARCH=x86_64 BACKEND=qemu BOOT_HDD_IMAGE=1 BUILD=4.4.121-261.1.g13f6b6d BUILD_SDK=GM CACHEDIRECTORY=/var/lib/openqa/cache COLLECT_COREDUMPS=1 DESKTOP=textmode DISTRI=sle FLAVOR=Server-DVD-Incidents-Kernel-KOTD HDDSIZEGB=30 HDD_1=sle-12-SP2-x86_64-4.4.121-261.1.g13f6b6d-Server-DVD-Incidents-Kernel-KOTD@64bit-with-ltp.qcow2 ISO=SLE-12-SP2-Server-DVD-x86_64-GM-DVD1.iso JOBTOKEN=wb7clBRKZi7z18vl KOTD_REPO=http://download.suse.de/ibs/Devel:/Kernel:/SLE12-SP2-LTSS/standard/ LOG_LEVEL=debug LTP_COMMAND_EXCLUDE=_16$|^(move_pages|msg(ctl|get|rcv|snd|stress)|sem(ctl|get|op|snd)|shm(at|ctl|dt|get)|syslog|inotify07|inotify08|fanotify07) LTP_COMMAND_FILE=syscalls LTP_KNOWN_ISSUES=http://qam.suse.de/media/downloads/ltp_known_issues.json MACHINE=64bit MAX_JOB_TIME=43200 NAME=05020506-sle-12-SP2-Server-DVD-Incidents-Kernel-KOTD-x86_64-Build4.4.121-261.1.g13f6b6d-ltp_syscalls_pre12sp4@64bit NOVIDEO=1 OPENQA_HOSTNAME=openqa.suse.de OPENQA_URL=openqa.suse.de PRJDIR=/var/lib/openqa/share QA_HEAD_REPO=http://dist.suse.de/ibs/QA:/Head/SLE-12-SP2/ QEMUCPU=qemu64 QEMUCPUS=2 QEMUPORT=20172 RETRY_DELAY=5 RETRY_DELAY_IF_WEBUI_BUSY=60 SHUTDOWN_NEEDS_AUTH=1 START_AFTER_TEST=install_ltp+sle+Server-DVD-Incidents-Kernel-KOTD TEST=ltp_syscalls_pre12sp4 TEST_SUITE_NAME=ltp_syscalls_pre12sp4 UEFI_PFLASH_VARS=sle-12-SP2-x86_64-4.4.121-261.1.g13f6b6d-Server-DVD-Incidents-Kernel-KOTD@64bit-with-ltp-uefi-vars.qcow2 VERSION=12-SP2 VIRTIO_CONSOLE=1 VNC=107 WORKER_CLASS=caasp_x86_64,tap,qemu_x86_64,openqaworker9 WORKER_HOSTNAME=10.160.1.20 WORKER_ID=616 WORKER_INSTANCE=17 [2020-11-18T06:40:55.0111 CET] [error] [pid:12060] Unable to setup job 5020506: No workers active in the cache service [2020-11-18T06:40:55.0111 CET] [debug] [pid:12060] Stopping job 5020506 from openqa.suse.de: 05020506-sle-12-SP2-Server-DVD-Incidents-Kernel-KOTD-x86_64-Build4.4.121-261.1.g13f6b6d-ltp_syscalls_pre12sp4@64bit - reason: setup failure [2020-11-18T06:40:55.0112 CET] [debug] [pid:12060] REST-API call: POST http://openqa.suse.de/api/v1/jobs/5020506/status [2020-11-18T06:40:55.0152 CET] [info] [pid:13158] Uploading autoinst-log.txt [2020-11-18T06:40:55.0207 CET] [info] [pid:13158] Uploading worker-log.txt ``` ## Steps to reproduce Find jobs referencing this ticket with the help of https://raw.githubusercontent.com/os-autoinst/scripts/master/openqa-query-for-job-label , for example to look this ticket #78169 call `openqa-query-for-job-label poo#78169` ## Suggestions * Crosscheck what the osd deployment 2020-11-18 could have brought in as changes explaining the problems * Lookup in source code what this message could mean