action #135407
Updated by livdywan 8 months ago
## Motivation Consolidate This poo contains all steps we took to mitigate #135122 https://progress.opensuse.org/issues/135122 and how to revert it. it 1) stopped workers: used: `sudo salt 'worker3[1,2,3,4,5,6]*' cmd.run 'sudo systemctl disable --now telegraf $(systemctl list-units | grep openqa-worker-auto-restart | cut -d "." -f 1 | xargs)'\ xargs)' && for i in {1..6}; do sudo salt-key -y -d "worker3$i*"; done` revert: `for i in {1..6}; do sudo salt-key -y -a "worker3$i*";done && sudo salt 'worker3[1,2,3,4,5,6]*' state.apply` 2) Lowered amount workers used: https://gitlab.suse.de/openqa/salt-pillars-openqa/-/merge_requests/606 revert: revert mentioned MR in GitLab ## Acceptance criteria * **AC1:** Ensure step #1 has been reverted * **AC2**: DONE Ensure step #2 has been reverted ## Suggestions - Maybe don't bring them all back at once (and be prepared to remove them again in case of new performance issues) - In case of new performance issues make sure to strace the openqa-scheduler and openqa-websockets processes