action #155179
closed
coordination #155182: [epic] Participate in alpha-testing of new version of velociraptor-client
Participate in alpha-testing of new version of velociraptor-client
Added by okurz about 1 year ago.
Updated 10 months ago.
Description
Motivation¶
rsimai approached me asking if LSG QE can participate in alpha-testing a new version of velociraptor client. Given that we have the deployment maintained in salt this should be low effort for us. So we would change the repo that we install within our OSD infrastructure, let it be deployed and if there are any problems, e.g. observed from our monitoring, then we will report them.
Rollback steps¶
- DONE
ssh grenache-1.oqa.prg2.suse.org 'systemctl unmask --now openqa-worker-auto-restart@7'
- DONE
ssh openqaworker-arm-1.qe.nue2.suse.org 'sudo userdel --remove sensor-test'
- Parent task set to #155182
- Status changed from New to Feedback
- Priority changed from Normal to Low
For now I will just need to wait until rsimai comes back to us with more specific information.
- Related to action #130648: Upgrade all other LSG QE salt controlled machines to openSUSE Leap 15.5 added
- Status changed from Feedback to Blocked
- Target version changed from Tools - Next to Ready
- Status changed from Blocked to In Progress
- Due date set to 2024-03-20
- Status changed from In Progress to Feedback
Follow-up MRs merged because I messed up.
sudo salt \* cmd.run 'zypper -n in --allow-vendor-change velociraptor-client'
to force the update. All hosts within the LSG QE salt managed infrastructure except s390x and openqa-piworker now run velociraptor-client-0.7.0.4.git47.0f8a4de1-lp155.38.1
including the updated config pointing to https://10.156.231.185:8000/. I will monitor if there is any considerable performance impact on our infrastructure.
- Target version changed from Ready to Tools - Next
- Due date deleted (
2024-03-20)
Evaluating our monitoring data from https://monitor.qa.suse.de/ on a sample size of 10 machines I could not find any significant impact on performance. So until further notice I would continue to run the development version on our hosts.
- Description updated (diff)
I was asked by email if we can help to test on ppc64le. For this I did ssh grenache-1.oqa.prg2.suse.org 'systemctl mask --now openqa-worker-auto-restart@7'
which is for grenache-8 and on grenache (novalink) did pvmctl lpar power-on -i name=grenache-8
I answered Marcela Maslanova by email and stated that they can use grenache-8 for days/weeks and should let us know if we can return the machine back to the openQA testing pool. Added according rollback step.
- Description updated (diff)
As requested by email I now did
sudo salt -C 'G@osarch:s390x' cmd.run 'zypper ar -f -p 85 https://download.opensuse.org/repositories/security:/sensor/SLE_15_SP5/security:sensor.repo && zypper -n in velociraptor-client-0.7.0.4.git47.0f8a4de1-150500.38.2.s390x'
as https://download.opensuse.org/repositories/security:/sensor/15.5/ does not supply s390x although it would be preferred to use that repo instead and stay consistent.
The output in the system journal was a very verbose log dump ending with
Mar 26 21:36:08 s390zl12 velociraptor-client[83250]: libbpf: prog 'trace_vfs_ioctl': failed to load: -22
Mar 26 21:36:08 s390zl12 velociraptor-client[83250]: libbpf: failed to load object 'chattrsnoop
Complete journal of the old and new version:
http://w3.nue.suse.com/~okurz/velociraptor-client-log-s390zl12-2024-03-26T21:38:18+01:00.log
sent by email
- Description updated (diff)
I was asked about ARM testing ressources as well. For this I created an account "sensor-test" on openqaworker-arm-1 and I will add SSH keys when I get them for access.
openqaworker-arm-1 is not needed (anymore) by the security sensor development team.
- Description updated (diff)
- Description updated (diff)
- Status changed from Feedback to Resolved
- Target version changed from Tools - Next to Ready
rollback task done, checked successful start of openQA jobs on the formerly disabled grenache openQA worker instance, task resolved.
- Copied to action #159060: Rollback/switch to officially installed velociraptor-client repo and server size:S added
Also available in: Atom
PDF