action #155179
closedcoordination #155182: [epic] Participate in alpha-testing of new version of velociraptor-client
Participate in alpha-testing of new version of velociraptor-client
0%
Description
Motivation¶
rsimai approached me asking if LSG QE can participate in alpha-testing a new version of velociraptor client. Given that we have the deployment maintained in salt this should be low effort for us. So we would change the repo that we install within our OSD infrastructure, let it be deployed and if there are any problems, e.g. observed from our monitoring, then we will report them.
Rollback steps¶
- DONE
ssh grenache-1.oqa.prg2.suse.org 'systemctl unmask --now openqa-worker-auto-restart@7'
- DONE
ssh openqaworker-arm-1.qe.nue2.suse.org 'sudo userdel --remove sensor-test'
Updated by okurz 11 months ago
- Related to action #130648: Upgrade all other LSG QE salt controlled machines to openSUSE Leap 15.5 added
Updated by okurz 11 months ago
- Status changed from Feedback to Blocked
- Target version changed from Tools - Next to Ready
There was some movement and I was looking into which package versions are installed on our systems. I realized that we have one system still on Leap 15.4, osiris, upgrading now. Done. Inconsistencies come from #130648 when I removed the security:sensor repo to not be added anymore on more recent Leap 15.5 but we still kept the repo for newer versions.
Blocking on https://suse.slack.com/archives/C02NJAA1PEC/p1709382114636189?thread_ts=1709283079.201359&cid=C02NJAA1PEC
I realized that https://build.opensuse.org/project/repository_state/security:sensor/15.5 has only x86_64 enabled. Assuming that you would like us to test packages from that project can those architectures be enabled?
Updated by okurz 11 months ago
- Status changed from Blocked to In Progress
https://download.opensuse.org/repositories/security:/sensor/15.5/ now has all four main architectures enabled but seemingly no s390x builds. Anyway, will enable that for testing now.
Updated by okurz 11 months ago
https://gitlab.suse.de/openqa/salt-pillars-openqa/-/merge_requests/736 to use the new test server directly.
https://gitlab.suse.de/openqa/salt-states-openqa/-/merge_requests/1120 to use the new package version.
Full system access blocked on https://sd.suse.com/servicedesk/customer/portal/1/SD-149901 but we can try with the machines that can already access.
Merged both MRs, monitoring.
Updated by livdywan 11 months ago
Full system access blocked on https://sd.suse.com/servicedesk/customer/portal/1/SD-149901 but we can try with the machines that can already access.
Please remember to share the ticket with OSD Admins.
Updated by okurz 11 months ago ยท Edited
- Due date set to 2024-03-20
- Status changed from In Progress to Feedback
Follow-up MRs merged because I messed up.
sudo salt \* cmd.run 'zypper -n in --allow-vendor-change velociraptor-client'
to force the update. All hosts within the LSG QE salt managed infrastructure except s390x and openqa-piworker now run velociraptor-client-0.7.0.4.git47.0f8a4de1-lp155.38.1
including the updated config pointing to https://10.156.231.185:8000/. I will monitor if there is any considerable performance impact on our infrastructure.
Updated by okurz 11 months ago
- Due date deleted (
2024-03-20)
Evaluating our monitoring data from https://monitor.qa.suse.de/ on a sample size of 10 machines I could not find any significant impact on performance. So until further notice I would continue to run the development version on our hosts.
Updated by okurz 11 months ago
- Description updated (diff)
I was asked by email if we can help to test on ppc64le. For this I did ssh grenache-1.oqa.prg2.suse.org 'systemctl mask --now openqa-worker-auto-restart@7'
which is for grenache-8 and on grenache (novalink) did pvmctl lpar power-on -i name=grenache-8
I answered Marcela Maslanova by email and stated that they can use grenache-8 for days/weeks and should let us know if we can return the machine back to the openQA testing pool. Added according rollback step.
Updated by okurz 11 months ago
- Description updated (diff)
As requested by email I now did
sudo salt -C 'G@osarch:s390x' cmd.run 'zypper ar -f -p 85 https://download.opensuse.org/repositories/security:/sensor/SLE_15_SP5/security:sensor.repo && zypper -n in velociraptor-client-0.7.0.4.git47.0f8a4de1-150500.38.2.s390x'
as https://download.opensuse.org/repositories/security:/sensor/15.5/ does not supply s390x although it would be preferred to use that repo instead and stay consistent.
The output in the system journal was a very verbose log dump ending with
Mar 26 21:36:08 s390zl12 velociraptor-client[83250]: libbpf: prog 'trace_vfs_ioctl': failed to load: -22
Mar 26 21:36:08 s390zl12 velociraptor-client[83250]: libbpf: failed to load object 'chattrsnoop
Complete journal of the old and new version:
http://w3.nue.suse.com/~okurz/velociraptor-client-log-s390zl12-2024-03-26T21:38:18+01:00.log
sent by email
Updated by okurz 10 months ago
- Copied to action #159060: Rollback/switch to officially installed velociraptor-client repo and server size:S added