action #120276
closed
- Priority changed from Normal to High
- Target version set to Ready
For the user acceptance test we stated that we need jsonrpc. We should clarify if that still works, if it can be enabled or if we need to change to REST.
And I think we need to talk about maintainership of the openqa_service VM, e.g. updates, upgrades, backup, config management, monitoring, etc.
- Copied to action #120279: Proper maintainership for openqa_service VM size:M added
- Subject changed from Prepare openqa_bugfetcher for upcoming bugzilla update to Prepare openqa_bugfetcher for upcoming bugzilla update size:M
- Description updated (diff)
- Status changed from New to Feedback
- Assignee set to dheidler
Setting to Feedback with @dheidler as the assignee since a question was already posted on the email from Jan
Thanks for creating this ticket and making sure that openqa_bugfetcher still works.
I asked Johannes van Wijk in #proj-it-bugzilla-improvement if JSON-RPC will work.
My guess is that not, because the reason for deprecation is authentication. "In the staging version there was still the option to use the XML-RPC 'api', because the IDP was still not implemented, but with the implementation of the IDP solution, we came unfortunately to the conclusion that we will the option to use the XML-RPC. , because the authentication method is no longer supported / depreciated as of version 5.0.4"
Will confirm as soon as I have the reply.
The JSON-RPC API will receive no further updates and will be removed. This means migration to REST API is inevitable.
jstehlik wrote:
The JSON-RPC API will receive no further updates and will be removed. This means migration to REST API is inevitable.
@jstehlik regarding the new bugzilla version. In #113255 we clearly stated that we need the JSON-RPC interface. According to what Dominik Heidler told me know that is planned to be removed which is a major issue. Can you confirm that our bugzilla test cases have been conducted?
- Parent task set to #120522
okurz wrote:
@jstehlik regarding the new bugzilla version. In #113255 we clearly stated that we need the JSON-RPC interface. According to what Dominik Heidler told me know that is planned to be removed which is a major issue. Can you confirm that our bugzilla test cases have been conducted?
Will be handled in #120522
REST API docs can be found here: https://bugzilla.readthedocs.io/en/5.0.4/api/
But it seems that the REST API is not yet available, so we need to wait for the update and will have a broken tool for a few days until it is modified to use the new API.
Unless there is already a new (test?) bugzilla instance that we can use to develop against.
- Status changed from Feedback to In Progress
I hope we clarified it now sufficiently in #proj-it-bugzilla-improvement . Sorry if I created a unnecessary sense of urgency. The JSON RPC shall work after upgrade, but its version 1.1 will be deprecated in future. Thus JSON RPC 1.0 is recommended by Bugzilla team and at some point we will have to move to REST API. Ivan Lausuch is currently working on a python library for integration with Bugzilla and Progress. I hope it could be helpful also in the future for bugfetcher.
- Due date set to 2022-11-30
Setting due date based on mean cycle time of SUSE QE Tools
- Subject changed from Prepare openqa_bugfetcher for upcoming bugzilla update size:M to Prepare openqa_bugfetcher for upcoming bugzilla update
I realized that we "estimated" this but do not even have ACs
@dheidler your PR in general looks ok but as we clarified we will still have JSONRPC for the foreseeable future so I suggest to only check the current implementation with changed authentication approach against the next instance, not change to REST.
- Status changed from In Progress to Feedback
The PR is already done - and the rest API is easy to use.
So I see no reason to build up technical debt by sticking with the deprecated API.
Waiting for new bugzilla to deploy to merge this PR after testing.
- Related to action #120525: Ensure our usual bugzilla integrated tooling works with the upgraded test instance size:M added
- Due date deleted (
2022-11-30)
- Status changed from Feedback to Blocked
As discussed in weekly estimation we should do #120525 first
- Priority changed from High to Normal
Just to clarify. This is effectively blocking on #120525#note-28 because the staging instance still isn't reliable. We did look into the new API again but it was raising more questions. Until this is sorted out there's unfortunately not much we can do from our side.
- Assignee changed from dheidler to livdywan
I'm grabbing the ticket alongside #120525 since Dominik isn't currently on the Tools team.
@cdywan Thank you Cris for taking the ownership. Oliver informed me, that the staging is currently reachable and XML-RPC has been confirmed to be usable. Do I understand correctly that we are now prepared for Bugzilla go live (possibly on short notice)? Switching to REST API is recommended and my hope is, this could be done together with recent work on metrics project and at least some effort on Bugzilla REST API studying can be shared, but this will happen later this year after go live.
jstehlik wrote:
@cdywan Thank you Cris for taking the ownership. Oliver informed me, that the staging is currently reachable and XML-RPC has been confirmed to be usable. Do I understand correctly that we are now prepared for Bugzilla go live (possibly on short notice)?
Yes, that is the case.
And even if the xml-rpc interface would not be supported anymore, we can simply merge the pr and use the bugzilla rest interface instead.
Which I would recommend anyway as it brings some advantages.
- Status changed from Blocked to New
- Assignee deleted (
livdywan)
#120525 done, bugzilla upgraded, unblocked
- Description updated (diff)
- Assignee set to dheidler
- Target version deleted (
Ready)
- Status changed from New to Resolved
yes it does work.
on openqa-service.qe.suse.de there are two cron jobs for o3 and for osd:
*/10 * * * * root (date;fetch_openqa_bugs) > /tmp/fetch_openqa_bugs_osd.log
1 */10 * * * root (date;fetch_openqa_bugs /etc/openqa/bugfetcher_o3.conf) > /tmp/fetch_openqa_bugs_o3.log
These calls can be tried manually as well.
As of now I was the only one getting emails when these cron jobs would fail.
But now I updated the aliasses so that error emails will reach the osd-admins list.
For access to the machine, please open a PR against https://gitlab.suse.de/OPS-Service/salt/-/blob/production/pillar/id/openqa-service_qe_suse_de.sls and ping me to give my thumbs ob.
- Related to action #132668: [alert] Cron job from openqa-service failed: fetch_openqa_bugs size:M added
Also available in: Atom
PDF