Project

General

Profile

Actions
Copy link

action #121699

closed

bot-ng - approve incidents pipeline fails with 401 unauthorized on GitLab size:S

Added by livdywan over 1 year ago. Updated over 1 year ago.

Status:
Resolved
Priority:
High
Assignee:
okurz
Target version:
openQA Project - Ready
Start date:
2021-09-02
Due date:
% Done:

0%

Estimated time:

Description

Motivation

The the following recent failures:

Excerpt from the last failure:

2022-12-08 09:08:15 INFO     Job 1963521 not found 
2022-12-08 09:08:16 INFO     Found failed, not-ignored job 55699 for incident 27071
2022-12-08 09:08:16 INFO     Inc 27071 has at least one failed job in aggregate tests
2022-12-08 09:08:16 INFO     Inc 27077 does not have any aggregates settings
2022-12-08 09:08:16 INFO     Aggregate missing for 27077
2022-12-08 09:08:16 INFO     Incidents to approve:
2022-12-08 09:08:16 INFO     SUSE:Maintenance:27054:285902
2022-12-08 09:08:16 INFO     SUSE:Maintenance:27059:285896
2022-12-08 09:08:16 INFO     Accepting review for SUSE:Maintenance:27054:285902
2022-12-08 09:08:16 ERROR    Recived error 401, reason: 'Unauthorized' for Request 285902 - problem on OBS side
2022-12-08 09:08:16 INFO     Accepting review for SUSE:Maintenance:27059:285896
2022-12-08 09:08:26 ERROR    Recived error 401, reason: 'Unauthorized' for Request 285896 - problem on OBS side
2022-12-08 09:08:26 INFO     End of bot run

Acceptance criteria

  • AC1: bot-ng approve incidents runs without authorization errors

Suggestions

  • This occurred outside the maintenance window
  • Investigate what authorization failed exactly
  • File a ticket with OBS... where?
Actions
Copy link
 #1

Updated by jbaier_cz over 1 year ago

My best guess: https://suse.slack.com/archives/C029APBKLGK/p1670481387345319

There was an issue with login to the IBS during maintenance window today.

osc from command line returned

Server returned an error: HTTP Error 401: Unauthorized
Actions
Copy link
 #2

Updated by jbaier_cz over 1 year ago

More info: https://suse.slack.com/archives/C02AET1AAAD/p1670495174789379

Issues with DMZ MySQL cluster. Affected services are internal IDP/MFA and Roundcube Webmail. ETA to be fixed: 2hr
Actions
Copy link
 #3

Updated by livdywan over 1 year ago

Note that I also paused it now because it's constantly failing and filling up my inbox. And the same for schedule:openqabot

Actions
Copy link
 #4

Updated by okurz over 1 year ago

  • Status changed from New to Resolved
  • Assignee set to okurz

Unpaused and working again

https://gitlab.suse.de/qa-maintenance/bot-ng/-/jobs/1278597 succeded with quite some reviews accepted. If anyone wants to crosscheck:

2022-12-08 16:18:50 INFO     Accepting review for SUSE:Maintenance:25982:285826
2022-12-08 16:18:56 INFO     Accepting review for SUSE:Maintenance:26855:285884
…
2022-12-08 16:19:00 INFO     Accepting review for SUSE:Maintenance:27067:285916
2022-12-08 16:19:00 INFO     Accepting review for SUSE:Maintenance:27069:285929
Actions
Copy link

Also available in: Atom PDF