Project

General

Profile

Actions

action #162644

closed

Job fails with api failure: 403 response: timestamp mismatch after brief osd outage

Added by livdywan 27 days ago. Updated 27 days ago.

Status:
Rejected
Priority:
High
Assignee:
Category:
Infrastructure
Target version:
Start date:
2024-06-20
Due date:
% Done:

0%

Estimated time:
Difficulty:
Tags:

Description

Observation

openQA test in scenario sle-15-SP5-Online-QR-x86_64-create_hdd_minimal_base+sdk@64bit fails in
welcome

The test failed with this reason:

api failure: 403 response: timestamp mismatch - check whether clocks on the local host and the web UI host are in sync

There were also reports of osd being inaccessible around that time.

There was a ton of Updating seen of worker and influxdb/telegraf timing out (sudo journalctl -S '2024-06-20 15:50:00' -U '2024-06-20 16:00:00').

The outage is also seen on grafana: https://monitor.qa.suse.de/d/nRDab3Jiz/openqa-jobs-test?orgId=1&from=1718889892165&to=1718893680225

Reproducible

Fails since (at least) Build testdev144.8 (current job)

Expected result

Last good: testdev144.8 (or more recent)

Further details

Always latest result in this scenario: latest


Related issues 1 (1 open0 closed)

Related to openQA Infrastructure - action #162038: No HTTP Response on OSD on 10-06-2024 - auto_review:".*timestamp mismatch - check whether clocks on the local host and the web UI host are in sync":retry size:SIn Progressnicksinger2024-06-102024-07-30

Actions
Actions

Also available in: Atom PDF