Project

General

Profile

Actions

action #106762

open

Prevent proxy timeout errors on `isos post` requests that take too long

Added by okurz about 2 years ago. Updated about 2 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Feature requests
Target version:
Start date:
2022-02-14
Due date:
% Done:

0%

Estimated time:

Description

Motivation

isos post by default is running synchronously and depending on the amount of to be scheduled tests that can take very long so that we run into ugly timeouts. There is already a custom apache config in https://github.com/os-autoinst/openQA/blob/master/etc/apache2/vhosts.d/openqa-common.inc#L89 which as of today failed on openqa.suse.de due to requests taking even longer than 5 minutes. The commands fail with a proxy error but at least parts of the tests are still scheduled. This behaviour should be changed to ensure that we don't run into timeouts without good error feedback. I am not sure if it's a good idea to further bump up the timeout. Likely the request should be explicitly handled in a better way before we hit the timeout, regardless if it's 60s, 5m or 20m. So maybe the server should respond with an explicit error pointing to the async route to use instead.

Also see https://suse.slack.com/archives/C02CANHLANP/p1644819600199619 and https://suse.slack.com/archives/C02CANHLANP/p1644830282823459 and https://suse.slack.com/archives/C02CANHLANP/p1644830317616679 and https://suse.slack.com/archives/C02CANHLANP/p1644831776045659

Acceptance criteria

  • AC1: No jobs are scheduled when requests time out
  • AC2: No custom proxy timeout settings are required
  • AC3: openQA explicitly handles timeouts on requests before the proxy intervenes, e.g. clear error feedback pointing to alternatives

Suggestions

How about aborting on an openQA internal timeout before any proxy timeouts, e.g. maybe 30s when apache timeout by default is 60s, and suggest to use the async parameter.

Actions

Also available in: Atom PDF