Project

General

Profile

Actions

action #159651

open

coordination #110833: [saga][epic] Scale up: openQA can handle a schedule of 100k jobs with 1k worker instances

coordination #108209: [epic] Reduce load on OSD

high response times on osd - nginx with enabled rate limiting features size:S

Added by okurz 10 days ago. Updated 10 days ago.

Status:
Workable
Priority:
Normal
Assignee:
-
Category:
Feature requests
Target version:
Start date:
2024-04-26
Due date:
% Done:

0%

Estimated time:
Tags:

Description

Motivation

Apache in prefork mode uses a lot of resources to provide mediocre performance. After nginx is deployed on OSD we should ensure that nginx helps to improve performance either with our default config or with additional config tweaks

Acceptance criteria

  • AC1: It is known if Nginx default config or rate limiting features help to prevent OSD unresponsiveness

Suggestions

  • Follow what was done for Nginx deployment on OSD in #130636 and #159654
  • Take a look at what we already do or didn't want to do on o3, see #129490
  • Monitor performance over some time, in particular if HTTP response graphs from openQA directly still show unresponsiveness windows or not
  • Add changes to salt-states-openqa for any nginx config tweaks

Out of scope

  • Any major research or big config tweaks for rate limiting, just some very basics if necessary at all

Related issues 2 (2 open0 closed)

Copied from openQA Project - action #130636: high response times on osd - Try nginx on OSD size:SIn Progressmkittler2024-05-17

Actions
Copied to openQA Project - action #159654: high response times on osd - nginx properly monitored in grafana size:SWorkable2024-04-26

Actions
Actions #1

Updated by okurz 10 days ago

  • Copied from action #130636: high response times on osd - Try nginx on OSD size:S added
Actions #2

Updated by okurz 10 days ago

  • Copied to action #159654: high response times on osd - nginx properly monitored in grafana size:S added
Actions #3

Updated by jbaier_cz 10 days ago

  • Subject changed from high response times on osd - nginx with enabled load limiting or load balancing features to high response times on osd - nginx with enabled rate limiting features size:S
  • Description updated (diff)
  • Status changed from New to Workable
Actions

Also available in: Atom PDF