Project

General

Profile

Actions

tickets #104265

closed

download.o.o under unusually heavy load

Added by pjessen over 2 years ago. Updated 11 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
Mirrors
Target version:
-
Start date:
2021-12-22
Due date:
% Done:

100%

Estimated time:

Description

I'm opening this to see if there is anything we need to do, if we can.
For a couple of days, download.o.o seems to be under heavy load, so much so that it is delaying mirrors in catching up. Looking at some random file, e.g.:

http://download.opensuse.org/ports/aarch64/tumbleweed/repo/oss/noarch/alacritty-bash-completion-0.9.0-3.1.noarch.rpm.mirrorlist,,

It is dated 16 December, but has so far only made it out to one mirror (out of 15 carrying ports/). The problem is - if our mirrors are falling behind, download.o.o will serve that content by itself, which only increases the total load, in effect only worsening the situation.
According to the logs, yesterday download.o.o served 51'568'740 (45'798'927 ipv4 plus 5'769'813 ipv6) requests which is about 597 per second. I don't actually know if that is unusual, I'm checking to see how much traffic we have had in the last week or so.


Related issues 1 (1 open0 closed)

Related to openSUSE admin - tickets #104193: Issues with openSUSE ReposFeedbackandriinikitin2021-12-20

Actions
Actions #1

Updated by pjessen over 2 years ago

pjessen wrote:

According to the logs, yesterday download.o.o served 51'568'740 (45'798'927 ipv4 plus 5'769'813 ipv6) requests which is about 597 per second. I don't actually know if that is unusual, I'm checking to see how much traffic we have had in the last week or so.

It is not so unusual - on 15 and 16 December, we had 600+ per second. On average over 24hours. I may have to look at the number of redirects too.

Actions #2

Updated by pjessen over 2 years ago

  • Private changed from Yes to No
Actions #3

Updated by pjessen over 2 years ago

According to the mirrorlist, the file mentioned above has now made it out to two mirrors. Maybe it isn't the rsync that is slow, but the scanning ?

Actions #4

Updated by okurz over 2 years ago

Actions #5

Updated by lrupp about 2 years ago

  • Category set to Mirrors
Actions #6

Updated by crameleon 11 months ago

OK to close this?

Actions #7

Updated by pjessen 11 months ago

  • Status changed from New to Resolved
  • % Done changed from 0 to 100

Yup, let's close - a lot has been happening with download.o.o

Actions

Also available in: Atom PDF