Project

General

Profile

Actions

tickets #128555

open

provo-mirror nginx log compression

Added by pjessen 12 months ago. Updated 8 months ago.

Status:
New
Priority:
Normal
Assignee:
Category:
Servers hosted in Provo
Target version:
-
Start date:
2023-05-03
Due date:
% Done:

0%

Estimated time:

Description

On provo-mirror, nginx has been writing emails to itself since at least 2017 - there were some 1800 mails in the mailbox. These were all from the cronjob running /usr/sbin/nginx-compress-logs daily.

I have updated the cronjob to send output to admin-auto, but here is the mail from 3 May:

Message 383:
From nginx@provo-mirror.opensuse.org  Wed May  3 00:30:02 2023
X-Original-To: nginx
Delivered-To: nginx@provo-mirror.opensuse.org
From: "(Cron Daemon)" <nginx@provo-mirror.opensuse.org>
To: nginx@provo-mirror.opensuse.org
Subject: Cron <nginx@provo-mirror> /usr/sbin/nginx-compress-logs
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Auto-Submitted: auto-generated
Precedence: bulk
X-Cron-Env: <XDG_SESSION_ID=c576>
X-Cron-Env: <XDG_RUNTIME_DIR=/run/user/491>
X-Cron-Env: <DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/491/bus>
X-Cron-Env: <XDG_SESSION_TYPE=unspecified>
X-Cron-Env: <XDG_SESSION_CLASS=background>
X-Cron-Env: <LANG=en_US.UTF-8>
X-Cron-Env: <SHELL=/bin/sh>
X-Cron-Env: <HOME=/var/lib/nginx>
X-Cron-Env: <PATH=/usr/bin:/bin>
X-Cron-Env: <LOGNAME=nginx>
X-Cron-Env: <USER=nginx>
Date: Wed,  3 May 2023 00:30:02 +0000 (UTC)

xz: /var/log/nginx/access.log.xz: File exists
xz: /var/log/nginx/downloadcontent/2023/05/2023-05-02-access.log.xz: Cannot set the file group: Operation not permitted
xz: /var/log/nginx/provo-mirror/2018/02/2018-02-27-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/02/2018-02-18-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/05/2018-05-01-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/05/2018-05-24-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/05/2018-05-18-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/05/2018-05-09-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/05/2018-05-02-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/06/2018-06-29-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/06/2018-06-30-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/06/2018-06-28-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/06/2018-06-10-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/06/2018-06-26-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/11/2018-11-05-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/11/2018-11-04-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/04/2018-04-23-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/04/2018-04-19-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/04/2018-04-13-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/04/2018-04-21-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/04/2018-04-14-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/03/2018-03-04-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-25-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-31-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-20-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-15-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-26-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-09-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-05-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-16-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-14-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-18-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-28-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-02-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-13-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-08-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/07/2018-07-29-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/09/2018-09-04-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-20-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-27-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-29-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-15-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-17-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-28-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-12-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-16-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-31-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-18-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-30-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-06-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-24-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-19-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-13-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-03-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2018/08/2018-08-23-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/02/2023-02-15-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/02/2023-02-10-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/02/2023-02-12-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/02/2023-02-13-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/02/2023-02-20-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/02/2023-02-19-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/02/2023-02-01-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/02/2023-02-16-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/02/2023-02-17-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/02/2023-02-11-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/02/2023-02-18-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-23-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-08-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-04-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-27-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-28-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-29-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-19-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-03-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-18-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-06-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-09-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-26-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/03/2023-03-24-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/01/2023-01-08-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/01/2023-01-03-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/01/2023-01-23-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/01/2023-01-19-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/01/2023-01-27-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/01/2023-01-31-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/01/2023-01-22-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/01/2023-01-10-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/01/2023-01-11-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/01/2023-01-28-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2023/01/2023-01-29-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/02/2022-02-04-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/02/2022-02-24-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/02/2022-02-27-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/02/2022-02-21-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-12-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-11-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-21-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-05-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-13-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-22-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-04-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-29-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-23-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-08-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-20-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-28-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-07-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-25-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-01-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-19-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/11/2022-11-30-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/10/2022-10-31-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/10/2022-10-06-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/10/2022-10-27-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/10/2022-10-14-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/10/2022-10-16-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/10/2022-10-12-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/10/2022-10-20-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/10/2022-10-13-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/10/2022-10-09-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/10/2022-10-19-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/10/2022-10-15-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/10/2022-10-11-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/12/2022-12-05-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/12/2022-12-08-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/12/2022-12-01-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/12/2022-12-22-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/12/2022-12-12-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/12/2022-12-09-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/12/2022-12-06-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/03/2022-03-17-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/03/2022-03-01-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/03/2022-03-18-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/03/2022-03-19-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/01/2022-01-16-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/01/2022-01-03-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/01/2022-01-28-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/01/2022-01-30-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/01/2022-01-25-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/09/2022-09-03-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/09/2022-09-29-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/09/2022-09-18-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/09/2022-09-17-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/09/2022-09-22-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/09/2022-09-25-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2022/09/2022-09-13-access.log.xz: File exists
etc etc etc.
xz: /var/log/nginx/provo-mirror/2017/12/2017-12-07-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2017/12/2017-12-26-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2017/12/2017-12-24-access.log.xz: File exists
xz: /var/log/nginx/provo-mirror/2017/12/2017-12-22-access.log.xz: File exists

This one is most likely my fault, I had to create /var/log/nginx/downloadcontent/2023/05 manually, and I almost certainly forgot the right ownership.

xz: /var/log/nginx/downloadcontent/2023/05/2023-05-02-access.log.xz: Cannot set the file group: Operation not permitted

Actions #1

Updated by pjessen 12 months ago

Hmm, maybe not -

00:09 provo-mirror (mirror):/var/log/nginx/downloadcontent # l 2023/05
total 20568
drwxr-xr-x 2 nginx nginx     4096 May  3 00:30 ./
drwxr-xr-x 6 nginx nginx     4096 May  2 15:39 ../
-rw-r--r-- 1 nginx nginx 20979596 May  2 23:59 2023-05-02-access.log-20230503.xz
-rw-r--r-- 1 nginx nginx       32 May  3 00:00 2023-05-02-access.log.xz
-rw-r--r-- 1 nginx nginx    65403 May  3 06:38 2023-05-03-access.log

Looking at a random file from the above:

-rw-r--r-- 1 nginx nginx  9629076 Oct 20  2022 2022-10-19-access.log-20221020.xz
-rw-r--r-- 1 nginx nginx       32 Oct 20  2022 2022-10-19-access.log.xz
-rw-r--r-- 1 nginx nginx      213 Oct 21  2022 2022-10-20-access.log
Actions #2

Updated by pjessen 12 months ago

  • Category set to Servers hosted in Provo
  • Assignee set to pjessen
  • Private changed from Yes to No
Actions #3

Updated by luc14n0 8 months ago

I'm curious, do we know why logrotate is not being used there?

Actions

Also available in: Atom PDF