Project

General

Profile

action #105064

openQA Infrastructure - coordination #96447: [epic] Failed systemd services and job age alerts

Reduce verbosity of openQA logging to improve performance and reduce storage requirements size:M

Added by okurz 4 months ago. Updated 4 months ago.

Status:
Resolved
Priority:
Low
Assignee:
okurz
Category:
Feature requests
Target version:
Ready
Start date:
2021-10-22
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Motivation

See #96551

Acceptance criteria

  • AC1: The most verbose logging calls on active openQA instances like OSD have been reduced in verbosity

Suggestions

  • Call journalctl -f on osd and look for what appears to be repeated most often and either remove those calls or change to log_trace
  • Revisit previous tickets where we increased logging
  • Look for redundant messages in the sense that they never really change and aren't that useful
  • Focus especially on debug messages
  • Consider all services (also scheduler, web sockets, …)

Related issues

Copied from openQA Infrastructure - action #96551: Persistent records of systemd journal size:SResolved2021-10-22

History

#1 Updated by okurz 4 months ago

  • Copied from action #96551: Persistent records of systemd journal size:S added

#2 Updated by cdywan 4 months ago

  • Subject changed from Reduce verbosity of some logging to improve performance and reduce storage requirements to Reduce verbosity of openQA logging to improve performance and reduce storage requirements
  • Description updated (diff)
  • Status changed from New to Workable

#3 Updated by okurz 4 months ago

  • Subject changed from Reduce verbosity of openQA logging to improve performance and reduce storage requirements to Reduce verbosity of openQA logging to improve performance and reduce storage requirements size:M

#4 Updated by okurz 4 months ago

  • Status changed from Workable to In Progress

#5 Updated by okurz 4 months ago

  • Status changed from In Progress to Feedback

OBS check was stuck. Rebased to retrigger.

#6 Updated by okurz 4 months ago

PR merged.

#7 Updated by okurz 4 months ago

  • Status changed from Feedback to Resolved

It's effective on OSD. We still have some rather verbose messages but the journal goes back to at least 2022-01-23 so I guess we are ok for now.

Also available in: Atom PDF