Project

General

Profile

Actions

tickets #36285

closed

Enabling influx db plugins on metrics.opensuse.org

Added by bgeuken@suse.de almost 6 years ago. Updated over 5 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
Servers hosted in NBG
Target version:
-
Start date:
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)

Description

Hi guys,

we would like to track some additional metrics for OBS.

For that we would need to have a couple of influx db plugins enabled for
the influx db used by metrics.opensuse.org.

Metrics we would like to collect are:

CC'ing Jimmy as he initially set up metrics.opensuse.org and mainly uses it.

Regards
Björn


Subtasks 1 (0 open1 closed)

tickets #36286: Re: Enabling influx db plugins on metrics.opensuse.orgClosed

Actions
Actions #1

Updated by tampakrap almost 6 years ago

  • Category set to Servers hosted in NBG
  • Assignee set to jberry
  • Private changed from Yes to No
Actions #2

Updated by jberry almost 6 years ago

  • Assignee deleted (jberry)

I would suggest getting a ram increase on box as the metrics import that runs weekly uses something like 8GB or ram or somesuch last I checked. If a bunch of extra services start consuming the ram I would expect it to cause issues.

As for actual setup, should be able to add to salt configuration to enable new stuff.

Actions #3

Updated by tampakrap almost 6 years ago

how much extra RAM you need?

Actions #4

Updated by tampakrap almost 6 years ago

  • Assignee set to tampakrap
Actions #5

Updated by jberry almost 6 years ago

Presumably the OBS team has more insight into what they need. I don't really want to know why we need three databases + a key value store.

Actions #6

Updated by jberry almost 6 years ago

Ah, I see the subject said "influxdb plugins", but still curious. The rails stuff sounds like for writing to influxdb from rails which would need to be installed with the rails application not influxdb? The others seem similar as presumably you want to write metrics about those services to influxdb. As such are you looking to have remote write access to influxdb or what?

Actions #7

Updated by bgeuken almost 6 years ago

The rails stuff sounds like for writing to influxdb from rails which would need to be installed with the rails application not influxdb?

Right, I mixed that up previously. So we would like to collect additional data via this plugin and wanted to ask for allowance from anyone who is involved in this machine / setup.

AFAIK for the using the plugins we would just need to have a port open (maybe some influxdb configuration is needed as well?). Eduardo is looking into that.

And like Jimmy mentioned a ram update if that is needed.

Actions #8

Updated by tampakrap almost 6 years ago

as discussed with Eduardo and henne on IRC, it makes sense to move metrics to the same VLAN that the rest of the OBS infrastructure is, so that we don't have to bridge the two vlans. I'd prefer to do the move back together with Jimmy online one afternoon. The problem is that I'll be on offsite next week. I'll try to do it Monday or Tuesday, but I can't promise it sorry

Actions #9

Updated by jberry almost 6 years ago

As discussed in #opensuse-admin metrics.o.o needs access to pontifex access logs in one form or another. They were originally synced to langley.suse.de which would work, but has same tunnel issue. Alternatively, influxdb could be exposed publicly if properly configured for authentication.

Actions #10

Updated by jberry almost 6 years ago

Presumably, if you were going to write to influxdb it would need to be exposed inside the network and authentication setup so realistically nothing changes from OBS perspective except the URL to the db.

Actions #11

Updated by tampakrap over 5 years ago

is there anything left for me? should I close the ticket or assign it to someone else?

Actions #12

Updated by tampakrap over 5 years ago

  • Status changed from New to Closed
Actions

Also available in: Atom PDF