tickets #36285
closedEnabling influx db plugins on metrics.opensuse.org
100%
Description
Hi guys,
we would like to track some additional metrics for OBS.
For that we would need to have a couple of influx db plugins enabled for
the influx db used by metrics.opensuse.org.
Metrics we would like to collect are:
- memcache
- mysql
- passenger
- postfix
- rails stats (https://github.com/influxdata/influxdb-rails)
CC'ing Jimmy as he initially set up metrics.opensuse.org and mainly uses it.
Regards
Björn
Updated by tampakrap almost 6 years ago
- Category set to Servers hosted in NBG
- Assignee set to jberry
- Private changed from Yes to No
Updated by jberry almost 6 years ago
- Assignee deleted (
jberry)
I would suggest getting a ram increase on box as the metrics import that runs weekly uses something like 8GB or ram or somesuch last I checked. If a bunch of extra services start consuming the ram I would expect it to cause issues.
As for actual setup, should be able to add to salt configuration to enable new stuff.
Updated by jberry almost 6 years ago
Presumably the OBS team has more insight into what they need. I don't really want to know why we need three databases + a key value store.
Updated by jberry almost 6 years ago
Ah, I see the subject said "influxdb plugins", but still curious. The rails stuff sounds like for writing to influxdb from rails which would need to be installed with the rails application not influxdb? The others seem similar as presumably you want to write metrics about those services to influxdb. As such are you looking to have remote write access to influxdb or what?
Updated by bgeuken almost 6 years ago
The rails stuff sounds like for writing to influxdb from rails which would need to be installed with the rails application not influxdb?
Right, I mixed that up previously. So we would like to collect additional data via this plugin and wanted to ask for allowance from anyone who is involved in this machine / setup.
AFAIK for the using the plugins we would just need to have a port open (maybe some influxdb configuration is needed as well?). Eduardo is looking into that.
And like Jimmy mentioned a ram update if that is needed.
Updated by tampakrap almost 6 years ago
as discussed with Eduardo and henne on IRC, it makes sense to move metrics to the same VLAN that the rest of the OBS infrastructure is, so that we don't have to bridge the two vlans. I'd prefer to do the move back together with Jimmy online one afternoon. The problem is that I'll be on offsite next week. I'll try to do it Monday or Tuesday, but I can't promise it sorry
Updated by jberry almost 6 years ago
As discussed in #opensuse-admin metrics.o.o needs access to pontifex access logs in one form or another. They were originally synced to langley.suse.de which would work, but has same tunnel issue. Alternatively, influxdb could be exposed publicly if properly configured for authentication.
Updated by jberry almost 6 years ago
Presumably, if you were going to write to influxdb it would need to be exposed inside the network and authentication setup so realistically nothing changes from OBS perspective except the URL to the db.
Updated by tampakrap over 5 years ago
is there anything left for me? should I close the ticket or assign it to someone else?