openSUSE Project Management Tool: Issueshttps://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842020-04-23T13:40:35ZopenSUSE Project Management Tool
Redmine openQA Infrastructure - action #66019 (Workable): Configure downsampling and a retention policy f...https://progress.opensuse.org/issues/660192020-04-23T13:40:35Zmkittlermarius.kittler@suse.com
<a name="Motivation"></a>
<h2 >Motivation<a href="#Motivation" class="wiki-anchor">¶</a></h2>
<p>When working on <a class="issue tracker-4 status-3 priority-4 priority-default closed child" title="action: Keep track of disk usage of results by job groups (Resolved)" href="https://progress.opensuse.org/issues/64574">#64574</a> I've noticed that we don't have a retention policy and the default policy seems to be storing the data forever. That's likely something we want to adjust in the long term.</p>
<a name="Acceptance-criteria"></a>
<h2 >Acceptance criteria<a href="#Acceptance-criteria" class="wiki-anchor">¶</a></h2>
<ul>
<li><strong>AC1:</strong> Downsampling and retention is enabled with at least <em>some</em> sensible settings on the influxdb on monitor.qa.suse.de</li>
</ul>
<a name="Suggestion"></a>
<h2 >Suggestion<a href="#Suggestion" class="wiki-anchor">¶</a></h2>
<ul>
<li>Read <a href="https://docs.influxdata.com/influxdb/v2.0/process-data/common-tasks/downsample-data/" class="external">https://docs.influxdata.com/influxdb/v2.0/process-data/common-tasks/downsample-data/</a> about downsampling</li>
<li>Read <a href="https://docs.influxdata.com/influxdb/v2.0/reference/api/influxdb-1x/dbrp/" class="external">https://docs.influxdata.com/influxdb/v2.0/reference/api/influxdb-1x/dbrp/</a> about retention</li>
<li>Look into what mkittler has drafted so far (not tested): <a href="https://gitlab.suse.de/mkittler/salt-states-openqa/-/commit/1880714e73d467ac5ed9c0a5b5cec4467fc14a20" class="external">https://gitlab.suse.de/mkittler/salt-states-openqa/-/commit/1880714e73d467ac5ed9c0a5b5cec4467fc14a20</a></li>
<li>Introduce the corresponding changes to limit the storage space used by influxdb, mainly to prevent the storage to run full</li>
</ul>