Project

General

Profile

Actions

tickets #110800

open

opensuse-hotstuff: packaging of /etc/rsyncd.d/*

Added by lkocman almost 2 years ago. Updated almost 2 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Mirrors
Target version:
-
Start date:
2022-05-09
Due date:
% Done:

0%

Estimated time:

Description

Hello team,

I have started a hackweek project to refresh our "hotstuff" mirror
configuration and simplify home mirror deployment.
https://hackweek.opensuse.org/projects/home-mirror-101-refresh-of-hotstuff

I did take configuration from pontifex as it is and placed it under
https://github.com/openSUSE/opensuse-hotstuff

Exposing existing configs in openSUSE namespace on github sounded like
the best first step to me. Hope you agree (so far people liked it).
Lars has asked for configuration via rpm so, here's initial SR of a
very simple opensuse-hotstuff package that just runs obs_scm and
explicitly lists individual files
https://build.opensuse.org/request/show/975806

This email is to ask you for initial review and further updates of
hotstuff configuration on pontifex through rpms built in the
openSUSE:infrastructure repository.

Thank you very much in advance

Lubos

Actions #1

Updated by pjessen almost 2 years ago

  • Private changed from Yes to No

First of all, surely rsync configs should be salted, not packaged ? Yes, I know pontifex has yet to be saltified.
Second, fiddling with the rsync config doesn't contribute much to the resurrection of the hotstuff modules? To resurrect the hotstuff modules, you need to generate the content.

The hotstuff content is kept in /srv/rsync-modules/{30g,80g,160g,320g,640g} - my understanding is that we used to produce stats of the most popular packages (probably based on apache logs?) and then use some knapsack algorithm to produce a suitable selection for each hotstuff module.

Actions #2

Updated by lkocman almost 2 years ago

pjessen wrote:

First of all, surely rsync configs should be salted, not packaged ? Yes, I know pontifex has yet to be saltified.
Second, fiddling with the rsync config doesn't contribute much to the resurrection of the hotstuff modules? To resurrect the hotstuff modules, you need to generate the content.

The hotstuff content is kept in /srv/rsync-modules/{30g,80g,160g,320g,640g} - my understanding is that we used to produce stats of the most popular packages (probably based on apache logs?) and then use some knapsack algorithm to produce a suitable selection for each hotstuff module.

Do we have any existing "salt book" where I could contribute with these? I'll be happy to add them
There was a task to go through hostuff modules manually in release process so not sure about the statistics.

We can handle "updating of these rsync separately"

Thank you for pointers, that already helps!

Actions #3

Updated by lkocman almost 2 years ago

I see https://github.com/SUSE/salt-formulas mentions both SUSE and openSUSE but I don't like the fact that it's not in the openSUSE namespace. Do we have better location?

Actions #4

Updated by pjessen almost 2 years ago

lkocman wrote:

Do we have any existing "salt book" where I could contribute with these? I'll be happy to add them
I see https://github.com/SUSE/salt-formulas mentions both SUSE and openSUSE but I don't like the fact that it's not in the openSUSE namespace. Do we have better location?

TBH, I'm no expert myself, but the openSUSE salt configs are kept here:
https://gitlab.infra.opensuse.org/infra/salt

Actions #5

Updated by cboltz almost 2 years ago

The formulas we use are in gitlab.opensuse.org/saltstack-formulas, but in this case I have a feeling that a formula would be over-engeneered. Using file.managed should do the job with less overhead.

To get started with the salt repo, have a look at https://progress.opensuse.org/projects/opensuse-admin-wiki/wiki/#Salt - or just ask ;-)

Actions #6

Updated by lkocman almost 2 years ago

Thank you I'll have a look. I didn't mean to create entire formulas repo just for this one thing :) I was more likely asking if there is any existing repo with salt formulas for heroes.

Actions #7

Updated by lrupp almost 2 years ago

  • Category set to Mirrors
Actions

Also available in: Atom PDF