Project

General

Profile

Actions

communication #25536

closed

2017-09-24 18:00 UTC: openSUSE:Heroes meeting power outage Nuremberg office

Added by Anonymous over 6 years ago. Updated over 6 years ago.

Status:
Closed
Priority:
Normal
Category:
Event
Target version:
-
Start date:
2017-09-24
Due date:
2017-09-24
% Done:

0%

Estimated time:
1.00 h

Description

There will be a planned power outage affecting the whole Nuremberg office from

Friday afternoon (18:00 CEST), 2017-10-13
until
Sunday afternoon (ETA ~22:00), 2017-10-15

Reason: maintenance off the power transformers in the building the whole Saturday.

Therefor we should discuss what we can do during that time and coordinate the efforts (might be the announcements or the migration of the workload to other locations).

Where: irc://irc.freenode.net/#openSUSE-admin IRC channel
When: 2017-09-05 18:00 UTC / 20:00 CEST
Who: The openSUSE Heroes team and everybody else!

Topics
see/use checklist


Files

2017-09-24-heroes-meeting.txt (22.9 KB) 2017-09-24-heroes-meeting.txt meeting log cboltz, 2017-09-24 20:43
NUE_office_downtime.txt (2.3 KB) NUE_office_downtime.txt Anonymous, 2017-09-25 09:10
Actions #1

Updated by cboltz over 6 years ago

  • Private changed from Yes to No
Actions #2

Updated by cboltz over 6 years ago

See also https://etherpad.opensuse.org/p/NUE_office_downtime - the text below is a copy of it:

Communication:

There should be something on:

When?

  • send the mail on opensuse-announce both on 2017-09-29 and a reminder 3 and 1 day before
  • news.opensuse.org will see an article at 2017-09-29
  • add a shortened version on progres.opensuse.org around 2017-10-06 (later as the news.o.o article, to have this news as 2nd reminder on planet.o.o)
  • 2017-10-06 headers of important services like wiki, forums and OBS should be changed to announce the downtime
  • 2017-10-10 Email announcements go out to:
    • opensuse-project
    • opensuse-factory
    • opensuse-buildservice
  • 2017-10-13
    • change the topic headers on all #opensuse-* IRC channels
    • again an announcement mail on opensuse-announce

Action items:

  • cboltz, ada_lovelace: ask darix to change the channel topics on all #opensuse-* IRC channels for the downtime
  • tampakrap: prepare announcements and sent them around as planned
  • tampakrap: be around on IRC during the downtime, to help our customers ;-)

Services Migration:

  • status2: take a recent dump from status.o.o and change dns (AI: lrupp)
  • download.opensuse.org is a must have - this includes a redundant PostgreSQL cluster and a mirror machine (no scanner) (AI: lrupp)
  • static.opensuse.org as well
  • conncheck is also important
  • freeipa.infra.opensuse.org needs a master-master setup anyway (and is needed to not loose the DNS)
  • chip is also needed (the machine that transfers the dns data to MF) - not really, as the DNS servers from MF transfer only from a specific IP, which can not be running in the Provo DC. Instead, we need to enlarge the TTL for the zone transfer to at least 4 days BEFORE the downtime

The haproxy in Provo should deliver 503 pages for all other services that are not migrated (and therefor down) during the downtime.

If time permits:

  • scar - to get a log in point in Provo
  • Galera cluster (as slave with a bigger lag)
  • lists
  • wiki machines (main + elastic search) - in read only mode
  • keyserver
Actions #3

Updated by Anonymous over 6 years ago

The latest state of the Etherpad page at https://etherpad.opensuse.org/p/NUE_office_downtime (2017-09-25).

Actions

Also available in: Atom PDF