Project

General

Profile

Actions

action #61368

closed

Update the rsync modules to include new ISO and repo

Added by lnussel over 4 years ago. Updated almost 4 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Infrastructure
Target version:
Start date:
2020-05-08
Due date:
2020-06-30
% Done:

100%

Estimated time:

Description

We have rsync-160hotstuff module and we need to make sure ISOs and repo of the new release is included. at least the popular parts of the distribution from the repo.

It would be good to have this for monday, so 160GB mirrors fetch the repo till release day.


Related issues 1 (0 open1 closed)

Copied from openSUSE Leap 15.1 - action #47621: Update the rsync modules to include new ISO and repoClosed2019-05-172019-05-20

Actions
Actions #1

Updated by lnussel over 4 years ago

  • Copied from action #47621: Update the rsync modules to include new ISO and repo added
Actions #2

Updated by lkocman almost 4 years ago

  • Assignee set to lkocman
Actions #3

Updated by lkocman almost 4 years ago

  • Due date changed from 2020-05-11 to 2020-06-30
Actions #4

Updated by lkocman almost 4 years ago

Added retro entry to https://etherpad.opensuse.org/p/ReleaseEngineering-Leap-15.2-retro-20200706

Tested excludes with, so far it syncs only repodata

sh-4.4$ for i in 160g 320g 640g; do rsync -vn -aH --exclude=/15.2/microos --exclude=/15.2/iso --exclude=/15.2/iso-devel --exclude=/15.2/appliances --exclude=/15.2/live --link-dest=/srv/ftp/pub/opensuse/distribution/leap/15.2 /srv/ftp/pub/opensuse/distribution/leap/15.2 /srv/rsync-modules/$i/distribution/leap/15.2 | tee /tmp/lkocman_$i.out; done

Actions #5

Updated by lkocman almost 4 years ago

Running as root in screen under lkocman@

sh-4.4# for i in 160g 320g 640g; do rsync -v -aH --exclude=/15.2/microos --exclude=/15.2/iso --exclude=/15.2/iso-devel --exclude=/15.2/appliances --exclude=/15.2/live --link-dest=/srv/ftp/pub/opensuse/distribution/leap/15.2 /srv/ftp/pub/opensuse/distribution/leap/15.2 /srv/rsync-modules/$i/distribution/leap/15.2 | tee /tmp/lkocman_$i.out; done
sending incremental file list
15.2/
15.2/repo/
15.2/repo/non-oss/
15.2/repo/non-oss/.current.txt
15.2/repo/non-oss/ARCHIVES.gz
15.2/repo/non-oss/CHECKSUMS
15.2/repo/non-oss/CHECKSUMS.asc
15.2/repo/non-oss/ChangeLog
15.2/repo/non-oss/GPLv2.txt
15.2/repo/non-oss/GPLv3.txt
15.2/repo/non-oss/INDEX.gz
15.2/repo/non-oss/README
15.2/repo/non-oss/SUSEgo.ico
15.2/repo/non-oss/SUSEgo.png
15.2/repo/non-oss/SUSEgo.svg
15.2/repo/non-oss/boot -> 695.1-boot
...

Actions #6

Updated by lkocman almost 4 years ago

  • Status changed from New to In Progress
  • % Done changed from 0 to 10
Actions #7

Updated by lkocman almost 4 years ago

  • % Done changed from 10 to 30

160GB done, doing 320GB now

Actions #8

Updated by lkocman almost 4 years ago

  • % Done changed from 30 to 90

repos were synced

640g

sent 51,166,241,529 bytes received 738,524 bytes 63,130,141.95 bytes/sec
total size is 51,150,097,736 speedup is 1.00

re-run to make sure we're up2date

sh-4.4# for i in 160g 320g 640g; do rsync -v -aH --exclude=/15.2/microos --exclude=/15.2/iso --exclude=/15.2/iso-devel --exclude=/15.2/appliances --exclude=/15.2/live --link-dest=/srv/ftp/pub/opensuse/distribution/leap/15.2 /srv/ftp/pub/opensuse/distribution/leap/15.2 /srv/rsync-modules/$i/distribution/leap/15.2 | tee /tmp/lkocman_$i.out; done
sending incremental file list

sent 2,135,589 bytes received 43 bytes 474,584.89 bytes/sec
total size is 51,150,097,736 speedup is 23,950.80
sending incremental file list

sent 2,135,589 bytes received 43 bytes 610,180.57 bytes/sec
total size is 51,150,097,736 speedup is 23,950.80
sending incremental file list

sent 2,135,589 bytes received 43 bytes 610,180.57 bytes/sec
total size is 51,150,097,736 speedup is 23,950.80
sh-4.4#

ISOS will be synced on GA day

Actions #9

Updated by lkocman almost 4 years ago

To be executed tomorrow on GA (skipped --exclude=/15.2/iso unlike in previous exp). Also permissions on the iso dir should be changed to 755 first I suppose

for i in 160g 320g 640g; do rsync -v -aH --exclude=/15.2/microos --exclude=/15.2/iso-devel --exclude=/15.2/appliances --exclude=/15.2/live --link-dest=/srv/ftp/pub/opensuse/distribution/leap/15.2 /srv/ftp/pub/opensuse/distribution/leap/15.2 /srv/rsync-modules/$i/distribution/leap/15.2 | tee /tmp/lkocman_$i.out; done

Actions #10

Updated by lkocman almost 4 years ago

rsyncing iso to mirrors ahead of the time.

Actions #11

Updated by lkocman almost 4 years ago

sh-4.4# chmod 755 /srv/rsync-modules//distribution/leap/15.2/iso
sh-4.4# ls -la /srv/rsync-modules/
/distribution/leap/15.2/iso/
/srv/rsync-modules/160g/distribution/leap/15.2/iso/:
total 4328464
drwxr-xr-x 2 mirror stage 4096 Jun 30 15:56 .
drwxr-xr-x 4 root root 39 Jul 2 08:29 ..
-rw-r--r-- 1 mirror stage 4287627264 Jun 26 06:50 openSUSE-Leap-15.2-DVD-x86_64.iso
-rw-r--r-- 1 mirror stage 630 Jun 30 15:55 openSUSE-Leap-15.2-DVD-x86_64.iso.sha256
-rw-r--r-- 1 mirror stage 144703488 Jun 26 06:35 openSUSE-Leap-15.2-NET-x86_64.iso
-rw-r--r-- 1 mirror stage 630 Jun 30 15:56 openSUSE-Leap-15.2-NET-x86_64.iso.sha256

/srv/rsync-modules/320g/distribution/leap/15.2/iso/:
total 4328476
drwxr-xr-x 2 mirror stage 4096 Jun 30 15:56 .
drwxr-xr-x 4 mirror stage 39 Jul 2 08:59 ..
-rw-r--r-- 4 mirror stage 4287627264 Jun 26 06:50 openSUSE-Leap-15.2-DVD-x86_64.iso
-rw-r--r-- 4 mirror stage 630 Jun 30 15:55 openSUSE-Leap-15.2-DVD-x86_64.iso.sha256
-rw-r--r-- 4 mirror stage 144703488 Jun 26 06:35 openSUSE-Leap-15.2-NET-x86_64.iso
-rw-r--r-- 4 mirror stage 630 Jun 30 15:56 openSUSE-Leap-15.2-NET-x86_64.iso.sha256

/srv/rsync-modules/640g/distribution/leap/15.2/iso/:
total 4328464
drwxr-xr-x 2 mirror stage 4096 Jun 30 15:56 .
drwxr-xr-x 4 mirror stage 39 Jun 25 17:31 ..
-rw-r--r-- 1 mirror stage 4287627264 Jun 26 06:50 openSUSE-Leap-15.2-DVD-x86_64.iso
-rw-r--r-- 1 mirror stage 630 Jun 30 15:55 openSUSE-Leap-15.2-DVD-x86_64.iso.sha256
-rw-r--r-- 1 mirror stage 144703488 Jun 26 06:35 openSUSE-Leap-15.2-NET-x86_64.iso
-rw-r--r-- 1 mirror stage 630 Jun 30 15:56 openSUSE-Leap-15.2-NET-x86_64.iso.sha256
sh-4.4#

Actions #12

Updated by lkocman almost 4 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 90 to 100

Done

Actions

Also available in: Atom PDF