Project

General

Profile

tickets #111719

request sync permissions to build a test repo here

Added by fefe2560@gmail.com 8 months ago. Updated 7 months ago.

Status:
Feedback
Priority:
Normal
Assignee:
Category:
Mirrors
Target version:
-
Start date:
2022-05-28
Due date:
% Done:

90%

Estimated time:

Description

hello sir ,

I would like access yours sync servers to make possible make

rsync -rlpt rsync.opensuse.org::opensuse-hotstuff-320gb /srv/pub/opensuse/
--port=8873 --delete-after --delete-excluded --max-delete=4000
--timeout=1800 -hi

rsync -rlpt stage.opensuse.org::opensuse-hotstuff-320gb /srv/pub/opensuse/
--port=8873 --delete-after --delete-excluded --max-delete=4000
--timeout=1800 -hi

For while is basic test to me understand how process work sir. i dont have
Fix ip

--
Felipe Fernandes da Costa
Graduado em Engenharia da Computação - Pontifícia Universidade Católica de
Goiás
Software / Verification / ASIC Engineer - GLADIC

History

#1 Updated by pjessen 8 months ago

  • Category set to Mirrors
  • Private changed from Yes to No

Hello Felipe

rsync.opensuse.org is open to everyone, and once you are ready, we'll be happy to provide access to stage.o.o too.

#2 Updated by fefe2560@gmail.com 8 months ago

I try this command as described on tutorial but it fails . something
changed ?

rsync -rlpt rsync.opensuse.org::opensuse-hotstuff-320gb /srv/pub/opensuse/
--delete-after --delete-excluded --max-delete=4000 --timeout=1800 -hi

This is rsync.opensuse.org, public rsync server of openSUSE.org,
limited to 50 connections.

If you run a public mirror, please get in contact so we can give you
access to the stage rsync server.
You'll find conditions for access and further information at
http://en.opensuse.org/Mirror_Infrastructure

Thanks!
admin@opensuse.org

@ERROR: Unknown module 'opensuse-hotstuff-320gb'
rsync error: error starting client-server protocol (code 5) at main.c(1672)
[Receiver=3.1.3]

#3 Updated by pjessen 8 months ago

Yes, the hotstuff modules are not currently available. To see what is available:

rsync --list-only rsync://rsync.opensuse.org

opensuse-full Without daily devel snapshots
opensuse-full-with-factory Includes daily devel snapshots
opensuse-full-with-factory-dvd5 Includes daily devel snapshots and large, short-lived Beta DVDs
opensuse-full-really-everything not recomended includes updates every minute
opensuse-full-really-everything-including-repositories not recomended includes updates every minute
opensuse-updates Official updates for released openSUSE distributions
buildservice-repos The repositories from the openSUSE build service
buildservice-repos-main The repositories from the openSUSE build service without the home: directories

#4 Updated by fefe2560@gmail.com 8 months ago

Please some advice

what of list you recommend with at least 400GB space to download ? Am try
opensuse-updates but dont know how much GB or TB needs :|.
Second ask there is no way to make parallel download from all other
packages; is only incremental ?

#5 Updated by fefe2560@gmail.com 8 months ago

Sorry my command am using

rsync -rlptz rsync.opensuse.org::opensuse-updates
/srv/pub/opensuse/opensuseup/ --progress --preallocate --delete-after
--delete-excluded --max-delete=4000 --timeout=1800 -hi

#6 Updated by fefe2560@gmail.com 8 months ago

rsync --info=stats2 -h -r rsync.opensuse.org::opensuse-updates

Number of files: 118,940 (reg: 118,794, dir: 140, link: 6)
Number of created files: 0
Number of deleted files: 0
Number of regular files transferred: 0
Total file size: 501.11G bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 6.58M
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 367
Total bytes received: 6.74M

sent 367 bytes received 6.74M bytes 364.20K bytes/sec
total size is 501.11G speedup is 74,374.19

#7 Updated by pjessen 8 months ago

fefe2560@gmail.com wrote:

Please some advice

what of list you recommend with at least 400GB space to download ? Am try
opensuse-updates but dont know how much GB or TB needs :|.

Hello Felipe
the rsync module sizes are listed here:
https://mirrors.opensuse.org/list/rsyncinfo-rsync.o.o.txt

For instance:

opensuse-full                                               5.54T
opensuse-full-with-factory                                  3.57T
opensuse-full-with-factory-dvd5                             3.57T
opensuse-full-really-everything                             8.13T
opensuse-full-really-everything-including-repositories     32.62T
opensuse-updates                                          501.11G
buildservice-repos                                          8.34T
buildservice-repos-main                                     3.90T

Second ask there is no way to make parallel download from all other
packages; is only incremental ?

You could run multiple rsyncs in parallel, selecting different files/directories with exclude/include, but you will still be limited by the available bandwidth.
Also, once you have completed the initial download, the regular changes are fairly small.

#8 Updated by fefe2560@gmail.com 8 months ago

hello people; am still downloading the thing, more issues appeared to me :

  1. I really need to have a fix ip ? Can I use some no-ip stuff to redirect stuff ? 2.how much stuff on opensuse can grow ? It was 501 GB .. and now is ~700; i dont have bugte yet. i will use a 8TB HD for now.
  2. A PC as I7 Gen2 deal nice with requests to download ?
  3. What internet plan do you recomend ?

#9 Updated by pjessen 8 months ago

  • Status changed from New to In Progress

fefe2560@gmail.com wrote:

hello people; am still downloading the thing, more issues appeared to me :

  1. I really need to have a fix ip ? Can I use some no-ip stuff to redirect stuff ?

If you want access to stage.o.o, we need a static IP address or be able to do a reverse lookup and match against our ACL. That will not work with a dynamic DNS service. There are no restrictions for accessing rsync.o.o.

  1. how much stuff on opensuse can grow ? It was 501 GB .. and now is ~700; i dont have bugte yet. i will use a 8TB HD for now.

The "regular" stuff, i.e. distribution (leap,tumbleweed) and update (without ports), does not grow very much.

  1. A PC as I7 Gen2 deal nice with requests to download ?

That is plenty. My mirror server is using an Intel Core2 6600 @ 2.4GHz.

  1. What internet plan do you recommend ?

It is not easy to make a recommendation, but I would say 100Mbit/s is probably a good start.

#10 Updated by fefe2560@gmail.com 8 months ago

hello again ; few more questions

Use nginx with ssl certificates seems i need validate it in other place
right ? if i wish open port 443 for example.
Port 80 is only used from people will do updates to his respective OS ?
To enable rsync from my computer"server" to others i need configure nginx
with port 873 ?
I did a link instead hard link to point place where repo is downloaded is
dangerous ?

#11 Updated by pjessen 8 months ago

fefe2560@gmail.com wrote:

hello again ; few more questions

Use nginx with ssl certificates seems i need validate it in other place
right ? if i wish open port 443 for example.

I'm not sure what you mean. You need certificates, e.g. from LetsEncrypt, but that's all.

Port 80 is only used from people will do updates to his respective OS ?

Port 80 and port 443 can be used for anyone for anything. Use of http:// and https:// are not tied to anything.

To enable rsync from my computer"server" to others i need configure nginx
with port 873 ?

For rsync, you need to run rsyncd which will listen on port 873.

#12 Updated by fefe2560@gmail.com 8 months ago

after some tests here with my network i finally got up
http://mrfeps.myftp.org:18555/ can you test please ?

#13 Updated by pjessen 8 months ago

fefe2560@gmail.com wrote:

after some tests here with my network i finally got up
http://mrfeps.myftp.org:18555/ can you test please ?

Works fine for me. I see packman and update.

#14 Updated by fefe2560@gmail.com 8 months ago

Could be possible test it as mirror on opensuse ? I could think better name
link ; i accdpt suggestion name

#15 Updated by pjessen 8 months ago

  • Assignee set to andriinikitin

fefe2560@gmail.com wrote:

Could be possible test it as mirror on opensuse ? I could think better name
link ; i accdpt suggestion name

Yeah, that should not be a problem. Assigning to our mirror admin.

#16 Updated by fefe2560@gmail.com 8 months ago

Thx. 😀

Em qui., 9 de jun. de 2022 às 14:02, redmine@opensuse.org escreveu:

[openSUSE Tracker]
Issue #111719 has been updated by pjessen.

Assignee set to andriinikitin

fefe2560@gmail.com wrote:

Could be possible test it as mirror on opensuse ? I could think better
name
link ; i accdpt suggestion name

Yeah, that should not be a problem. Assigning to our mirror admin.


tickets #111719: request sync permissions to build a test repo here
https://progress.opensuse.org/issues/111719#change-527429

  • Author: fefe2560@gmail.com
  • Status: In Progress
  • Priority: Normal
  • Assignee: andriinikitin
  • Category: Mirrors

* Target version:

hello sir ,

I would like access yours sync servers to make possible make

rsync -rlpt rsync.opensuse.org::opensuse-hotstuff-320gb /srv/pub/opensuse/
--port=8873 --delete-after --delete-excluded --max-delete=4000
--timeout=1800 -hi

rsync -rlpt stage.opensuse.org::opensuse-hotstuff-320gb /srv/pub/opensuse/
--port=8873 --delete-after --delete-excluded --max-delete=4000
--timeout=1800 -hi

For while is basic test to me understand how process work sir. i dont have
Fix ip

--
Felipe Fernandes da Costa
Graduado em Engenharia da Computação - Pontifícia Universidade Católica de
Goiás
Software / Verification / ASIC Engineer - GLADIC

--
You have received this notification because you have either subscribed to
it, or are involved in it.
To change your notification preferences, please click here:
http://progress.opensuse.org/my/account

--
Felipe Fernandes da Costa
Graduado em Engenharia da Computação - Pontifícia Universidade Católica de
Goiás
Software / Verification / ASIC Engineer - GLADIC

#17 Updated by fefe2560@gmail.com 8 months ago

hello again;

there is such way to me know how much time or check it out ?

Em qui., 9 de jun. de 2022 às 14:03, Felipe Fernandes da Costa <
fefe2560@gmail.com> escreveu:

Thx. 😀

Em qui., 9 de jun. de 2022 às 14:02, redmine@opensuse.org escreveu:

[openSUSE Tracker]
Issue #111719 has been updated by pjessen.

Assignee set to andriinikitin

fefe2560@gmail.com wrote:

Could be possible test it as mirror on opensuse ? I could think better
name
link ; i accdpt suggestion name

Yeah, that should not be a problem. Assigning to our mirror admin.


tickets #111719: request sync permissions to build a test repo here
https://progress.opensuse.org/issues/111719#change-527429

  • Author: fefe2560@gmail.com
  • Status: In Progress
  • Priority: Normal
  • Assignee: andriinikitin
  • Category: Mirrors

* Target version:

hello sir ,

I would like access yours sync servers to make possible make

rsync -rlpt rsync.opensuse.org::opensuse-hotstuff-320gb
/srv/pub/opensuse/
--port=8873 --delete-after --delete-excluded --max-delete=4000
--timeout=1800 -hi

rsync -rlpt stage.opensuse.org::opensuse-hotstuff-320gb
/srv/pub/opensuse/
--port=8873 --delete-after --delete-excluded --max-delete=4000
--timeout=1800 -hi

For while is basic test to me understand how process work sir. i dont have
Fix ip

--
Felipe Fernandes da Costa
Graduado em Engenharia da Computação - Pontifícia Universidade Católica de
Goiás
Software / Verification / ASIC Engineer - GLADIC

--
You have received this notification because you have either subscribed to
it, or are involved in it.
To change your notification preferences, please click here:
http://progress.opensuse.org/my/account

--
Felipe Fernandes da Costa
Graduado em Engenharia da Computação - Pontifícia Universidade Católica
de Goiás
Software / Verification / ASIC Engineer - GLADIC

--
Felipe Fernandes da Costa
Graduado em Engenharia da Computação - Pontifícia Universidade Católica de
Goiás
Software / Verification / ASIC Engineer - GLADIC

#18 Updated by andriinikitin 7 months ago

Hi,

fefe2560@gmail.com wrote:

there is such way to me know how much time or check it out ?

Please excuse me the delay. I had many tickets piled up and also some other things were distracting.

I've added the mirror to our system and it should start receiving traffic in next few days.

#19 Updated by andriinikitin 7 months ago

  • Status changed from In Progress to Feedback
  • % Done changed from 0 to 90

#20 Updated by fefe2560@gmail.com 7 months ago

Hello there.

Em qui, 30 de jun de 2022 15:27, redmine@opensuse.org escreveu:

[openSUSE Tracker]
Issue #111719 has been updated by andriinikitin.

Hi,

fefe2560@gmail.com wrote:

there is such way to me know how much time or check it out ?

Please excuse me the delay. I had many tickets piled up and also some
other things were distracting.

I've added the mirror to our system and it should start receiving traffic
in next few days.


tickets #111719: request sync permissions to build a test repo here
https://progress.opensuse.org/issues/111719#change-533114

  • Author: fefe2560@gmail.com
  • Status: In Progress
  • Priority: Normal
  • Assignee: andriinikitin
  • Category: Mirrors

* Target version:

hello sir ,

I would like access yours sync servers to make possible make

rsync -rlpt rsync.opensuse.org::opensuse-hotstuff-320gb /srv/pub/opensuse/
--port=8873 --delete-after --delete-excluded --max-delete=4000
--timeout=1800 -hi

rsync -rlpt stage.opensuse.org::opensuse-hotstuff-320gb /srv/pub/opensuse/
--port=8873 --delete-after --delete-excluded --max-delete=4000
--timeout=1800 -hi

For while is basic test to me understand how process work sir. i dont have
Fix ip

--
Felipe Fernandes da Costa
Graduado em Engenharia da Computação - Pontifícia Universidade Católica de
Goiás
Software / Verification / ASIC Engineer - GLADIC

--
You have received this notification because you have either subscribed to
it, or are involved in it.
To change your notification preferences, please click here:
http://progress.opensuse.org/my/account

#21 Updated by fefe2560@gmail.com 7 months ago

hello people,

Well i was thinking about ip address : i created a onion then to help too
http://ok5gebj3yfokll4ok6uveed5cui3errkgyllp2b526oqxgtppqepneyd.onion/

Em qui., 30 de jun. de 2022 às 15:27, redmine@opensuse.org escreveu:

[openSUSE Tracker]
Issue #111719 has been updated by andriinikitin.

Status changed from In Progress to Feedback
% Done changed from 0 to 90


tickets #111719: request sync permissions to build a test repo here
https://progress.opensuse.org/issues/111719#change-533117

  • Author: fefe2560@gmail.com
  • Status: Feedback
  • Priority: Normal
  • Assignee: andriinikitin
  • Category: Mirrors

* Target version:

hello sir ,

I would like access yours sync servers to make possible make

rsync -rlpt rsync.opensuse.org::opensuse-hotstuff-320gb /srv/pub/opensuse/
--port=8873 --delete-after --delete-excluded --max-delete=4000
--timeout=1800 -hi

rsync -rlpt stage.opensuse.org::opensuse-hotstuff-320gb /srv/pub/opensuse/
--port=8873 --delete-after --delete-excluded --max-delete=4000
--timeout=1800 -hi

For while is basic test to me understand how process work sir. i dont have
Fix ip

--
Felipe Fernandes da Costa
Graduado em Engenharia da Computação - Pontifícia Universidade Católica de
Goiás
Software / Verification / ASIC Engineer - GLADIC

--
You have received this notification because you have either subscribed to
it, or are involved in it.
To change your notification preferences, please click here:
http://progress.opensuse.org/my/account

--
Felipe Fernandes da Costa
Graduado em Engenharia da Computação - Pontifícia Universidade Católica de
Goiás
Software / Verification / ASIC Engineer - GLADIC

Also available in: Atom PDF