Project

General

Profile

Actions

tickets #90308

closed

Submit mirror site to openSUSE mirrors list (https://mirrors.sustech.edu.cn/opensuse/)

Added by sustech_cra about 3 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Mirrors
Target version:
-
Start date:
2021-03-18
Due date:
% Done:

0%

Estimated time:

Description

Dear the administrator of openSUSE project,

We've hosted a mirror site of the openSUSE. The information of the mirror is listed as below:

  • Admin Name: Computer Research Association, Southern University of Science and Technology - Admin Email: cra@sustech.edu.cn - Subscribed to mirror@opensuse.org: NO (Our subscription email had been reject, the error shows: "host mx2.opensuse.org[195.135.221.158] said: 554 5.7.1 : Recipient address rejected: The mlmmj command interface has been discontinued. For instructions on how to interact with mailman3," - Sponsor Name: Southern University of Science and Technology (SUSTech) - Sponsor URL: https://www.sustech.edu.cn/ - RSYNC URL: rsync://mirrors.sustech.edu.cn/opensuse/ (Currently IPv6 only) - RSYNC allowed only for scans: YES - HTTP URL: https://mirrors.sustech.edu.cn/opensuse/ - FTP URL: NO - Limitations: As we only have limited IPv4 Bandwidth (currently 100Mbps) but Sufficient IPv6 bandwidth (About 500Mbps), we may apply for "limit the access to our mirror just to clients with IPv6 and set the 'amount of requests' score to 50 or lower". - IPs and DNS for the whitelist on stage.opensuse.org: 116.7.234.0/24 and 2001:da8:201d::47:198/112

It's our pleasure to add our mirror to the official mirror list. If you have any question about the details of the mirror, please don't hesitate to contact us.

Best regards,

Qingyuan Fan (fanqy2018@mail.sustech.edu.cn)
Maintainer of Open Source Mirror in SUSTech
Computer Research Association, SUSTech
https://mirrors.sustech.edu.cn/

 

Actions #1

Updated by pjessen about 3 years ago

  • Category set to Mirrors
  • Status changed from New to In Progress
  • Assignee set to pjessen
  • Private changed from Yes to No

Hello,
many thanks for volunteering your time and resources to help support our mirroring infrastructure, much appreciated!

Actions #2

Updated by pjessen about 3 years ago

When trying to create the database enetry, I kept getting this:

# sh newmirror
Traceback (most recent call last):
  File "/usr/bin/mb", line 1729, in <module>
    r = mirrordoctor.main()
  File "/usr/lib/python2.7/site-packages/cmdln.py", line 261, in main
    return self.cmd(args)
  File "/usr/lib/python2.7/site-packages/cmdln.py", line 284, in cmd
    retval = self.onecmd(argv)
  File "/usr/lib/python2.7/site-packages/cmdln.py", line 422, in onecmd
    return self._dispatch_cmd(handler, argv)
  File "/usr/lib/python2.7/site-packages/cmdln.py", line 1123, in _dispatch_cmd
    return handler(argv[0], opts, *args)
  File "/usr/bin/mb", line 212, in do_new
    prefixOnly   = opts.prefix_only or 0)
  File "/usr/lib/python2.7/site-packages/sqlobject/main.py", line 1301, in __init__
    self._create(id, **kw)
  File "/usr/lib/python2.7/site-packages/sqlobject/main.py", line 1352, in _create
    self._SO_finishCreate(id)
  File "/usr/lib/python2.7/site-packages/sqlobject/main.py", line 1378, in _SO_finishCreate
    id, names, values)
  File "/usr/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 493, in queryInsertID
    names, values)
  File "/usr/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 342, in _runWithConnection
    val = meth(conn, *args)
  File "/usr/lib/python2.7/site-packages/sqlobject/postgres/pgconnection.py", line 295, in _queryInsertID
    self._executeRetry(conn, c, q)
  File "/usr/lib/python2.7/site-packages/sqlobject/postgres/pgconnection.py", line 259, in _executeRetry
    raise dberrors.DataError(ErrorMessage(e))
sqlobject.dberrors.DataError: value too long for type character varying(2)

I guess that "varying(2)" is either region or country, but why we should get a value longer than that, dunno.
For now I have "hardcoded" country as 'cn' and region as 'as'.

Actions #3

Updated by pjessen about 3 years ago

  • Status changed from In Progress to Feedback

Hello Qingyuan Fan

when I look up the IP addresses for 'mirrors.sustech.edu.cn', I get:

# host mirrors.sustech.edu.cn
mirrors.sustech.edu.cn has address 172.18.6.198
mirrors.sustech.edu.cn has IPv6 address 2001:da8:201d::47:198

The private IPv4 address is a problem for us.

Actions #4

Updated by pjessen about 3 years ago

Also, I need a single IPv4 address for adding to the rsync ACL, I cannot use a full range.

Actions #5

Updated by sustech_cra about 3 years ago

Hello,

About the DNS issues, we found that this is an occasional problem. We have heard some feedback users resolve this domain name of the other service domain of our university out of mainland China, there is a small probability that they will get the intranet address of the service (maybe this issue is related to the GeoDNS system of our university’s DNS server, but I've tried serval DNS in mainland China and DNS from Cloudflare and Google but have not been able to reproduce this issue for now). I will report this issue and investigate with our university's ITSC.

nslookup mirrors.sustech.edu.cn 1.0.0.1
Server: 1.0.0.1
Address: 1.0.0.1#53

Non-authoritative answer:
Name: mirrors.sustech.edu.cn
Address: 116.7.234.220
Name: mirrors.sustech.edu.cn
Address: 2001:da8:201d::47:198

About the rsync whitelist IP, it is okay for you to add only IPv6 address to the ACL, as the mirror infrastructure is operated behind an NAT and have a dynamic outbound IP in the range I mentioned in the ticket (116.7.234.0/24).

Sincerely,
Qingyuan Fan

Actions #6

Updated by pjessen about 3 years ago

cra@sustech.edu.cn wrote:

About the rsync whitelist IP, it is okay for you to add only IPv6 address to the ACL, as the mirror infrastructure is operated behind an NAT and have a dynamic outbound IP in the range I mentioned in the ticket (116.7.234.0/24).

Okay, done.
I'm just running another scan, when that is complete, the mirror will be automatically enabled.

FYI, we do have an option 'ipv6only', but I don't know if it works. I have enabled it for your mirror, please let me know if you have any problems.

Actions #7

Updated by pjessen about 3 years ago

Hmm, the scan still does not complete. It looks like the rsync filelisting fails (probably a timeout), after which the scanner reverts to http. Unfortunately, your directory listing is not in a format we recognise.

# mb scan suste
Fri Mar 19 16:34:00 2021 mirrors.sustech.edu.cn: starting
Fri Mar 19 16:37:32 2021 mirrors.sustech.edu.cn: total files before scan: 0
__DIE__: (/usr/bin/scanner 315 main::rsync_readdir => /usr/bin/scanner 1123 (eval) => /usr/bin/scanner 1124 main::rsync_get_filelist)
mirrors.sustech.edu.cn: unparseable HTML index in /
Fri Mar 19 16:39:45 2021 mirrors.sustech.edu.cn: scanned 0 files (0/s) in 132s
Fri Mar 19 16:39:45 2021 mirrors.sustech.edu.cn: files to be purged: 0
Fri Mar 19 16:43:48 2021 mirrors.sustech.edu.cn: total files after scan: 0 (delta: 0)
Fri Mar 19 16:43:48 2021 mirrors.sustech.edu.cn: purged old files in 243s.
Fri Mar 19 16:43:48 2021 mirrors.sustech.edu.cn: done.
Completed in 9.8 minutes
Actions #8

Updated by sustech_cra about 3 years ago

Hi, unfortunately we found that recently our university have filtered the port 873 for user out of our ASN on IPv4. But it seems that the scanner of openSUSE can only be initialized from IPv4 (195.135.220.0/22) as referring to the documentation (https://en.opensuse.org/openSUSE:Mirror_infrastructure#Registering_your_mirror).

We will report this issue to ITSC. However, it may take some time to fix this issues together with university's ITSC. May you just close this issue for now and we will open a new issue once we processed the port filter issues with our university 's ITSC. Sorry for the inconvenience. Sorry for the inconvenience.

Actions #9

Updated by pjessen about 3 years ago

  • Status changed from Feedback to Resolved

sustech_cra wrote:

Hi, unfortunately we found that recently our university have filtered the port 873 for user out of our ASN on IPv4. But it seems that the scanner of openSUSE can only be initialized from IPv4 (195.135.220.0/22) as referring to the documentation (https://en.opensuse.org/openSUSE:Mirror_infrastructure#Registering_your_mirror).

Yes, unfortunately the scanner is not IPv6 capable.

We will report this issue to ITSC. However, it may take some time to fix this issues together with university's ITSC. May you just close this issue for now and we will open a new issue once we processed the port filter issues with our university 's ITSC. Sorry for the inconvenience. Sorry for the inconvenience.

Don't worry, no inconvenience at all, we are happy you want to join our mirroring setup.

Actions

Also available in: Atom PDF