tickets #78155
closedNew Mirror From London, UK
100%
Description
Admin mailing list -- admin@lists.opensuse.org
To unsubscribe, email admin-leave@lists.opensuse.org
List Netiquette: https://en.opensuse.org/openSUSE:Mailing_list_netiquette
List Archives: https://lists.opensuse.org/archives/list/admin@lists.opensuse.org
Hi
I am writing to you as part of our open-source commitment to offer you a new mirror, entirely DDoS protected. We currently mirror a range of projects from GNU, KDE and Gnome to Apache, OpenOffice, etc.
Access points:
HTTP: http://mirrors.gethosted.online/opensuse http://mirrors.gethosted.online/opensuse
HTTPS: https://mirrors.gethosted.online/opensuse https://mirrors.gethosted.online/opensuse
RSYNC: rsync://mirrors.gethosted.online/opensuse rsync://mirrors.gethosted.online/opensuse
FTP: ftp://mirrors.gethosted.online/opensuse ftp://mirrors.gethosted.online/opensuse
Here are your requirements, fulfilled:
• Admin Name: Get Hosted Online (Craig Fairhurst)
• Admin Email: support@gethosted.online
• Subscribed to mirror@opensuse.org: YES
• Sponsor Name: Get Hosted Online
• Sponsor URL: https://mirrors.gethosted.online/opensuse
• RSYNC URL: rsync://mirrors.gethosted.online/opensuse
• RSYNC allowed only for scans: YES
• HTTP URL: https://mirrors.gethosted.online/opensuse
• FTP URL: ftp://mirrors.gethosted.online/opensuse
• Limitations: unlimited
• IPs and DNS for the whitelist on stage.opensuse.org: 51.195.168.80
This mirror is setup solely for the purpose of mirroring your software so if there is anything you need please don’t hesitate to ask.
Kind regards
Updated by pjessen over 3 years ago
- Category set to Mirrors
- Status changed from New to Feedback
- Assignee set to pjessen
- Private changed from Yes to No
Hello Craig
that's great, many thanks for volunteering your time and resources!
If you can arrange to have the reverse mapping for 51.195.168.80 corrected, I'll update the ACL right away.
Right now I see:
51.195.168.80 -> ip80.ip-51-195-168.eu.
I have added your mirror to our database, but the first scan wasn't quite right:
# mb scan -e gethosted
Wed Nov 18 08:17:07 2020 mirror.gethosted.online: starting
Wed Nov 18 08:17:18 2020 mirror.gethosted.online: total files before scan: 0
mirror.gethosted.online: tag=8 rsync: opendir "/ports/aarch64/distribution" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/aarch64/distribution" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/aarch64/source" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/aarch64/source" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/aarch64/debug/distribution/leap/15.2/repo/oss/repodata" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/aarch64/debug/distribution/leap/15.2/repo/oss/repodata" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/aarch64/debug/distribution/leap/15.2/repo/oss/media.1" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/aarch64/debug/distribution/leap/15.2/repo/oss/media.1" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/aarch64/debug/tumbleweed" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/aarch64/debug/tumbleweed" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/aarch64/tumbleweed" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/aarch64/tumbleweed" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/aarch64/update" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/aarch64/update" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/debug" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/debug" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/armv7hl" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/armv7hl" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/zsystems" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/zsystems" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/update" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/update" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/armv6hl" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/armv6hl" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/ppc" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/ppc" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/ports/riscv" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/ports/riscv" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: tag=8 rsync: opendir "/update" (in opensuse) failed: Permission denied (13)
mirror.gethosted.online: info: rsync: opendir "/update" (in opensuse) failed: Permission denied (13)
(I interrupted the scan at this point).
identifier : mirror.gethosted.online
operatorName : Get Hosted Online
operatorUrl : https://gethosted.online
baseurl : http://mirrors.gethosted.online/opensuse
baseurlFtp :
baseurlRsync : rsync://mirrors.gethosted.online/opensuse
region : eu
country : fr
asn : 16276
prefix : 51.195.0.0/16
lat,lng : 48.858,2.339
regionOnly : False
countryOnly : False
asOnly : False
prefixOnly : False
ipv6Only : False
otherCountries :
fileMaxsize : 0
publicNotes :
score : 100
enabled : False
statusBaseurl : False
admin : Craig Fairhurst
adminEmail : support@gethosted.online
Updated by support@gethosted.online over 3 years ago
Hi
Thanks for the feedback, the IP address has now been updated although it may take some time to be seen to be in effect.
I have run a generic file permission script to rewrite server wide perms (including your opensuse directory) but I can’t see any changes when listing permissions. See below.
[mirrors@server2 public_html]$ ls -l | grep opensuse
drwxr-xr-x 6 mirrors mirrors 4096 Sep 6 2018 opensuse
[mirrors@server2 public_html]$ ls -l opensuse
total 16
drwxr-xr-x 3 mirrors mirrors 4096 May 22 2019 distribution
drwxr-xr-x 7 mirrors mirrors 4096 Jan 10 2020 history
drwxr-xr-x 10 mirrors mirrors 4096 May 25 2018 ports
drwx------ 2 mirrors mirrors 4096 Nov 18 00:33 update
[mirrors@server2 public_html]$ ls -l opensuse/ports
total 32
drwxr-xr-x 7 mirrors mirrors 4096 Sep 11 2017 aarch64
drwx------ 2 mirrors mirrors 4096 Nov 18 07:35 armv6hl
drwx------ 2 mirrors mirrors 4096 Nov 18 07:35 armv7hl
drwx------ 2 mirrors mirrors 4096 Nov 18 07:35 debug
drwx------ 2 mirrors mirrors 4096 Nov 18 07:35 ppc
drwx------ 2 mirrors mirrors 4096 Nov 18 07:35 riscv
drwx------ 2 mirrors mirrors 4096 Nov 18 07:35 update
drwx------ 2 mirrors mirrors 4096 Nov 18 07:35 zsystems
[mirrors@server2 public_html]$c
As you can see, the mirror is denying most folders under opensuse/ports but I believe that this is because —perms is being used via rsync, hence permissions are retained from the mirror. Here is the rsync command I use:
/usr/bin/rsync -aqzH --perms --delete rsync://rsync.opensuse.org/opensuse-full/opensuse/ /home/mirrors/domains/mirrors.gethosted.online/public_html/opensuse
So as you can see, —perms is enabled.
Let me know how to proceed.
Kind regards
Get Hosted Online
Tel: +44 (0)1200 422 533
Web: http://www.gethosted.online
Email: sales@gethosted.online
Updated by pjessen over 3 years ago
support@gethosted.online wrote:
Hi
Thanks for the feedback, the IP address has now been updated although it may take some time to be seen to be in effect.
No prob, I'll add "mirrors.gethosted.online" to the ACL.
/usr/bin/rsync -aqzH --perms --delete rsync://rsync.opensuse.org/opensuse-full/opensuse/ /home/mirrors/domains/mirrors.gethosted.online/public_html/opensuse
So as you can see, —perms is enabled.
Let me know how to proceed.
As soon as your reverse map is updated, I suggest you switch to stage.opensuse.org - I suspect the issue is on rsync.o.o, will have to double check.
I ran another scan and excluding that permissions issues, it looks good:
# mb scan -e gethosted
Wed Nov 18 12:34:29 2020 mirror.gethosted.online: starting
Wed Nov 18 12:34:38 2020 mirror.gethosted.online: total files before scan: 123500
Wed Nov 18 12:43:34 2020 mirror.gethosted.online: scanned 546766 files (1020/s) in 535s
Wed Nov 18 12:43:34 2020 mirror.gethosted.online: files to be purged: 0
Wed Nov 18 12:43:45 2020 mirror.gethosted.online: total files after scan: 546766 (delta: 423266)
Wed Nov 18 12:43:45 2020 mirror.gethosted.online: purged old files in 11s.
Wed Nov 18 12:43:45 2020 mirror.gethosted.online: now enabled.
Wed Nov 18 12:43:45 2020 mirror.gethosted.online: done.
Wed Nov 18 12:43:45 2020 mirror.gethosted.online: testing status of base URL...
Wed Nov 18 12:43:45 2020 mirror.gethosted.online: OK. Mirror is online now.
Completed in 9.3 minutes
Updated by support@gethosted.online over 3 years ago
Ah, ok. I am using —address=IP in rsync which means the .80 address will be used. (not the server IP)
I have removed the opensuse folder and started off a new rsync request via stage server, so will hopefully have this resolved soon.
FYI, I was using mirrorservice.org to pull the data from.
Updated by pjessen over 3 years ago
- Status changed from Feedback to Resolved
- % Done changed from 0 to 100
This is looking good now, thanks.
Updated by support@gethosted.online over 3 years ago
- Status changed from Resolved to New
Updated by support@gethosted.online over 3 years ago
- Status changed from Resolved to New
Updated by support@gethosted.online over 3 years ago
- Status changed from Resolved to New
Updated by support@gethosted.online over 3 years ago
- Status changed from Resolved to New
Updated by support@gethosted.online over 3 years ago
- Status changed from Resolved to New
Updated by support@gethosted.online over 3 years ago
Hi
Small concern, I know the provider of my server (which is UK based) originates from a French company - but the IP information should be that of the UK. For some reason, you are referencing the location of the server as being in France, which is note true! I have requested in the past for various GeoIP databases update the source location of the IP but on this occasion can’t determine who I would contact. Could you update the information as-is on the website infrastructure?
Thank you
Updated by pjessen over 3 years ago
support@gethosted.online wrote:
Hi
Small concern, I know the provider of my server (which is UK based) originates from a French company - but the IP information should be that of the UK. For some reason, you are referencing the location of the server as being in France, which is note true! I have requested in the past for various GeoIP databases update the source location of the IP but on this occasion can’t determine who I would contact. Could you update the information as-is on the website infrastructure?
Hi,
I can confirm your address 51.195.168.80 is indeed in the UK. We are using maxmind for geolocation, have you also been in touch with them? I am unable to update that information manually, maxmind is the authority.
Updated by support@gethosted.online over 3 years ago
Hi
Sorry to bother you about this - however, we have underestimated the size of this mirror! I reconfigured a partition but even at 2.2TB the mirror is not done.
May I suggest shelving this mirror for now and when we have better hardware specs, will pick up on this then.
I trust this is satisfactory.
Kind regards
Get Hosted Online
Tel: +44 (0)1200 422 533
Web: http://www.gethosted.online
Email: sales@gethosted.online
Updated by pjessen over 3 years ago
- Status changed from New to Closed
support@gethosted.online wrote:
Hi
Sorry to bother you about this - however, we have underestimated the size of this mirror! I reconfigured a partition but even at 2.2TB the mirror is not done.
A mirror excluding repositories/ takes up about 2.3Tb of which about half is taking up by debug/.
May I suggest shelving this mirror for now and when we have better hardware specs, will pick up on this then.
No problem, let me know. Happy Christmas!