tickets #125666
opensource not available in tumbleweed snapshots
Added by JoeS about 1 year ago. Updated about 1 year ago.
0%
Description
Hi,
Could you please look at fixing the permissions on the "history"
repositories?
Browsing packages from these locations work fine
https://download.opensuse.org/tumbleweed/repo/src-oss/
https://download.opensuse.org/tumbleweed/repo/src-non-oss/
Browsing packages from these locations produce a 403 Access Forbidden! error
https://download.opensuse.org/history/20230131/tumbleweed/repo/src-oss
https://download.opensuse.org/history/20230131/tumbleweed/repo/src-non-oss
Thanks very much!
--
Regards,
Joe
Updated by pjessen about 1 year ago
- Subject changed from Permissions error on download.opensuse.org to Permissions error on htp://download.opensuse.org/history
- Status changed from New to Feedback
- Private changed from Yes to No
Hi Joe
Browsing packages from these locations produce a 403 Access Forbidden! error
https://download.opensuse.org/history/20230131/tumbleweed/repo/src-oss
https://download.opensuse.org/history/20230131/tumbleweed/repo/src-non-oss
Those both gave me a 404, but these two worked fine:
https://download.opensuse.org/history/20230215/tumbleweed/repo/src-oss
https://download.opensuse.org/history/20230215/tumbleweed/repo/src-non-oss
Updated by pjessen about 1 year ago
- Category set to Core services and virtual infrastructure
- Status changed from Feedback to New
pjessen wrote:
https://download.opensuse.org/history/20230215/tumbleweed/repo/src-oss
https://download.opensuse.org/history/20230215/tumbleweed/repo/src-non-oss
Correction - no they didn't, I got a 403 on the source and the debug directories.
They are in fact symlinks to non-existent locations:
pontifex2 (download.o.o):/srv/ftp/pub/opensuse/history/20230215/tumbleweed/repo # l
total 8
drwxrwxr-x 4 tumbleweed-snapshot tumbleweed-snapshot 98 Oct 28 2015 ./
drwxrwxr-x 3 tumbleweed-snapshot tumbleweed-snapshot 25 Nov 30 10:42 ../
lrwxrwxrwx 20 tumbleweed-snapshot tumbleweed-snapshot 31 Oct 28 2015 debug -> ../../debug/tumbleweed/repo/oss
drwxr-xr-x 8 tumbleweed-snapshot tumbleweed-snapshot 4096 Feb 16 18:32 non-oss/
drwxr-xr-x 11 tumbleweed-snapshot tumbleweed-snapshot 4096 Feb 16 18:52 oss/
lrwxrwxrwx 20 tumbleweed-snapshot tumbleweed-snapshot 36 Oct 28 2015 src-non-oss -> ../../source/tumbleweed/repo/non-oss
lrwxrwxrwx 20 tumbleweed-snapshot tumbleweed-snapshot 32 Oct 28 2015 src-oss -> ../../source/tumbleweed/repo/oss
Updated by JoeS about 1 year ago
Hi pjessen,
Thanks for getting back to me!
In case you are not aware, TW keeps the last 20 builds in the history
folders which are used by the tumbleweed-cli package.
Browsing source packages from the normal TW repos works fine
https://download.opensuse.org/tumbleweed/repo/src-oss/
https://download.opensuse.org/tumbleweed/repo/src-non-oss/
Somewhere around the 20230131 timeframe I started getting the 403 errors
when trying to access the src-oss and src-non-oss folders of some of the
history folders
Build 20230307 now gives those 403 errors
https://download.opensuse.org/history/20230307/tumbleweed/repo/src-oss
https://download.opensuse.org/history/20230307/tumbleweed/repo/src-non-oss
I had assumed that it was just a permission issue but since they are
pointing to non-existent folders, it would appear that around the time
of build 20230131 someone decided that for the history folders they
would only copy the oss and non-oss folders and stop copying the src-oss
and src-non-oss folders for those 20 builds.
Now we are at the point where more than 20 new builds have occurred
since 20230131 was released so all of the 20 history folders no longer
provide access to the source for those builds.
I'm not sure why that changed, maybe there were disk space issues which
caused that decision to be made.
It was nice to have access to those 2 src folders for debugging purposes.
The solution would be to copy those 2 folders ( src-oss and src-non-oss
) when the new build history folder is created but I'm not what the real
reason is that they stopped doing this.
Joe
Updated by pjessen about 1 year ago
- Subject changed from Permissions error on htp://download.opensuse.org/history to Permissions error on http://download.opensuse.org/history
JoeS wrote:
In case you are not aware, TW keeps the last 20 builds in the history
folders which are used by the tumbleweed-cli package.
Yup, I'm aware.
Browsing source packages from the normal TW repos works fine
https://download.opensuse.org/tumbleweed/repo/src-oss/
https://download.opensuse.org/tumbleweed/repo/src-non-oss/
The issue is in the directory structure - you don't see it above, but those two are symlinked to
https://download.opensuse.org/source/tumbleweed/repo/oss/
https://download.opensuse.org/source/tumbleweed/repo/non-oss/
Somewhere around the 20230131 timeframe I started getting the 403 errors
when trying to access the src-oss and src-non-oss folders of some of the
history foldersBuild 20230307 now gives those 403 errors
https://download.opensuse.org/history/20230307/tumbleweed/repo/src-oss
https://download.opensuse.org/history/20230307/tumbleweed/repo/src-non-oss
They all will - the symlinks are being copied, that is all.
I'm guessing it is giving a 403 because Apache is not permitted/configured to follow symlinks.
I had assumed that it was just a permission issue but since they are
pointing to non-existent folders, it would appear that around the time
of build 20230131 someone decided that for the history folders they
would only copy the oss and non-oss folders and stop copying the src-oss
and src-non-oss folders for those 20 builds.
The copy is fine, the snapshots are exact copies, including the exact symlinks. That is the problem - to copy the contents of the symlinked directories would require more effort. It is possible the process was changed, I dunno.
Updated by JoeS about 1 year ago
The issue is in the directory structure - you don't see it above, but those two are symlinked to
Right, I understand everything you are saying. Originally from the outside it looked like a permissions issue but I now see that the symlinks are just being copied.
The copy is fine, the snapshots are exact copies, including the exact symlinks. That is the problem - to copy the contents of the symlinked directories would require more
effort. It is possible the process was changed, I dunno.
Yes, I'd stay the process has changed.
When I first noticed the issue you could download source from the older build folders in history, just not the latest one or two.
I suspect they were previously copying and changed to the symlinks and when they did that, we not longer had the source for the history builds and fast forward 20+ builds and now all 20 history folders have the symlinks so nothing is available.
Certainly was useful at times to be able to go back and get that source for those older builds but I'm guessing that someone decided it was not worth continuing to do so.
Joe
Updated by pjessen about 1 year ago
- Subject changed from Permissions error on http://download.opensuse.org/history to source not available in tumbleweed snapshots
I have to leave it at that - if someone changed the process, he or she will hopefully chime in to explain why.