https://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842023-03-09T07:01:25ZopenSUSE Project Management ToolopenSUSE admin - tickets #125666: source not available in tumbleweed snapshotshttps://progress.opensuse.org/issues/125666?journal_id=6110002023-03-09T07:01:25Zpjessenper@computer.org
<ul><li><strong>Subject</strong> changed from <i>Permissions error on download.opensuse.org</i> to <i>Permissions error on htp://download.opensuse.org/history</i></li><li><strong>Status</strong> changed from <i>New</i> to <i>Feedback</i></li><li><strong>Private</strong> changed from <i>Yes</i> to <i>No</i></li></ul><p>Hi Joe</p>
<blockquote>
<p>Browsing packages from these locations produce a 403 Access Forbidden! error<br>
<a href="https://download.opensuse.org/history/20230131/tumbleweed/repo/src-oss" class="external">https://download.opensuse.org/history/20230131/tumbleweed/repo/src-oss</a><br>
<a href="https://download.opensuse.org/history/20230131/tumbleweed/repo/src-non-oss" class="external">https://download.opensuse.org/history/20230131/tumbleweed/repo/src-non-oss</a></p>
</blockquote>
<p>Those both gave me a 404, but these two worked fine:</p>
<p><a href="https://download.opensuse.org/history/20230215/tumbleweed/repo/src-oss" class="external">https://download.opensuse.org/history/20230215/tumbleweed/repo/src-oss</a><br>
<a href="https://download.opensuse.org/history/20230215/tumbleweed/repo/src-non-oss" class="external">https://download.opensuse.org/history/20230215/tumbleweed/repo/src-non-oss</a></p>
openSUSE admin - tickets #125666: source not available in tumbleweed snapshotshttps://progress.opensuse.org/issues/125666?journal_id=6110062023-03-09T07:06:27Zpjessenper@computer.org
<ul><li><strong>Category</strong> set to <i>Core services and virtual infrastructure</i></li><li><strong>Status</strong> changed from <i>Feedback</i> to <i>New</i></li></ul><p>pjessen wrote:</p>
<blockquote>
<p><a href="https://download.opensuse.org/history/20230215/tumbleweed/repo/src-oss" class="external">https://download.opensuse.org/history/20230215/tumbleweed/repo/src-oss</a><br>
<a href="https://download.opensuse.org/history/20230215/tumbleweed/repo/src-non-oss" class="external">https://download.opensuse.org/history/20230215/tumbleweed/repo/src-non-oss</a></p>
</blockquote>
<p>Correction - no they didn't, I got a 403 on the source and the debug directories. <br>
They are in fact symlinks to non-existent locations:</p>
<pre><code>pontifex2 (download.o.o):/srv/ftp/pub/opensuse/history/20230215/tumbleweed/repo # l
total 8
drwxrwxr-x 4 tumbleweed-snapshot tumbleweed-snapshot 98 Oct 28 2015 ./
drwxrwxr-x 3 tumbleweed-snapshot tumbleweed-snapshot 25 Nov 30 10:42 ../
lrwxrwxrwx 20 tumbleweed-snapshot tumbleweed-snapshot 31 Oct 28 2015 debug -> ../../debug/tumbleweed/repo/oss
drwxr-xr-x 8 tumbleweed-snapshot tumbleweed-snapshot 4096 Feb 16 18:32 non-oss/
drwxr-xr-x 11 tumbleweed-snapshot tumbleweed-snapshot 4096 Feb 16 18:52 oss/
lrwxrwxrwx 20 tumbleweed-snapshot tumbleweed-snapshot 36 Oct 28 2015 src-non-oss -> ../../source/tumbleweed/repo/non-oss
lrwxrwxrwx 20 tumbleweed-snapshot tumbleweed-snapshot 32 Oct 28 2015 src-oss -> ../../source/tumbleweed/repo/oss
</code></pre> openSUSE admin - tickets #125666: source not available in tumbleweed snapshotshttps://progress.opensuse.org/issues/125666?journal_id=6115162023-03-09T13:56:11ZJoeS
<ul></ul><p>Hi pjessen,</p>
<p>Thanks for getting back to me!</p>
<p>In case you are not aware, TW keeps the last 20 builds in the history <br>
folders which are used by the tumbleweed-cli package.</p>
<p>Browsing source packages from the normal TW repos works fine</p>
<p><a href="https://download.opensuse.org/tumbleweed/repo/src-oss/" class="external">https://download.opensuse.org/tumbleweed/repo/src-oss/</a><br>
<a href="https://download.opensuse.org/tumbleweed/repo/src-non-oss/" class="external">https://download.opensuse.org/tumbleweed/repo/src-non-oss/</a></p>
<p>Somewhere around the 20230131 timeframe I started getting the 403 errors <br>
when trying to access the src-oss and src-non-oss folders of some of the <br>
history folders</p>
<p>Build 20230307 now gives those 403 errors</p>
<p><a href="https://download.opensuse.org/history/20230307/tumbleweed/repo/src-oss" class="external">https://download.opensuse.org/history/20230307/tumbleweed/repo/src-oss</a><br>
<a href="https://download.opensuse.org/history/20230307/tumbleweed/repo/src-non-oss" class="external">https://download.opensuse.org/history/20230307/tumbleweed/repo/src-non-oss</a></p>
<p>I had assumed that it was just a permission issue but since they are <br>
pointing to non-existent folders, it would appear that around the time <br>
of build 20230131 someone decided that for the history folders they <br>
would only copy the oss and non-oss folders and stop copying the src-oss <br>
and src-non-oss folders for those 20 builds.</p>
<p>Now we are at the point where more than 20 new builds have occurred <br>
since 20230131 was released so all of the 20 history folders no longer <br>
provide access to the source for those builds.</p>
<p>I'm not sure why that changed, maybe there were disk space issues which <br>
caused that decision to be made.</p>
<p>It was nice to have access to those 2 src folders for debugging purposes.</p>
<p>The solution would be to copy those 2 folders ( src-oss and src-non-oss <br>
) when the new build history folder is created but I'm not what the real <br>
reason is that they stopped doing this.</p>
<p>Joe</p>
openSUSE admin - tickets #125666: source not available in tumbleweed snapshotshttps://progress.opensuse.org/issues/125666?journal_id=6115792023-03-09T16:52:26Zpjessenper@computer.org
<ul><li><strong>Subject</strong> changed from <i>Permissions error on htp://download.opensuse.org/history</i> to <i>Permissions error on http://download.opensuse.org/history</i></li></ul><p>JoeS wrote:</p>
<blockquote>
<p>In case you are not aware, TW keeps the last 20 builds in the history <br>
folders which are used by the tumbleweed-cli package.</p>
</blockquote>
<p>Yup, I'm aware. </p>
<blockquote>
<p>Browsing source packages from the normal TW repos works fine</p>
<p><a href="https://download.opensuse.org/tumbleweed/repo/src-oss/" class="external">https://download.opensuse.org/tumbleweed/repo/src-oss/</a><br>
<a href="https://download.opensuse.org/tumbleweed/repo/src-non-oss/" class="external">https://download.opensuse.org/tumbleweed/repo/src-non-oss/</a></p>
</blockquote>
<p>The issue is in the directory structure - you don't see it above, but those two are symlinked to</p>
<p><a href="https://download.opensuse.org/source/tumbleweed/repo/oss/" class="external">https://download.opensuse.org/source/tumbleweed/repo/oss/</a><br>
<a href="https://download.opensuse.org/source/tumbleweed/repo/non-oss/" class="external">https://download.opensuse.org/source/tumbleweed/repo/non-oss/</a></p>
<blockquote>
<p>Somewhere around the 20230131 timeframe I started getting the 403 errors <br>
when trying to access the src-oss and src-non-oss folders of some of the <br>
history folders</p>
<p>Build 20230307 now gives those 403 errors</p>
<p><a href="https://download.opensuse.org/history/20230307/tumbleweed/repo/src-oss" class="external">https://download.opensuse.org/history/20230307/tumbleweed/repo/src-oss</a><br>
<a href="https://download.opensuse.org/history/20230307/tumbleweed/repo/src-non-oss" class="external">https://download.opensuse.org/history/20230307/tumbleweed/repo/src-non-oss</a></p>
</blockquote>
<p>They all will - the symlinks are being copied, that is all. <br>
I'm guessing it is giving a 403 because Apache is not permitted/configured to follow symlinks. </p>
<blockquote>
<p>I had assumed that it was just a permission issue but since they are <br>
pointing to non-existent folders, it would appear that around the time <br>
of build 20230131 someone decided that for the history folders they <br>
would only copy the oss and non-oss folders and stop copying the src-oss <br>
and src-non-oss folders for those 20 builds.</p>
</blockquote>
<p>The copy is fine, the snapshots are exact copies, including the exact symlinks. That is the problem - to copy the contents of the symlinked directories would require more effort. It is possible the process was changed, I dunno.</p>
openSUSE admin - tickets #125666: source not available in tumbleweed snapshotshttps://progress.opensuse.org/issues/125666?journal_id=6115912023-03-09T20:06:05ZJoeS
<ul></ul><blockquote>
<blockquote>
<p>The issue is in the directory structure - you don't see it above, but those two are symlinked to</p>
</blockquote>
</blockquote>
<p>Right, I understand everything you are saying. Originally from the outside it looked like a permissions issue but I now see that the symlinks are just being copied.</p>
<blockquote>
<blockquote>
<p>The copy is fine, the snapshots are exact copies, including the exact symlinks. That is the problem - to copy the contents of the symlinked directories would require more<br>
effort. It is possible the process was changed, I dunno.</p>
</blockquote>
</blockquote>
<p>Yes, I'd stay the process has changed.</p>
<p>When I first noticed the issue you could download source from the older build folders in history, just not the latest one or two.</p>
<p>I suspect they were previously copying and changed to the symlinks and when they did that, we not longer had the source for the history builds and fast forward 20+ builds and now all 20 history folders have the symlinks so nothing is available.</p>
<p>Certainly was useful at times to be able to go back and get that source for those older builds but I'm guessing that someone decided it was not worth continuing to do so.</p>
<p>Joe</p>
openSUSE admin - tickets #125666: source not available in tumbleweed snapshotshttps://progress.opensuse.org/issues/125666?journal_id=6118342023-03-10T09:29:00Zpjessenper@computer.org
<ul><li><strong>Subject</strong> changed from <i>Permissions error on http://download.opensuse.org/history</i> to <i>source not available in tumbleweed snapshots</i></li></ul><p>I have to leave it at that - if someone changed the process, he or she will hopefully chime in to explain why. </p>