https://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842021-05-05T14:39:25ZopenSUSE Project Management ToolopenSUSE admin - tickets #92173: poor quality of mirrors in Brazilhttps://progress.opensuse.org/issues/92173?journal_id=4041522021-05-05T14:39:25Zpjessenper@computer.org
<ul><li><strong>Private</strong> changed from <i>Yes</i> to <i>No</i></li></ul><p>Just a couple of minor comments - </p>
<ul>
<li>many countries have few or no mirrors, in South America as well as in Europe.</li>
<li>requests always go to download.o.o (mirrorbrain) in Nürnberg first, then they are redirected.</li>
</ul>
<p>To improve on the level or quality of national mirrors, we are 100% reliant on the respective national communities promoting it.</p>
<p>"Route BR to US, not DE" ? I'm not sure if I understand what that means. For the time being, we only have one mirrorbrain instance. Technically, there is nothing preventing us from setting up a few instances, strategically placed around the world, with anycast DNS - it is only a matter of resources. </p>
openSUSE admin - tickets #92173: poor quality of mirrors in Brazilhttps://progress.opensuse.org/issues/92173?journal_id=4041552021-05-05T14:52:36Zavicenzi
<ul></ul><p>Sure, a lot of countries do not have the size and problems that Brazil has with infra.</p>
<p>The "Route BR to US, not DE" would be to send BR requests (metadata and download) to US and not Nuremberg, but I'm not sure if that is possible.</p>
<p>One of the biggest issues that I heard from some people is either, the content is not available in Brazil, there's only one TW mirror, and the other is that this routing to DE is costly in Brazil, due to latency and distancy, which will happen very frequently if the content is not in Brazil.</p>
<p>On the "we are 100% reliant on the respective national communities promoting it", that's not a major problem, I started to promote it and I already got two possible sponsors.</p>
<p>I strongly believe that we will have two new mirrors in Brazil by the end of May, and I will try to also host a mirrorcache instance in one of these.</p>
openSUSE admin - tickets #92173: poor quality of mirrors in Brazilhttps://progress.opensuse.org/issues/92173?journal_id=4041582021-05-05T15:07:30Zpjessenper@computer.org
<ul></ul><p>Space needed, from <a href="https://mirrors.opensuse.org/list/rsyncinfo-stage.o.o.txt" class="external">https://mirrors.opensuse.org/list/rsyncinfo-stage.o.o.txt</a></p>
<p>rsync modules and size of stage.opensuse.org:</p>
<p>opensuse-ports 4.40T<br>
opensuse-full 3.53T<br>
opensuse-full-with-factory 3.06T<br>
opensuse-full-with-factory-dvd5 3.06T<br>
opensuse-full-really-everything 8.62T<br>
opensuse-full-really-everything-including-repositories 28.20T<br>
opensuse-updates 596.85G<br>
buildservice-repos 6.57T<br>
buildservice-repos-main 3.16T<br>
opensuse-source 518.15G<br>
opensuse-debug 1.18T<br>
opensuse-history 1.92T</p>
openSUSE admin - tickets #92173: poor quality of mirrors in Brazilhttps://progress.opensuse.org/issues/92173?journal_id=4041702021-05-05T16:26:19Zpjessenper@computer.org
<ul></ul><p>avicenzi wrote:</p>
<blockquote>
<p>The "Route BR to US, not DE" would be to send BR requests (metadata and download) to US and not Nuremberg, but I'm not sure if that is possible.</p>
</blockquote>
<p>Metadata - without multiple mirrorbrains, that isn't possible.<br>
Download - if Brazilian clients are being given German mirrors, maybe that is something in the mirrorbrain selection algorithm. I don't know if mirrorbrain sees one continent as being different to another. I think mirrorbrain can decide available mirrors by "network proximity", so if US mirrors are better connected to Brazil, that ought to work. </p>
<blockquote>
<p>On the "we are 100% reliant on the respective national communities promoting it", that's not a major problem, I started to promote it and I already got two possible sponsors.</p>
</blockquote>
<p>That's very cool, more mirrors are always welcome. I think we used to have more in South America, but they slowly went inactive. </p>
openSUSE admin - tickets #92173: poor quality of mirrors in Brazilhttps://progress.opensuse.org/issues/92173?journal_id=4049952021-05-07T08:47:20Zavicenzi
<ul></ul><p>Binario Cloud agreed to give a server and space to host an openSUSE mirror.<br>
The VM is 1 cpu 2 gb RAM, 1TB storage, 100mbit transfer, no hard data cap on transfer.<br>
They agreed to monitor how we grow and adjust to our needs if needed.<br>
This will be valid for 1 year, with the possibility to extend.</p>
<p>UFSC (University of Santa Catarina), also agreed to host a mirror, but I don't have details on how much storage it will be available.<br>
UFSC is waiting for a containerized solution that can run on Swarm.<br>
I started to work on it and I'll use Binario mirror as a test for my docker images.<br>
Once it's working I'll ask UFSC to deploy to their infra.</p>
openSUSE admin - tickets #92173: poor quality of mirrors in Brazilhttps://progress.opensuse.org/issues/92173?journal_id=4052382021-05-07T12:53:04Zpjessenper@computer.org
<ul></ul><p>avicenzi wrote:</p>
<blockquote>
<p>Binario Cloud agreed to give a server and space to host an openSUSE mirror.<br>
The VM is 1 cpu 2 gb RAM, 1TB storage, 100mbit transfer, no hard data cap on transfer.<br>
They agreed to monitor how we grow and adjust to our needs if needed.<br>
This will be valid for 1 year, with the possibility to extend.</p>
<p>UFSC (University of Santa Catarina), also agreed to host a mirror, but I don't have details on how much storage it will be available.<br>
UFSC is waiting for a containerized solution that can run on Swarm.<br>
I started to work on it and I'll use Binario mirror as a test for my docker images.<br>
Once it's working I'll ask UFSC to deploy to their infra.</p>
</blockquote>
<p>That's very cool - when you're ready, I'll just need some details for creating them, see <br>
<a href="https://en.opensuse.org/openSUSE:Mirror_infrastructure#Registering_your_mirror" class="external">https://en.opensuse.org/openSUSE:Mirror_infrastructure#Registering_your_mirror</a></p>
<p>One comment - 100Mbit isn't very much, but it depends on the local demand. </p>
openSUSE admin - tickets #92173: poor quality of mirrors in Brazilhttps://progress.opensuse.org/issues/92173?journal_id=4052472021-05-07T12:57:50Zavicenzi
<ul></ul><p>pjessen wrote:</p>
<blockquote>
<p>One comment - 100Mbit isn't very much, but it depends on the local demand.</p>
</blockquote>
<p>Well, it will be limited by disc speeds, as I said, they are willing to upgrade if needed, but first, we need metrics to know how bad or good the current setup is.</p>
openSUSE admin - tickets #92173: poor quality of mirrors in Brazilhttps://progress.opensuse.org/issues/92173?journal_id=4052922021-05-07T13:55:02Zpjessenper@computer.org
<ul></ul><p>avicenzi wrote:</p>
<blockquote>
<p>pjessen wrote:</p>
<blockquote>
<p>One comment - 100Mbit isn't very much, but it depends on the local demand.</p>
</blockquote>
<p>Well, it will be limited by disc speeds, as I said, they are willing to upgrade if needed, but first, we need metrics to know how bad or good the current setup is.</p>
</blockquote>
<p>We can probably get some data from the download.o.o logs, at least to see what sort of demand we are looking at.</p>
openSUSE admin - tickets #92173: poor quality of mirrors in Brazilhttps://progress.opensuse.org/issues/92173?journal_id=5842032022-12-12T16:22:18Zavicenzi
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Resolved</i></li><li><strong>% Done</strong> changed from <i>0</i> to <i>100</i></li></ul><p>Over the last year, we made many improvements in Brazil's infra. The most significant changes were announced here <a href="https://news.opensuse.org/2022/11/02/significant-improvements-in-brazil-south-america-mirror-infra/" class="external">1</a>.</p>
<p>Brazil now has two mirrorcache instances, one downloadcontent for proxy cache, and a few new mirrors.</p>
<p>I consider the original problem solved, and the community seems happy with the recent changes.</p>