Updates from the GNOME Sysadmin Team: New Mirroring service, Owncloud 6

2013-12-11 Thread Andrea Veri
Howdy,

it's time for yet another round of updates from the GNOME Sysadmin Team.
This time it's not about future maintenances or outages but about our
completely new mirroring service.

As you may have been aware of GNOME has a lot of mirrors around the world
but we never took advantage of them and kept using our main mirror kindly
served by the Academic Computer Club of the Umea University.
(ftp.acc.umu.sebeing a CNAME to
ftp.gnome.org)

Many mirrors contacted me and the team in the past asking if keeping their
mirror around was worth the disk space they were using for our project
given the very low amount of downloads they were receiving. (that was
expected given download.gnome.org was a plain redirect to ftp.gnome.org,
and thus to ftp.acc.umu.se)

I personally always answered yes, it was worth keeping the GNOME code
synced in as much places in the world as possible but at the same time I
felt that we needed a proper mirroring infrastructure to properly serve the
downloads through all the mirrors that decided to provide disk space and
bandwitdh to support our project.

Looking around and thanks to an Olav Vitter's review we decided to move
forward and setup a Mirrorbrain [1] istance. You can read more about its
features at [2].

After a few days spent making the EPEL packages (Thanks Patrick for the
work you put on reviewing and accepting them!), configuring and tweaking,
our istance is finally live at [3]. As you will see we have plenty of
mirrors based in EU and just one in the US and Asia. I'll be contacting a
few mirrors in those zones and eventually welcome them as new GNOME mirrors
so we can have our downloads served in the fastest way possible even in
remote regions like Australia, Asia and the US itself. (if anyone knows
someone interested in mirroring GNOME sources, please redirect the request
to supp...@gnome.org)

Gving a look at a new indexing table we've introduced on the file indexes
of our main mirror can be a good way to get started to how Mirrorbrain
works behind the scenes. [4] Obviously all the links that existed before
Mirrorbrain are still working just fine but the great difference are them
now being served through Mirrorbrain (which then redirects the user to the
closest mirror through mod_geoip) itself and SSL. Another good way of
testing the whole setup out is by using curl, this way: 'curl -iS
https://download.gnome.org/sources/gnome-terminal/3.11/gnome-terminal-3.11.0.tar.xz.mirrorlist
'

---

Owncloud release 6

The other update I wanted to report is our Owncloud istance [5] being
upgraded to the very latest release being Owncloud 6. As usual please
redirect account requests to me or to supp...@gnome.org directly as
explained at [6].


[1] http://mirrorbrain.org/
[2] http://mirrorbrain.org/features/
[3] https://download.gnome.org/
[4]
https://download.gnome.org/sources/gnome-terminal/3.11/gnome-terminal-3.11.0.tar.xz.mirrorlist
[5] http://cloud.gnome.org/
[6] https://wiki.gnome.org/Sysadmin/Owncloud

-- 
Cheers,

Andrea

Debian Developer,
Fedora / EPEL packager,
GNOME Sysadmin,
GNOME Foundation Membership & Elections Committee Chairman

Homepage: http://www.gnome.org/~av
___
desktop-devel-list mailing list
desktop-devel-list@gnome.org
https://mail.gnome.org/mailman/listinfo/desktop-devel-list

Re: Updates from the GNOME Sysadmin Team: New Mirroring service, Owncloud 6

2013-12-12 Thread Dominique Leuenberger a.k.a. Dimstar

Hi all!

Quoting Andrea Veri :


Howdy,

Looking around and thanks to an Olav Vitter's review we decided to move
forward and setup a Mirrorbrain [1] istance. You can read more about its
features at [2].


Great to hear that an existing solution was found and chosen.


Gving a look at a new indexing table we've introduced on the file indexes
of our main mirror can be a good way to get started to how Mirrorbrain
works behind the scenes. [4] Obviously all the links that existed before
Mirrorbrain are still working just fine but the great difference are them
now being served through Mirrorbrain (which then redirects the user to the
closest mirror through mod_geoip) itself and SSL. Another good way of
testing the whole setup out is by using curl, this way: 'curl -iS
https://download.gnome.org/sources/gnome-terminal/3.11/gnome-terminal-3.11.0.tar.xz.mirrorlist


There might be something not entirely setup yet. Looking at this I get  
11 Mirrors as option, but all of them returned with the same Prio (100)


looking at for example  
http://download.opensuse.org/distribution/13.1/iso/openSUSE-13.1-Addon-NonOss-BiArch-i586-x86_64.iso.mirrorlist (also based on MirrorBrain) the provided mirrors are clearly differently  
prioritized.


Might be worthy to have a look at this.

Dominique
___
desktop-devel-list mailing list
desktop-devel-list@gnome.org
https://mail.gnome.org/mailman/listinfo/desktop-devel-list


Re: Updates from the GNOME Sysadmin Team: New Mirroring service, Owncloud 6

2013-12-12 Thread Andrea Veri
2013/12/12 Dominique Leuenberger a.k.a. Dimstar 
>
> There might be something not entirely setup yet. Looking at this I get 11
> Mirrors as option, but all of them returned with the same Prio (100)
>
> looking at for example http://download.opensuse.org/distribution/13.1/iso/
> openSUSE-13.1-Addon-NonOss-BiArch-i586-x86_64.iso.mirrorlist (also based
> on MirrorBrain) the provided mirrors are clearly differently prioritized.
>
> Might be worthy to have a look at this.
>

Thanks for noticing Dominique, mirrors priorities (Prio) should be actually
tweaked when, for example, a specific mirror (it being on the same country
of the user requesting the file) has more bandwidth or reliability than
another and we might want to prefer a redirect to that specific mirror
which has more chances to serve the file in the fastest way as possible.
That said given I didn't yet have time to investigate the provided
bandwidth for each of the mirrors we use, keeping Prio at 100 for each of
the mirrors will actually result in MirrorBrain randomly selecting one of
the closest mirrors to your area even if that specific mirror has a lower
bandwidth than another one close to you. We might want to tweak this
parameter a bit as soon as I find the time to get more stats about what our
mirrors are providing in terms of bandwidth speed.

Thanks again for reporting and have an awesome day! (/me added a note
accordingly)

-- 
Cheers,

Andrea

Debian Developer,
Fedora / EPEL packager,
GNOME Sysadmin,
GNOME Foundation Membership & Elections Committee Chairman

Homepage: http://www.gnome.org/~av
___
desktop-devel-list mailing list
desktop-devel-list@gnome.org
https://mail.gnome.org/mailman/listinfo/desktop-devel-list