Re: RHEL9 migration

On Mon, Sep 26, 2022 at 02:56:18PM -0700, Kevin Fenzi wrote: > Some of them need applications/packages built for rhel9 and we can't do them > until > that is sorted out: > > badges (hopefully now ongoing?) > notifs (ongoing) > mm- (is mirrormanager2 ready to branch/build for rhel9?) We were

Upcoming MirrorManager changes (removal of Internet2 support)

I will remove Internet2 support from MirrorManager in the next few weeks. The main reason is, that the source for the Internet2 routing tables does not exist any more: http://routes.net.internet2.edu/ It changed a couple of years ago and it seems Fedora was one of the only users of that data.

Re: FBR: Enable CentOS Stream in MirrorManager

On Mon, Sep 06, 2021 at 08:01:40PM +0200, Adrian Reber wrote: > Over the last weeks we prepared adding CentOS Stream to Fedora's > MirrorManager instance and are now at a point where we would like to > push the changes to ansible. > > The current state can be see

FBR: Enable CentOS Stream in MirrorManager

Over the last weeks we prepared adding CentOS Stream to Fedora's MirrorManager instance and are now at a point where we would like to push the changes to ansible. The current state can be seen at: http://mirrors.stg.centos.org/metalink?repo=centos-baseos-9-stream=x86_64 (https just broke over

Re: epel-next and MirrorManager

On Wed, Jun 02, 2021 at 09:21:05AM -0400, Neal Gompa wrote: > On Wed, Jun 2, 2021 at 9:17 AM Adrian Reber wrote: > > > > Recently a bug was opened to add additional repositories to > > MirrorManager for epel-next. One of the problems with adding new > > repository d

epel-next and MirrorManager

Recently a bug was opened to add additional repositories to MirrorManager for epel-next. One of the problems with adding new repository definitions to MirrorManager is that the definitions are part of the code. For each new/changed repository a new release is needed. I was thinking about changing

Re: Another Rust MirrorManager experiment

On Tue, Oct 06, 2020 at 10:38:40AM -0400, Stephen John Smoogen wrote: > On Tue, 6 Oct 2020 at 03:46, Adrian Reber wrote: > > > On Mon, Oct 05, 2020 at 08:30:12AM -0400, Stephen John Smoogen wrote: > > > On Mon, 5 Oct 2020 at 02:24, Adrian Reber wrote: > > >

Re: Mirrorlist bad entry for ftp.icm.edu.pl resulting 404

On Tue, Oct 27, 2020 at 02:11:49PM +0100, Rafal Maszkowski wrote: > On Tue, Oct 27, 2020 at 10:20:08AM +0100, Adrian Reber wrote: > > On Tue, Oct 27, 2020 at 06:29:27AM -, Mariusz Brzezik wrote: > > > Dear community, recently i we faced a errors during machines creation >

Re: Mirrorlist bad entry for ftp.icm.edu.pl resulting 404

On Tue, Oct 27, 2020 at 06:29:27AM -, Mariusz Brzezik wrote: > Dear community, recently i we faced a errors during machines creation phase > due to bad entry for ftp.icm.edu.pl within EPEL mirrorlist. Checked for > CentOS 7 and 8. > > Centos 7 entry giving 404 error: >

Re: Another Rust MirrorManager experiment

On Mon, Oct 05, 2020 at 08:30:12AM -0400, Stephen John Smoogen wrote: > On Mon, 5 Oct 2020 at 02:24, Adrian Reber wrote: > > > On Wed, Jul 01, 2020 at 09:16:05AM -0700, Kevin Fenzi wrote: > > > On Tue, Jun 30, 2020 at 02:17:30PM +0200, Adrian Reber wrote: > > > &

Re: Another Rust MirrorManager experiment

On Wed, Jul 01, 2020 at 09:16:05AM -0700, Kevin Fenzi wrote: > On Tue, Jun 30, 2020 at 02:17:30PM +0200, Adrian Reber wrote: > > On Mon, Jun 15, 2020 at 03:36:23PM -0700, Kevin Fenzi wrote: > > > On Wed, Jun 10, 2020 at 11:09:49AM +0200, Adrian Reber wrote: > > >

Re: Another Rust MirrorManager experiment

On Thu, Jul 02, 2020 at 09:44:10AM +0200, Pierre-Yves Chibon wrote: > On Wed, Jul 01, 2020 at 06:25:47PM +0200, Adrian Reber wrote: > > On Wed, Jul 01, 2020 at 09:16:05AM -0700, Kevin Fenzi wrote: > > > On Tue, Jun 30, 2020 at 02:17:30PM +0200, Adrian Reber wrote: > >

Re: Another Rust MirrorManager experiment

On Wed, Jul 01, 2020 at 09:16:05AM -0700, Kevin Fenzi wrote: > On Tue, Jun 30, 2020 at 02:17:30PM +0200, Adrian Reber wrote: > > On Mon, Jun 15, 2020 at 03:36:23PM -0700, Kevin Fenzi wrote: > > > On Wed, Jun 10, 2020 at 11:09:49AM +0200, Adrian Reber wrote: > > >

Re: Another Rust MirrorManager experiment

On Mon, Jun 15, 2020 at 03:36:23PM -0700, Kevin Fenzi wrote: > On Wed, Jun 10, 2020 at 11:09:49AM +0200, Adrian Reber wrote: > > > > Then I just have to wait a bit. No problem. > > > > > > Having the possibility to generate the mirrorlist input data in about a &

Re: mirrorlist-server fix is in testing

On Thu, Jun 25, 2020 at 04:02:35PM -0700, Kevin Fenzi wrote: > On Wed, Jun 24, 2020 at 06:06:26PM +0200, Adrian Reber wrote: > > Currently there is a bug open against our mirrorlist servers that > > certain locations have trouble, especially with the > > fedora-cisco-openh26

mirrorlist-server fix is in testing

Currently there is a bug open against our mirrorlist servers that certain locations have trouble, especially with the fedora-cisco-openh264 repository, getting a list of up to date mirrors. https://bugzilla.redhat.com/show_bug.cgi?id=1844087 This has been fixed upstream and is available from

Re: Another Rust MirrorManager experiment

On Thu, Jun 04, 2020 at 07:02:41PM -0700, Kevin Fenzi wrote: > On Mon, Jun 01, 2020 at 04:18:35PM +0200, Adrian Reber wrote: > > Our MirrorManager setup exports the current state of all mirrors every > > hour at :30 to a protobuf based file which is then used by the > &g

Another Rust MirrorManager experiment

Our MirrorManager setup exports the current state of all mirrors every hour at :30 to a protobuf based file which is then used by the mirrorlist servers to answer the requests from yum and dnf. The Python script requires up to 10GB of memory and takes between 35 and 50 minutes. The script does a

Re: IAD2 datacenter testing/application validation

On Tue, May 26, 2020 at 03:22:02PM -0700, Kevin Fenzi wrote: > Greetings everyone. > > We now have most things deployed in our new datacenter (IAD2). > > Accordingly, I would like to get some testing and validation started. > > Please see the following document: > >

Re: Issue with Fedora GeoIP service

On Wed, Dec 18, 2019 at 01:29:03PM +0100, Martin Kolman wrote: > On Fri, 2019-12-13 at 09:21 -0800, Kevin Fenzi wrote: > > On Fri, Dec 13, 2019 at 08:00:01AM +0100, Adrian Reber wrote: > > > On Mon, Dec 09, 2019 at 12:19:17PM -0800, Kevin Fenzi wrote: > > > > On S

Re: Update geoip-city

ook. > > On Tue, 31 Mar 2020 at 05:45, Adrian Reber wrote: > > > Attached is the patch to take the upstream update of geoip-city to > > Fedora infrastructure. > > > > I would like to try this first in staging and need some help to run the > > corresponding play

Update geoip-city

2ef Mon Sep 17 00:00:00 2001 From: Adrian Reber Date: Tue, 31 Mar 2020 11:40:40 +0200 Subject: [PATCH] geoip-city-wsgi: update geoip-city-wsgi The geoip-city-wsgi script has been updated upstream to support geoip2 and Python 3. This pulls the update to Fedora infrastructure. Signed-off-by: Adrian Re

Re: [PATCH] s3-mirror: sync s3-sync-path script with ideas from s3.sh

On Fri, Mar 27, 2020 at 05:14:48PM -0700, Kevin Fenzi wrote: > On Fri, Mar 27, 2020 at 12:06:22PM +0100, Pavel Raiskup wrote: > > On Friday, March 27, 2020 11:34:28 AM CET Adrian Reber wrote: > > > The global 'exclude' has '--exclude "*/repodata/*"' and you

Re: [PATCH] s3-mirror: sync s3-sync-path script with ideas from s3.sh

On Fri, Mar 27, 2020 at 05:14:48PM -0700, Kevin Fenzi wrote: > On Fri, Mar 27, 2020 at 12:06:22PM +0100, Pavel Raiskup wrote: > > On Friday, March 27, 2020 11:34:28 AM CET Adrian Reber wrote: > > > The global 'exclude' has '--exclude "*/repodata/*"' and you

Re: [PATCH] s3-mirror: sync s3-sync-path script with ideas from s3.sh

On Fri, Mar 27, 2020 at 12:06:22PM +0100, Pavel Raiskup wrote: > On Friday, March 27, 2020 11:34:28 AM CET Adrian Reber wrote: > > The global 'exclude' has '--exclude "*/repodata/*"' and you are using > > "${excludes[@]}" everywhere. In all three syncs. This loo

Re: [PATCH] s3-mirror: sync s3-sync-path script with ideas from s3.sh

/ > echo "Starting EPEL sync at $(date)" >> /var/log/s3-mirror/timestamps > @@ -132,10 +135,12 @@ for file in $(echo > /srv/pub/fedora/linux/updates/*/*/*/repodata/repomd.xml | sed >aws cloudfront create-invalidation --distribution-id "$DIST_ID" --paths

Re: [PATCH] s3-mirror: avoid potential unexpected shell-expansion, dedup

t; > "$file" > > done > > > > for file in $(echo /srv/pub/epel/7/*/repodata/repomd.xml | sed > > 's#/srv##g'); do > > - aws cloudfront create-invalidation --distribution-id E2KJMDC0QAJDMU > > --paths "$file" > > + aws cloudfront cr

MirrorManager upgraded to 0.13

I have upgraded MirrorManager in staging to 0.12, saw that the webinterface broke, released 0.13, upgraded staging to 0.13 and after seeing that everything still worked I also upgraded the production instance. It contains a couple of small changes which were already active (EPEL 8 modular

Re: Freeze Break Request: s3-mirror adjustments

Looks correct from my point of view, for both scripts we are now doing: 1. sync everything besides repodata 2. sync everything including (or only) repodata 3. invalidate repodata 4. delete files The only problem I can see now is that the files on the master are changing between those steps. Not

Re: Freeze Break Request: s3-mirror adjustments

On Thu, Mar 05, 2020 at 02:39:36PM -0800, Kevin Fenzi wrote: > -CMD="aws s3 sync \ > +# first run do not delete anything or copy the repodata. > +CMD1="aws s3 sync \ > + --exclude */repodata/* \ > + --exclude *.snapshot/* \ > + --exclude

Re: Freeze Break Request: s3-mirror adjustments

The only thing which is not clear in the documentation is when the delete is happening. With rsync there is an option '--delete-after' to make sure first all files are transferred and deletion happens afterwards. If 'aws s3 sync' does the deletion during or before all files are transferred you

Re: Issue with Fedora GeoIP service

On Mon, Dec 09, 2019 at 12:19:17PM -0800, Kevin Fenzi wrote: > On Sat, Dec 07, 2019 at 09:39:46AM -0500, Kevin Sandy wrote: > > I have an updated copy working with geoip2, with the exception of area code > > data (which isn’t included in the new database). But if I’m understanding > > it’s

Re: New mirrorlist server implementation

ct.org/updates/FEDORA-2019-48a3fc7eb5 > > On Tue, Oct 8, 2019 at 8:53 AM Igor Gnatenko > wrote: > > > > I'll try to package new Rust implementation in Fedora :) > > > > And thanks for working on this! > > > > On Tue, Oct 8, 2019 at 8:52 AM Adria

Re: Mirrorlist server bug report - behaviour change requested

On Mon, Nov 11, 2019 at 02:15:03PM +0100, Adrian Reber wrote: > I was contacted by someone working on openSUSE's Open Build System > (OBS). They are using download.fedoraproject.org and some layout change > concerning noarch breaks their workflow. The problem is, that the > redi

Mirrorlist server bug report - behaviour change requested

I was contacted by someone working on openSUSE's Open Build System (OBS). They are using download.fedoraproject.org and some layout change concerning noarch breaks their workflow. The problem is, that the redirect service of download.fedoraproject.org based on the mirrorlist servers returns a 200

Re: [FBR 0/1] Enable new mirrorlist server on proxy14

everything to the new code-base. Adrian On Wed, Oct 16, 2019 at 10:50:08AM +0200, Adrian Reber wrote: > This is a freeze break request to enable the new mirrorlist server on > proxy14 as discussed on the mailing list. > > I hope my conditionals are correct for the Ansibl

Re: [FBR 1/1] Enable new mirrorlist server on proxy14

On Wed, Oct 16, 2019 at 03:37:17PM -0400, Randy Barlow wrote: > On Wed, 2019-10-16 at 10:50 +0200, Adrian Reber wrote: > > {% if env == "staging" or inventory_hostname == > > "proxy14.fedoraproject.org" %} > > Rather than inlining host names like this, wh

Re: [FBR 0/1] Enable new mirrorlist server on proxy14

On Wed, Oct 16, 2019 at 10:21:46AM -0400, Randy Barlow wrote: > On Wed, 2019-10-16 at 10:50 +0200, Adrian Reber wrote: > > This is a freeze break request to enable the new mirrorlist server on > > proxy14 as discussed on the mailing list. > > Would it be feasible to wait unt

Re: [FBR 1/1] Enable new mirrorlist server on proxy14

On Wed, Oct 16, 2019 at 10:02:09AM -0700, Kevin Fenzi wrote: > On Wed, Oct 16, 2019 at 10:50:09AM +0200, Adrian Reber wrote: > > After a successful test of the new mirrorlist server code in staging, > > this is the next step. Try to make it work in production on one of

[FBR 1/1] Enable new mirrorlist server on proxy14

was never using the new data during the last few months. Signed-off-by: Adrian Reber --- roles/mirrormanager/backend/files/backend.cron| 8 +--- .../backend/templates/sync_pkl_to_mirrorlists.sh | 2 +- roles/mirrormanager/mirrorlist_proxy/tasks/main.yml | 2

[FBR 0/1] Enable new mirrorlist server on proxy14

the playbook, proxy14 should be removed from DNS to make sure, that the old mirrorlist containers are correctly stopped and deleted and that the new mirrorlist containers are correctly running. Adrian Reber (1): Enable new mirrorlist server on proxy14 roles/mirrormanager/backend/files/backend.cron

Re: New mirrorlist server implementation

On Mon, Oct 14, 2019 at 07:42:30AM -0700, Kevin Fenzi wrote: > On Mon, Oct 14, 2019 at 08:53:26AM -0400, Stephen John Smoogen wrote: > > On Mon, 14 Oct 2019 at 03:39, Adrian Reber wrote: > > > > I would say proxy14. It should have ipv6 and is not a OMG we broke > >

Re: New mirrorlist server implementation

On Tue, Oct 08, 2019 at 08:38:18AM -0700, Kevin Fenzi wrote: > On Tue, Oct 08, 2019 at 08:42:13AM +0200, Adrian Reber wrote: > > After the Fedora 31 freeze I would like to introduce this new mirrorlist > > server implementation on the proxies. I already verified that I can run >

Re: New mirrorlist server implementation

On Tue, Oct 08, 2019 at 08:38:18AM -0700, Kevin Fenzi wrote: > On Tue, Oct 08, 2019 at 08:42:13AM +0200, Adrian Reber wrote: > ...snip... > > > > After the Fedora 31 freeze I would like to introduce this new mirrorlist > > server implementation on the proxies. I already

Re: FBR: clean up disk space on mirrors

On Tue, Mar 26, 2019 at 12:59:16PM -0400, Stephen John Smoogen wrote: > On Tue, 26 Mar 2019 at 11:48, Adrian Reber wrote: > > > > On Mon, Mar 25, 2019 at 04:28:09PM -0400, Stephen John Smoogen wrote: > > > On Mon, 25 Mar 2019 at 16:01, Mohan Boddu wrote: > > > &g

Re: FBR: clean up disk space on mirrors

On Mon, Mar 25, 2019 at 04:28:09PM -0400, Stephen John Smoogen wrote: > On Mon, 25 Mar 2019 at 16:01, Mohan Boddu wrote: > > > > On Mon, Mar 25, 2019 at 8:37 AM Stephen John Smoogen > > wrote: > >> > >> 1. Remove F29beta from mirrors so mirrors can keep up > >>

Re: mirrorlist server with Python3

On Sun, Feb 17, 2019 at 04:07:46PM +0100, Adrian Reber wrote: > The latest release of MirrorManager2 is still in updates-testing. I did > not want to push this version to updates-released because this is the > first Python3 based released. > > Could someone test the version from

mirrorlist server with Python3

The latest release of MirrorManager2 is still in updates-testing. I did not want to push this version to updates-released because this is the first Python3 based released. Could someone test the version from updates-testing? Update the mirrorlist container and test it on one of the proxies?

[release] MirrorManager2: 0.9.0

A new release of MirrorManager2 is available: 0.9.0 - crawler: Correctly calculate the remaining time https://github.com/fedora-infra/mirrormanager2/pull/244 - repomap: more modular repository detection logic https://github.com/fedora-infra/mirrormanager2/pull/243 - crawler: correctly handle

Re: MirrorManager changes - report_mirror

On Fri, Sep 28, 2018 at 11:42:02AM -0500, Jason L Tibbitts III wrote: > >>>>> "AR" == Adrian Reber writes: > > AR> I would like to ignore report_mirror results for non-private mirrors > AR> in the future. > > I don't really see why this would h

MirrorManager changes - report_mirror

During the last months most mirror problems have been related to report_mirror reporting that mirrors are up to date and the crawler then marking the mirror as not up to date. Which resulted in mirrors being added and removed from the mirrorlist every few hours. As the crawler normally sees what

MirrorManager 29 redirects removed

Now that MirrorManager detected the newly created Fedora 29 repositories, I removed the repository redirects from 29 to rawhide and I added new redirects from 30 to rawhide. Adrian signature.asc Description: PGP signature ___

Re: FBR: Change to category based crawling

On Thu, Apr 19, 2018 at 08:54:21AM +0200, Adrian Reber wrote: > As discussed previously I would like to change the crawler to crawl each > category separately. The goal is to reduce the load on the database by > distributing the crawling better over the whole day and to reduce the

Re: FBR: Change to category based crawling

On Thu, Apr 19, 2018 at 08:54:21AM +0200, Adrian Reber wrote: > As discussed previously I would like to change the crawler to crawl each > category separately. The goal is to reduce the load on the database by > distributing the crawling better over the whole day and to reduce the

FBR: Change to category based crawling

2001 From: Adrian Reber <adr...@lisas.de> Date: Tue, 17 Apr 2018 19:42:16 +0200 Subject: [PATCH] mirror crawler: crawl each category separately This is the first try to split up the mirror crawling by category. One of the goals is to better distribute the load on the database. If this actually

Re: Planned MirrorManager changes

On Sat, Apr 14, 2018 at 04:28:37PM -0700, Kevin Fenzi wrote: > > I would like to change the setup of our mirror crawler and just wanted > > to mention my planned changes here before working on them. > > > > Currently we have two VMs which are crawling our mirrors. Each of the > > machine is

Re: Planned MirrorManager changes

On Sat, Apr 14, 2018 at 12:37:24AM +, Stephen John Smoogen wrote: > On Fri, Apr 13, 2018 at 11:14 AM Adrian Reber <adr...@lisas.de> wrote: > > > I would like to change the setup of our mirror crawler and just wanted > > to mention my planned changes her

Planned MirrorManager changes

I would like to change the setup of our mirror crawler and just wanted to mention my planned changes here before working on them. Currently we have two VMs which are crawling our mirrors. Each of the machine is responsible for one half of the active mirrors. The crawl starts every 12 hours on

Re: FBR: add exclude to mirror crawler

Pushed and live on both MM crawlers. Adrian On Thu, Mar 08, 2018 at 04:37:41PM +0100, Adrian Reber wrote: > The rsync based crawler has two excludes hardcoded: > > cmd = "rsync --temp-dir=/tmp -r --exclude=.snapshot --exclude='*.~tmp~'" > > I am just

FBR: add exclude to mirror crawler

The rsync based crawler has two excludes hardcoded: cmd = "rsync --temp-dir=/tmp -r --exclude=.snapshot --exclude='*.~tmp~'" I am just in discussions with a new mirror and the rsync based crawler fails there with: rsync: opendir "/lost+found" (in epel) failed: Permission denied (13) To avoid

[release] MirrorManager2: 0.8.4

A new release of MirrorManager2 is available: 0.8.4 - Correctly handle Fedora 28 modular layout https://github.com/fedora-infra/mirrormanager2/pull/242 - Use "site", "host" and "mirror" consistently https://github.com/fedora-infra/mirrormanager2/pull/241 - crawler: support https only hosts

[PATCH] Added script to check age of mirrorlist pkl

) $ ./check_mirrorlist_pkl_age.py 14 5000 7000 OK: up-to-date mirrorlist data on proxy14 (3921s) $ ./check_mirrorlist_pkl_age.py 08 2000 3000 CRIT: mirrorlist data on proxy08 older than 3000s (3938s) Signed-off-by: Adrian Reber <adr...@lisas.de> --- .../nagios/plugins/check_mirrorlist_pkl_age.py

Script to check mirrorlist age

The following patch would add a script to check for the age of the mirrorlist servers. If somebody could add the necessary nagios configuration to let this run against the proxies I would add this script to the repository. The script makes it easy to verify that the mirrorlist containers have

Re: FBR: Updating MirrorManager to 0.8.3

On Wed, Sep 27, 2017 at 08:20:51AM +0200, Adrian Reber wrote: > The new MirrorManager2 0.8.3 release correctly detects and creates > repositories for the newly created 'modular' tree: > > /srv/pub/fedora/linux/modular/ > > I have installed the new release in staging and

FBR: Updating MirrorManager to 0.8.3

The new MirrorManager2 0.8.3 release correctly detects and creates repositories for the newly created 'modular' tree: /srv/pub/fedora/linux/modular/ I have installed the new release in staging and it works correctly. The changes between MirrorManager2 0.8.1 which is installed in production and

[release] MirrorManager2: 0.8.3

On Tue, Sep 26, 2017 at 08:18:21AM +0200, Adrian Reber wrote: > A new release of MirrorManager2 is available: 0.8.2 > > - detect and setup mirrorlist/metalinks for modular Fedora > https://github.com/fedora-infra/mirrormanager2/pull/220 > - umdl: only create repositories

[release] MirrorManager2: 0.8.2

A new release of MirrorManager2 is available: 0.8.2 - detect and setup mirrorlist/metalinks for modular Fedora https://github.com/fedora-infra/mirrormanager2/pull/220 - umdl: only create repositories for 'Everything' https://github.com/fedora-infra/mirrormanager2/pull/219 - Correctly detect

Re: [release] MirrorManager2: 0.8

On Fri, Jun 16, 2017 at 03:26:42PM +0200, Adrian Reber wrote: > A new release of MirrorManager2 is available: 0.8 > > - Specify rel="noopener noreferrer" to link including target='_blank' > - Improve the runserver script > - Make the propagation script more robust >

[release] MirrorManager2: 0.8

A new release of MirrorManager2 is available: 0.8 - Specify rel="noopener noreferrer" to link including target='_blank' - Improve the runserver script - Make the propagation script more robust - crawler: also crawl https-only mirrors https://github.com/fedora-infra/mirrormanager2/issues/183 -

Re: fedora/linux/development/25

On Tue, Jan 17, 2017 at 09:20:41AM -0600, Dennis Gilmore wrote: > El lun, 16-01-2017 a las 09:53 +0100, Adrian Reber escribió: > > For some time now mirrormanager points to fedora/linux/releases/25 > > for all > > the categories 'Fedora Linux' and 'Fedora Secondary Arches

fedora/linux/development/25

For some time now mirrormanager points to fedora/linux/releases/25 for all the categories 'Fedora Linux' and 'Fedora Secondary Arches'. The files at fedora/linux/development/25 could now be deleted. At least from MirrorManager's point of view. Adrian signature.asc Description:

Re: mirror lists plan

On Tue, Sep 13, 2016 at 12:05:27PM -0600, Kevin Fenzi wrote: > Greetings. > > We currently have 3 lists associated with mirrors. 2 of them are still > located at redhat.com and we want to move them over to our > infrastructure. > > mirror-adm...@lists.fedoraproject.org It actually is

Re: Proposal to mirror Docker images

On Thu, Sep 01, 2016 at 10:49:15AM -0400, Colin Walters wrote: > On Tue, Aug 16, 2016, at 11:33 AM, Randy Barlow wrote: > > > > In summary, the proposal is to write a patch for the docker client that > >

Re: Mirrormanager doesn't provide F25 x86_64 debuginfo mirror for updates repository

On Wed, Aug 31, 2016 at 09:31:43PM -, Christian Stadelmann wrote: > I'm trying to report a bug in a package (gnome-settings-daemon) and it would > be useful to have debuginfo for this package. When running `dnf > debuginfo-install gnome-settings-daemon`, I'm getting an error that the >

[release] MirrorManager2: 0.7.3

A new release of MirrorManager2 is available: 0.7.3 * Thu Jun 23 2016 Adrian Reber <adr...@lisas.de> - 0.7.3-1 - Update to 0.7.3 - Allow submission of checkin information via json (Patrick Uiterwijk) https://github.com/fedora-infra/mirrormanager2/issues/170 - Add logging to checki

Re: [ansible] Disable crawler and automatic pkl push before the release

eb5 > > commit 8e83d2cc8f827e6124ac698aef37ec123e9f3eb5 > Author: Adrian Reber <adr...@lisas.de> > Date: Tue Jun 21 11:53:39 2016 + > > Disable crawler and automatic pkl push before the release > > To better control what is available on the mirrorlist servers the > cronjob

Re: Failed to synchronize cache for repo 'fedora', disabling.

On Fri, May 27, 2016 at 11:12:39AM -0600, Kevin Fenzi wrote: > On Fri, 27 May 2016 10:35:43 +0200 > Adrian Reber <adr...@lisas.de> wrote: > > > I wrote details about this in the above mentioned issue. I am not > > convinced it is a MirrorManager bug. I

Re: Failed to synchronize cache for repo 'fedora', disabling.

On Thu, May 26, 2016 at 09:14:55AM -0600, Kevin Fenzi wrote: > On Thu, 26 May 2016 06:11:57 -0400 (EDT) > Jun Aruga wrote: > > > Hi, > > > > I got an error in mock building in my environment for fedora-rawhide > > from today. Yesterday I could do mock building. My colleague

Re: RFC: Fedora Scale-Out Docker Registry Proposal

On Tue, May 10, 2016 at 08:52:00AM -0400, Stephen John Smoogen wrote: > On 10 May 2016 at 03:02, Adrian Reber <adr...@lisas.de> wrote: > > On Mon, May 09, 2016 at 01:49:26PM -0600, Kevin Fenzi wrote: > >> On Fri, 6 May 2016 17:30:18 -0500 > >> Adam Miller <

Re: RFC: Fedora Scale-Out Docker Registry Proposal

On Mon, May 09, 2016 at 01:49:26PM -0600, Kevin Fenzi wrote: > On Fri, 6 May 2016 17:30:18 -0500 > Adam Miller wrote: > > ...snip... > > > > > Proposal: > > > > Pulp[1] + Crane[2] + MirrorManager[3] + Docker Distribution[4] > > Are all of these packaged up? For

Re: [ansible] Remove mirror01.prgmr.com, it's now the same as mirror.prgmr.com

On Tue, Apr 19, 2016 at 10:55:12AM -0600, Kevin Fenzi wrote: > On Fri, 15 Apr 2016 18:46:02 +0200 > Adrian Reber <adr...@lisas.de> wrote: > > > These diffs of the rsync ACLs are not very useful. For me it is almost > > impossible to see if and what has cha

Re: [ansible] Remove mirror01.prgmr.com, it's now the same as mirror.prgmr.com

On Fri, Apr 15, 2016 at 02:01:34PM +, Nick Bebout wrote: > diff --git a/roles/rsyncd/files/rsyncd.conf.download-ibiblio > b/roles/rsyncd/files/rsyncd.conf.download-ibiblio > index 15375aa..478bf48 100644 > --- a/roles/rsyncd/files/rsyncd.conf.download-ibiblio > +++

Re: Can not download repomd.xml for rawhide-source repo.

On Wed, Mar 30, 2016 at 02:52:02AM -0400, Jun Aruga wrote: > > > https://mirrors.fedoraproject.org/metalink?repo=rawhide-source=x86_64, > > > and downloaded "metalink" text file by my Firefox. Though several > > > link sites were "not found 404" for the repomd.xml. I could find one > > > available

Re: a new MirrorManager-related tool for stripping old metadata and pushing critical updates in a defined time

On Mon, Feb 08, 2016 at 07:43:14AM -0500, Kamil Paral wrote: > > On Fri, Jan 08, 2016 at 02:40:52PM -0500, Patrick Uiterwijk wrote: > > > > 3. The tool will go through all metalinks for f23-updates (all primary > > > > architectures), and drop each section which has > > > > older than the

Re: a new MirrorManager-related tool for stripping old metadata and pushing critical updates in a defined time

On Fri, Jan 08, 2016 at 02:40:52PM -0500, Patrick Uiterwijk wrote: > > 3. The tool will go through all metalinks for f23-updates (all primary > > architectures), and drop each section which has > > older than the provided date (let's say midnight UTC). > > Please note that there are no metalink

Re: isn't mirrormanager smarter than this?

On Thu, Jan 28, 2016 at 08:41:19AM -0500, Matthew Miller wrote: > I'm getting 404 errors from several places to which mirrormanager wants > to send me to get > https://download.fedoraproject.org/pub/alt/atomic/stable/Cloud-Images/x86_64/Images/Fedora-Cloud-Atomic-23-20160127.x86_64.qcow2 >

host_category_url_private

This is mainly a question for Matt. Currently it seems there is a problem with newly added private mirrors that they never seem to appear in the mirrorlist. I am tracking this for the last few weeks, but I have not found the cause for this yet. As this problem does not yet seem very widely spread

Re: host_category_url_private

On Mon, Dec 14, 2015 at 01:48:33PM +0100, Adrian Reber wrote: > This is mainly a question for Matt. > > Currently it seems there is a problem with newly added private mirrors > that they never seem to appear in the mirrorlist. I am tracking this for > the last few weeks, but I

Re: Freeze Break Request: Increase number of children for mirrorlist-server

On Thu, Oct 15, 2015 at 09:50:03AM -0600, Kevin Fenzi wrote: > +1 here, but could we also increase the processes on the wsgi to 60 at > the same time? Like this: diff --git a/inventory/group_vars/mirrorlist2 b/inventory/group_vars/mirrorlist2 index 42138a3..f0d5655 100644 ---

Freeze Break Request: Increase number of children for mirrorlist-server

. Adrian commit 2b8e284e687d097c2cad6cd24dc3db3aa23f837d Author: Adrian Reber <adr...@lisas.de> Date: Thu Oct 15 14:03:02 2015 + Increase the number of possible child processes The mirrorlist-server is the process which has the mirrorlist data loaded and

Re: Freeze Break Request: Increase number of children for mirrorlist-server

On Thu, Oct 15, 2015 at 06:33:22PM +0200, Pierre-Yves Chibon wrote: > On Thu, Oct 15, 2015 at 06:08:15PM +0200, Adrian Reber wrote: > > On Thu, Oct 15, 2015 at 09:50:03AM -0600, Kevin Fenzi wrote: > > > +1 here, but could we also increase the processes on the wsgi to 60 at &

Re: Master and mirror crawling

On Sat, Sep 12, 2015 at 12:52:55PM -0600, Kevin Fenzi wrote: > > On Fri, Sep 11, 2015 at 04:56:41PM +0200, Adrian Reber wrote: > > [...] > > > So my main question is if we should insert a delay between umdl and > > > the crawl of the mirrors? This would require a f

Freeze break request: s3sync

This is a try to fix the s3sync on mm-backend01. I have tested the script and it successfully syncs the content to S3. I have, however, not tested if the ansible rules work. Please have a look at following patch and if the ansible rules are correct. In addition to this patch it is necessary to

Re: Freeze break request: decrease number of crawlers to 29

On Wed, Jul 29, 2015 at 01:48:57PM -0600, Kevin Fenzi wrote: On Wed, 29 Jul 2015 21:24:02 +0200 Adrian Reber adr...@lisas.de wrote: Can I get two +1's for: +1. Thanks Kevin and Pierre. Pushed. Also, if we want, I could also give them another 32GB memory... Either that or we can

MM related changes

477f2ac02e30be805eacffda47c7c926f25bc892 Author: Adrian Reber adr...@lisas.de Date: Fri Jun 12 08:20:24 2015 + The crawler logs are now on mm-crawler01 diff --git a/roles/httpd/reverseproxy/templates/reversepassproxy.mirrormanager.conf b/roles/httpd/reverseproxy/templates/reversepassproxy.mirrormanager.conf index 44987a1

Re: MM related changes

On Fri, Jun 12, 2015 at 11:13:28AM +0200, Pierre-Yves Chibon wrote: ProxyPass {{localpath}} {{proxyurl}}{{remotepath}} ProxyPassReverse {{localpath}} {{proxyurl}}{{remotepath}} commit 8e09f5a37620c52265aa83305c99173f9e982d76 Author: Adrian Reber adr...@lisas.de Date: Fri Jun 12 08

Re: MM related changes

On Fri, Jun 12, 2015 at 09:47:34AM -0600, Kevin Fenzi wrote: These changes look ok to me. ;) Thanks, for the reviews. I will commit them and somebody needs to run the corresponding playbooks. Related however, what is our plan for crawlers currently? We are only going to use mm-crawler01?

Re: [release] MirrorManager2: 0.2.0

header file in MM2 itself (Adrian Reber) - Support always update hosts which are unreachable in the crawler (Adrian Reber) - Adjust the spec file to the systemd packaging guidelines for Fedora - Multiple improvements to the crawler, including a start of a canary mode (Adrian Reber) - Offer

[adr...@fedoraproject.org: [ansible] Re-enable /mirrormanager without slash at the end]

This change still needs a playbook to be run. If this change is correct it would be great if someone could run the playbook. Thanks. Adrian - Forwarded message from Adrian Reber adr...@fedoraproject.org - Date: Sun, 31 May 2015 09:30:09 + (UTC) From: Adrian Reber adr

[piotr.mal...@grupaonet.pl: New public mirror Fedora PL.]

There is a fix missing, I think for varnish, to make the mirrormanager flask application work without a '/' at the end. Would be good if this could be added. I changed the MirrorManager instructions in the wiki to point to the correct URL to avoid troubles like this. Adrian -

  1   2   >