Copr to use primary Fedora download location
Hi, right now Copr is using stock mock, with its default configuration. Which means that Copr builders are downloading packages from Fedora mirrors. I find this sub-optimal, because: * sometimes is mirror little bit off-sync and occasionally this result in failed builds. * while mirrors are generally good thing, primary Fedora servers are AFAIK just few racks away from Copr. In term of measurable data it is 100 ms of ping vs. 4 ms of ping. Therefore I plan to replace: metalink=https://mirrors.fedoraproject.org/metalink?repo=fedora-$releasever&arch=$basearch in mock config with: baseurl=http://dl.fedoraproject.org/pub/fedora/linux/releases/$releasever/Everything/$basearch/os/ and similary for epel, rawhide and F21. But before I proceed, would like to ask if this is ok? Or should I rather not use dl.f.o for some reason? -- Miroslav Suchy, RHCE, RHCDS Red Hat, Senior Software Engineer, #brno, #devexp, #fedora-buildsys ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Copr to use primary Fedora download location
Additionally I would like to do the same for Centos. Before I ask CentOS guys... do we have somewhere in our datacenter copy of CentoOS repo? If not, I'm not sure if I would like to rsync everything. Maybe rather just setup squid. -- Miroslav Suchy, RHCE, RHCDS Red Hat, Senior Software Engineer, #brno, #devexp, #fedora-buildsys ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: [RFR #4562] Koschei - continuous integration in Koji
On 10/16/2014 05:51 PM, Kevin Fenzi wrote: > And deps are then checked when something updates in a group and the > rest of the group rebuilt? or can you explain when a scratch build is > fired? Strictly speaking scratch build is scheduled when all the following conditions are met: * package has the highest priority from all packages known to Koschei, * priority is above some threshold (configurable), * Koji load is below some threshold (configurable, 50 % ATM), * number of currently running Koji taks started by Koschei is below some threshold (also configurable, currently 50 concurrent tasks). Package priority depends on several fatcors (time since last rebuild, dependency changes, package state, package importance and more). For more information about priority see [1]. From higher-level perspective, with current settings package will be rebuilt when: * at least build-dependency changes, or * one week passes since last successful build or scratch build, or * someone (currently only admin) requests immediate rebuild. [1] https://fedoraproject.org/wiki/Koschei#Priority -- Mikolaj Izdebski Software Engineer, Red Hat IRC: mizdebsk ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
package changes and comps
Hi Not sure whether fedmsg or something else can handle this but throwing it out there if anyone is interested. I just split up a package which is listed in comps.xml and it would have been quite easy to miss adding the sub package (deja-dup-nautilus in this case) and new users wouldn't get the nautilus extension. IIRC this happened with file-roller earlier. Would it be feasible to check when spec file changes intro a new sub package, verify that the package is listed in comps and send a note to the package maintainer reminding them about potential changes they might need to make in comps? Also when someone is introducing a new package, a similar note would be useful Rahul ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Copr to use primary Fedora download location
On Fri, Oct 17, 2014 at 10:16:14AM +0200, Miroslav Suchý wrote: > Hi, > right now Copr is using stock mock, with its default configuration. > Which means that Copr builders are downloading packages from Fedora mirrors. > * while mirrors are generally good thing, primary Fedora servers are AFAIK > just few racks away from Copr. In term of measurable data it is 100 ms of > ping vs. 4 ms of ping. > > Therefore I plan to replace: > > metalink=https://mirrors.fedoraproject.org/metalink?repo=fedora-$releasever&arch=$basearch > in mock config with: > > baseurl=http://dl.fedoraproject.org/pub/fedora/linux/releases/$releasever/Everything/$basearch/os/ > > and similary for epel, rawhide and F21. Wouldn't it be better to configure MirrorManager to return primary sites to hosts belonging to Fedora Infra? -- Tomasz Torcz "Never underestimate the bandwidth of a station xmpp: zdzich...@chrome.plwagon filled with backup tapes." -- Jim Gray ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
MM2/Ansible FAD (was FAS3/MM2 FAD)
As was discussed in a previous thread, the FAD was slightly reorganized to continue to cover (1) MirrorManager 2 work, and (2) based on available people, Ansible playbook migration. Thank you to pingou and others for organization efforts and willingness to help! mattdm gave his +1 for the FAD, and rsuehle has said she can support the budget, with the caveat that we Red Hatters hold off expensing our USA airfares until ~December 1, so they will hit the OSAS budget in Red Hat's fiscal Q4. This is something we can handle administratively within Red Hat, just noted here for transparency. If any of the travelers don't know what this means, please contact me off-list and I'll be glad to explain and help with planning. If possible, I'll try to drive down for at least one day of the FAD event, to see you guys and pitch in. -- Paul W. Frieldshttp://paul.frields.org/ gpg fingerprint: 3DA6 A0AC 6D58 FEC4 0233 5906 ACDB C937 BD11 3717 http://redhat.com/ - - - - http://pfrields.fedorapeople.org/ The open source story continues to grow: http://opensource.com ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Copr to use primary Fedora download location
On Fri, Oct 17, 2014 at 02:39:46PM +0200, Tomasz Torcz wrote: > > > > baseurl=http://dl.fedoraproject.org/pub/fedora/linux/releases/$releasever/Everything/$basearch/os/ > > and similary for epel, rawhide and F21. > Wouldn't it be better to configure MirrorManager to return primary sites > to hosts belonging to Fedora Infra? This should just be a matter of our team configuring our mirrors in mirrormanager to know to prioritize our networks, right? (It has that feature, I know.) -- Matthew Miller Fedora Project Leader ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Freeze Break request: switch nightly check/diff back to run each playbook
On Thu, Oct 16, 2014 at 09:22:31AM -0600, Kevin Fenzi wrote: > Greetings. > > In puppet commit a9d2e61de5413edf297bd594051905e661760d0d I changed the > nightly ansible check/diff cron job to just use the master playbook > instead of doing each playbook on it's own. > > Turns out this has a few downsides: > > * If the execution fails somewhere, the run stops and it never runs on > the playbooks after the one that failed. > > * Our logging/reporting looks at the playbook name that was run, so it > lumps all of them into 'master.yml' and it's harder to see what > playbooks have changed or failed items in them. > > I'd like to just revert this commit. > > +1s? +1 here pgpBMWtXlBdUH.pgp Description: PGP signature ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Freeze Break: add some playbooks to rbac-playbook
On Thu, Oct 16, 2014 at 09:17:52AM -0600, Kevin Fenzi wrote: > Greetings. > > vgologuz has been reworking the copr ansible playbooks. Before we had > some host playbooks that had all the logic in them. Now, we will have > some group ones that use roles properly, etc. > > I'd like to add the new group playbooks to rbac-playbook so he can run > them and test with them. > > copr is not frozen, but lockbox01 is, so thats why I ask. > > kevin > -- > +'groups/copr-frontend.yml': ['sysadmin-cloud'], > +'groups/copr-backend.yml': ['sysadmin-cloud'], > +'groups/copr-keygen.yml': ['sysadmin-cloud'], > Yup, yup. +1 here. pgpAZZ4CCGmy5.pgp Description: PGP signature ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Copr to use primary Fedora download location
On Fri, 17 Oct 2014 10:53:44 -0400 Matthew Miller wrote: > On Fri, Oct 17, 2014 at 02:39:46PM +0200, Tomasz Torcz wrote: > > > > > > baseurl=http://dl.fedoraproject.org/pub/fedora/linux/releases/$releasever/Everything/$basearch/os/ > > > and similary for epel, rawhide and F21. > > Wouldn't it be better to configure MirrorManager to return > > primary sites to hosts belonging to Fedora Infra? > > This should just be a matter of our team configuring our mirrors in > mirrormanager to know to prioritize our networks, right? (It has that > feature, I know.) Yep. I can (and will) just set the default for our private cloud to use the master mirrors. It should take effect in an hour or two. So, no need to change anything in copr for that... Smooge was working on some kind of centos mirror/sync, but I don't know the status off hand of that, so will wait for him to chime in on it. It's kind of increasingly seeming like we should look at just officially mirroring centos for various projects. kevin signature.asc Description: PGP signature ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Freeze Break request: switch nightly check/diff back to run each playbook
Applied. Thanks. kevin signature.asc Description: PGP signature ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Freeze Break: add some playbooks to rbac-playbook
Applied. Thanks. kevin signature.asc Description: PGP signature ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Copr to use primary Fedora download location
On 10/17/2014 06:02 PM, Kevin Fenzi wrote: Yep. I can (and will) just set the default for our private cloud to use the master mirrors. It should take effect in an hour or two. Great. Thanks. Mirek ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
