Re: Fedora Cloud questions and proposal

2015-04-13 Thread Miroslav Suchý
On 04/10/2015 06:04 PM, Kevin Fenzi wrote:
> I think it might be a good idea to have some swift space setup, but I
> am not sure what use cases we fully have for it, so I would say it
> should be somewhat small. 100GB or something? 
> This would also be backed by the equalogics? Or would it be
> distributed on the nodes?

Swift have built-in split/replica mechanism. So I think that with this size, I 
can steal some space from vg_server of nodes.

> Are there specific cases where live migrations would help us out a lot?

I do not know. Cold migration last several minutes. I agree that we can afford 
it. We are not bank or stock operator
where every outage cost pile of money.

-- 
Miroslav Suchy, RHCA
Red Hat, Senior Software Engineer, #brno, #devexp, #fedora-buildsys
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Freeze break request: update python-bugzilla on bodhi*

2015-04-13 Thread Patrick Uiterwijk
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

Hi,

Red Hat Bugzilla got upgraded to a version that no longer
has the Bug.get_bugs API call.
There is a new python-bugzilla available that uses the new
Bug.get call instead.
Staging bodhi* has been upgraded last friday to use the new
python-bugzilla.

I would like +1s to upgrade python-bugzilla in production,
since Red Hat Bugzilla has been upgraded and as such attaching
bugs to updates is currently broken.

With kind regards,
Patrick Uiterwijk
-BEGIN PGP SIGNATURE-
Version: GnuPG v1

iQIcBAEBCgAGBQJVK8hJAAoJEIZXmA2atR5QYcAQAKNHg8QNRDNniqdkaFzEMPPI
RAX5jcbTe8o2kaz2ztFTlthNLW2qfVIamylOlCQRansbdyT6RVBntYEDHraMEVvf
Izv1Hx1wkzPh9EUaeKX7ZmZtmruBV+yKEBH5kRqQZRB5D2o6HE0KTZo26W98z1aI
jfv89jn778K3GS2BW3w2gEHUuQQtym0GQJCvluwP93IchltW8Ud5R8f+5JIa2EPY
N5p/zlBEB4sKvKil7NnXlFHpB1w01Ygc+Xb0MGWHgSG5ONKALNem1a1nJ++nVXDv
v8bQWm8pSw5lQI9cM31yMowOolg1WYqY+zE31qdPqx4F1V9JzoK3mvYZ9qfOl4Dp
pz4RFnfCqbLzFqScj+jeAJ41k1WetrhqfzGr6wWXpS+bTZJH7bTKGqP68sG6YZPJ
kB9PL3lpcg2CCAuVUiaJqfLmhBj0X4Mns4gPiZaZ8w3uRjQji2U8b3EHTyoAlUeC
3vnvAcrc/ZVbiK5hbkVsVXEx1rFJHeq5YEH0CHMHanBTVx7CPzAX5EaHeioOXggE
nOf/CS3+qsyskRSJuAsQB3T0tiPbcGdBxLuzwjBTu+dgck37f6i3jXcvjTai8oHl
KeZ2ICZ3ywHjvJOwvP40oxJE1P3MF3+lk8/YpXcgZu6CYrwpXne0J9JdV1otuNCv
K2ZgBYS7ZCXaO2gYqJLN
=/QsT
-END PGP SIGNATURE-
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Re: Freeze break request: update python-bugzilla on bodhi*

2015-04-13 Thread Kevin Fenzi
On Mon, 13 Apr 2015 15:44:42 +0200
Patrick Uiterwijk  wrote:

> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA512
> 
> Hi,
> 
> Red Hat Bugzilla got upgraded to a version that no longer
> has the Bug.get_bugs API call.
> There is a new python-bugzilla available that uses the new
> Bug.get call instead.
> Staging bodhi* has been upgraded last friday to use the new
> python-bugzilla.
> 
> I would like +1s to upgrade python-bugzilla in production,
> since Red Hat Bugzilla has been upgraded and as such attaching
> bugs to updates is currently broken.

+1. 

We may well run into further issues, but this is the first step. 

kevin


pgpFtEXExnbUr.pgp
Description: OpenPGP digital signature
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Re: Fedora Cloud questions and proposal

2015-04-13 Thread Kevin Fenzi
On Mon, 13 Apr 2015 09:56:26 +0200
Miroslav Suchý  wrote:

> On 04/10/2015 06:04 PM, Kevin Fenzi wrote:
> > I think it might be a good idea to have some swift space setup, but
> > I am not sure what use cases we fully have for it, so I would say it
> > should be somewhat small. 100GB or something? 
> > This would also be backed by the equalogics? Or would it be
> > distributed on the nodes?
> 
> Swift have built-in split/replica mechanism. So I think that with
> this size, I can steal some space from vg_server of nodes.

Yeah. Or perhaps somewhat bigger would make sense? 500G? 

> > Are there specific cases where live migrations would help us out a
> > lot?
> 
> I do not know. Cold migration last several minutes. I agree that we
> can afford it. We are not bank or stock operator where every outage
> cost pile of money.

Yeah. The one place I thought might be nice was if we wanted to reboot
a compute node to update it, but then I got to thinking, why shouldn't
we also just reboot the instances too and update them as well? ;) 

kevin




pgpM_GFlHsHil.pgp
Description: OpenPGP digital signature
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Re: Freeze break request: update python-bugzilla on bodhi*

2015-04-13 Thread Pierre-Yves Chibon
On Mon, Apr 13, 2015 at 03:44:42PM +0200, Patrick Uiterwijk wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA512
> 
> Hi,
> 
> Red Hat Bugzilla got upgraded to a version that no longer
> has the Bug.get_bugs API call.
> There is a new python-bugzilla available that uses the new
> Bug.get call instead.
> Staging bodhi* has been upgraded last friday to use the new
> python-bugzilla.
> 
> I would like +1s to upgrade python-bugzilla in production,
> since Red Hat Bugzilla has been upgraded and as such attaching
> bugs to updates is currently broken.
> 
+1 as well

Pierre


pgpwWoQ5zeIDS.pgp
Description: PGP signature
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Re: [Freeze Break] elections 2.5.1

2015-04-13 Thread Patrick Uiterwijk
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

On Mon, Apr 13, 2015 at 04:07:38PM +0200, Pierre-Yves Chibon wrote:
> Hi all,
> 
> Elections runs into some DB troubles once in a while with a lot of queries
> running.
> I am not yet sure what is the root cause but one step that might already
> mitigate this problem is closing the DB session after the request.
> 
> I opened a pull-request for this:
> https://github.com/fedora-infra/elections/pull/41
> 
> and since it is the first change since the last release, I would like to ask 
> for
> a freeze break to cut and push a new release.

+1 from me

> 
> 
> Thanks,
> Pierre
-BEGIN PGP SIGNATURE-
Version: GnuPG v1

iQIcBAEBCgAGBQJVK85CAAoJEIZXmA2atR5QvQcP/10FzQ9+/tpB8PP/CWYSOjzG
jXMo1T+iCUadF4cgyiutkHdAE+uYYR8L5vhvxMyr5/GcHZbOWNQbjq78IoAwz6Lp
fqhLBrnm4bUhWHlT0AdCMpTJKSraRgxr025CFCTqLFEYUR5Jxb39OHmyAsbswLF8
QIktF3hJS8Pih2VBuAUb6ZaiPF/56yGe8V0KIRiwUlltS3/7qBYM1ciZlPY5dUAj
DB6KtPFc94m0AozY1vdgL0jhFDIKYYRnJW1ppDVlGcjm+6gY7I6z4Rn1rAbzmI0M
xsMQ2hsdBIKo+1b+J2oP4XZ6B3jgpKSnbGKMoF86ptTASx73hTeRtL2eNN8+8tP5
tlGpXzisXzCKNRDFB8z435edwFjoW9GFqEW4EC5sbYjqaJG7y8i5E41jlN4xxHVB
1dlHTUl8IhWJ/80uWddSOhScsKnZGvyv7Ktd85U1FeA9941j9TlD1ztb2kv+6HTa
t5fHH18PPqjexy0SYEwMXc0SItNkYTM75c1WtOowlTbX4gJ/dIuuwYJNg19cEkeR
Wa49kGY2r8snSnSwej4It9pr/fETKYJhrqcp1p7hF6UYIbDubPr3UAtWlPgEnpTn
vnzdn34NCrm3MbTapMSpwA8ralqDR+F5h+FG960AIyP3rS5+IcWpwgHQXHV5YtOo
g03lzjkdTY8h69f7vYko
=nlKi
-END PGP SIGNATURE-
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Re: [Freeze Break] elections 2.5.1

2015-04-13 Thread Kevin Fenzi
+1 here. No elections right now, so should be a fine time. 

kevin


pgpHfBwAsGEQ7.pgp
Description: OpenPGP digital signature
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

[release] MirrorManager2: 0.0.7

2015-04-13 Thread Pierre-Yves Chibon
Hi all,

I just cut a new mirrormanager2 release: 0.0.7 and push it to staging. This
might help with the occasional apache failure I have seen.

There were no changes to mirrorlist, but the new rpm is in the main infra repo,
so beware if you run yum update on these hosts before freeze.

Here is the changelog:

* Mon Apr 13 2015 Pierre-Yves Chibon  - 0.0.7-1
- Update to 0.0.7
- Add missing import on mm2_update-EC2-netblocks
- Have the cron jobs running under a ``mirrormanager`` user (Adrian Reber)
- Update the last_crawled and last_crawled_duration correctly (Adrian Reber)
- Fix systemd's tempfile.conf for mirrormanager2
- Fix link to the crawler log file (Adrian Reber)
- Close per thread logging correctly (Adrian Reber)
- Add more informations to the log output (Adrian Reber)
- Start crawling the hosts which require the most time (Adrian Reber)
- Filters the hosts to crawl at the DB level to save time and memory (Adrian
  Reber)
- Fix the xmlrpc endpoint (Adrian Reber)
- Adjust Build Requires to include systemd-devel instead of just systemd
- Close session at the end and make the session permanent
- Add new columns to the host table to store extra infos (Adrian Reber)
- Use urllib2 instead of urlgrabber in the crawler (Adrian Reber)
- Fix crawler timeout (Adrian Reber)
- run_rsync() returns a temporary file which needs to be closed (Adrian Reber)


Pierre


pgpw9U3KXFonT.pgp
Description: PGP signature
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

[Freeze Break] elections 2.5.1

2015-04-13 Thread Pierre-Yves Chibon
Hi all,

Elections runs into some DB troubles once in a while with a lot of queries
running.
I am not yet sure what is the root cause but one step that might already
mitigate this problem is closing the DB session after the request.

I opened a pull-request for this:
https://github.com/fedora-infra/elections/pull/41

and since it is the first change since the last release, I would like to ask for
a freeze break to cut and push a new release.


Thanks,
Pierre


pgpj4Lab7qw1e.pgp
Description: PGP signature
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

[release] elections: 2.5.1

2015-04-13 Thread Pierre-Yves Chibon
Hi all,

So following on the freeze break I just cut and push a new elections release:
2.5.1

Here is its changelog:
* Mon Apr 13 2015 Pierre-Yves Chibon  - 2.5.1-1
- Update to 2.5.1
- Close the DB connection at the end of the request


Let's see if that helps at the DB level.

Pierre


pgpX4eU5WU2pV.pgp
Description: PGP signature
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Re: Freeze break request: update python-bugzilla on bodhi*

2015-04-13 Thread Tim Flink
On Mon, 13 Apr 2015 15:44:42 +0200
Patrick Uiterwijk  wrote:

> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA512
> 
> Hi,
> 
> Red Hat Bugzilla got upgraded to a version that no longer
> has the Bug.get_bugs API call.
> There is a new python-bugzilla available that uses the new
> Bug.get call instead.
> Staging bodhi* has been upgraded last friday to use the new
> python-bugzilla.
> 
> I would like +1s to upgrade python-bugzilla in production,
> since Red Hat Bugzilla has been upgraded and as such attaching
> bugs to updates is currently broken.

+1 - the update been working fine in blockerbugs-stg since last
Wednesday

Is blockerbugs included in the list of systems to update to the new
version of python-bugzilla?

Tim


pgppbDMYm_Mot.pgp
Description: OpenPGP digital signature
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Re: Freeze break request: update python-bugzilla on bodhi*

2015-04-13 Thread Kevin Fenzi
On Mon, 13 Apr 2015 09:13:01 -0600
Tim Flink  wrote:

> On Mon, 13 Apr 2015 15:44:42 +0200
> Patrick Uiterwijk  wrote:
> 
> > -BEGIN PGP SIGNED MESSAGE-
> > Hash: SHA512
> > 
> > Hi,
> > 
> > Red Hat Bugzilla got upgraded to a version that no longer
> > has the Bug.get_bugs API call.
> > There is a new python-bugzilla available that uses the new
> > Bug.get call instead.
> > Staging bodhi* has been upgraded last friday to use the new
> > python-bugzilla.
> > 
> > I would like +1s to upgrade python-bugzilla in production,
> > since Red Hat Bugzilla has been upgraded and as such attaching
> > bugs to updates is currently broken.
> 
> +1 - the update been working fine in blockerbugs-stg since last
> Wednesday
> 
> Is blockerbugs included in the list of systems to update to the new
> version of python-bugzilla?

I think really we need to update it whereever it's installed. We have a
number more machines using it. 

So, +1 to updating it on all machines where it's installed. ;) 

kevin


pgpfqyvcGNeiE.pgp
Description: OpenPGP digital signature
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Freeze break request: Update servers with new python-bugzilla

2015-04-13 Thread Patrick Uiterwijk
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

Hi,

I would like to ask for +1 to update all other servers running python-bugzilla.
The list is below:

bvirthost08.phx2.fedoraproject.org
osuosl01.fedoraproject.org
fed-cloud13.cloud.fedoraproject.org
busgateway01.phx2.fedoraproject.org
resultsdb01.qa.fedoraproject.org
kojipkgs01.phx2.fedoraproject.org
qa05.qa.fedoraproject.org
badges-backend01.stg.phx2.fedoraproject.org
taskotron-client26.qa.fedoraproject.org
db-fas01.stg.phx2.fedoraproject.org
buildhw-01.phx2.fedoraproject.org
buildvm-08.phx2.fedoraproject.org
arm01-builder04.arm.fedoraproject.org
arm02-builder04.arm.fedoraproject.org
arm04-builder05.arm.fedoraproject.org
hosted03.fedoraproject.org
mailman02.phx2.fedoraproject.org
taskotron-client13.qa.fedoraproject.org
value01.phx2.fedoraproject.org
download02.phx2.fedoraproject.org
proxy04.fedoraproject.org
taskotron-client23.qa.fedoraproject.org
qa13.qa.fedoraproject.org
branched-composer.phx2.fedoraproject.org
buildhw-05.phx2.fedoraproject.org
buildvm-13.phx2.fedoraproject.org
arm01-builder03.arm.fedoraproject.org
arm02-builder05.arm.fedoraproject.org
arm04-builder06.arm.fedoraproject.org
proxy05.fedoraproject.org
sign-bridge01.phx2.fedoraproject.org
nuancier02.phx2.fedoraproject.org
taskotron-client20.qa.fedoraproject.org
log01.phx2.fedoraproject.org
fed-cloud09.cloud.fedoraproject.org
coloamer01.fedoraproject.org
wiki01.phx2.fedoraproject.org
datagrepper01.stg.phx2.fedoraproject.org
mailman01.stg.phx2.fedoraproject.org
buildhw-12.phx2.fedoraproject.org
buildvm-22.phx2.fedoraproject.org
arm01-builder17.arm.fedoraproject.org
arm02-builder16.arm.fedoraproject.org
arm04-builder16.arm.fedoraproject.org
smtp-mm-ib01.fedoraproject.org
notifs-web02.phx2.fedoraproject.org
copr-keygen.cloud.fedoraproject.org
virthost-comm01.qa.fedoraproject.org
virthost17.phx2.fedoraproject.org
fedimg01.phx2.fedoraproject.org
pkgdb02.phx2.fedoraproject.org
sundries02.phx2.fedoraproject.org
serverbeach09.fedoraproject.org
packages03.phx2.fedoraproject.org
taskotron-client29.qa.fedoraproject.org
github2fedmsg01.stg.phx2.fedoraproject.org
buildhw-03.phx2.fedoraproject.org
buildvm-24.phx2.fedoraproject.org
arm01-builder16.arm.fedoraproject.org
arm02-builder18.arm.fedoraproject.org
arm04-builder18.arm.fedoraproject.org
smtp-mm-tummy01.fedoraproject.org
elections02.phx2.fedoraproject.org
taskotron-client19.qa.fedoraproject.org
taskotron01.qa.fedoraproject.org
hotness01.phx2.fedoraproject.org
cloud-noc01.cloud.fedoraproject.org
mirrorlist-phx2.phx2.fedoraproject.org
dedicatedsolutions01.fedoraproject.org
bastion01.phx2.fedoraproject.org
lockbox-comm01.qa.fedoraproject.org
fedoauth01.stg.phx2.fedoraproject.org
proxy01.stg.phx2.fedoraproject.org
buildvm-10.phx2.fedoraproject.org
arm01-builder07.arm.fedoraproject.org
arm02-builder08.arm.fedoraproject.org
arm04-builder09.arm.fedoraproject.org
ns02.fedoraproject.org
paste01.phx2.fedoraproject.org
lists-dev.cloud.fedoraproject.org
taskotron-client12.qa.fedoraproject.org
db-qa01.qa.fedoraproject.org
fed-cloud11.cloud.fedoraproject.org
tagger01.phx2.fedoraproject.org
arm03-packager00.cloud.fedoraproject.org
relepel01.phx2.fedoraproject.org
buildhw-11.phx2.fedoraproject.org
buildvm-21.phx2.fedoraproject.org
arm01-builder18.arm.fedoraproject.org
arm02-builder17.arm.fedoraproject.org
arm04-builder17.arm.fedoraproject.org
smtp-mm-coloamer01.fedoraproject.org
copr-fe-dev.cloud.fedoraproject.org
beaker01.qa.fedoraproject.org
badges-web01.phx2.fedoraproject.org
db-fas01.phx2.fedoraproject.org
buildvmhost-11.phx2.fedoraproject.org
fed-cloud01.cloud.fedoraproject.org
virthost11.phx2.fedoraproject.org
notifs-backend01.phx2.fedoraproject.org
pagure-stg01.fedoraproject.org
taskotron-client22.qa.fedoraproject.org
qa07.qa.fedoraproject.org
notifs-backend01.stg.phx2.fedoraproject.org
buildhw-08.phx2.fedoraproject.org
buildvm-18.phx2.fedoraproject.org
arm01-builder13.arm.fedoraproject.org
arm02-builder13.arm.fedoraproject.org
arm04-builder13.arm.fedoraproject.org
noc01.phx2.fedoraproject.org
mailman01.phx2.fedoraproject.org
taskotron-client14.qa.fedoraproject.org
copr-fe.cloud.fedoraproject.org
virthost08.phx2.fedoraproject.org
download04.phx2.fedoraproject.org
osuosl03.fedoraproject.org
paste01.stg.phx2.fedoraproject.org
host1plus01.fedoraproject.org
download-rdu02.fedoraproject.org
gallery01.stg.phx2.fedoraproject.org
buildhw-02.phx2.fedoraproject.org
buildvm-09.phx2.fedoraproject.org
arm01-builder05.arm.fedoraproject.org
arm02-builder07.arm.fedoraproject.org
arm04-builder08.arm.fedoraproject.org
proxy11.fedoraproject.org
blockerbugs-dev.cloud.fedoraproject.org
hosted04.fedoraproject.org
ibiblio01.fedoraproject.org
fed-cloud12.cloud.fedoraproject.org
tagger02.phx2.fedoraproject.org
sundries01.phx2.fedoraproject.org
qa06.qa.fedoraproject.org
bastion02.phx2.fedoraproject.org
bapp02.phx2.fedoraproject.org
buildvm-05.phx2.fedoraproject.org
buildvm-27.phx2.fedoraproject.org
arm01-builder23.arm.fedoraproject.org
arm04-builder01.arm.fedoraproject.org
bkernel01

Re: Freeze break request: Update servers with new python-bugzilla

2015-04-13 Thread Kevin Fenzi
+1. 

Some of these don't seem like they should be using it at all. Likely
it's pulled in by some strange dep. 

kevin


pgpbf9BgLbJWt.pgp
Description: OpenPGP digital signature
___
infrastructure mailing list
infrastructure@lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/infrastructure

Re: Freeze break request: Update servers with new python-bugzilla

2015-04-13 Thread Tim Flink
On Mon, 13 Apr 2015 18:17:22 +0200
Patrick Uiterwijk  wrote:

> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA512
> 
> Hi,
> 
> I would like to ask for +1 to update all other servers running
> python-bugzilla. The list is below:
> 
> bvirthost08.phx2.fedoraproject.org
> osuosl01.fedoraproject.org
> fed-cloud13.cloud.fedoraproject.org
> busgateway01.phx2.fedoraproject.org
> resultsdb01.qa.fedoraproject.org
> kojipkgs01.phx2.fedoraproject.org
> qa05.qa.fedoraproject.org
> badges-backend01.stg.phx2.fedoraproject.org
> taskotron-client26.qa.fedoraproject.org
> db-fas01.stg.phx2.fedoraproject.org
> buildhw-01.phx2.fedoraproject.org
> buildvm-08.phx2.fedoraproject.org
> arm01-builder04.arm.fedoraproject.org
> arm02-builder04.arm.fedoraproject.org
> arm04-builder05.arm.fedoraproject.org
> hosted03.fedoraproject.org
> mailman02.phx2.fedoraproject.org
> taskotron-client13.qa.fedoraproject.org
> value01.phx2.fedoraproject.org
> download02.phx2.fedoraproject.org
> proxy04.fedoraproject.org
> taskotron-client23.qa.fedoraproject.org
> qa13.qa.fedoraproject.org
> branched-composer.phx2.fedoraproject.org
> buildhw-05.phx2.fedoraproject.org
> buildvm-13.phx2.fedoraproject.org
> arm01-builder03.arm.fedoraproject.org
> arm02-builder05.arm.fedoraproject.org
> arm04-builder06.arm.fedoraproject.org
> proxy05.fedoraproject.org
> sign-bridge01.phx2.fedoraproject.org
> nuancier02.phx2.fedoraproject.org
> taskotron-client20.qa.fedoraproject.org
> log01.phx2.fedoraproject.org
> fed-cloud09.cloud.fedoraproject.org
> coloamer01.fedoraproject.org
> wiki01.phx2.fedoraproject.org
> datagrepper01.stg.phx2.fedoraproject.org
> mailman01.stg.phx2.fedoraproject.org
> buildhw-12.phx2.fedoraproject.org
> buildvm-22.phx2.fedoraproject.org
> arm01-builder17.arm.fedoraproject.org
> arm02-builder16.arm.fedoraproject.org
> arm04-builder16.arm.fedoraproject.org
> smtp-mm-ib01.fedoraproject.org
> notifs-web02.phx2.fedoraproject.org
> copr-keygen.cloud.fedoraproject.org
> virthost-comm01.qa.fedoraproject.org
> virthost17.phx2.fedoraproject.org
> fedimg01.phx2.fedoraproject.org
> pkgdb02.phx2.fedoraproject.org
> sundries02.phx2.fedoraproject.org
> serverbeach09.fedoraproject.org
> packages03.phx2.fedoraproject.org
> taskotron-client29.qa.fedoraproject.org
> github2fedmsg01.stg.phx2.fedoraproject.org
> buildhw-03.phx2.fedoraproject.org
> buildvm-24.phx2.fedoraproject.org
> arm01-builder16.arm.fedoraproject.org
> arm02-builder18.arm.fedoraproject.org
> arm04-builder18.arm.fedoraproject.org
> smtp-mm-tummy01.fedoraproject.org
> elections02.phx2.fedoraproject.org
> taskotron-client19.qa.fedoraproject.org
> taskotron01.qa.fedoraproject.org
> hotness01.phx2.fedoraproject.org
> cloud-noc01.cloud.fedoraproject.org
> mirrorlist-phx2.phx2.fedoraproject.org
> dedicatedsolutions01.fedoraproject.org
> bastion01.phx2.fedoraproject.org
> lockbox-comm01.qa.fedoraproject.org
> fedoauth01.stg.phx2.fedoraproject.org
> proxy01.stg.phx2.fedoraproject.org
> buildvm-10.phx2.fedoraproject.org
> arm01-builder07.arm.fedoraproject.org
> arm02-builder08.arm.fedoraproject.org
> arm04-builder09.arm.fedoraproject.org
> ns02.fedoraproject.org
> paste01.phx2.fedoraproject.org
> lists-dev.cloud.fedoraproject.org
> taskotron-client12.qa.fedoraproject.org
> db-qa01.qa.fedoraproject.org
> fed-cloud11.cloud.fedoraproject.org
> tagger01.phx2.fedoraproject.org
> arm03-packager00.cloud.fedoraproject.org
> relepel01.phx2.fedoraproject.org
> buildhw-11.phx2.fedoraproject.org
> buildvm-21.phx2.fedoraproject.org
> arm01-builder18.arm.fedoraproject.org
> arm02-builder17.arm.fedoraproject.org
> arm04-builder17.arm.fedoraproject.org
> smtp-mm-coloamer01.fedoraproject.org
> copr-fe-dev.cloud.fedoraproject.org
> beaker01.qa.fedoraproject.org
> badges-web01.phx2.fedoraproject.org
> db-fas01.phx2.fedoraproject.org
> buildvmhost-11.phx2.fedoraproject.org
> fed-cloud01.cloud.fedoraproject.org
> virthost11.phx2.fedoraproject.org
> notifs-backend01.phx2.fedoraproject.org
> pagure-stg01.fedoraproject.org
> taskotron-client22.qa.fedoraproject.org
> qa07.qa.fedoraproject.org
> notifs-backend01.stg.phx2.fedoraproject.org
> buildhw-08.phx2.fedoraproject.org
> buildvm-18.phx2.fedoraproject.org
> arm01-builder13.arm.fedoraproject.org
> arm02-builder13.arm.fedoraproject.org
> arm04-builder13.arm.fedoraproject.org
> noc01.phx2.fedoraproject.org
> mailman01.phx2.fedoraproject.org
> taskotron-client14.qa.fedoraproject.org
> copr-fe.cloud.fedoraproject.org
> virthost08.phx2.fedoraproject.org
> download04.phx2.fedoraproject.org
> osuosl03.fedoraproject.org
> paste01.stg.phx2.fedoraproject.org
> host1plus01.fedoraproject.org
> download-rdu02.fedoraproject.org
> gallery01.stg.phx2.fedoraproject.org
> buildhw-02.phx2.fedoraproject.org
> buildvm-09.phx2.fedoraproject.org
> arm01-builder05.arm.fedoraproject.org
> arm02-builder07.arm.fedoraproject.org
> arm04-builder08.arm.fedoraproject.org
> proxy11.fedoraproject.org
> blockerbugs-dev.cloud.fedoraproject.org
> hosted04.fedoraproject.org
> ibiblio01.fedoraproject.org
> fed-cl