Re: [OpenStack-Infra] Installing Zuul without the openstack-infra Puppet

[Ricardo Carrillo Cruz]

Absolutely.

As a matter of fact, the OpenStack Infra CI no longer has a Puppetmaster
daemon running.
The current puppetmaster.openstack.org is a host containing hiera and
puppet modules. A cron'd Ansible play pushes to the clients the pertinent
hiera secrets
and modules for each node and then runs puppet apply.
It's thus a puppetmaster-less setup.

I recommend you take a look at
https://git.openstack.org/cgit/openstack-infra/puppet-openstackci/ .
Puppet-openstackci is a project that contains puppet modules to install an
OpenStack based CI, and of course it has manifests/classes for Zuul.

Regards

2016-06-11 0:16 GMT+02:00 Coggins, Dean (OTSI Contractor) <
dean.cogg...@hpe.com>:

> Hello,
>
>
>
> I’ve been asked to set up a Zuul environment for the HPE Networks switch
> development environment.  I already have Gerrit and Jenkins master/slave
> servers up and running in our environment.  These servers were set up by
> myself manually, outside of the openstack CI processes.
>
>
>
> In reading the documentation at
> http://docs.openstack.org/infra/system-config/running-your-own.html, it
> indicates that I need to set up a puppet master server using the openstack
> system-config and project-config repositories.  We already have a puppet
> managed environment in the Lab.  Will the openstack puppet-zuul work with a
> non openstack puppet process?  Or, am I required to use an openstack puppet
> environment for the install and setup?
>
>
>
> *Regards,*
>
> *Dean Coggins*
>
>
> *dean.cogg...@hpe.com  *Software Engineer
> Object Technology Solutions, Inc. (OTSI) contractor
> HPE Roseville – R3U (R7)
>
> +1 916 785 3263  Office
>
> +1 650 316 2386  Skype Office
>
>
>
> ___
> OpenStack-Infra mailing list
> OpenStack-Infra@lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
>
>
___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

Re: [OpenStack-Infra] Fun (important!) project: optimize Gerrit's nova git repo

[Jeremy Stanley]

On 2016-06-10 12:20:01 -0700 (-0700), Zaro wrote:
[...]
> The difference is that we would save a significant amount
> of disk space on the servers (7G for nova-nogc vs 400M for nova-gc).
[...]

And that's with an old snapshot. For some reason after the upgrade
from 2.8 to 2.11 our repos have been rapidly growing in size on
disk. The space occupied by
~gerrit2/review_site/git/openstack/nova.git is now a whopping 38GiB.
-- 
Jeremy Stanley

___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

[OpenStack-Infra] Jenkins job builder status report

[Kien Ha]

Hello,

My name is Kien Ha and I am being mentored by Thanh Ha. I mainly work on
the Jenkins Job Builder Project. I was asked to give my status report to
the OpenStack.

This week I have:
- Update Cucumber Reports plugin
- Update EnvInject plugin
- Update FSTrigger plugin
- Update JaCoCo plugin
- Update support for BuildResultTrigger plugin
- Update Sonatype CLM for CI plugin
- External Monitor Job Type is up-to-date
- Investigate HTTP Request

I was asked to investigate HTTP Request and I found out that it does not
have a way to put files onto nexus. It can however delete files on nexus if
they are there.

Next week I plan on working on:
- FindBugs Plugin
- Gearman Plugin
- IvyTrigger Plugin

I have a final exam next week so I will be more focused on my studies.

Attach below is a link to my Jenkins job builder project proposal document
with a complete table of plugins that I have worked on found at the top of
the document [0]. The weekly work log is found at the bottom of the
document.

Regards,
Kien Ha

[0]
https://docs.google.com/document/d/17AHluxqiBFcsTCkpyekDOFSTahX50pXFmQgjlK-PoEQ/edit
___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

Re: [OpenStack-Infra] Fun (important!) project: optimize Gerrit's nova git repo

[Zaro]

Hello All.

My previous testing on this was sorta bogus because I was cloning with
a file reference to the repo which isn't a use case that Openstack
supports.  It's also why I saw such a significant clone performance
difference between the a GCed repo and a non-GCed repo.

This is a redo and this time I've tested the use cases that infra does
support.  Just about all of our community (bots and people) clone from
our git mirrors (git.openstack.org) and not directly from our Gerrit
server (review.o.o).  Thus it's much more realistic to verify git
performance from our git mirrors rather than from review.o.o.  This
next set of test result attempts to simulate the performance of the
nova repo cloned from git.o.o.  Since git.o.o allows git interactions
using a few different protocols (git, http smart, and http dumb) for I
have attempted to test cloning using each protocol.

Test Environment:
I setup a test CentOS 7 VM server (1 VCPU, 10 G RAM) to host two nova
repros, one repo was not GCed (nova-nogc) and the second repro was
GCed (nova-gc).  The GC was done using the C git client (`git gc`)
packaged with CentOS.  Both repos can be cloned using either git, http
smart or http dumb protocols.  I cloned the repos directly on the host
machine for my tests.

Results:

repo | protocol | average clone time (5 runs) | disk consumption after
clone | ram usage
-
nova-gc  | http dumb  | 2m 33 sec  | 409M | 1% ~200M
nova-nogc  | http dumb  | 2m 33 sec  | 409M | 1% ~200M
nova-gc  | http smart  | 3m 5 sec| 147M | 4% ~500M
nova-nogc  | http smart  | 3m 15 sec  | 147M | 4% ~500M
nova-gc  | git  | 3m 4 sec| 147M | 4% ~500M
nova-nogc  | git  | 3m 12 sec  | 147M | 4% ~500M


The conclusion I draw from the test result is that there should really
be no performance difference between cloning a nova repo as-is (`git
repack -afd`) vs a nova repo that has gone thru a garbage collection
(`git gc`).  The difference is that we would save a significant amount
of disk space on the servers (7G for nova-nogc vs 400M for nova-gc).
I guess garbage collection is all about reducing repo size but does
not really do anything to help increase git performance.  The only
realized performance gain I see is that smaller repos would probably
speed up Gerrit replication to all our git slaves.

-Khai

___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

[OpenStack-Infra] [StoryBoard] StoryBoard Bug Squash!

[Zara Zaimeche]

Hi all!

We're running a bugsquash for bugs in StoryBoard and the StoryBoard 
webclient, on the 22nd and 23rd of June. It'll start and finish around 
11:00 UTC-- though of course every day is a StoryBoard bugsquash day 
*really*, so that's just the timeframe where StoryBoard people will 
sometimes be active in #openstack-sprint on freenode. We'll also be 
around in #storyboard, which is where we live the rest of the time. If 
you're interested in helping out with the bugs, then it's a good time to 
start! We're going to try to be more vigilant actually tagging 
low-hanging-fruit as low-hanging-fruit in the next couple of weeks, so 
that it's easy for people to see what needs work. :) Feel free to join 
#storyboard if you want to squash some bugs. Or if you have questions. 
Or if you just want to keep us company.


Best Wishes,

Zara (and SotK probably also wishes you all well, but he hasn't seen 
this email, so I won't put his name on it, except in parentheses like these)


___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra