Re: [Gluster-infra] Tracking issues on Bugzilla

2016-06-10 Thread Nigel Babu
On Fri, Jun 10, 2016 at 08:09:28PM +0200, Michael Scherer wrote: > Le vendredi 10 juin 2016 à 14:12 +0530, Nigel Babu a écrit : > > Hello folks, > > > > There's a bugzilla component for glusterfs on Bugzilla called > > project-infrastructure. As far as I can see, we

Re: [Gluster-infra] Review request to remove the -1 from verified tag

2016-06-11 Thread Nigel Babu
The -1 is now removed. On Sat, Jun 11, 2016 at 01:49:54AM -0400, Karthik Subrahmanya wrote: > Hi, > > Previously this week the patch http://review.gluster.org/#/c/14619/ is > assigned with > -1 for the verified tag due to the problem with regression machines. Now all > the regression > tests

[Gluster-infra] Gerrit migration to PostgreSQL

2016-05-25 Thread Nigel Babu
Hello, I've attempted a test migration of our gerrit database from H2 to PostgreSQL. # How I copied everything another server, so I wouldn't affect the production instance in anyway. I converted everything from H2 into csv and then imported the files into postgres. I ran into a few problems at

Re: [Gluster-infra] Unable to get correct bug status.

2016-05-26 Thread Nigel Babu
Hi Sakshi, The bugzilla status is MODIFIED at the moment and not POST. Perhaps that's what's going wrong here? On Wed, May 25, 2016 at 10:11 AM, Sakshi Bansal wrote: > Hi, > > The smoke test for http://review.gluster.org/#/c/14496/ keeps failing as > it is unable > to get

[Gluster-infra] Bash scripts for Jenkins jobs

2016-06-13 Thread Nigel Babu
Hello folks, We define shell scripts inside the Jenkins job[1], which Jenkins allows you to do for flexibility. The ideal workflow is that the xml for the job is updated every time the job is changed, but this does not always happen. I'd like to propose that we split this script into a bash

Re: [Gluster-infra] Updating the email address of our Jenkins test user?

2016-06-14 Thread Nigel Babu
On Mon, Jun 13, 2016 at 03:36:06PM +0200, Niels de Vos wrote: > Hi, > > when patches get tested by Jenkins jobs, the following tags are added to > the git commit message: > > Smoke: Gluster Build System > CentOS-regression: Gluster Build System

Re: [Gluster-infra] Bash scripts for Jenkins jobs

2016-06-13 Thread Nigel Babu
On Mon, Jun 13, 2016 at 02:01:42PM +0530, Nigel Babu wrote: > Hello folks, > > We define shell scripts inside the Jenkins job[1], which Jenkins allows you > to do > for flexibility. The ideal workflow is that the xml for the job is updated > every time the job is changed, but th

[Gluster-infra] Switching to Bugzilla for infra failures

2016-06-15 Thread Nigel Babu
Hello, We've had a bugzilla component for a long time and it's been unused. With effect from today, we've decided to resurrect it. Please file a bug in the glusterfs -> Project-infrastructure component for infra issues. We're doing this so that * We can track bugs to their logical conclusion

Re: [Gluster-infra] Need jenkins account to configure some jobs

2016-06-15 Thread Nigel Babu
On Mon, Jun 06, 2016 at 05:50:12AM -0400, Prashanth Pai wrote: > Hi, > > Bump. This request kinda got lost. > > Reviewers currently have to rely on running the unit and functional > tests on their machines. A jenkins account will allow me to set CI > jobs for the same. I've already got the

[Gluster-infra] Access to Jenkins

2016-06-15 Thread Nigel Babu
Hello folks, We have 45 people who have access to Jenkins UI. Pretty much everyone will be losing this access in the next couple of weeks. At the moment, I understand that access to the UI is essential for configuring jobs. I’m going to change this in the near future. Jenkins Job Builder[1] will

Re: [Gluster-infra] Putting the netbsd builders in the ansible pool ?

2016-06-13 Thread Nigel Babu
On Thu, Jun 09, 2016 at 08:44:40PM +0200, Emmanuel Dreyfus wrote: > Michael Scherer wrote: > > > The only issue I face is that you flagged most of /usr as unchangeable, > > and I do not know how cleanly it would be to remove the flags before > > applying changes and apply

Re: [Gluster-infra] Issues from Gerrit Upgrade

2016-06-05 Thread Nigel Babu
ave changed. Please clear your cookies and cache and sign in to Gerrit and visit the account page. If you have any issues, please email me or ping me on IRC (I'm nigelb). On Wed, Jun 1, 2016 at 4:07 PM, Nigel Babu <nig...@redhat.com> wrote: > Hello folks, > > This upgrade has prod

Re: [Gluster-infra] [Gluster-devel] Please test Gerrit 2.12.2

2016-05-31 Thread Nigel Babu
Hi Prasanna, > > > > 'Fix' button is visible. May be you are missing something, please > > check. > > > > +1 > > > Thanks and Regards, > > Kotresh H R > > > > - Original Message - > > > > > > From: "Prasanna Kal

[Gluster-infra] Gerrit downtime on Monday

2016-05-27 Thread Nigel Babu
Hello, As there's been no negative feedback and encouragement from Vijay, I'm going to bring down Gerrit at 0230[1] on Monday. The outage window is for 2 hours. I will be migrating the data from H2 to PostgreSQL. Please let me know if you notice any issues after the migration. I'm available on

Re: [Gluster-infra] Opinions on ideal time for gerrit downtime

2016-05-25 Thread Nigel Babu
Thanks Vijay, I'm leaning towards the morning slot, so it's done before everyone starts work. On Thu, May 26, 2016 at 8:20 AM, Vijay Bellur <vbel...@redhat.com> wrote: > On 05/25/2016 07:02 AM, Nigel Babu wrote: > >> Hello folks, >> >> I'd like to bring down ger

Re: [Gluster-infra] [Gluster-devel] Gerrit (review.gluster.org/git.gluster.org) downtime in 15 mins

2016-06-01 Thread Nigel Babu
I'm looking into this now. On Wed, Jun 1, 2016 at 11:58 AM, Susant Palai <spa...@redhat.com> wrote: > Getting "server error" while trying to login. > > Regards, > Susant > > - Original Message - > From: "Nigel Babu" <nig...@redhat.com

Re: [Gluster-infra] Gerrit (review.gluster.org/git.gluster.org) going down in the next 30 mins

2016-05-29 Thread Nigel Babu
The migration is now complete. Please let me know if you notice any issues whatsoever. On Mon, May 30, 2016 at 7:25 AM, Nigel Babu <nig...@redhat.com> wrote: > Hello, > > I'll be bring down Gerrit in 30 mins for a planned downtime of 2 hours. > I'll post updates to this threa

[Gluster-infra] Gerrit (review.gluster.org/git.gluster.org) going down in the next 30 mins

2016-05-29 Thread Nigel Babu
Hello, I'll be bring down Gerrit in 30 mins for a planned downtime of 2 hours. I'll post updates to this thread when all is well. -- nigelb ___ Gluster-infra mailing list Gluster-infra@gluster.org http://www.gluster.org/mailman/listinfo/gluster-infra

[Gluster-infra] jenkins-cli on build.gluster.org

2016-06-22 Thread Nigel Babu
Hello, If anyone has successfully got Jenkins CLI working on build.gluster.org, please let me know how to get it working? My attempts seem to have failed so far with this: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method)

Re: [Gluster-infra] [Gluster-devel] Access to Jenkins

2016-06-16 Thread Nigel Babu
On Thu, Jun 16, 2016 at 01:05:26PM +0200, Michael Scherer wrote: > Le mercredi 15 juin 2016 à 21:14 +0530, Nigel Babu a écrit : > > Hello folks, > > > > We have 45 people who have access to Jenkins UI. Pretty much everyone will > > be > > losing this a

Re: [Gluster-infra] Access to Jenkins

2016-06-16 Thread Nigel Babu
On Thu, Jun 16, 2016 at 12:29:24PM +0200, Niels de Vos wrote: > On Wed, Jun 15, 2016 at 09:14:16PM +0530, Nigel Babu wrote: > > Hello folks, > > > > We have 45 people who have access to Jenkins UI. Pretty much everyone will > > be > > losing this a

[Gluster-infra] Moving to Jenkins Job Builder

2016-06-23 Thread Nigel Babu
Hello folks, In the last week or so, I've been working on converting our jobs from xml to yaml for Jenkins Job Builder. It lets us define our Jenkins job in yaml files (more readable than XML). It then pushes these jobs to Jenkins. My plan is convert all the jobs into this style eventually. I've

Re: [Gluster-infra] Moving to Jenkins Job Builder

2016-06-23 Thread Nigel Babu
Update, the jobs have changed https://build.gluster.org/view/RPMs/job/rpm-el6/ https://build.gluster.org/view/RPMs/job/rpm-fedora/ If all goes well, tomorrow morning, I'll disable the old rpm jobs. On Thu, Jun 23, 2016 at 7:07 PM, Nigel Babu <nig...@redhat.com> wrote: > On Thu, Jun

Re: [Gluster-infra] Moving to Jenkins Job Builder

2016-06-23 Thread Nigel Babu
On Thu, Jun 23, 2016 at 01:49:27PM +0530, Nigel Babu wrote: > Hello folks, > > In the last week or so, I've been working on converting our jobs from xml to > yaml for Jenkins Job Builder. It lets us define our Jenkins job in yaml files > (more readable than XML). It then pu

Re: [Gluster-infra] Rackspace Account Removal

2016-06-16 Thread Nigel Babu
On Thu, Jun 16, 2016 at 07:42:29AM -0700, Amye Scavarda wrote: > On Thu, Jun 16, 2016 at 3:11 AM, Niels de Vos wrote: > > On Wed, Jun 15, 2016 at 08:45:02PM -0700, Amye Scavarda wrote: > >> Hi all, > >> > >> In the spirit of cleaning out access to various things, we're also >

Re: [Gluster-infra] Access to Jenkins

2016-06-27 Thread Nigel Babu
On Thu, Jun 16, 2016 at 04:58:52PM +0530, Nigel Babu wrote: > On Thu, Jun 16, 2016 at 12:29:24PM +0200, Niels de Vos wrote: > > On Wed, Jun 15, 2016 at 09:14:16PM +0530, Nigel Babu wrote: > > > Hello folks, > > > > > > We have 45 people who have access

[Gluster-infra] Opinions on ideal time for gerrit downtime

2016-05-25 Thread Nigel Babu
Hello folks, I'd like to bring down gerrit for 2 hours some time next week to migrate our database from H2 to PostgreSQL. This will start us on the path to scaling gerrit better. This migration will also speed up the process of upgrading gerrit to the latest version and having our install running

[Gluster-infra] NetBSD now with more space

2016-07-25 Thread Nigel Babu
Hello folks, With Emmanuel's help, I've added an extra partition to the NetBSD machines. The /build and /archives folders are now in a new partition mounted at /data. This partition has about 23 GB of space. It will reduce instances of NetBSD machines out of action because of lack of space. A

[Gluster-infra] Gluster Infra Updates - July

2016-07-27 Thread Nigel Babu
Hello folks, We'll be sending updates about the state of the infrastructure and what's been going on every month from now on. Here's the update for July What's Been Going on In Gluster Infra # Gerrit * We've updated how the review flags work. When you rebase a change or you update the commit

Re: [Gluster-infra] [Gluster-devel] tests/basic/op_errnos.t failure

2016-07-12 Thread Nigel Babu
Please file a bug against project-infrastructure. On Tue, Jul 12, 2016 at 6:50 PM, Raghavendra Talur wrote: > Nigel/Misc, > > Could you please look into this? > slave29 does not seem to have a xfs formatted backend for tests. > > Thanks, > Raghavendra Talur > > On Tue, Jul

Re: [Gluster-infra] nbslave7g has a problem

2016-07-21 Thread Nigel Babu
Can anyone tell me what exactly the failure means and how I can go about fixing it? On Thu, Jul 21, 2016 at 12:52 PM, Niels de Vos wrote: > > https://build.gluster.org/job/rackspace-netbsd7-regression-triggered/18224/consoleFull > failed really weird, it can not have to do

Re: [Gluster-infra] Netbsd folders filling up

2016-07-15 Thread Nigel Babu
On Fri, Jul 15, 2016 at 10:10:13AM +, Emmanuel Dreyfus wrote: > On Fri, Jul 15, 2016 at 03:04:39PM +0530, Nigel Babu wrote: > > Would it be okay to write a cron to clean up anything older than 15 days in > > /build/install and /archives? > > You have to cleanup

Re: [Gluster-infra] Netbsd folders filling up

2016-07-15 Thread Nigel Babu
On Fri, Jul 15, 2016 at 07:22:45AM +, Emmanuel Dreyfus wrote: > On Fri, Jul 15, 2016 at 07:19:17AM +, Emmanuel Dreyfus wrote: > > On Fri, Jul 15, 2016 at 10:59:04AM +0530, Nigel Babu wrote: > > > nbslave77.cloud.gluster.org > > > > That one has 1,6 Go of

Re: [Gluster-infra] Updating /opt/qa and installing dependencies

2016-07-17 Thread Nigel Babu
On Fri, Jul 15, 2016 at 04:45:24PM +0200, Michael Scherer wrote: > Le vendredi 15 juillet 2016 à 11:43 +0530, Nigel Babu a écrit : > > Hello, > > > > I'm toying with the idea that each job will have commands to install > > dependencies and update the /opt/qa folde

[Gluster-infra] Deleting old jobs and nodes

2016-07-19 Thread Nigel Babu
Hello, I've deleted the gluster-swift nodes and jobs. The machines are sitting idle and burning us money. I've had discussions with the owners of these jobs. I'll circle back to making the process of setting up nodes for these jobs scripted in the near future. These jobs will be converted to JJB

Re: [Gluster-infra] nbslave71.cloud.gluster.org can't clone git repo ? DNS issue

2016-07-17 Thread Nigel Babu
Both netbsd0 and nbslave71 are likely to be running into the same problem - out of space :( On Sun, Jul 17, 2016 at 5:59 PM, Kaleb Keithley wrote: > > And seems to be the only machine running netbsd regressions > ___ >

Re: [Gluster-infra] Netbsd folders filling up

2016-07-17 Thread Nigel Babu
On Fri, Jul 15, 2016 at 03:57:39PM +0530, Nigel Babu wrote: > On Fri, Jul 15, 2016 at 10:10:13AM +, Emmanuel Dreyfus wrote: > > On Fri, Jul 15, 2016 at 03:04:39PM +0530, Nigel Babu wrote: > > > Would it be okay to write a cron to clean up anything older than 15 days >

Re: [Gluster-infra] Netbsd folders filling up

2016-07-18 Thread Nigel Babu
Thank you. I'll give that a shot. I also want to setup ntp and change passwords for all the machines in one go. On Mon, Jul 18, 2016 at 5:22 PM, Emmanuel Dreyfus <m...@netbsd.org> wrote: > Nigel Babu <nig...@redhat.com> wrote: > > > Oh, can I apply this to al

[Gluster-infra] Netbsd folders filling up

2016-07-14 Thread Nigel Babu
Hello, Does anyone know which folders are usually filled up quickly on netbsd machines? A lot of the machines are offline merely because they're out of diskspace. I'm working through them. I've cleared out old files in /build and /archives. Is there anywhere else I should be looking? -- nigelb

Re: [Gluster-infra] Netbsd folders filling up

2016-07-14 Thread Nigel Babu
take a look at /var/crash in all of them. On Fri, Jul 15, 2016 at 10:14 AM, Emmanuel Dreyfus <m...@netbsd.org> wrote: > Nigel Babu <nig...@redhat.com> wrote: > > > Does anyone know which folders are usually filled up quickly on netbsd > > machines? A lot of t

[Gluster-infra] All rpm jobs are now in jenkins job builder

2016-06-28 Thread Nigel Babu
Hello, All the rpm jobs are now in Jenkins job builder format. I've disabled the old jobs and replaced them with new ones: glusterfs-rpm -> rpm-fedora glusterfs-rpm-el6 -> rpm-el6 glusterfs-devrpm -> devrpm-fedora glusterfs-devrpm-el6 -> devrpm-el6 glusterfs-devrpm-el7 -> devrpm-el7 Please let

[Gluster-infra] Updating Jenkins with Jenkins

2016-07-07 Thread Nigel Babu
Hello folks, As you have read from my emails over this month, I'm going to have Jenkins jobs generated from JJB. I'm going to go one step further. I'm going to move the repo[1] into Gerrit. One successful merge on Gerrit, it will update Jenkins. I'll do a sync from Gerrit to Github for this repo.

[Gluster-infra] Jenkins access changes

2016-07-10 Thread Nigel Babu
Hello, As I've discussed previously, I've removed access to edit jobs and manage Jenkins from everyone. misc and and I will continue to have access for now. I intend to reduce both our access eventually as well, in favor of a bot user that'll update jobs automatically. That bit is blocked on

[Gluster-infra] Jenkins results for devrpms 404ing

2016-07-11 Thread Nigel Babu
Hello folks, A lot of older devrpm jobs will 404 because I was only saving 10 latest jobs. I thought since we didn't consume the rpms, I could safely delete them. Turns out we do want the logs. I've updated the job so we keep the last 50 jobs. This won't fix the jobs that already 404, but at

[Gluster-infra] Developer RPMs for Fedora now on F24

2016-08-09 Thread Nigel Babu
Hello, The Fedora rpms that we build during smoke and on every commit to master are now built on Fedora 24 rather than Fedora 22. The following jobs have changed: https://build.gluster.org/job/devrpm-fedora/ https://build.gluster.org/job/rpm-fedora/ -- nigelb

[Gluster-infra] Renaming the log files for regression runs

2016-08-01 Thread Nigel Babu
Hello, Nithya suggested we rename the log files to have the Jenkins Job ID, making it easier to match the log file to the job. I think this is a good idea and I'm going to make the code changes. Does anyone have a reason *not* to do this? -- nigelb

[Gluster-infra] Can I update /opt/qa for NetBSD?

2016-08-02 Thread Nigel Babu
Hello folks, The /opt/qa folder on NetBSD nodes are on quite an old commit[1]. This means the URL to the logs and cores do not work. The script in master generates the correct URL. Is it safe to update this repo to the latest git master? [1]:

[Gluster-infra] Idea: Failure Trends

2016-08-16 Thread Nigel Babu
Hello folks, For the last few weeks, Poornima has been sending in a report of failures over the last week. I've been thinking of how to use automation to make that report better. One of the ideas was to use Jenkins to send the email. It seemed like we were automating the wrong thing there.

Re: [Gluster-infra] Idea: Failure Trends

2016-08-16 Thread Nigel Babu
On Tue, Aug 16, 2016 at 06:35:09PM -0700, Amye Scavarda wrote: > On Tue, Aug 16, 2016 at 6:17 PM, Sankarshan Mukhopadhyay < > sankarshan.mukhopadh...@gmail.com> wrote: > > > On Wed, Aug 17, 2016 at 6:33 AM, Nigel Babu <nig...@redhat.com> wrote: > > > Instea

Re: [Gluster-infra] Idea: Failure Trends

2016-08-17 Thread Nigel Babu
On Wed, Aug 17, 2016 at 02:59:15PM +0200, Michael Scherer wrote: > Le mercredi 17 août 2016 à 06:33 +0530, Nigel Babu a écrit : > > Hello folks, > > > > For the last few weeks, Poornima has been sending in a report of failures > > over > > the last week.

[Gluster-infra] Postmortem for RPM build failures

2017-02-01 Thread Nigel Babu
Hello, Some of you may have noticed that we've been particularly plagued with RPM build failures for the past couple of days. The failure looks like a Java error from Jenkins[1]. I first noticed the error on Tuesday, 31st January. I narrowed down the issue with a problem with permissions. Jenkins

Re: [Gluster-infra] [IMPORTANT!] Entire test cluster is down

2017-01-26 Thread Nigel Babu
Fixed! Thanks to Matt and Karsten :) On Fri, Jan 27, 2017 at 7:34 AM, Nigel Babu <nig...@redhat.com> wrote: > Looks like a network issue in the cage or between the cage and rackspace. > I'll page people to get things going. I've filed > https://bugzilla.redhat.com/show_bug

[Gluster-infra] Possible Gluster outage? (was Re: [Gluster-devel] tests/bitrot/bug-1373520.t is failing multiple times)

2017-01-30 Thread Nigel Babu
Hi Pranith, What problems did you see? * Did you have an Apache error? * Did you have a possible DNS issue? On Sat, Jan 28, 2017 at 3:56 PM, Pranith Kumar Karampuri < pkara...@redhat.com> wrote: > It is a bug in EC name heal code path. I sent a fix but review.gluster.org > is not accessible now

[Gluster-infra] Smoke builds (other than *bsd) moving to cage

2017-02-21 Thread Nigel Babu
Hello folks, In the next week or so, we'll be moving all of our smoke builds to the cage. This way, we can get rid of some of our cloud machines. This will also speed up the smoke builds a bit since they'll be on the same network as Gerrit resulting in faster clones. If there's something you

[Gluster-infra] Gerrting Voting Problems

2017-02-23 Thread Nigel Babu
Hello folks, I know we've had Jenkins voting issues for a while and I'd like to offer tips to avoid the worst of it. 1. Do not set a Verified +1 flag until smoke tests have reported back. If you do, all jobs will vote together. This will cause smoke tests or regressions to vote

[Gluster-infra] Outage Announcement: Mar 14 2017

2017-02-19 Thread Nigel Babu
Hello folks, Michael and I have brought up the community cage outage at the last meeting. The details are now confirmed. There will be a major outage window for the community cage on March 14-16 2017. The migration will begin around 1000 EST / 1600 CET / 2030 IST. During this time, servers will

[Gluster-infra] Please welcome Worker Ant

2016-08-22 Thread Nigel Babu
Hello, I've just switched the bugzilla authentication on Gerrit today. From today onwards, Gerrit will comment on Bugzilla using a new account: bugzilla-...@gluster.org If you notice any issues, please file a bug against project-infrastructure. This bot will only comment on public bugs, so if

Re: [Gluster-infra] Access issue while tagging gluster-block v0.1

2017-02-27 Thread Nigel Babu
File a bug, please. On Mon, Feb 27, 2017 at 7:03 PM, Prasanna Kalever wrote: > Hi, > > > We seem to be having access issues in tagging v0.1 release for > gluster-block. > > This is what I see, > > $ git push --tags gerrit master > All keys already loaded > Counting objects:

Re: [Gluster-infra] Can I update /opt/qa for NetBSD?

2016-08-23 Thread Nigel Babu
Hello folks, I've been thinking about a different approach here. I'd like to fork the build.sh/regression.sh/smoke.sh scripts for NetBSD until we unify them. This seems to be the approach with most gains at this point. This way, I can make smaller bite sized changes that can be tested in

Re: [Gluster-infra] Zuul?

2016-09-02 Thread Nigel Babu
On Fri, Sep 02, 2016 at 08:39:14AM -0400, Kaleb S. KEITHLEY wrote: > On 09/02/2016 06:36 AM, Nigel Babu wrote: > > > > Here's the flow as I see it: > > 1. Propose a review request. > > 2. Smoke tests run as soon as a patchset is created or updated. > > 3. Review

Re: [Gluster-infra] Zuul?

2016-09-06 Thread Nigel Babu
On Sun, Sep 04, 2016 at 07:43:04PM +0200, Niels de Vos wrote: > On Fri, Sep 02, 2016 at 12:12:00PM -0400, Jeff Darcy wrote: > > > We already only merge after NetBSD-regression and CentOS-regression have > > > voted > > > back. All I'm changing is that you don't need to do the merge manually or >

Re: [Gluster-infra] [Gluster-devel] Gerrit Access Control

2016-09-01 Thread Nigel Babu
On Mon, Aug 29, 2016 at 08:42:22PM +0200, Niels de Vos wrote: > On Mon, Aug 29, 2016 at 09:18:05PM +0530, Pranith Kumar Karampuri wrote: > > On Mon, Aug 29, 2016 at 12:25 PM, Nigel Babu <nig...@redhat.com> wrote: > > > > > Hello folks, > > > > > >

[Gluster-infra] Zuul?

2016-09-02 Thread Nigel Babu
Hello, We've had master breaking twice in this week because we of when we run regressions and how we merge. I think it's time we officially thought of moving regressions as a gate controlld by Zuul. And Zuul will do the merge onto the correct branch. This is me throwing the idea about to hear

Re: [Gluster-infra] Zuul?

2016-09-02 Thread Nigel Babu
project? Have you > previously worked with Zuul or, can cite situations where adoption of > Zuul has helped? > > > > On Fri, Sep 2, 2016 at 3:01 PM, Nigel Babu <nig...@redhat.com> wrote: > >> Hello, > >> > >> We've had master breaking twice in thi

Re: [Gluster-infra] Request to provide PASS flags to a patch in gerrit

2016-08-31 Thread Nigel Babu
On Wed, Aug 31, 2016 at 4:23 PM, Raghavendra Talur wrote: > Hi All, > > We have a test [1] which is causing hangs in NetBSD. We have not been able > to debug the issue yet. > It could be because the bash script does not comply with posix guidelines > or that there is a bug in

[Gluster-infra] Jenkins Jobs on Gerrit

2016-09-11 Thread Nigel Babu
Hello, This has been in the works for some time and it's finally ready. Today, I'll be moving the Jenkins Jobs for build.gluster.org to Gerrit[1]. This should not have any major side effects. The only one I see is a few pull requests will become un-mergable and will need to be re-submitted on

[Gluster-infra] cgit on review.gluster.org

2016-09-11 Thread Nigel Babu
Hello, I'm contemplating adding cgit or a similar git view on review.gluster.org so we don't have to push everything to Github to view the code online. I'm contemplating using cgit. Do we have a preferred git viewer? -- nigelb ___ Gluster-infra

Re: [Gluster-infra] Unplanned Gerrit outage

2016-09-09 Thread Nigel Babu
Update: I missed taking a jstack just before restarting, so I don't think we'll be able to find root cause. The error logs do not indicate anything gone awry. On Fri, Sep 9, 2016 at 11:58 AM, Nigel Babu <nig...@redhat.com> wrote: > Hello, > > I've had to restart Gerrit just now wi

[Gluster-infra] Gluster Infra Updates - August

2016-09-13 Thread Nigel Babu
Hello folks, Here's a delayed summary of infra updates from August. # Gerrit * We now use Worker Ant to update bugs on bugzilla. # Jenkins * The conversion to JJB for all jobs on build.gluster.org complete. We have our first new job entirely written in JJB (strfmt_errors) * We've built a

[Gluster-infra] gluster-de...@gluster.org

2016-09-24 Thread Nigel Babu
Hello folks, The downtime window is about to start. The following sites will be unavailable for the next 6 hours. Please refrain from pushing any changes in the next 6 hours. review.gluster.org build.gluster.org I'll send a follow up email when the downtime is complete. -- nigelb

Re: [Gluster-infra] Downtime extended

2016-09-24 Thread Nigel Babu
On Sat, Sep 24, 2016 at 06:56:26PM +0530, Nigel Babu wrote: > On Sat, Sep 24, 2016 at 02:27:27PM +0530, Nigel Babu wrote: > > Hello folks, > > > > The downtime window is about to start. The following sites will be > > unavailable > > for the next 6 hours. Please

[Gluster-infra] Downtime extended

2016-09-24 Thread Nigel Babu
On Sat, Sep 24, 2016 at 02:27:27PM +0530, Nigel Babu wrote: > Hello folks, > > The downtime window is about to start. The following sites will be unavailable > for the next 6 hours. Please refrain from pushing any changes in the next > 6 hours. > > review.gluster.org > bu

[Gluster-infra] Migration complete

2016-09-24 Thread Nigel Babu
Hello, Michael and I are happy to announce that the migration is now complete. Both review.gluster.org and build.gluster.org are now served from the community cage. Our remaining server will move to the cage shortly and we'll have all our machines in the cage. If you notice anything wrong,

Re: [Gluster-infra] Renaming the log files for regression runs

2016-09-30 Thread Nigel Babu
On Tue, Aug 02, 2016 at 10:02:41AM -0400, Vijay Bellur wrote: > On Tue, Aug 2, 2016 at 1:59 AM, Nigel Babu <nig...@redhat.com> wrote: > > Hello, > > > > Nithya suggested we rename the log files to have the Jenkins Job ID, making > > it > > easier to

Re: [Gluster-infra] Build machines requires glib2-devel

2016-09-30 Thread Nigel Babu
Please file a bug? On Thu, Sep 29, 2016 at 2:17 PM, Prasanna Kalever wrote: > Hi, > > The patch [1] requires glib2-devel, can someone help me in installing > this in the smoke machines? > > Here is the failure smoke, reporting the rpm build configuration failure > [2]. > >

Re: [Gluster-infra] slave33 is sick

2016-09-14 Thread Nigel Babu
File a bug rather than emailing gluster-infra, please. On Thu, Sep 15, 2016 at 8:33 AM, Kaleb Keithley wrote: > rpmbuild jobs are crashing with java runtime errors. > > And it seems to be first in the queue every time. I had to disable it so > that (one of) the other

[Gluster-infra] Centos-Regression voting issues

2016-09-20 Thread Nigel Babu
Hello, Niels pointed out that there were some issues with Centos-regression not voting yesterday. As part of the Jenkins authorization clean up[1], I had accidentally deleted the known hosts file for the jenkins user. This caused the SSH command to not work and therefore no votes. I've fixed it

Re: [Gluster-infra] [Gluster-devel] Jenkins Jobs on Gerrit

2016-09-20 Thread Nigel Babu
On Mon, Sep 12, 2016 at 08:04:37AM +0200, Niels de Vos wrote: > Ah, ok, so the repository in GitHub will not be a mirror of the one in > Gerrit that contains the JJB files? Do you plan to have the new > repository (in Gerrit) also push to a repository on GitHub? I do not at this point intend to

[Gluster-infra] Emergency downtime for review.gluster.org and build.gluster.org

2016-09-23 Thread Nigel Babu
Hello folks, We need to urgently migrate review.gluster.org and build.gluster.org to a new physical server. We will be having the following emergency maintenance window on Saturday 24th September (tomorrow) and Sunday 25th September: 0900 to 1500 UTC 1430 to 2030 IST 0500 to 1100 EDT If all

Re: [Gluster-infra] centos-5 build failures on mainline

2016-09-21 Thread Nigel Babu
On Wed, Sep 21, 2016 at 11:53:43AM +0530, Atin Mukherjee wrote: > > > As of now we don't check for build sanity on RHEL5/centos-5 distros. > I believe Gluster still has legacy support for these distros. Here we could > either add a

[Gluster-infra] Jenkins Access Restrictions

2016-09-17 Thread Nigel Babu
Hello folks, Our Jenkins instance had way too many people having access and has not undergone a clean up. This is a huge problem as Jenkins has security issues anyway and we're running a much older version. There's a good chance that we won't have time to upgrade Jenkins soon. As an immediate

Re: [Gluster-infra] Reboot of jenkins/gerrit for upgrade and snapshot

2016-08-29 Thread Nigel Babu
Late in the day India time would be best, I think. 1400 UTC perhaps? On Mon, Aug 29, 2016 at 5:45 PM, Michael Scherer wrote: > Hi, > > so since the release is on the 30, I was wondering if people would be ok > with a small (less than 1h) downtime for upgrade and snapshot of

Re: [Gluster-infra] [regression tests] Aborted runs and diagnostic information

2016-09-28 Thread Nigel Babu
We don't collect any information before aborting tests. However, if we can put together a list of things we'd like to do collect before aborting jobs, I can look into what can be done to collect it. On Wed, Sep 28, 2016 at 4:19 PM, Raghavendra Gowdappa wrote: > Hi all, > >

[Gluster-infra] Catching up on Gerrit infrastructure debt

2016-09-27 Thread Nigel Babu
Hello, Our Gerrit instance runs on a Centos 5 machine and isn't automated with ansible. This is a bit of infrastructure debt for us. We're hoping to tackle this in the next couple of months. Here's a plan of action that we've come up with: https://github.com/gluster/infra-docs/wiki/Gerrit At

Re: [Gluster-infra] nbslave75 seems hosed

2016-10-26 Thread Nigel Babu
Thanks Jeff. I've rebooted the machine and put it back in the pool. Should work now, I suspect. On Wed, Oct 26, 2016 at 09:20:08PM -0400, Jeff Darcy wrote: > It's hanging right after "*** Build GlusterFS ***". I marked it offline, a > retriggered job on another node got past that point just

[Gluster-infra] Widespread outages

2016-10-27 Thread Nigel Babu
Hello, We're having issues with DNS, among other things. Red Hat IT is working on this and we'll see our services recover once DNS is back online. -- nigelb ___ Gluster-infra mailing list Gluster-infra@gluster.org

[Gluster-infra] Gerrit downtime beginning now

2016-11-18 Thread Nigel Babu
Hello, I'm taking Gerrit offline now. I'll post an update when it's online and ready again. -- nigelb ___ Gluster-infra mailing list Gluster-infra@gluster.org http://www.gluster.org/mailman/listinfo/gluster-infra

Re: [Gluster-infra] Gerrit downtime beginning now

2016-11-19 Thread Nigel Babu
Migration completed successfully! On Sat, Nov 19, 2016 at 12:05:18PM +0530, Nigel Babu wrote: > Hello, > > I'm taking Gerrit offline now. I'll post an update when it's online and ready > again. > > -- > nigelb -- nigelb ___ Glust

[Gluster-infra] Planned Gerrit outage from 0430 to 1030 on Nov 18

2016-11-17 Thread Nigel Babu
Hello folks, Now that 3.9 is released, we'd like to get started on planned infrastructure maintenance. If all goes well today, we'll have another maintenance window in weeks as well to move to Gerrit to CentOS 7. # Date and Time We're planning a 6-hour outage window tomorrow (Nov 18) from 0430

Re: [Gluster-infra] Ding dong, salt is no longer used

2016-12-13 Thread Nigel Babu
Yay! On Tue, Dec 13, 2016 at 11:13 PM, Michael Scherer wrote: > Hi, > > so I finally migrated all servers to be managed by ssh instead of the > salt bus, and I am now soon moving the server (salt-master) out of > rackspace to the cage, to a server called

Re: [Gluster-infra] I do not have access to communicate with Centos-CI

2016-12-01 Thread Nigel Babu
Michael, Does it work for you? I'm curious if I made a mistake in the format for multiple users. On Thu, Dec 1, 2016 at 6:28 AM, Luis Pabon wrote: > Hi guys, > While at Red Hat, I used to be able to start jobs on Centos-CI from > Heketi pull requests. For some reason, now

Re: [Gluster-infra] I do not have access to communicate with Centos-CI

2016-12-01 Thread Nigel Babu
016-12-01 at 23:56 +0530, Nigel Babu wrote: > > Michael, > > > > Does it work for you? I'm curious if I made a mistake in the format for > > multiple users. > > it works for me. > > What i don't understand: > > not only do I now have powers to do "@cento

Re: [Gluster-infra] I do not have access to communicate with Centos-CI

2016-12-04 Thread Nigel Babu
Hello, I've dug this up and the right approach is to be separated by a space. I've fixed this up. Could you both please test that it works fine? On Fri, Dec 2, 2016 at 9:30 AM, Nigel Babu <nig...@redhat.com> wrote: > Hi Michael and Luis, > > I couldn't find any documentation ei

[Gluster-infra] Jenkins restarted

2016-12-28 Thread Nigel Babu
Hello, I've had to restart Jenkins today because of a very long running job that couldn't be killed through any other means. If you had any jobs in progress or pending, you'll have to retrigger them. Apologies for the inconvinience. I will make sure that we have better ways of dealing with this

[Gluster-infra] Servers in UTC now (mostly)

2017-03-26 Thread Nigel Babu
Hello folks, All of our servers now speak UTC with two notable exceptions - gerrit-stage and production gerrit servers. These servers aren't yet connected to Ansible. They will will be connected in the next few weeks as we finish up code review for the ansible roles for Gerrit. Thanks to Michael

Re: [Gluster-infra] [Gluster-devel] RPM build failures post-mortem

2017-03-18 Thread Nigel Babu
This is all sorted now. I've restarted Jenkins so it's English rather than French :) -- nigelb signature.asc Description: PGP signature ___ Gluster-infra mailing list Gluster-infra@gluster.org http://lists.gluster.org/mailman/listinfo/gluster-infra

[Gluster-infra] Gerrit staging upgraded

2017-03-21 Thread Nigel Babu
Hello folks, I've upgraded Gerrit to 2.12.7. We run 2.12.2 in production. The changes are mostly bug fixes. The full release notes are in the release notes[1]. Please test out staging[2] and let me know if you notice anything wrong. [1]: https://www.gerritcodereview.com/releases/2.12.md#2.12.3

[Gluster-infra] Centos CI and Gerrit clone issues

2017-03-20 Thread Nigel Babu
Hello folks, This is email is only relevant if your project runs builds on CentOS CI and clones from the Gluster Gerrit instance. There's a networking issue that's re-emerged after the migration. I've brought it up with the Networking folks and the CentOS folks. I'm hoping it will be fixed later

Re: [Gluster-infra] Request for right permission levels on gluster-block github project

2017-03-20 Thread Nigel Babu
Please file a bug. On Mon, Mar 20, 2017 at 1:42 PM, Prasanna Kalever wrote: > Hi Infra-team, > > > As we choose github/issues as the board for bugs and other upstream > release tracking, I request for permissions on > https://github.com/gluster/gluster-block for activities

[Gluster-infra] RPM build failures post-mortem

2017-03-17 Thread Nigel Babu
Hello folks, You may have noticed that the RPM jobs failed quite often since the migration. This should finally be fixed now. Here's a quick post-mortem of what happened. After the restart, our Jenkins server has accidentally had a fr_FR locale. This means some of the logs are now in French. In

  1   2   3   >