Re: [Gluster-devel] Reduce regression runs wait time - New gerrit/review work flow

2015-06-17 Thread Kaushal M
On 16-Jun-2015 19:22, "Aravinda" wrote: > +1 for running regressions on need basis. > > Also we need to make the tests more intelligent so that same tests runs > differently when triggered nightly/regular. > > function test_some_functionality > { > if env.NIGHTLY { > # run nightly tes

Re: [Gluster-devel] Regression tests and improvement ideas

2015-06-17 Thread Kaushal M
On Thu, Jun 18, 2015 at 10:26 AM, Kotresh Hiremath Ravishankar wrote: > Hi All, > > Another thing to be considered is every patch automatically triggers > regressions. > It is very unlikely that, the very Patch Set 1 submitted would be a merge > candidate. > There would be some or the other revi

Re: [Gluster-devel] Regression tests and improvement ideas

2015-06-17 Thread Kaushal M
On Thu, Jun 18, 2015 at 1:17 AM, Niels de Vos wrote: > On Wed, Jun 17, 2015 at 04:26:13PM +0530, Raghavendra Talur wrote: >> Hi, >> >> >> MSV Bhat and I had presented in Gluster Design Summit some ideas about >> improving our testing infrastructure. >> >> Here is the link to the slides: http://red

[Gluster-devel] New tracker for glusterfs-3.7.3

2015-06-17 Thread Atin Mukherjee
Hi All, I've create a tracker bug for 3.7.3 [1]. If you are working on a 3.7.2 blocker bug [2] and don't think it can get merged in release-3.7 by today please start moving them from 3.7.2 to 3.7.3. I will be creating 3.7.2 tag today evening post which no patches will be taken in for 3.7.2. Please

Re: [Gluster-devel] Regression tests and improvement ideas

2015-06-17 Thread Kotresh Hiremath Ravishankar
Hi All, Another thing to be considered is every patch automatically triggers regressions. It is very unlikely that, the very Patch Set 1 submitted would be a merge candidate. There would be some or the other review comments to be addressed. Considering that, I think it would be a good idea to t

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Justin Clift
On 17 Jun 2015, at 20:14, Niels de Vos wrote: > On Wed, Jun 17, 2015 at 03:14:31PM +0200, Michael Scherer wrote: >> Le mercredi 17 juin 2015 à 11:58 +0100, Justin Clift a écrit : >>> On 17 Jun 2015, at 10:53, Michael Scherer wrote: Le mercredi 17 juin 2015 à 11:48 +0200, Michael Scherer a éc

[Gluster-devel] Open source-based object storage startup Minio raises $3.3M from Nexus, others

2015-06-17 Thread Justin Clift
Kind of interesting. This is a new startup by AB, one of the initial Gluster guys: http://www.vccircle.com/news/technology/2015/06/17/open-source-based-object-storage-startup-minio-raises-33m-nexus-others Regards and best wishes, Justin Clift -- GlusterFS - http://www.gluster.org An open s

Re: [Gluster-devel] NetBSD regressions not being triggered for patches

2015-06-17 Thread Vijay Bellur
On Wednesday 17 June 2015 04:23 PM, Niels de Vos wrote: On Wed, Jun 17, 2015 at 09:56:32PM +0200, Emmanuel Dreyfus wrote: Niels de Vos wrote: Maybe, but I hope those issues stay masked when resolving the hostnames is more stable. When we have the other servers up and running, we would have a

Re: [Gluster-devel] NetBSD regressions not being triggered for patches

2015-06-17 Thread Niels de Vos
On Wed, Jun 17, 2015 at 09:56:32PM +0200, Emmanuel Dreyfus wrote: > Niels de Vos wrote: > > > Maybe, but I hope those issues stay masked when resolving the hostnames > > is more stable. When we have the other servers up and running, we would > > have a better understanding and options to investig

Re: [Gluster-devel] [Gluster-infra] Reduce regression runs wait time - New gerrit/review work flow

2015-06-17 Thread Niels de Vos
On Mon, Jun 15, 2015 at 04:19:14PM +0530, Kaushal M wrote: > Hi all, ... > I propose that we move back to the old model of starting regression > runs only once the maintainers are ready to merge. But instead of the > maintainers manually tiggering the runs, we could automate it. I think auto trigg

Re: [Gluster-devel] NetBSD regressions not being triggered for patches

2015-06-17 Thread Emmanuel Dreyfus
Niels de Vos wrote: > Maybe, but I hope those issues stay masked when resolving the hostnames > is more stable. When we have the other servers up and running, we would > have a better understanding and options to investigate issues like this. But Jenkins is still unable to launch an agent on e.g

Re: [Gluster-devel] Regression tests and improvement ideas

2015-06-17 Thread Niels de Vos
On Wed, Jun 17, 2015 at 04:26:13PM +0530, Raghavendra Talur wrote: > Hi, > > > MSV Bhat and I had presented in Gluster Design Summit some ideas about > improving our testing infrastructure. > > Here is the link to the slides: http://redhat.slides.com/rtalur/distaf# > > Here are the same suggest

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Niels de Vos
On Wed, Jun 17, 2015 at 03:14:31PM +0200, Michael Scherer wrote: > Le mercredi 17 juin 2015 à 11:58 +0100, Justin Clift a écrit : > > On 17 Jun 2015, at 10:53, Michael Scherer wrote: > > > Le mercredi 17 juin 2015 à 11:48 +0200, Michael Scherer a écrit : > > >> Le mercredi 17 juin 2015 à 08:20 +02

Re: [Gluster-devel] NetBSD regressions not being triggered for patches

2015-06-17 Thread Niels de Vos
On Wed, Jun 17, 2015 at 11:48:46AM +0200, Michael Scherer wrote: > Le mercredi 17 juin 2015 à 08:20 +0200, Emmanuel Dreyfus a écrit : > > Venky Shankar wrote: > > > > > If that's the case, then I'll vote for this even if it takes some time > > > to get things in workable state. > > > > See my ot

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Niels de Vos
On Wed, Jun 17, 2015 at 12:13:46PM +, Emmanuel Dreyfus wrote: > On Wed, Jun 17, 2015 at 07:44:14AM -0400, Vijay Bellur wrote: > > Do we still have the NFS crash that was causing tests to hang? > > Do we still have it on rebased patchsets? Yes, the fixes depend on the refcounting change which

Re: [Gluster-devel] Regression tests and improvement ideas

2015-06-17 Thread Atin Mukherjee
Sent from one plus one On Jun 17, 2015 10:28 PM, "Raghavendra Talur" wrote: > > > On Jun 17, 2015 17:18, Atin Mukherjee wrote: > > > > > > > > On 06/17/2015 04:26 PM, Raghavendra Talur wrote: > > > Hi, > > > > > > > > > MSV Bhat and I had presented in Gluster Design Summit some ideas about > > >

Re: [Gluster-devel] Regression tests and improvement ideas

2015-06-17 Thread Raghavendra Talur
On Jun 17, 2015 22:27, Atin Mukherjee wrote: > > Sent from one plus one > On Jun 17, 2015 10:20 PM, "Anand Nekkunti" wrote: > > > > Hi All > >  I have  suggestion to improve regression test. > > Issue :   We are calling cleanup function at the starting and ending of each test (twice for each t

Re: [Gluster-devel] Regression tests and improvement ideas

2015-06-17 Thread Raghavendra Talur
On Jun 17, 2015 17:18, Atin Mukherjee wrote: > > > > On 06/17/2015 04:26 PM, Raghavendra Talur wrote: > > Hi, > > > > > > MSV Bhat and I had presented in Gluster Design Summit some ideas about > > improving our testing infrastructure. > > > > Here is the link to the slides: http://redhat.s

Re: [Gluster-devel] Regression tests and improvement ideas

2015-06-17 Thread Atin Mukherjee
Sent from one plus one On Jun 17, 2015 10:20 PM, "Anand Nekkunti" wrote: > > Hi All > I have suggestion to improve regression test. > Issue : We are calling cleanup function at the starting and ending of each test (twice for each test ). > #time prove -vf tests/bugs/glusterd/cleanup.t #(c

Re: [Gluster-devel] Regression tests and improvement ideas

2015-06-17 Thread Anand Nekkunti
Hi All I have suggestion to improve regression test. Issue : We are calling cleanup function at the starting and ending of each test (twice for each test ). #time prove -vf tests/bugs/glusterd/cleanup.t #(cleanup function called 20 times in loop ) -- find attached file *real0m29.14

Re: [Gluster-devel] [Gluster-infra] Reduce regression runs wait time - New gerrit/review work flow

2015-06-17 Thread Michael Scherer
Le lundi 15 juin 2015 à 16:19 +0530, Kaushal M a écrit : > Hi all, > > The recent rush of reviews being sent due to the release of 3.7 was a > cause of frustration for many of us because of the regression tests > (gerrit troubles themselves are another thing). > > W.R.T regression 3 main sources

Re: [Gluster-devel] [Gluster-infra] Status of nbslave7x

2015-06-17 Thread Emmanuel Dreyfus
On Wed, Jun 17, 2015 at 03:00:29PM +, Emmanuel Dreyfus wrote: > Oh no, it did, but nuked them all almost instantly (see below). I > disabled it again. Basically we have borken jenkins setups, and DNS > trouble prevent us from adding new VM. What a mess. I retriggered most of the jobs, but at

Re: [Gluster-devel] [Gluster-infra] Status of nbslave7x

2015-06-17 Thread Emmanuel Dreyfus
On Wed, Jun 17, 2015 at 08:34:06PM +0530, Kaushal M wrote: > Would restarting jenkins once help? It might help it pick up the newly > added entries to the hosts file. Won't it break all running jobs? -- Emmanuel Dreyfus m...@netbsd.org ___ Gluster-deve

[Gluster-devel] An update on GlusterD-2.0

2015-06-17 Thread Kaushal M
At the Gluster Summit, everyone agreed that GlusterD should be the first component to be targeted for GlusterFS-4.0. We had good discussions on what GlusterD lacks currently and what is required for GlusterD-2.0. KP and I had promised to send an update to mailing list summarizing the discussions, a

Re: [Gluster-devel] [Gluster-infra] Status of nbslave7x

2015-06-17 Thread Kaushal M
Would restarting jenkins once help? It might help it pick up the newly added entries to the hosts file. On Wed, Jun 17, 2015 at 8:30 PM, Emmanuel Dreyfus wrote: > On Wed, Jun 17, 2015 at 02:57:28PM +, Emmanuel Dreyfus wrote: >> I re-enabled it and it went online, but it does not seems to pick

Re: [Gluster-devel] [Gluster-infra] Status of nbslave7x

2015-06-17 Thread Emmanuel Dreyfus
On Wed, Jun 17, 2015 at 02:57:28PM +, Emmanuel Dreyfus wrote: > I re-enabled it and it went online, but it does not seems to pick a job. Oh no, it did, but nuked them all almost instantly (see below). I disabled it again. Basically we have borken jenkins setups, and DNS trouble prevent us fro

Re: [Gluster-devel] [Gluster-infra] Status of nbslave7x

2015-06-17 Thread Emmanuel Dreyfus
On Wed, Jun 17, 2015 at 07:39:06PM +0530, Kaushal M wrote: > nbslave7{d..f} were the entries created by Vijay last week, which were > resolving to nbslave71; there were no actual vms on rackspace. I had > disabled nbslave71 at that point in time to reboot it, but I think I > forgot to re-enable it.

Re: [Gluster-devel] [Gluster-infra] Status of nbslave7x

2015-06-17 Thread Kaushal M
nbslave7{d..f} were the entries created by Vijay last week, which were resolving to nbslave71; there were no actual vms on rackspace. I had disabled nbslave71 at that point in time to reboot it, but I think I forgot to re-enable it. ~kaushal On Wed, Jun 17, 2015 at 7:21 PM, Emmanuel Dreyfus wrot

[Gluster-devel] Status of nbslave7x

2015-06-17 Thread Emmanuel Dreyfus
Status of NetBSD slave VM: 1 booked: nbslave71 It is noted to be disconnected by amarts. Is usage over? 3 removed from rackspace but still in jenkins: nbslave7d, nbslave7e, nbslave7f 6 active: nbslave72, nbslave77, nbslave7c, nbslave7g, nbslave7i, nbslave7j 3 offline: nbslave74 nbslave75 nbs

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Michael Scherer
Le mercredi 17 juin 2015 à 11:58 +0100, Justin Clift a écrit : > On 17 Jun 2015, at 10:53, Michael Scherer wrote: > > Le mercredi 17 juin 2015 à 11:48 +0200, Michael Scherer a écrit : > >> Le mercredi 17 juin 2015 à 08:20 +0200, Emmanuel Dreyfus a écrit : > >>> Venky Shankar wrote: > >>> >

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Vijay Bellur
On Wednesday 17 June 2015 08:13 AM, Emmanuel Dreyfus wrote: On Wed, Jun 17, 2015 at 07:44:14AM -0400, Vijay Bellur wrote: Do we still have the NFS crash that was causing tests to hang? Do we still have it on rebased patchsets? I am not certain. I am still trying to come to terms with my ema

Re: [Gluster-devel] Notes on "brick multiplexing" in 4.0

2015-06-17 Thread Jeff Darcy
> One more question. I keep hearing about QoS for volumes as a feature. > How will we guarantee service quality for all the bricks from a single > server? Even if we weren't doing QoS, we make sure that operations on > brick doesn't DOS the others. We already keep hearing from users about > self-he

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Emmanuel Dreyfus
On Wed, Jun 17, 2015 at 07:44:14AM -0400, Vijay Bellur wrote: > Do we still have the NFS crash that was causing tests to hang? Do we still have it on rebased patchsets? -- Emmanuel Dreyfus m...@netbsd.org ___ Gluster-devel mailing list Gluster-devel@gl

Re: [Gluster-devel] Notes on "brick multiplexing" in 4.0

2015-06-17 Thread Vijay Bellur
On Wednesday 17 June 2015 02:21 AM, Kaushal M wrote: One more question. I keep hearing about QoS for volumes as a feature. How will we guarantee service quality for all the bricks from a single server? Even if we weren't doing QoS, we make sure that operations on brick doesn't DOS the others. We

Re: [Gluster-devel] Regression tests and improvement ideas

2015-06-17 Thread Atin Mukherjee
On 06/17/2015 04:26 PM, Raghavendra Talur wrote: > Hi, > > > MSV Bhat and I had presented in Gluster Design Summit some ideas about > improving our testing infrastructure. > > Here is the link to the slides: http://redhat.slides.com/rtalur/distaf# > > Here are the same suggestions, > > 1. *A

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Vijay Bellur
On Wednesday 17 June 2015 05:20 AM, Emmanuel Dreyfus wrote: On Wed, Jun 17, 2015 at 11:05:38AM +0200, Niels de Vos wrote: I've already scripted the reboot-vm job to use Rackspace API, the DNS requesting and formatting the results into some file can't be that difficult. Let me know if a /etc/host

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Kaushal M
Just moving Gerrit and Jenkins out of iWeb should help a lot. On Wed, Jun 17, 2015 at 4:28 PM, Justin Clift wrote: > On 17 Jun 2015, at 10:53, Michael Scherer wrote: >> Le mercredi 17 juin 2015 à 11:48 +0200, Michael Scherer a écrit : >>> Le mercredi 17 juin 2015 à 08:20 +0200, Emmanuel Dreyfus

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Justin Clift
On 17 Jun 2015, at 10:53, Michael Scherer wrote: > Le mercredi 17 juin 2015 à 11:48 +0200, Michael Scherer a écrit : >> Le mercredi 17 juin 2015 à 08:20 +0200, Emmanuel Dreyfus a écrit : >>> Venky Shankar wrote: >>> If that's the case, then I'll vote for this even if it takes some time

[Gluster-devel] Regression tests and improvement ideas

2015-06-17 Thread Raghavendra Talur
Hi, MSV Bhat and I had presented in Gluster Design Summit some ideas about improving our testing infrastructure. Here is the link to the slides: http://redhat.slides.com/rtalur/distaf# Here are the same suggestions, 1. *A .t file for a bug* When a community user discovers a bug in Gluster,

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Justin Clift
On 17 Jun 2015, at 07:29, Kaushal M wrote: > cloud.gluster.org is served by Rackspace Cloud DNS. AFAICT, there is > no readily available option to do zone transfers from it. We might > have to contact the Rackspace support to find out if they can do it as > a special request. Contacting Rackspace

Re: [Gluster-devel] Notes on "brick multiplexing" in 4.0

2015-06-17 Thread Justin Clift
On 17 Jun 2015, at 07:21, Kaushal M wrote: > One more question. I keep hearing about QoS for volumes as a feature. > How will we guarantee service quality for all the bricks from a single > server? Even if we weren't doing QoS, we make sure that operations on > brick doesn't DOS the others. We alr

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Michael Scherer
Le mercredi 17 juin 2015 à 11:48 +0200, Michael Scherer a écrit : > Le mercredi 17 juin 2015 à 08:20 +0200, Emmanuel Dreyfus a écrit : > > Venky Shankar wrote: > > > > > If that's the case, then I'll vote for this even if it takes some time > > > to get things in workable state. > > > > See my o

Re: [Gluster-devel] NetBSD regressions not being triggered for patches

2015-06-17 Thread Michael Scherer
Le mercredi 17 juin 2015 à 08:20 +0200, Emmanuel Dreyfus a écrit : > Venky Shankar wrote: > > > If that's the case, then I'll vote for this even if it takes some time > > to get things in workable state. > > See my other mail about this: you enter a new slave VM in the DNS and it > does not reso

[Gluster-devel] REMINDER: Weekly Gluster Community meeting today at 12:00 UTC (~90 minutes from now)

2015-06-17 Thread Niels de Vos
Hi All, In about 90 minutes from now we will have the regular weekly Gluster Community meeting. Meeting details: - location: #gluster-meeting on Freenode IRC - webchat: https://webchat.freenode.net/?channels=gluster-meeting - date: every Wednesday - time: 8:00 EDT, 12:00 UTC, 12:00 CEST, 17:30

Re: [Gluster-devel] NetBSD regressions not being triggered for patches

2015-06-17 Thread Emmanuel Dreyfus
On Wed, Jun 17, 2015 at 11:48:46AM +0200, Michael Scherer wrote: > And I think the DNS issues are just a symptom of a bigger network issue, > having local DNS might just mask the problem and which would then be non > DNS related ( like tcp connexion not working ). Well, if it is lost packets, TCP

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Emmanuel Dreyfus
On Wed, Jun 17, 2015 at 11:05:38AM +0200, Niels de Vos wrote: > I've already scripted the reboot-vm job to use Rackspace API, the DNS > requesting and formatting the results into some file can't be that > difficult. Let me know if a /etc/hosts format would do, or if you expect > something else. Pe

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Niels de Vos
On Wed, Jun 17, 2015 at 11:59:22AM +0530, Kaushal M wrote: > cloud.gluster.org is served by Rackspace Cloud DNS. AFAICT, there is > no readily available option to do zone transfers from it. We might > have to contact the Rackspace support to find out if they can do it as > a special request. Not s

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Nithya Balachandran
- Original Message - > From: "Avra Sengupta" > To: "Rajesh Joseph" , "Kaushal M" > Cc: "Gluster Devel" , "gluster-infra" > > Sent: Wednesday, June 17, 2015 1:42:25 PM > Subject: Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being > triggered for patches > > On 06/17/2015

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Avra Sengupta
On 06/17/2015 12:12 PM, Rajesh Joseph wrote: - Original Message - From: "Kaushal M" To: "Emmanuel Dreyfus" Cc: "Gluster Devel" , "gluster-infra" Sent: Wednesday, 17 June, 2015 11:59:22 AM Subject: Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patche

Re: [Gluster-devel] [Gluster-infra] NetBSD regressions not being triggered for patches

2015-06-17 Thread Emmanuel Dreyfus
On Wed, Jun 17, 2015 at 11:59:22AM +0530, Kaushal M wrote: > cloud.gluster.org is served by Rackspace Cloud DNS Perhaps we can change that and setup a DNS for the zone? -- Emmanuel Dreyfus m...@netbsd.org ___ Gluster-devel mailing list Gluster-devel@g