Re: [Gluster-devel] How to cope with spurious regression failures

2016-03-09 Thread Raghavendra Talur
On Thu, Mar 3, 2016 at 7:12 AM, Raghavendra Talur wrote: > > > On Wed, Feb 10, 2016 at 8:29 PM, Emmanuel Dreyfus wrote: > >> On Wed, Feb 10, 2016 at 07:30:24PM +0530, Raghavendra Talur wrote: >> > Any comments before I merge the patch >>

Re: [Gluster-devel] How to cope with spurious regression failures

2016-03-02 Thread Emmanuel Dreyfus
Raghavendra Talur wrote: > Yes, because I updated from patch set 2 to 3 and tests for 2 were running > on the same slave. It seems my test for concurent runs misfires when previous run was aborted. I need to improve that. -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz

Re: [Gluster-devel] How to cope with spurious regression failures

2016-03-02 Thread Raghavendra Talur
On Mar 3, 2016 7:42 AM, "Emmanuel Dreyfus" wrote: > > Raghavendra Talur wrote: > > > The tests passed on the first run itself, except for the NetBSD with > > "another test running on slave" error. > > Was the previous test on the slave canceled? Yes, because

Re: [Gluster-devel] How to cope with spurious regression failures

2016-03-02 Thread Emmanuel Dreyfus
Raghavendra Talur wrote: > The tests passed on the first run itself, except for the NetBSD with > "another test running on slave" error. Was the previous test on the slave canceled? -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz m...@netbsd.org

Re: [Gluster-devel] How to cope with spurious regression failures

2016-03-02 Thread Raghavendra Talur
On Wed, Feb 10, 2016 at 8:29 PM, Emmanuel Dreyfus wrote: > On Wed, Feb 10, 2016 at 07:30:24PM +0530, Raghavendra Talur wrote: > > Any comments before I merge the patch > http://review.gluster.org/#/c/13393/ ? > > The proposal has the merit of adressing the multi-OS case, but

Re: [Gluster-devel] How to cope with spurious regression failures

2016-02-10 Thread Raghavendra Talur
Any comments before I merge the patch http://review.gluster.org/#/c/13393/ ? On Mon, Feb 8, 2016 at 3:15 PM, Raghavendra Talur wrote: > > > On Tue, Jan 19, 2016 at 8:33 PM, Emmanuel Dreyfus wrote: > >> On Tue, Jan 19, 2016 at 07:08:03PM +0530, Raghavendra

Re: [Gluster-devel] How to cope with spurious regression failures

2016-02-08 Thread Raghavendra Talur
On Tue, Jan 19, 2016 at 8:33 PM, Emmanuel Dreyfus wrote: > On Tue, Jan 19, 2016 at 07:08:03PM +0530, Raghavendra Talur wrote: > > a. Allowing re-running to tests to make them pass leads to complacency > with > > how tests are written. > > b. A test is bad if it is not

Re: [Gluster-devel] How to cope with spurious regression failures

2016-01-19 Thread Atin Mukherjee
On 01/19/2016 10:45 AM, Emmanuel Dreyfus wrote: > Hi > > Spurious regression failures make developers frustrated. One submits a > change and gets completely unrelated failures. The only way out is to > retrigger regression until it passes, a boring and time-wasting task. > Sometimes after 4 or

Re: [Gluster-devel] How to cope with spurious regression failures

2016-01-19 Thread Raghavendra Talur
On Tue, Jan 19, 2016 at 5:21 PM, Atin Mukherjee wrote: > > > On 01/19/2016 10:45 AM, Emmanuel Dreyfus wrote: > > Hi > > > > Spurious regression failures make developers frustrated. One submits a > > change and gets completely unrelated failures. The only way out is to > >

Re: [Gluster-devel] How to cope with spurious regression failures

2016-01-19 Thread Atin Mukherjee
On 01/19/2016 07:08 PM, Raghavendra Talur wrote: > > > On Tue, Jan 19, 2016 at 5:21 PM, Atin Mukherjee > wrote: > > > > On 01/19/2016 10:45 AM, Emmanuel Dreyfus wrote: > > Hi > > > > Spurious regression failures make

Re: [Gluster-devel] How to cope with spurious regression failures

2016-01-19 Thread Emmanuel Dreyfus
On Tue, Jan 19, 2016 at 07:08:03PM +0530, Raghavendra Talur wrote: > a. Allowing re-running to tests to make them pass leads to complacency with > how tests are written. > b. A test is bad if it is not deterministic and running a bad test has *no* > value. We are wasting time even if the test runs