Re: [Gluster-devel] netbsd regression logs

2015-05-02 Thread Emmanuel Dreyfus
Emmanuel Dreyfus  wrote:

> Note that it failed a lot of jobs yesterday, I do not know why, but I am
> not sure the system is the culprit: nbslave7a exhibited the same
> behavior and is now fine while I did nothing for it.

I think it is git.gluster.org that misbehaved: I started
/autobuild/autobuild.sh on nbslave78 and it seems fine.

-- 
Emmanuel Dreyfus
http://hcpnet.free.fr/pubz
m...@netbsd.org
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] netbsd regression logs

2015-05-02 Thread Emmanuel Dreyfus
Atin Mukherjee  wrote:

> Is this reproducible in netbsd everytime, if yes I would need a VM to
> further debug it. 

nbslave78.cloud.gluster.org

Note that it failed a lot of jobs yesterday, I do not know why, but I am
not sure the system is the culprit: nbslave7a exhibited the same
behavior and is now fine while I did nothing for it.

>I am guessing that the reason of other failure from
> tests/geo-rep/georep-setup.t is same. Is it a new regression failure ?

Yes, I would say it started on april 30th but it is not ovious to tell
as NetBSD regression was already borken by the ENOKEY change.

-- 
Emmanuel Dreyfus
http://hcpnet.free.fr/pubz
m...@netbsd.org
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] netbsd regression logs

2015-05-01 Thread Atin Mukherjee


On 05/02/2015 09:08 AM, Atin Mukherjee wrote:
> 
> 
> On 05/02/2015 08:54 AM, Emmanuel Dreyfus wrote:
>> Pranith Kumar Karampuri  wrote:
>>
>>> Seems like glusterd failure from the looks of it: +glusterd folks.
>>>
>>> Running tests in file ./tests/basic/cdc.t
>>> volume delete: patchy: failed: Another transaction is in progress for
>>> patchy. Please try again after sometime.
>>> [18:16:40] ./tests/basic/cdc.t ..
>>> not ok 52
>>
>> This is a volume stop that fails. Logs says a lock is held by an UUID
>> which happeens to be the volume's own UUID. 
>>
>> I tried git bisect and it seems to be related to
>> http://review.gluster.org/9918 but I am not completely sure (I may have
>> botched by git bisect)
> 
> I'm looking into this.
Looking at the logs, here is the findings:

- gluster volume stop got timed out at cli because of which
cmd_history.log didn't capture it.
- glusterd acquired the volume lock in volume stop but didn't release it
somehow as gluster v delete failed saying another transaction is in progress
- For gluster volume stop transaction I could see glusterd_nfssvc_stop
was triggered but after that it didn't log anything for almost two
minutes, but catching point here is by this time volinfo->status should
have been marked as stopped and persisted in the disk, but gluster v
info didn't reflect the same.

Is this reproducible in netbsd everytime, if yes I would need a VM to
further debug it. I am guessing that the reason of other failure from
tests/geo-rep/georep-setup.t is same. Is it a new regression failure ?

~Atin
>>
> 

-- 
~Atin
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] netbsd regression logs

2015-05-01 Thread Atin Mukherjee


On 05/02/2015 08:54 AM, Emmanuel Dreyfus wrote:
> Pranith Kumar Karampuri  wrote:
> 
>> Seems like glusterd failure from the looks of it: +glusterd folks.
>>
>> Running tests in file ./tests/basic/cdc.t
>> volume delete: patchy: failed: Another transaction is in progress for
>> patchy. Please try again after sometime.
>> [18:16:40] ./tests/basic/cdc.t ..
>> not ok 52
> 
> This is a volume stop that fails. Logs says a lock is held by an UUID
> which happeens to be the volume's own UUID. 
> 
> I tried git bisect and it seems to be related to
> http://review.gluster.org/9918 but I am not completely sure (I may have
> botched by git bisect)

I'm looking into this.
> 

-- 
~Atin
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] netbsd regression logs

2015-05-01 Thread Emmanuel Dreyfus
Pranith Kumar Karampuri  wrote:

> Seems like glusterd failure from the looks of it: +glusterd folks.
> 
> Running tests in file ./tests/basic/cdc.t
> volume delete: patchy: failed: Another transaction is in progress for
> patchy. Please try again after sometime.
> [18:16:40] ./tests/basic/cdc.t ..
> not ok 52

This is a volume stop that fails. Logs says a lock is held by an UUID
which happeens to be the volume's own UUID. 

I tried git bisect and it seems to be related to
http://review.gluster.org/9918 but I am not completely sure (I may have
botched by git bisect)

-- 
Emmanuel Dreyfus
http://hcpnet.free.fr/pubz
m...@netbsd.org
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] netbsd regression logs

2015-05-01 Thread Pranith Kumar Karampuri

Seems like glusterd failure from the looks of it: +glusterd folks.

Running tests in file ./tests/basic/cdc.t
volume delete: patchy: failed: Another transaction is in progress for patchy. 
Please try again after sometime.
[18:16:40] ./tests/basic/cdc.t ..
not ok 52
not ok 53 Got "Started" instead of "Stopped"
not ok 54
not ok 55
Failed 4/55 subtests
[18:16:40]

Pranith

On 05/02/2015 01:23 AM, Emmanuel Dreyfus wrote:

Justin Clift  wrote:


They are archived, in /archives/logs/ on the regressions VM. It's just
that you have to get them through sftp.

Is it easy to add web access for them?

It was really easy:
http://nbslave76.cloud.gluster.org/archives/logs/glusterfs-logs-20150501182952.tgz

Now there is the script in jenkins to tweak to give the URL instead of 
host:/path
I go offline, feel free to beat me at fixing this.



___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] netbsd regression logs

2015-05-01 Thread Emmanuel Dreyfus
Justin Clift  wrote:

> > They are archived, in /archives/logs/ on the regressions VM. It's just
> > that you have to get them through sftp.
> 
> Is it easy to add web access for them? 

It was really easy:
http://nbslave76.cloud.gluster.org/archives/logs/glusterfs-logs-20150501182952.tgz

Now there is the script in jenkins to tweak to give the URL instead of 
host:/path
I go offline, feel free to beat me at fixing this.

-- 
Emmanuel Dreyfus
http://hcpnet.free.fr/pubz
m...@netbsd.org
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] netbsd regression logs

2015-05-01 Thread Emmanuel Dreyfus
Justin Clift  wrote:

> Is it easy to add web access for them? (eg nginx or whatever)

NetBSD has a built-in simple web server but I have never set it up. I
will look at it once I will have investigated the cdc.t regression.

-- 
Emmanuel Dreyfus
http://hcpnet.free.fr/pubz
m...@netbsd.org
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] netbsd regression logs

2015-05-01 Thread Justin Clift
On 1 May 2015, at 16:08, Emmanuel Dreyfus  wrote:
> Pranith Kumar Karampuri  wrote:
> 
>>  I was not able to re-create glupy failure. I see that netbsd
>> is not archiving logs like the linux regression. Do you mind adding that
>> one? I think kaushal and Vijay did this for Linux regressions, so CC them.
> 
> They are archived, in /archives/logs/ on the regressions VM. It's just
> that you have to get them through sftp.

Is it easy to add web access for them? (eg nginx or whatever)

We have the nginx rule for the CentOS ones around somewhere if it'd help?

+ Justin


> -- 
> Emmanuel Dreyfus
> http://hcpnet.free.fr/pubz
> m...@netbsd.org
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] netbsd regression logs

2015-05-01 Thread Emmanuel Dreyfus
Pranith Kumar Karampuri  wrote:

>   I was not able to re-create glupy failure. I see that netbsd
> is not archiving logs like the linux regression. Do you mind adding that
> one? I think kaushal and Vijay did this for Linux regressions, so CC them.

They are archived, in /archives/logs/ on the regressions VM. It's just
that you have to get them through sftp.

-- 
Emmanuel Dreyfus
http://hcpnet.free.fr/pubz
m...@netbsd.org
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel