Re: [Gluster-devel] regarding spurious failure tests/bugs/bug-1112559.t

2014-07-14 Thread Joseph Fernandes
Hi All,

Thanks Justin for the setup(slave30). 

Executed the whole regression suite on slave30 multiple times. 

Once there was a failure of ./tests/basic/mgmt_v3-locks.t with a core
 http://build.gluster.org/job/rackspace-regression-2GB-joe/12/console

Test Summary Report
---
./tests/basic/mgmt_v3-locks.t   (Wstat: 0 Tests: 14 Failed: 3)
  Failed tests:  11-13
Files=250, Tests=4897, 3968 wallclock secs ( 1.91 usr  1.41 sys + 330.06 cusr 
457.27 csys = 790.65 CPU)
Result: FAIL
+ RET=1
++ ls -l /core.20215
++ wc -l

There is a glusterd crash 

Log files and core files are available @ 
http://build.gluster.org/job/rackspace-regression-2GB-joe/12/console


And the very next regression test  bug-1112559.t failed with the same port 
unavailability.
 http://build.gluster.org/job/rackspace-regression-2GB-joe/13/console


After this I restart slave30 and executed the whole regression test again and 
never hit his issue.
Looks like the issue is not originated @  bug-1112559.t. The failure in  
bug-1112559.t test 10 is the result because of a previous failure or crash.

Regards,
Joe

- Original Message -
From: Justin Clift jus...@gluster.org
To: Vijay Bellur vbel...@redhat.com
Cc: Avra Sengupta aseng...@redhat.com, Joseph Fernandes 
josfe...@redhat.com, Pranith Kumar Karampuri pkara...@redhat.com, 
Gluster Devel gluster-devel@gluster.org
Sent: Thursday, July 10, 2014 8:26:49 PM
Subject: Re: [Gluster-devel] regarding spurious failure tests/bugs/bug-1112559.t

On 10/07/2014, at 12:44 PM, Vijay Bellur wrote:
snip
 A lot of regression runs are failing because of this test unit. Given feature 
 freeze is around the corner, shall we provide a +1 verified manually for 
 those patchsets that fail this test?


Went through and did this manually, as Gluster Build System.

Also got Joe set up so he can debug things on a Rackspace VM
to find out what's wrong.

+ Justin

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] P

2014-07-14 Thread Emmanuel Dreyfus
Raghavendra Gowdappa rgowd...@redhat.com wrote:

 I can help you out with the review of the paper.

Here is it, please send a diff with your changes:
http://ftp.espci.fr/shadow/manu/fuse.txt

-- 
Emmanuel Dreyfus
http://hcpnet.free.fr/pubz
m...@netbsd.org
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] Proposal for change regarding latency calculation

2014-07-14 Thread Vipul Nayyar
Hello,

Following is a proposal for modifying the io profiling capability of the 
io-stats xlator. I recently sent in a patch(review.gluster.org/#/c/8244/) 
regarding that, which uses the already written latency related functions in 
io-stats to dump info through meta and added some more data containers which 
would track some more fops related info each time a request goes through 
io-stats. Currently, before the io-stats' custom latency functions can run, the 
measure_latency and count_fop_hits option should be enabled. I propose to 
remove these two options entirely from io-stats.

In order to track io performance, these options should be enabled all the time, 
or removed entirely, so that a record of io requests can be kept since mount 
time, else enabling these options only when it is required will not give you 
the average statistics over the whole period since the start. This is based on 
the methodology of Linux kernel itself, since it internally maintains the io 
statistics data structures all the time and presents it via /proc filesystem 
whenever required. Enabling of any option is not required, and the data 
available represents statistics since the boot time.

I would like to know the views over this, if having io-stats profiling info 
available all the time would be a good thing?

Apart from this, I was going over latency.c in libglusterfs, which does a fine 
job of maintaining latency info for every xlator and encountered an anomaly 
which I thought should be dealt with. The function gf_proc_dump_latency_info 
which dumps the latency array for the specified xlator consists of a last line 
which in the end flushes this array through memset after every dump. That 
means, you get different latency info every time you read the profile file in 
meta. I think, flushing the data structure after every dump is wrong since, you 
don't get overall stats since one enabled the option at the top of meta, and 
more importantly, multiple applications reading this file can get wrong info, 
since it gets cleared after one read only.

If my reasons seem apt for you, I'll send a patch over for evaluation.

Regards

Vipul Nayyar 
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Is this a transient failure?

2014-07-14 Thread Justin Clift
On 14/07/2014, at 6:38 AM, Pranith Kumar Karampuri wrote:
snip
 Kick off a regression test manually here, and see if the same
 failure occurs:
 
   http://build.gluster.org/job/rackspace-regression-2GB/
 
 If it happens again, it's not a spurious one.
 I believe this is a spurious one. I didn't get a chance to debug this issue.


Yeah, it ran through without any errors on the 2nd run. :)

  http://build.gluster.org/job/rackspace-regression-2GB/561/consoleFull

+ Justin

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] regarding spurious failure tests/bugs/bug-1112559.t

2014-07-14 Thread Justin Clift
On 14/07/2014, at 7:40 AM, Joseph Fernandes wrote:
snip
 After this I restart slave30 and executed the whole regression test again and 
 never hit his issue.
 Looks like the issue is not originated @  bug-1112559.t. The failure in  
 bug-1112559.t test 10 is the result because of a previous failure or crash.


Thanks Joe, that's excellent.  Sounds like we're making
progress. :)

Git blame has Avra's name all over mgmt_v3-locks.t, so I
guess Avra will take it from here. ;

Avra, is that core file and the logs for it useful?  It's
easy to give you a login for slave30 too, so you can
investigate at your leisure.  (useful?)

Regards and best wishes,

Justin Clift

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] Updating blog entry list on www.gluster.org?

2014-07-14 Thread Justin Clift
Hi Eco,

Humble just published a blog post about the new GlusterFS 3.4.5
beta2 RPMs:

  http://blog.gluster.org/2014/07/glusterfs-3-4-5beta2-rpms-are-available-now/

How do we get the www.gluster.org website updated, so new blog
posts appear automagically?

Regards and best wishes,

Justin Clift

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Patches to be merged before 3.6 branching

2014-07-14 Thread Kaushal M
My patch for improving peer identification [1] needs to get in. It's
functionally complete and can be merged right now. But KP has some
minor comments. I'll update it tonight, and it should be good for
merge by the morning,

~kaushal

[1] https://review.gluster.org/8238

On Mon, Jul 14, 2014 at 7:33 PM, Vijay Bellur vbel...@redhat.com wrote:
 Hi All,

 I intend creating the 3.6 branch tomorrow. After that, the branch will be
 restricted to bug fixes only. If you have any major patches to be reviewed
 and merged for release-3.6, please update this thread.

 Thanks,
 Vijay
 ___
 Gluster-devel mailing list
 Gluster-devel@gluster.org
 http://supercolony.gluster.org/mailman/listinfo/gluster-devel
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Patches to be merged before 3.6 branching

2014-07-14 Thread Anders Blomdell
On 2014-07-14 16:03, Vijay Bellur wrote:
 Hi All,
 
 I intend creating the 3.6 branch tomorrow. After that, the branch
 will be restricted to bug fixes only. If you have any major patches
 to be reviewed and merged for release-3.6, please update this
 thread.
Does this mean that https://bugzilla.redhat.com/show_bug.cgi?id=1113050
has no chance to get in (no patch for that yet, still trying to figure out
how things work inside gluster)?

I think http://review.gluster.org/8299 is important, since gluster will break
with some locales.

And I would really like to get http://review.gluster.org/8292, 
http://review.gluster.org/8208 and http://review.gluster.org/8203.

All the things above should already be on 
https://bugzilla.redhat.com/show_bug.cgi?id=1117822, so maybe this mail is just
noise.

/Anders

-- 
Anders Blomdell  Email: anders.blomd...@control.lth.se
Department of Automatic Control
Lund University  Phone:+46 46 222 4625
P.O. Box 118 Fax:  +46 46 138118
SE-221 00 Lund, Sweden

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] Is it OK to pick Code-Reviewer(s)

2014-07-14 Thread Anders Blomdell
When submitting patches where there is an/some obvious person(s) to blame,
is it OK/desirable to request them as Code-Reviewers in gerrit?

/Anders
-- 
Anders Blomdell  Email: anders.blomd...@control.lth.se
Department of Automatic Control
Lund University  Phone:+46 46 222 4625
P.O. Box 118 Fax:  +46 46 138118
SE-221 00 Lund, Sweden

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Is it OK to pick Code-Reviewer(s)

2014-07-14 Thread Jeff Darcy
 When submitting patches where there is an/some obvious person(s) to blame,
 is it OK/desirable to request them as Code-Reviewers in gerrit?

Inviting reviewers with clear interest or knowledge in a piece of code is
not only OK but recommended.  I think blame might not be a good idea,
though.
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Is it OK to pick Code-Reviewer(s)

2014-07-14 Thread Harshavardhana
On Mon, Jul 14, 2014 at 9:31 AM, Anders Blomdell
anders.blomd...@control.lth.se wrote:
 When submitting patches where there is an/some obvious person(s) to blame,
 is it OK/desirable to request them as Code-Reviewers in gerrit?

Gist of adding Core-Reviewers is to find faults in oneself - not the
other way around :-)

-- 
Religious confuse piety with mere ritual, the virtuous confuse
regulation with outcomes
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Patches to be merged before 3.6 branching

2014-07-14 Thread Justin Clift
On 14/07/2014, at 4:20 PM, Anders Blomdell wrote:
 On 2014-07-14 16:03, Vijay Bellur wrote:
 Hi All,
 
 I intend creating the 3.6 branch tomorrow. After that, the branch
 will be restricted to bug fixes only. If you have any major patches
 to be reviewed and merged for release-3.6, please update this
 thread.
 Does this mean that https://bugzilla.redhat.com/show_bug.cgi?id=1113050
 has no chance to get in (no patch for that yet, still trying to figure out
 how things work inside gluster)?

Sounds like that would be a bug fix, so it'd get applied to everything that
it makes sense too.  eg likely 3.6, 3.5, 3.7dev, etc.


 I think http://review.gluster.org/8299 is important, since gluster will break
 with some locales.

Also a bug fix.  It seems simpler to commit sooner rather than later, but
it'll depend on reviews.


 And I would really like to get http://review.gluster.org/8292,

IPv6 support.  Niels, have you had a change to look at this?  Should we
get this merged, and fix any bugs that turn up later?


 http://review.gluster.org/8208

Seems like a bugfix, so it can likely go in after Susant and others have
finished working on it.


 and http://review.gluster.org/8203.

Same as 8208, it looks like a bugfix.  Seems further along the dev/review
process.


 All the things above should already be on 
 https://bugzilla.redhat.com/show_bug.cgi?id=1117822, so maybe this mail is 
 just
 noise.


Nah, reminders are useful. :)

+ Justin

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Change in glusterfs[master]: porting: use __builtin_ffsll() instead of ffsll()

2014-07-14 Thread Pranith Kumar Karampuri

CC gluster-devel, Anuradha who committed the test.

Pranith

On 07/15/2014 01:58 AM, Harshavardhana wrote:

Mr Spurious is here again!


Patch Set 2: Verified-1

http://build.gluster.org/job/rackspace-regression-2GB-triggered/351/consoleFull 
: FAILED


Test Summary Report
---
./tests/bugs/bug-1038598.t  (Wstat: 0 Tests: 28 Failed: 1)
   Failed test:  28
Files=262, Tests=7738, 5904 wallclock secs ( 4.09 usr  2.35 sys +
546.04 cusr 750.64 csys = 1303.12 CPU)
Result: FAIL




___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Paper about GlusterFS on NetBSD

2014-07-14 Thread Emmanuel Dreyfus
Raghavendra Gowdappa rgowd...@redhat.com wrote:

 What is the time-line you want this to be reviewed within? I am busy this
 week. Is it ok if I can pick this up after this week? If it is very
 urgent I can try to allocate some time for it.

Next week is fine, no problem.

-- 
Emmanuel Dreyfus
http://hcpnet.free.fr/pubz
m...@netbsd.org
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] Change DEFAULT_WORKDIR from hard-coded value

2014-07-14 Thread Harshavardhana
http://review.gluster.org/#/c/8246/

Two important things it achieves

- Break-way from '/var/lib/glusterd' hard-coded previously,
  instead rely on 'configure' value from 'localstatedir'
- Provide 's/lib/db' as default working directory for gluster
  management daemon for BSD and Darwin based installations

${localstatedir}/db was used for FreeBSD (In fact FreeNAS) - where
we are planning for a 3.6 release integration as an experimental
option perhaps to begin with.

Since ${localstatedir}/lib is non-existent on non-linux platforms,
it was decided as a natural choice.

Future changes in next set would be migrate all the 'tests/*' to
handle non '/var/{lib,db}' directories.

Need your reviews on the present patchset, please chime in - thank you!

-- 
Religious confuse piety with mere ritual, the virtuous confuse
regulation with outcomes
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-devel