[Gluster-devel] REMINDER: Gluster Community Bug Triage meeting today at 12:00 UTC

2015-02-17 Thread Niels de Vos
Hi all,

Later today we will have an other Gluster Community Bug Triage meeting.

Meeting details:
- location: #gluster-meeting on Freenode IRC
   - web client: https://webchat.freenode.net/?channels=gluster-meeting
- date: every Tuesday
- time: 12:00 UTC, 13:00 CET (in your terminal, run: date -d "12:00 UTC")
- agenda: https://public.pad.fsfe.org/p/gluster-bug-triage

Currently the following items are listed:
* Roll Call
* Status of last weeks action items
* Group Triage
* Open Floor

The last two topics have space for additions. If you have a suitable bug
or topic to discuss, please add it to the agenda.

Thanks,
Niels


pgppP_ITBbxIk.pgp
Description: PGP signature
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] [Gluster-users] glusterfs-3.6.3beta1 released

2015-02-17 Thread Kingsley
Hi,

Your alternative URL appears to be exactly the same. Not that I'm having
issues with either copy ... :)

Cheers,
Kingsley.

On Fri, 2015-02-13 at 17:06 +0530, Humble Devassy Chirammal wrote:
> >glusterfs-3.6.3beta1 has been released and can be found here. 
> http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.6.3beta1/
> >
> 
> 
> 
> The above url is getting redirected to "3.6.2 beta2" location.  
> 
> 
> Use below url in that situation :)
> 
> 
> http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.6.3beta1/
> 
> 
> 
> 
> --Humble
> 
> 
> 
> 
> 
> 
> 
> On Fri, Feb 13, 2015 at 3:57 PM, Raghavendra Bhat 
> wrote:
> 
> Hi 
> 
> glusterfs-3.6.3beta1 has been released and can be found here. 
> 
> http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.6.3beta1/
> 
> This beta release supposedly fixes the bugs listed below since
> 3.6.2 was made available. Thanks to all who submitted the
> patches, reviewed the changes.
> 
> 1138897 - NetBSD port
> 1184527 - Some newly created folders have root ownership
> although created by unprivileged user
> 1181977 - gluster vol clear
> 1159471 - rename operation leads to core dump
> 1173528 - Change in volume heal info command output
> 1186119 - tar on a gluster directory gives message "file
> changed as we read it" even though no updates to file in
> progress
> 1183716 - Force replace
> 1178590 - Enable quota(default) leads to heal directory's
> xattr failed.
> 1182490 - Internal ec xattrs are allowed to be modified
> 1187547 - self-heal-algorithm with option "full" doesn't heal
> sparse files correctly
> 1174170 - Glusterfs outputs a lot of warnings and errors when
> quota is enabled
> 1186119 - tar on a gluster directory gives message "file
> changed as we read it" even though no updates to file in
> progress
> 
> Regards,
> Raghavendra Bhat
> 
> 
> 
> 
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
> 
> 
> 
> 
> 
> ___
> Gluster-users mailing list
> gluster-us...@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] Object Quota feature proposal for GlusterFS-3.7

2015-02-17 Thread Vijaikumar M

Hi All,

We are proposing files/objects quota feature for GlusterFS-3.7.

Here is the feature page: 
http://www.gluster.org/community/documentation/index.php/Features/Object_Count



'Object Quotas' is an enhancement to the existing 'File Usage Quotas' 
and has the following benefits:


 * Easy to query number of objects present in a volume.
 * Can serve as an accounting mechanism for quota enforcement based on
   number of Inodes.
 * This interface will be useful for integration with OpenStack Swift
   and Ceilometer.


We can set the following Quota object limits, similar to file usage:

 * 1) Directory level - limit the number of files at the directory level
 * 2) Volume level - limit the number of files at the volume level




Looking forward for Question/Feedback.

Thanks,
Vijay

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] Minutes of todays Gluster Community Bug Triage meeting

2015-02-17 Thread Niels de Vos
On Tue, Feb 17, 2015 at 12:05:05PM +0100, Niels de Vos wrote:
> Hi all,
> 
> Later today we will have an other Gluster Community Bug Triage meeting.
> 
> Meeting details:
> - location: #gluster-meeting on Freenode IRC
>- web client: https://webchat.freenode.net/?channels=gluster-meeting
> - date: every Tuesday
> - time: 12:00 UTC, 13:00 CET (in your terminal, run: date -d "12:00 UTC")
> - agenda: https://public.pad.fsfe.org/p/gluster-bug-triage
> 
> Currently the following items are listed:
> * Roll Call
> * Status of last weeks action items
> * Group Triage
> * Open Floor
> 
> The last two topics have space for additions. If you have a suitable bug
> or topic to discuss, please add it to the agenda.

Participation was rather low today, so we only triaged the new bugs and did not
handle the open standing action items. I hope we will have more people joining
next week.

Thanks,
Niels


Minutes: 
http://meetbot.fedoraproject.org/gluster-meeting/2015-02-17/gluster-meeting.2015-02-17-12.01.html
Minutes (text): 
http://meetbot.fedoraproject.org/gluster-meeting/2015-02-17/gluster-meeting.2015-02-17-12.01.txt
Log: 
http://meetbot.fedoraproject.org/gluster-meeting/2015-02-17/gluster-meeting.2015-02-17-12.01.log.html


Meeting summary
---
* Meeting agenda: https://public.pad.fsfe.org/p/gluster-bug-triage
  (ndevos, 12:01:57)
* Roll Call  (ndevos, 12:02:11)

* Group Triage  (ndevos, 12:06:35)

* Open Floor  (ndevos, 12:44:08)

Meeting ended at 12:47:22 UTC.




Action Items






Action Items, by person
---
* **UNASSIGNED**
  * (none)




People Present (lines said)
---
* ndevos (32)
* lalatenduM (18)
* keithley_ (10)
* zodbot (2)


pgpD5jPxnMKIY.pgp
Description: PGP signature
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] Who changed the rackspace regression test job and didn't tell anyone?

2015-02-17 Thread Justin Clift
Just discovered the Rackspace regression testing job has been altered
to only require a GERRIT_REFSPEC now, instead of previous parameter set.

(just searched through gluster-infra and gluster-devel mailing lists,
no mention there that I can see)

The change itself doesn't bother me (optimisations are encouraged).

But leaving the team to find out about it the hard way DOES bother me.
(and not sure this is really an "optimisation", as it no longer picks
the latest version of a given CR)

Not happy. :(

+ Justin

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Who changed the rackspace regression test job and didn't tell anyone?

2015-02-17 Thread Justin Clift
... and ignore this.  Turns out it's my own fault mixing up job parameter
lists.  How embarrassing. ;)

+ Justin


On 17 Feb 2015, at 18:18, Justin Clift  wrote:
> Just discovered the Rackspace regression testing job has been altered
> to only require a GERRIT_REFSPEC now, instead of previous parameter set.
> 
> (just searched through gluster-infra and gluster-devel mailing lists,
> no mention there that I can see)
> 
> The change itself doesn't bother me (optimisations are encouraged).
> 
> But leaving the team to find out about it the hard way DOES bother me.
> (and not sure this is really an "optimisation", as it no longer picks
> the latest version of a given CR)
> 
> Not happy. :(
> 
> + Justin
> 
> --
> GlusterFS - http://www.gluster.org
> 
> An open source, distributed file system scaling to several
> petabytes, and handling thousands of clients.
> 
> My personal twitter: twitter.com/realjustinclift
> 
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] Gluster Design Summit

2015-02-17 Thread Tom Callaway
Hello Gluster people! I'd like to propose that we bring our Gluster
community together for an in-person summit. This event will have a few
goals:

* To come together to discuss the features and changes we want to see in
the future of GlusterFS
* To hear from our user community about their experiences (and hopes)
for Gluster
* To encourage our greater Gluster ecosystem (think GlusterForge)

While it would be easy enough to have this summit on IRC or Google
Hangouts, I believe in the importance of meeting face-to-face, and I
think it accelerates our efforts to grow the Gluster Community.

On to the logistics:

When: I'm looking at sometime during the second week of May (May 11-15).
Alternately, the third week of April (April 13-19), though, I'm
concerned about being able to get it all in place before then. I'd like
to have at least one day worth of scheduled presentations, then another
day for an in-person board meeting and open sprints, so this would make
a total of two days of Summit.

Where: I know we have a lot of international Gluster contributors who
are not in the United States, so I'm open to suggestion on this point. A
quick internet search seems to imply that large international airports
like Washington DC, New York, Chicago, and Los Angeles have cheaper
international flights. I only suggest the US as a location country
because it tends to be simpler for people to travel to the US from a
visa and logistics perspective, but if anyone wants to make the case for
a different location country, speak up (quickly).

Who gets to go: The event will be open to anyone who wishes to attend,
but we want to encourage active community members to be present. The
intention is to use the bulk of the funding allocated to this event to
cover travel and lodging costs for members of the Gluster community who
wish to present and/or sprint. (Yes, you read that right. We will cover
the travel and hotel costs for community contributors to attend, as
needed, and as funding permits.)

How can I help?

Right now, we need for people interested in the Gluster Design Summit to
fill out a Google Form so we can track that interest and start to nail
down the specifics about the event.

If you'd like to attend the Gluster Design Summit, please go here:

http://goo.gl/forms/NYRFz5aaop

Thanks in advance,

Tom Callaway
Gluster Community Manager

==
Red Hat
<>___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] Looking for volunteer to write up official "How to do GlusterFS in the Cloud: The Right Way" for Rackspace...

2015-02-17 Thread Justin Clift
Yeah, huge subject line.  :)

But it gets the message across... Rackspace provide us a *bunch* of online VM's
which we have our infrastructure in + run the majority of our regression tests
with.

They've asked us if we could write up a "How to do GlusterFS in the Cloud: The
Right Way" (technical) doc, for them to add to their doc collection.
They get asked for this a lot by customers. :D

Sooo... looking for volunteers to write this up.  And yep, you're welcome to
have your name all over it (eg this is good promo/CV material :>)

VM's (in Rackspace obviously) will be provided of course.

Anyone interested?

(Note - not suitable for a GlusterFS newbie. ;))

Regards and best wishes,

Justin Clift

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] [Gluster-users] Gluster Design Summit

2015-02-17 Thread Justin Clift
On 17 Feb 2015, at 19:28, Tom Callaway  wrote:

> Where: I know we have a lot of international Gluster contributors who
> are not in the United States, so I'm open to suggestion on this point. A
> quick internet search seems to imply that large international airports
> like Washington DC, New York, Chicago, and Los Angeles have cheaper
> international flights. I only suggest the US as a location country
> because it tends to be simpler for people to travel to the US from a
> visa and logistics perspective, but if anyone wants to make the case for
> a different location country, speak up (quickly).

Please, anywhere but the US.  What's wrong with Europe? ;)

+ Justin

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Looking for volunteer to write up official "How to do GlusterFS in the Cloud: The Right Way" for Rackspace...

2015-02-17 Thread Josh Boon
Do we have use cases to focus on? Gluster is part of the answer to many 
different questions so if it's things like simple replication and distribution 
and basic performance tuning I could help. I also have a heavy Ubuntu tilt so 
if it's Red Hat oriented I'm not much help :) 


- Original Message -
From: "Justin Clift" 
To: "Gluster Users" , "Gluster Devel" 

Cc: "Jesse Noller" 
Sent: Tuesday, February 17, 2015 9:37:05 PM
Subject: [Gluster-devel] Looking for volunteer to write up official "How to 
do GlusterFS in the Cloud: The Right Way" for Rackspace...

Yeah, huge subject line.  :)

But it gets the message across... Rackspace provide us a *bunch* of online VM's
which we have our infrastructure in + run the majority of our regression tests
with.

They've asked us if we could write up a "How to do GlusterFS in the Cloud: The
Right Way" (technical) doc, for them to add to their doc collection.
They get asked for this a lot by customers. :D

Sooo... looking for volunteers to write this up.  And yep, you're welcome to
have your name all over it (eg this is good promo/CV material :>)

VM's (in Rackspace obviously) will be provided of course.

Anyone interested?

(Note - not suitable for a GlusterFS newbie. ;))

Regards and best wishes,

Justin Clift

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] missing files

2015-02-17 Thread David F. Robinson

Any updates on this issue?  Thanks in advance...

David


-- Original Message --
From: "Shyam" 
To: "David F. Robinson" ; "Justin Clift" 


Cc: "Gluster Devel" 
Sent: 2/11/2015 10:02:09 PM
Subject: Re: [Gluster-devel] missing files


On 02/11/2015 08:28 AM, David F. Robinson wrote:
My base filesystem has 40-TB and the tar takes 19 minutes. I copied 
over 10-TB and it took the tar extraction from 1-minute to 7-minutes.


My suspicion is that it is related to number of files and not 
necessarily file size. Shyam is looking into reproducing this behavior 
on a redhat system.


I am able to reproduce the issue on a similar setup internally (at 
least at the surface it seems to be similar to what David is facing).


I will continue the investigation for the root cause.

Shyam


___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] [Gluster-users] Gluster Design Summit

2015-02-17 Thread Joe Julian


On 02/17/2015 01:40 PM, Justin Clift wrote:

On 17 Feb 2015, at 19:28, Tom Callaway  wrote:


Where: I know we have a lot of international Gluster contributors who
are not in the United States, so I'm open to suggestion on this point. A
quick internet search seems to imply that large international airports
like Washington DC, New York, Chicago, and Los Angeles have cheaper
international flights. I only suggest the US as a location country
because it tends to be simpler for people to travel to the US from a
visa and logistics perspective, but if anyone wants to make the case for
a different location country, speak up (quickly).

Please, anywhere but the US.  What's wrong with Europe? ;)


As long as it's on Red Hat's dime, I'm open to anywhere in the world... 
um, my wife is also a huge supporter, she'll need to go with me. Yeah, 
that's the ticket...

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Looking for volunteer to write up official "How to do GlusterFS in the Cloud: The Right Way" for Rackspace...

2015-02-17 Thread Justin Clift
On 17 Feb 2015, at 21:49, Josh Boon  wrote:
> Do we have use cases to focus on? Gluster is part of the answer to many 
> different questions so if it's things like simple replication and 
> distribution and basic performance tuning I could help. I also have a heavy 
> Ubuntu tilt so if it's Red Hat oriented I'm not much help :)

Jesse, thoughts on this?

I kinda think it would be useful to have instructions which give
correct steps for Ubuntu + Red Hat (and anything else suitable).

Josh, if Jesse agrees, then your Ubuntu knowledge will probably
be useful for this. ;)

+ Justin


> 
> - Original Message -
> From: "Justin Clift" 
> To: "Gluster Users" , "Gluster Devel" 
> 
> Cc: "Jesse Noller" 
> Sent: Tuesday, February 17, 2015 9:37:05 PM
> Subject: [Gluster-devel] Looking for volunteer to write up official "How to   
> do GlusterFS in the Cloud: The Right Way" for Rackspace...
> 
> Yeah, huge subject line.  :)
> 
> But it gets the message across... Rackspace provide us a *bunch* of online 
> VM's
> which we have our infrastructure in + run the majority of our regression tests
> with.
> 
> They've asked us if we could write up a "How to do GlusterFS in the Cloud: The
> Right Way" (technical) doc, for them to add to their doc collection.
> They get asked for this a lot by customers. :D
> 
> Sooo... looking for volunteers to write this up.  And yep, you're welcome to
> have your name all over it (eg this is good promo/CV material :>)
> 
> VM's (in Rackspace obviously) will be provided of course.
> 
> Anyone interested?
> 
> (Note - not suitable for a GlusterFS newbie. ;))
> 
> Regards and best wishes,
> 
> Justin Clift
> 
> --
> GlusterFS - http://www.gluster.org
> 
> An open source, distributed file system scaling to several
> petabytes, and handling thousands of clients.
> 
> My personal twitter: twitter.com/realjustinclift
> 
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Looking for volunteer to write up official "How to do GlusterFS in the Cloud: The Right Way" for Rackspace...

2015-02-17 Thread Benjamin Turner
This is interesting to me, I'd like the chance to run my performance tests
on a cloud provider's systems.  We could put together some recommendations
for configuration, tuning, and performance numbers?  Also it would be cool
to enhance my setup scripts to work with cloud instances.  Sound like what
you are looking for ish?

-b

On Tue, Feb 17, 2015 at 5:06 PM, Justin Clift  wrote:

> On 17 Feb 2015, at 21:49, Josh Boon  wrote:
> > Do we have use cases to focus on? Gluster is part of the answer to many
> different questions so if it's things like simple replication and
> distribution and basic performance tuning I could help. I also have a heavy
> Ubuntu tilt so if it's Red Hat oriented I'm not much help :)
>
> Jesse, thoughts on this?
>
> I kinda think it would be useful to have instructions which give
> correct steps for Ubuntu + Red Hat (and anything else suitable).
>
> Josh, if Jesse agrees, then your Ubuntu knowledge will probably
> be useful for this. ;)
>
> + Justin
>
>
> >
> > - Original Message -
> > From: "Justin Clift" 
> > To: "Gluster Users" , "Gluster Devel" <
> gluster-devel@gluster.org>
> > Cc: "Jesse Noller" 
> > Sent: Tuesday, February 17, 2015 9:37:05 PM
> > Subject: [Gluster-devel] Looking for volunteer to write up official "How
> to   do GlusterFS in the Cloud: The Right Way" for Rackspace...
> >
> > Yeah, huge subject line.  :)
> >
> > But it gets the message across... Rackspace provide us a *bunch* of
> online VM's
> > which we have our infrastructure in + run the majority of our regression
> tests
> > with.
> >
> > They've asked us if we could write up a "How to do GlusterFS in the
> Cloud: The
> > Right Way" (technical) doc, for them to add to their doc collection.
> > They get asked for this a lot by customers. :D
> >
> > Sooo... looking for volunteers to write this up.  And yep, you're
> welcome to
> > have your name all over it (eg this is good promo/CV material :>)
> >
> > VM's (in Rackspace obviously) will be provided of course.
> >
> > Anyone interested?
> >
> > (Note - not suitable for a GlusterFS newbie. ;))
> >
> > Regards and best wishes,
> >
> > Justin Clift
> >
> > --
> > GlusterFS - http://www.gluster.org
> >
> > An open source, distributed file system scaling to several
> > petabytes, and handling thousands of clients.
> >
> > My personal twitter: twitter.com/realjustinclift
> >
> > ___
> > Gluster-devel mailing list
> > Gluster-devel@gluster.org
> > http://www.gluster.org/mailman/listinfo/gluster-devel
>
> --
> GlusterFS - http://www.gluster.org
>
> An open source, distributed file system scaling to several
> petabytes, and handling thousands of clients.
>
> My personal twitter: twitter.com/realjustinclift
>
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] Two consistent regression failures in release-3.6 HEAD

2015-02-17 Thread Justin Clift
We seem to have two non-spurious regression failures in release-3.6
HEAD:

  ./tests/bugs/bug-1045333.t (Wstat: 0 Tests: 16 Failed: 1)
Failed test:  15
  ./tests/features/ssl-authz.t   (Wstat: 0 Tests: 18 Failed: 1)
Failed test:  18

Found while running a "burn in" regression run on some new
Rackpace nodes, prior to swapping out some of our busted ones.

They happened on both runs:

  slave30 (will become slave20)
  http://build.gluster.org/job/regression-test-burn-in/3/console

  slave31 (may or may not be kept)
  http://build.gluster.org/job/regression-test-burn-in/4/console

Avra, git blame says you're the primary author for bug-1045333.t,
do you want to take a look?

Jeff, ditto for ssl-authz.t?

+ Justin

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Looking for volunteer to write up official "How to do GlusterFS in the Cloud: The Right Way" for Rackspace...

2015-02-17 Thread Justin Clift
Yeah, that'd be pretty optimal.  How full on do you want to go?

Should we look into arranging some OnMetal stuff, in addition to the
VM offerings?

Jesse, Ben is our *very best* GlusterFS and RHS performance tuning
expert, so capturing his interest is a *very* good thing. ;)

+ Justin

On 17 Feb 2015, at 23:10, Benjamin Turner  wrote:
> This is interesting to me, I'd like the chance to run my performance tests on 
> a cloud provider's systems.  We could put together some recommendations for 
> configuration, tuning, and performance numbers?  Also it would be cool to 
> enhance my setup scripts to work with cloud instances.  Sound like what you 
> are looking for ish?
> 
> -b
> 
> On Tue, Feb 17, 2015 at 5:06 PM, Justin Clift  wrote:
> On 17 Feb 2015, at 21:49, Josh Boon  wrote:
> > Do we have use cases to focus on? Gluster is part of the answer to many 
> > different questions so if it's things like simple replication and 
> > distribution and basic performance tuning I could help. I also have a heavy 
> > Ubuntu tilt so if it's Red Hat oriented I'm not much help :)
> 
> Jesse, thoughts on this?
> 
> I kinda think it would be useful to have instructions which give
> correct steps for Ubuntu + Red Hat (and anything else suitable).
> 
> Josh, if Jesse agrees, then your Ubuntu knowledge will probably
> be useful for this. ;)
> 
> + Justin
> 
> 
> >
> > - Original Message -
> > From: "Justin Clift" 
> > To: "Gluster Users" , "Gluster Devel" 
> > 
> > Cc: "Jesse Noller" 
> > Sent: Tuesday, February 17, 2015 9:37:05 PM
> > Subject: [Gluster-devel] Looking for volunteer to write up official "How to 
> >   do GlusterFS in the Cloud: The Right Way" for Rackspace...
> >
> > Yeah, huge subject line.  :)
> >
> > But it gets the message across... Rackspace provide us a *bunch* of online 
> > VM's
> > which we have our infrastructure in + run the majority of our regression 
> > tests
> > with.
> >
> > They've asked us if we could write up a "How to do GlusterFS in the Cloud: 
> > The
> > Right Way" (technical) doc, for them to add to their doc collection.
> > They get asked for this a lot by customers. :D
> >
> > Sooo... looking for volunteers to write this up.  And yep, you're welcome to
> > have your name all over it (eg this is good promo/CV material :>)
> >
> > VM's (in Rackspace obviously) will be provided of course.
> >
> > Anyone interested?
> >
> > (Note - not suitable for a GlusterFS newbie. ;))
> >
> > Regards and best wishes,
> >
> > Justin Clift
> >
> > --
> > GlusterFS - http://www.gluster.org
> >
> > An open source, distributed file system scaling to several
> > petabytes, and handling thousands of clients.
> >
> > My personal twitter: twitter.com/realjustinclift
> >
> > ___
> > Gluster-devel mailing list
> > Gluster-devel@gluster.org
> > http://www.gluster.org/mailman/listinfo/gluster-devel
> 
> --
> GlusterFS - http://www.gluster.org
> 
> An open source, distributed file system scaling to several
> petabytes, and handling thousands of clients.
> 
> My personal twitter: twitter.com/realjustinclift
> 
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
> 

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] Sqlite3 dependency for Data Tiering

2015-02-17 Thread Joseph Fernandes
Hi Guys,

The upcoming Data tiering/Classification feature has a dependency on Sqlite3 
Devel packages.
Could you please suggest me, how do I include sqlite3 devel packages 
automatically in
the GlusterFS upstream code.

Regards,
Joe
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Sqlite3 dependency for Data Tiering

2015-02-17 Thread Justin Clift
On 18 Feb 2015, at 01:59, Joseph Fernandes  wrote:
> Hi Guys,
> 
> The upcoming Data tiering/Classification feature has a dependency on Sqlite3 
> Devel packages.
> Could you please suggest me, how do I include sqlite3 devel packages 
> automatically in
> the GlusterFS upstream code.

It'll be a dependency in the .rpm/.deb/etc won't it?

If so, it *should* (in theory) be reasonably simple. :)

+ Justin

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Sqlite3 dependency for Data Tiering

2015-02-17 Thread Joseph Fernandes
Then there will be two things 
1) Update the this page 
http://www.gluster.org/community/documentation/index.php/CompilingRPMS#Common_Steps
i.e add yum install sqlite3-devel 

2) Modify configure.ac to check if the sqlite3-devel packages are installed 
before make.

Is there something I am missing?

~Joe 

- Original Message -
From: "Justin Clift" 
To: "Joseph Fernandes" 
Cc: "gluster Devel" , "Kaleb KEITHLEY" 
, "Niels de Vos" 
Sent: Wednesday, February 18, 2015 7:35:48 AM
Subject: Re: Sqlite3 dependency for Data Tiering

On 18 Feb 2015, at 01:59, Joseph Fernandes  wrote:
> Hi Guys,
> 
> The upcoming Data tiering/Classification feature has a dependency on Sqlite3 
> Devel packages.
> Could you please suggest me, how do I include sqlite3 devel packages 
> automatically in
> the GlusterFS upstream code.

It'll be a dependency in the .rpm/.deb/etc won't it?

If so, it *should* (in theory) be reasonably simple. :)

+ Justin

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Sqlite3 dependency for Data Tiering

2015-02-17 Thread Joseph Fernandes
Also update this page

http://www.gluster.org/community/documentation/index.php/Development_Work_Flow#Environment_Setup

- Original Message -
From: "Joseph Fernandes" 
To: "Justin Clift" 
Cc: "gluster Devel" , "Kaleb KEITHLEY" 
, "Niels de Vos" 
Sent: Wednesday, February 18, 2015 7:52:02 AM
Subject: Re: Sqlite3 dependency for Data Tiering

Then there will be two things 
1) Update the this page 
http://www.gluster.org/community/documentation/index.php/CompilingRPMS#Common_Steps
i.e add yum install sqlite3-devel 

2) Modify configure.ac to check if the sqlite3-devel packages are installed 
before make.

Is there something I am missing?

~Joe 

- Original Message -
From: "Justin Clift" 
To: "Joseph Fernandes" 
Cc: "gluster Devel" , "Kaleb KEITHLEY" 
, "Niels de Vos" 
Sent: Wednesday, February 18, 2015 7:35:48 AM
Subject: Re: Sqlite3 dependency for Data Tiering

On 18 Feb 2015, at 01:59, Joseph Fernandes  wrote:
> Hi Guys,
> 
> The upcoming Data tiering/Classification feature has a dependency on Sqlite3 
> Devel packages.
> Could you please suggest me, how do I include sqlite3 devel packages 
> automatically in
> the GlusterFS upstream code.

It'll be a dependency in the .rpm/.deb/etc won't it?

If so, it *should* (in theory) be reasonably simple. :)

+ Justin

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Object Quota feature proposal for GlusterFS-3.7

2015-02-17 Thread Prashanth Pai
This might be helpful for  better integration with Swift. Swift maintains 
accounting metadata per account and per container. From glusterfs perspective, 
accounts are (represented as) first level directories in root and containers 
are second level directories. So accounts contain containers.

Each account has following metadata:
X-Account-Object-Count
X-Account-Bytes-Used
X-Account-Container-Count

Each container has following metadata:
X-Container-Object-Count
X-Container-Bytes-Used

I've got a few questions:
Will there be separate count stored for files vs directories ?
Does the count represent entire sub tree or just the immediate directory 
contents ?
Would a getxattr on a dir for count aggregate counts from all distributed 
bricks ?

Thanks.

Regards,
 -Prashanth Pai

- Original Message -
From: "Vijaikumar M" 
To: "gluster-devel@gluster.org >> Gluster Devel" 
Sent: Tuesday, February 17, 2015 5:22:34 PM
Subject: [Gluster-devel] Object Quota feature proposal for GlusterFS-3.7

Hi All, 

We are proposing files/objects quota feature for GlusterFS-3.7. 

Here is the feature page: 
http://www.gluster.org/community/documentation/index.php/Features/Object_Count 


'Object Quotas' is an enhancement to the existing 'File Usage Quotas' and has 
the following benefits: 


* Easy to query number of objects present in a volume. 
* Can serve as an accounting mechanism for quota enforcement based on 
number of Inodes. 
* This interface will be useful for integration with OpenStack Swift and 
Ceilometer. 

We can set the following Quota object limits, similar to file usage: 


* 1) Directory level - limit the number of files at the directory level 
* 2) Volume level - limit the number of files at the volume level 



Looking forward for Question/Feedback. 

Thanks, 
Vijay 


___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


Re: [Gluster-devel] Object Quota feature proposal for GlusterFS-3.7

2015-02-17 Thread Vijaikumar M


On Wednesday 18 February 2015 08:17 AM, Prashanth Pai wrote:

This might be helpful for  better integration with Swift. Swift maintains 
accounting metadata per account and per container. From glusterfs perspective, 
accounts are (represented as) first level directories in root and containers 
are second level directories. So accounts contain containers.

Each account has following metadata:
X-Account-Object-Count
X-Account-Bytes-Used
X-Account-Container-Count

Each container has following metadata:
X-Container-Object-Count
X-Container-Bytes-Used

I've got a few questions:
Will there be separate count stored for files vs directories ?

There will be xattr set for all files and directories.
For files, count is '1'.
For directories, count is sum of all the files and directories of entire 
sub-tree + 1 (counts itself)

Does the count represent entire sub tree or just the immediate directory 
contents ?

Count for any directory represents the entire sub tree.


Would a getxattr on a dir for count aggregate counts from all distributed 
bricks ?

Individual bricks will account for files residing only within itself.
We need to send a RPC call to quotad to get the aggregated value. we can 
provide a interface from gluster CLI to query the values from quotad.


Thanks,
Vijay




Thanks.

Regards,
  -Prashanth Pai

- Original Message -
From: "Vijaikumar M" 
To: "gluster-devel@gluster.org >> Gluster Devel" 
Sent: Tuesday, February 17, 2015 5:22:34 PM
Subject: [Gluster-devel] Object Quota feature proposal for GlusterFS-3.7

Hi All,

We are proposing files/objects quota feature for GlusterFS-3.7.

Here is the feature page: 
http://www.gluster.org/community/documentation/index.php/Features/Object_Count


'Object Quotas' is an enhancement to the existing 'File Usage Quotas' and has 
the following benefits:


 * Easy to query number of objects present in a volume.
 * Can serve as an accounting mechanism for quota enforcement based on 
number of Inodes.
 * This interface will be useful for integration with OpenStack Swift and 
Ceilometer.

We can set the following Quota object limits, similar to file usage:


 * 1) Directory level - limit the number of files at the directory level
 * 2) Volume level - limit the number of files at the volume level



Looking forward for Question/Feedback.

Thanks,
Vijay


___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel


___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel