date:20150614

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Niels de Vos

On Fri, Jun 12, 2015 at 11:29:51AM -0700, chris holcombe wrote:
 Yeah I have this repo but it's basically empty:
 https://github.com/cholcombe973/GlusterUtils

If you decide on a name, we can create a repository for you under the
https://github.com/gluster organization. That will make it easier for
others to find the repository and start contributuing or using it.

Personally, I'd like a name like gluster-coreutils or something similar,
because I think the intention is to match the functionality and usage of
the standard coreutils as much as possible?

Thanks,
Niels

 
 On 06/12/2015 11:27 AM, Craig Cabrey wrote:
 Chris,
 
 That sounds good to me.
 
 I already have started on implementation, just to get familiar with the 
 codebase and GFAPI.
 
 Is there a public repo that we can use for collaboration?
 
 Craig
 
 On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com 
 wrote:
 
 Craig,
 
 I was actually planning on building the same tool set.  I would like to 
 work with you also on this if that's ok.
 
 -Chris
 
 On 06/12/2015 10:43 AM, Jeff Darcy wrote:
 Hi everyone,
 
 This summer I am an intern at Facebook working on the Gluster team. Part 
 of
 my project for the summer includes developing a set of coreutils that
 utilizes the Gluster C API natively.
 
 This project is similar in nature to the NFS coreutils that some of you 
 may
 have heard about from the other Facebook engineers at the Gluster summit
 recently. I just wanted to reach out to the Gluster community to gather
 ideas, potential features, feedback, and direction.
 
 The initial set of utilities that I am developing includes the following:
 
 * cat
 * mkdir
 * put (read from stdin and write to a file)
 * mv
 * ls
 * rm
 * tail
 
 Again, any feedback will be welcome.
 Hi, Craig, and welcome to the project.  :)
 
 There seems to be some overlap with a proposal Ragahavendra Talur sent out
 a couple of days ago.
 
 https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162
 
 This seems like an excellent opportunity to collaborate.  Ideally, I think
 it would be useful to have both an FTP-client-like shell and a set of
 standalone one shot commands, based on as much common code as possible.
 
 ___
 Gluster-devel mailing list
 Gluster-devel@gluster.org
 https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3
 
 ___
 Gluster-devel mailing list
 Gluster-devel@gluster.org
 http://www.gluster.org/mailman/listinfo/gluster-devel
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Matthew McKeen

Hey Craig and Chris:

I might be interested in collaborating on this as well.

Will be useful when I come back to FB in September.

Let me know where the public repository ends up being.

Thanks,
Matthew McKeen

P.S. Tell Richard I said hello

On Fri, Jun 12, 2015 at 11:29 AM chris holcombe
chris.holco...@canonical.com wrote:

Yeah I have this repo but it's basically empty:
https://github.com/cholcombe973/GlusterUtils

On 06/12/2015 11:27 AM, Craig Cabrey wrote:
Chris,

That sounds good to me.

I already have started on implementation, just to get familiar with the
codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe
chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I would like to
work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:
Hi everyone,

This summer I am an intern at Facebook working on the Gluster team.
Part of
my project for the summer includes developing a set of coreutils that
utilizes the Gluster C API natively.

This project is similar in nature to the NFS coreutils that some of
you may
have heard about from the other Facebook engineers at the Gluster
summit
recently. I just wanted to reach out to the Gluster community to
gather
ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing includes the
following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.
Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra Talur sent
out
a couple of days ago.

https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162

This seems like an excellent opportunity to collaborate. Ideally, I
think
it would be useful to have both an FTP-client-like shell and a set of
standalone one shot commands, based on as much common code as
possible.

___
Gluster-devel mailing list
Gluster-devel@gluster.org

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Niels de Vos

On Sun, Jun 14, 2015 at 04:58:23PM +, Craig Cabrey wrote:
 I think it does make sense to have it under the gluster organization. 
 
 As for naming gluster-coreutils works as the intention is indeed to
 match the functionality of coreutils as much as possible.

I've created an empty repository for you now. Please start with
explaining the purpose/goals/ideas/... on the GitHub wiki:

https://github.com/gluster/gluster-coreutils/wiki

When you have an idea how to get seriously started, push the code to the
repository. The explanation to do so can be found here:

https://github.com/gluster/gluster-coreutils

Let me know if you need any assistance.

Thanks,
Niels


 
 Craig
 
  On Jun 14, 2015, at 2:29 AM, Niels de Vos nde...@redhat.com wrote:
  
  On Fri, Jun 12, 2015 at 11:29:51AM -0700, chris holcombe wrote:
  Yeah I have this repo but it's basically empty:
  https://github.com/cholcombe973/GlusterUtils
  
  If you decide on a name, we can create a repository for you under the
  https://github.com/gluster organization. That will make it easier for
  others to find the repository and start contributuing or using it.
  
  Personally, I'd like a name like gluster-coreutils or something similar,
  because I think the intention is to match the functionality and usage of
  the standard coreutils as much as possible?
  
  Thanks,
  Niels
  
  
  On 06/12/2015 11:27 AM, Craig Cabrey wrote:
  Chris,
  
  That sounds good to me.
  
  I already have started on implementation, just to get familiar with the 
  codebase and GFAPI.
  
  Is there a public repo that we can use for collaboration?
  
  Craig
  
  On Jun 12, 2015, at 10:46 AM, chris holcombe 
  chris.holco...@canonical.com wrote:
  
  Craig,
  
  I was actually planning on building the same tool set.  I would like to 
  work with you also on this if that's ok.
  
  -Chris
  
  On 06/12/2015 10:43 AM, Jeff Darcy wrote:
  Hi everyone,
  
  This summer I am an intern at Facebook working on the Gluster team. 
  Part of
  my project for the summer includes developing a set of coreutils that
  utilizes the Gluster C API natively.
  
  This project is similar in nature to the NFS coreutils that some of 
  you may
  have heard about from the other Facebook engineers at the Gluster 
  summit
  recently. I just wanted to reach out to the Gluster community to gather
  ideas, potential features, feedback, and direction.
  
  The initial set of utilities that I am developing includes the 
  following:
  
  * cat
  * mkdir
  * put (read from stdin and write to a file)
  * mv
  * ls
  * rm
  * tail
  
  Again, any feedback will be welcome.
  Hi, Craig, and welcome to the project.  :)
  
  There seems to be some overlap with a proposal Ragahavendra Talur sent 
  out
  a couple of days ago.
  
  https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162
  
  This seems like an excellent opportunity to collaborate.  Ideally, I 
  think
  it would be useful to have both an FTP-client-like shell and a set of
  standalone one shot commands, based on as much common code as 
  possible.
  
  ___
  Gluster-devel mailing list
  Gluster-devel@gluster.org
  https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3
  
  ___
  Gluster-devel mailing list
  Gluster-devel@gluster.org
  https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=yiRXm4P%2B7jkUD8T8QucHmE7RAd14NXpACGukNZ0KKRA%3D%0As=b0b8784ae9e5b4a6cc7cde03172898945f0e26a16ea086bc9ed3ca642162446f
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Raghavendra Talur

On Sun, Jun 14, 2015 at 11:02 PM, chris holcombe
chris.holco...@canonical.com wrote:

Welcome to the party Matthew! Nice to see you're still keeping an eye on
on the list. I'm excited to see this collaboration. This is going to turn
out great :)

On 06/14/2015 01:58 AM, Matthew McKeen wrote:

Hey Craig and Chris:

I might be interested in collaborating on this as well.

Will be useful when I come back to FB in September.

Let me know where the public repository ends up being.

Thanks,
Matthew McKeen

P.S. Tell Richard I said hello

On Fri, Jun 12, 2015 at 11:29 AM chris holcombe
chris.holco...@canonical.com mailto:chris.holco...@canonical.com
wrote:

Yeah I have this repo but it's basically empty:
https://github.com/cholcombe973/GlusterUtils

On 06/12/2015 11:27 AM, Craig Cabrey wrote:
Chris,

That sounds good to me.

I already have started on implementation, just to get familiar
with the codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe
chris.holco...@canonical.com
mailto:chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I would
like to work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:
Hi everyone,

This summer I am an intern at Facebook working on the Gluster
team. Part of
my project for the summer includes developing a set of
coreutils that
utilizes the Gluster C API natively.

This project is similar in nature to the NFS coreutils that
some of you may
have heard about from the other Facebook engineers at the
Gluster summit
recently. I just wanted to reach out to the Gluster community
to gather
ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing includes
the following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.
Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra
Talur sent out
a couple of days ago.

This seems like an excellent opportunity to collaborate.
Ideally, I think
it would be useful to have both an FTP-client-like shell and
a set of
standalone one shot commands, based on as much common code
as possible.

___
Gluster-devel mailing list
Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org

___
Gluster-devel mailing list
Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Hi Craig, Chris and Matthew,

Welcome to the project :)

We are really excited to see so many interested in getting core utils like
feature in Gluster.
As Jeff mentioned earlier, we have put up a very similar proposal recently.
He also shared
the design doc in the same mail.

Here is an illustration of how we imagined it:

In gist, all the core utils commands would be functions in what we are
calling
glusterclientd. The functions would return the output in a format like JSON
or XML.
It would be the handlers which will send the data to a *real* client.

To support one-off commands, we were thinking of having a cli-direct
handler,
which when invoked will behave like a one-off command and output directly
to cli.

Also, we were of the opinion that python would be a good language to get
this done.

As you can see, core-utils would be part of a bigger project and it would
be really useful
for all of us to have same code base.

Please read the design doc and give your reviews either in doc or here in
mail.

Thanks!
*Raghavendra Talur *
___

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Craig Cabrey

I think it does make sense to have it under the gluster organization. 

As for naming gluster-coreutils works as the intention is indeed to match the 
functionality of coreutils as much as possible.

Craig

 On Jun 14, 2015, at 2:29 AM, Niels de Vos nde...@redhat.com wrote:
 
 On Fri, Jun 12, 2015 at 11:29:51AM -0700, chris holcombe wrote:
 Yeah I have this repo but it's basically empty:
 https://github.com/cholcombe973/GlusterUtils
 
 If you decide on a name, we can create a repository for you under the
 https://github.com/gluster organization. That will make it easier for
 others to find the repository and start contributuing or using it.
 
 Personally, I'd like a name like gluster-coreutils or something similar,
 because I think the intention is to match the functionality and usage of
 the standard coreutils as much as possible?
 
 Thanks,
 Niels
 
 
 On 06/12/2015 11:27 AM, Craig Cabrey wrote:
 Chris,
 
 That sounds good to me.
 
 I already have started on implementation, just to get familiar with the 
 codebase and GFAPI.
 
 Is there a public repo that we can use for collaboration?
 
 Craig
 
 On Jun 12, 2015, at 10:46 AM, chris holcombe 
 chris.holco...@canonical.com wrote:
 
 Craig,
 
 I was actually planning on building the same tool set.  I would like to 
 work with you also on this if that's ok.
 
 -Chris
 
 On 06/12/2015 10:43 AM, Jeff Darcy wrote:
 Hi everyone,
 
 This summer I am an intern at Facebook working on the Gluster team. Part 
 of
 my project for the summer includes developing a set of coreutils that
 utilizes the Gluster C API natively.
 
 This project is similar in nature to the NFS coreutils that some of you 
 may
 have heard about from the other Facebook engineers at the Gluster summit
 recently. I just wanted to reach out to the Gluster community to gather
 ideas, potential features, feedback, and direction.
 
 The initial set of utilities that I am developing includes the following:
 
 * cat
 * mkdir
 * put (read from stdin and write to a file)
 * mv
 * ls
 * rm
 * tail
 
 Again, any feedback will be welcome.
 Hi, Craig, and welcome to the project.  :)
 
 There seems to be some overlap with a proposal Ragahavendra Talur sent out
 a couple of days ago.
 
 https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162
 
 This seems like an excellent opportunity to collaborate.  Ideally, I think
 it would be useful to have both an FTP-client-like shell and a set of
 standalone one shot commands, based on as much common code as possible.
 
 ___
 Gluster-devel mailing list
 Gluster-devel@gluster.org
 https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3
 
 ___
 Gluster-devel mailing list
 Gluster-devel@gluster.org
 https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=yiRXm4P%2B7jkUD8T8QucHmE7RAd14NXpACGukNZ0KKRA%3D%0As=b0b8784ae9e5b4a6cc7cde03172898945f0e26a16ea086bc9ed3ca642162446f
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Joe Julian

I would prefer python.

On 06/14/2015 11:18 AM, Niels de Vos wrote:

On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote:

On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com
wrote:

Yeah I have this repo but it's basically empty:
https://github.com/cholcombe973/GlusterUtils

AFAIK the plan is to collaborate through a git repo in github.com/gluster
account. But anything that works should be good...

And the choice of language seems to be python.

Depending on the target systems, Python may not be suitable. There are
cloud deployments that do not have Python installed. I think that even
includes the minimal cloud images Fedora and CentOS provide. IMHO would
be nice to be able to support those systems too, without pulling in too
many dependencies.

But, I'll leave it up to the people writing the code ;-)

Cheers,
Niels

Best Regards,
Vishwanath

On 06/12/2015 11:27 AM, Craig Cabrey wrote:

Chris,

That sounds good to me.

I already have started on implementation, just to get familiar with the
codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe

chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I would like to
work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:

Hi everyone,

This summer I am an intern at Facebook working on the Gluster team.
Part of
my project for the summer includes developing a set of coreutils that
utilizes the Gluster C API natively.

This project is similar in nature to the NFS coreutils that some of
you may
have heard about from the other Facebook engineers at the Gluster
summit
recently. I just wanted to reach out to the Gluster community to gather
ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing includes the
following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.

Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra Talur sent
out
a couple of days ago.

___
Gluster-devel mailing list
Gluster-devel@gluster.org

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread chris holcombe

Do you want to split up who does what utility? I could pick off some
easier ones like mv or rm or something.
I imagine there will be some common functions we will want to share
between them. We can split things out as we go. No big deal

On 06/14/2015 02:49 PM, Craig Cabrey wrote:

I've already started writing the utilities in C per my internship project. I'll
push these up when ready (most probably sometime this week) as a POC.

Maybe then we can look into implementing with Python?

Craig

On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote:

I was thinking the other way around. Write it in python then optimize if it's
necessary.

On 06/14/2015 02:45 PM, chris holcombe wrote:
Maybe we could write these in C and setup python bindings for them. Thoughts?
I'm down with writing them in C. I could use more practice.

On 06/14/2015 02:36 PM, Joe Julian wrote:
I would prefer python.

On 06/14/2015 11:18 AM, Niels de Vos wrote:

On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote:
On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com
wrote:

Yeah I have this repo but it's basically empty:
https://github.com/cholcombe973/GlusterUtils

AFAIK the plan is to collaborate through a git repo in github.com/gluster
account. But anything that works should be good...

And the choice of language seems to be python.

But, I'll leave it up to the people writing the code ;-)

Cheers,
Niels

Best Regards,
Vishwanath

On 06/12/2015 11:27 AM, Craig Cabrey wrote:

Chris,

That sounds good to me.

I already have started on implementation, just to get familiar with the
codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe

chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I would like to
work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:

Hi everyone,

This summer I am an intern at Facebook working on the Gluster team.
Part of
my project for the summer includes developing a set of coreutils that
utilizes the Gluster C API natively.

This project is similar in nature to the NFS coreutils that some of
you may
have heard about from the other Facebook engineers at the Gluster
summit
recently. I just wanted to reach out to the Gluster community to gather
ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing includes the
following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.

Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra Talur sent
out
a couple of days ago.

___
Gluster-devel mailing list
Gluster-devel@gluster.org

___
Gluster-devel mailing list
Gluster-devel@gluster.org
https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0As=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1

___
Gluster-devel mailing list
Gluster-devel@gluster.org

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Joe Julian

I was thinking the other way around. Write it in python then optimize if
it's necessary.

On 06/14/2015 02:45 PM, chris holcombe wrote:
Maybe we could write these in C and setup python bindings for them.
Thoughts? I'm down with writing them in C. I could use more practice.

On 06/14/2015 02:36 PM, Joe Julian wrote:

I would prefer python.

On 06/14/2015 11:18 AM, Niels de Vos wrote:

On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote:
On 12 June 2015 at 23:59, chris holcombe
chris.holco...@canonical.com

wrote:

Yeah I have this repo but it's basically empty:
https://github.com/cholcombe973/GlusterUtils

AFAIK the plan is to collaborate through a git repo in
github.com/gluster

account. But anything that works should be good...

And the choice of language seems to be python.

But, I'll leave it up to the people writing the code ;-)

Cheers,
Niels

Best Regards,
Vishwanath

On 06/12/2015 11:27 AM, Craig Cabrey wrote:

Chris,

That sounds good to me.

I already have started on implementation, just to get familiar
with the

codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe

chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I would
like to

work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:

Hi everyone,
This summer I am an intern at Facebook working on the Gluster
team.

Part of
my project for the summer includes developing a set of
coreutils that

utilizes the Gluster C API natively.

This project is similar in nature to the NFS coreutils that
some of

you may
have heard about from the other Facebook engineers at the Gluster
summit
recently. I just wanted to reach out to the Gluster community
to gather

ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing includes the
following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.

Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra
Talur sent

out
a couple of days ago.

This seems like an excellent opportunity to collaborate.
Ideally, I

think
it would be useful to have both an FTP-client-like shell and
a set of

standalone one shot commands, based on as much common code as
possible.

___
Gluster-devel mailing list
Gluster-devel@gluster.org

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread chris holcombe

Welcome to the party Matthew! Nice to see you're still keeping an eye
on on the list. I'm excited to see this collaboration. This is going
to turn out great :)

On 06/14/2015 01:58 AM, Matthew McKeen wrote:

Hey Craig and Chris:

I might be interested in collaborating on this as well.

Will be useful when I come back to FB in September.

Let me know where the public repository ends up being.

Thanks,
Matthew McKeen

P.S. Tell Richard I said hello

On Fri, Jun 12, 2015 at 11:29 AM chris holcombe
chris.holco...@canonical.com mailto:chris.holco...@canonical.com
wrote:

Yeah I have this repo but it's basically empty:
https://github.com/cholcombe973/GlusterUtils

On 06/12/2015 11:27 AM, Craig Cabrey wrote:
Chris,

That sounds good to me.

I already have started on implementation, just to get familiar
with the codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe
chris.holco...@canonical.com
mailto:chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I would
like to work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:
Hi everyone,

This summer I am an intern at Facebook working on the Gluster
team. Part of
my project for the summer includes developing a set of
coreutils that
utilizes the Gluster C API natively.

This project is similar in nature to the NFS coreutils that
some of you may
have heard about from the other Facebook engineers at the
Gluster summit
recently. I just wanted to reach out to the Gluster community
to gather
ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing includes
the following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.
Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra
Talur sent out
a couple of days ago.

This seems like an excellent opportunity to collaborate.
Ideally, I think

it would be useful to have both an FTP-client-like shell and
a set of
standalone one shot commands, based on as much common code
as possible.

___
Gluster-devel mailing list
Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org

___
Gluster-devel mailing list
Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Niels de Vos

On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote:
On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com
wrote:

Yeah I have this repo but it's basically empty:
https://github.com/cholcombe973/GlusterUtils

AFAIK the plan is to collaborate through a git repo in github.com/gluster
account. But anything that works should be good...

And the choice of language seems to be python.

But, I'll leave it up to the people writing the code ;-)

Cheers,
Niels

Best Regards,
Vishwanath

On 06/12/2015 11:27 AM, Craig Cabrey wrote:

Chris,

That sounds good to me.

I already have started on implementation, just to get familiar with the
codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe
chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I would like to
work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:

Hi everyone,

This summer I am an intern at Facebook working on the Gluster team.
Part of
my project for the summer includes developing a set of coreutils that
utilizes the Gluster C API natively.

This project is similar in nature to the NFS coreutils that some of
you may
have heard about from the other Facebook engineers at the Gluster
summit
recently. I just wanted to reach out to the Gluster community to gather
ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing includes the
following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.

Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra Talur sent
out
a couple of days ago.

___
Gluster-devel mailing list
Gluster-devel@gluster.org

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread chris holcombe

Maybe we could write these in C and setup python bindings for them.
Thoughts? I'm down with writing them in C. I could use more practice.

On 06/14/2015 02:36 PM, Joe Julian wrote:

I would prefer python.

On 06/14/2015 11:18 AM, Niels de Vos wrote:

On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote:

On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com
wrote:

Yeah I have this repo but it's basically empty:
https://github.com/cholcombe973/GlusterUtils

AFAIK the plan is to collaborate through a git repo in
github.com/gluster

account. But anything that works should be good...

And the choice of language seems to be python.

But, I'll leave it up to the people writing the code ;-)

Cheers,
Niels

Best Regards,
Vishwanath

On 06/12/2015 11:27 AM, Craig Cabrey wrote:

Chris,

That sounds good to me.

I already have started on implementation, just to get familiar
with the

codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe

chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I would
like to

work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:

Hi everyone,
This summer I am an intern at Facebook working on the Gluster
team.

Part of
my project for the summer includes developing a set of
coreutils that

utilizes the Gluster C API natively.

This project is similar in nature to the NFS coreutils that
some of

you may
have heard about from the other Facebook engineers at the Gluster
summit
recently. I just wanted to reach out to the Gluster community
to gather

ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing includes the
following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.

Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra
Talur sent

out
a couple of days ago.

This seems like an excellent opportunity to collaborate.
Ideally, I

think
it would be useful to have both an FTP-client-like shell and a
set of

standalone one shot commands, based on as much common code as
possible.

___
Gluster-devel mailing list
Gluster-devel@gluster.org

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Joe Julian

On 06/14/2015 11:43 AM, Raghavendra Talur wrote:

On Sun, Jun 14, 2015 at 11:02 PM, chris holcombe
chris.holco...@canonical.com mailto:chris.holco...@canonical.com
wrote:

Welcome to the party Matthew! Nice to see you're still keeping an
eye on on the list. I'm excited to see this collaboration. This
is going to turn out great :)

On 06/14/2015 01:58 AM, Matthew McKeen wrote:

Hey Craig and Chris:

I might be interested in collaborating on this as well.

Will be useful when I come back to FB in September.

Let me know where the public repository ends up being.

Thanks,
Matthew McKeen

P.S. Tell Richard I said hello

On Fri, Jun 12, 2015 at 11:29 AM chris holcombe
chris.holco...@canonical.com
mailto:chris.holco...@canonical.com
mailto:chris.holco...@canonical.com
mailto:chris.holco...@canonical.com wrote:

Yeah I have this repo but it's basically empty:
https://github.com/cholcombe973/GlusterUtils

On 06/12/2015 11:27 AM, Craig Cabrey wrote:
Chris,

That sounds good to me.

I already have started on implementation, just to get
familiar
with the codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe
chris.holco...@canonical.com
mailto:chris.holco...@canonical.com
mailto:chris.holco...@canonical.com
mailto:chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set.
I would

like to work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:
Hi everyone,

This summer I am an intern at Facebook working on the
Gluster
team. Part of
my project for the summer includes developing a set of
coreutils that
utilizes the Gluster C API natively.

This project is similar in nature to the NFS
coreutils that
some of you may
have heard about from the other Facebook engineers at the
Gluster summit
recently. I just wanted to reach out to the Gluster
community
to gather
ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing
includes
the following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.
Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal
Ragahavendra
Talur sent out
a couple of days ago.

This seems like an excellent opportunity to
collaborate. Ideally, I think
it would be useful to have both an FTP-client-like
shell and
a set of
standalone one shot commands, based on as much
common code
as possible.

___
Gluster-devel mailing list
Gluster-devel@gluster.org
mailto:Gluster-devel@gluster.org
mailto:Gluster-devel@gluster.org
mailto:Gluster-devel@gluster.org

___
Gluster-devel mailing list
Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org
mailto:Gluster-devel@gluster.org
mailto:Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

___
Gluster-devel mailing list
Gluster-devel@gluster.org

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Craig Cabrey

I've already started writing the utilities in C per my internship project. I'll
push these up when ready (most probably sometime this week) as a POC.

Maybe then we can look into implementing with Python?

Craig

On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote:

I was thinking the other way around. Write it in python then optimize if it's
necessary.
On 06/14/2015 02:45 PM, chris holcombe wrote:
Maybe we could write these in C and setup python bindings for them.
Thoughts? I'm down with writing them in C. I could use more practice.

On 06/14/2015 02:36 PM, Joe Julian wrote:
I would prefer python.

On 06/14/2015 11:18 AM, Niels de Vos wrote:
On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote:
On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com
wrote:

Yeah I have this repo but it's basically empty:
https://github.com/cholcombe973/GlusterUtils

AFAIK the plan is to collaborate through a git repo in github.com/gluster
account. But anything that works should be good...

And the choice of language seems to be python.
Depending on the target systems, Python may not be suitable. There are
cloud deployments that do not have Python installed. I think that even
includes the minimal cloud images Fedora and CentOS provide. IMHO would
be nice to be able to support those systems too, without pulling in too
many dependencies.

But, I'll leave it up to the people writing the code ;-)

Cheers,
Niels

Best Regards,
Vishwanath

On 06/12/2015 11:27 AM, Craig Cabrey wrote:

Chris,

That sounds good to me.

I already have started on implementation, just to get familiar with the
codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe
chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I would like to
work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:

Hi everyone,
This summer I am an intern at Facebook working on the Gluster team.
Part of
my project for the summer includes developing a set of coreutils that
utilizes the Gluster C API natively.

The initial set of utilities that I am developing includes the
following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.
Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra Talur sent
out
a couple of days ago.

This seems like an excellent opportunity to collaborate. Ideally, I
think
it would be useful to have both an FTP-client-like shell and a set
of
standalone one shot commands, based on as much common code as
possible.

___
Gluster-devel mailing list
Gluster-devel@gluster.org

https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3
___
Gluster-devel mailing list
Gluster-devel@gluster.org
https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0As=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
___
Gluster-devel mailing list
Gluster-devel@gluster.org
https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0As=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1
___
Gluster-devel mailing list
Gluster-devel@gluster.org

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread chris holcombe

Having previously worked at Facebook myself I know that it's absolutely
critical that these tools be as performant as possible. I understand the
desire to program these in Python because it allows more people to
participate but unfortunately in this case it's not possible.

Craig - Let us know when you push your code. I'll start lending a hand
as soon as I can.

On 06/14/2015 02:49 PM, Craig Cabrey wrote:

I've already started writing the utilities in C per my internship project. I'll
push these up when ready (most probably sometime this week) as a POC.

Maybe then we can look into implementing with Python?

Craig

On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote:

I was thinking the other way around. Write it in python then optimize if it's
necessary.

On 06/14/2015 02:45 PM, chris holcombe wrote:
Maybe we could write these in C and setup python bindings for them. Thoughts?
I'm down with writing them in C. I could use more practice.

On 06/14/2015 02:36 PM, Joe Julian wrote:
I would prefer python.

On 06/14/2015 11:18 AM, Niels de Vos wrote:

On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote:
On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com
wrote:

Yeah I have this repo but it's basically empty:
https://github.com/cholcombe973/GlusterUtils

AFAIK the plan is to collaborate through a git repo in github.com/gluster
account. But anything that works should be good...

And the choice of language seems to be python.

But, I'll leave it up to the people writing the code ;-)

Cheers,
Niels

Best Regards,
Vishwanath

On 06/12/2015 11:27 AM, Craig Cabrey wrote:

Chris,

That sounds good to me.

I already have started on implementation, just to get familiar with the
codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe

chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I would like to
work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:

Hi everyone,

This summer I am an intern at Facebook working on the Gluster team.
Part of
my project for the summer includes developing a set of coreutils that
utilizes the Gluster C API natively.

This project is similar in nature to the NFS coreutils that some of
you may
have heard about from the other Facebook engineers at the Gluster
summit
recently. I just wanted to reach out to the Gluster community to gather
ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing includes the
following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.

Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra Talur sent
out
a couple of days ago.

___
Gluster-devel mailing list
Gluster-devel@gluster.org

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread M S Vishwanath Bhat

MS
On 15 Jun 2015 10:20 am, Prashanth Pai p...@redhat.com wrote:

Personally, I'd use Go which is performant as you put it. You could
reuse(read fork) this project: https://github.com/aisola/go-coreutils
And also leverage Kaushal's go bindings (
https://forge.gluster.org/gogfapi#more) which itself can grow along with
glusterfs-coreutils project.

I'd prefer Go myself.

Cheers,
Vishwanath

Regards,
-Prashanth Pai

- chris holcombe chris.holco...@canonical.com wrote:
Having previously worked at Facebook myself I know that it's absolutely
critical that these tools be as performant as possible. I understand the
desire to program these in Python because it allows more people to
participate but unfortunately in this case it's not possible.

Craig - Let us know when you push your code. I'll start lending a hand
as soon as I can.

On 06/14/2015 02:49 PM, Craig Cabrey wrote:
I've already started writing the utilities in C per my internship
project. I'll push these up when ready (most probably sometime this week)
as a POC.

Maybe then we can look into implementing with Python?

Craig

On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote:

I was thinking the other way around. Write it in python then
optimize if it's necessary.
On 06/14/2015 02:45 PM, chris holcombe wrote:
Maybe we could write these in C and setup python bindings for them.
Thoughts? I'm down with writing them in C. I could use more practice.

On 06/14/2015 02:36 PM, Joe Julian wrote:
I would prefer python.

On 06/14/2015 11:18 AM, Niels de Vos wrote:
On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat
wrote:
On 12 June 2015 at 23:59, chris holcombe
chris.holco...@canonical.com
wrote:

Yeah I have this repo but it's basically empty:
https://github.com/cholcombe973/GlusterUtils
AFAIK the plan is to collaborate through a git repo in
github.com/gluster
account. But anything that works should be good...

And the choice of language seems to be python.
Depending on the target systems, Python may not be suitable.
There are
cloud deployments that do not have Python installed. I think that
even
includes the minimal cloud images Fedora and CentOS provide. IMHO
would
be nice to be able to support those systems too, without pulling
in too
many dependencies.

But, I'll leave it up to the people writing the code ;-)

Cheers,
Niels

Best Regards,
Vishwanath

On 06/12/2015 11:27 AM, Craig Cabrey wrote:

Chris,

That sounds good to me.

I already have started on implementation, just to get familiar
with the
codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe
chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I
would like to
work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:

Hi everyone,
This summer I am an intern at Facebook working on the
Gluster team.
Part of
my project for the summer includes developing a set of
coreutils that
utilizes the Gluster C API natively.

This project is similar in nature to the NFS coreutils that
some of
you may
have heard about from the other Facebook engineers at the
Gluster
summit
recently. I just wanted to reach out to the Gluster
community to gather
ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing includes
the
following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.
Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra
Talur sent
out
a couple of days ago.

This seems like an excellent opportunity to collaborate.
Ideally, I
think
it would be useful to have both an FTP-client-like shell
and a set of
standalone one shot commands, based on as much common code
as
possible.

___
Gluster-devel mailing list
Gluster-devel@gluster.org

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Kaushal M

Just a heads up on gogfapi. It is not complete as the directory
listing functions are yet to be implemented and it hasn't been tested
a lot.

The gogfapi package replicates golang's file API, which makes it very
easy to convert an existing go application to support gfapi.
Converting go-coreutils should be easy.

Also, the I'll not be maintaining the Gluster Forge repository, as the
forge is about to be closed. Use the github repository
http://github.com/kshlm/gogfapi instead.

~kaushal

On Mon, Jun 15, 2015 at 10:26 AM, Matthew McKeen matt...@mmckeen.net wrote:
 I agree, go would be perfect for these tools.

 Static compilation makes deployment trivial.

 +1


 On Sun, Jun 14, 2015, 9:50 PM Prashanth Pai p...@redhat.com wrote:

 Personally, I'd use Go which is performant as you put it. You could
 reuse(read fork) this project: https://github.com/aisola/go-coreutils
 And also leverage Kaushal's go bindings
 (https://forge.gluster.org/gogfapi#more) which itself can grow along with
 glusterfs-coreutils project.

 Regards,
  -Prashanth Pai

 - chris holcombe chris.holco...@canonical.com wrote:
  Having previously worked at Facebook myself I know that it's absolutely
  critical that these tools be as performant as possible. I understand the
  desire to program these in Python because it allows more people to
  participate but unfortunately in this case it's not possible.
 
  Craig - Let us know when you push your code.  I'll start lending a hand
  as soon as I can.
 
  On 06/14/2015 02:49 PM, Craig Cabrey wrote:
   I've already started writing the utilities in C per my internship
   project. I'll push these up when ready (most probably sometime this 
   week) as
   a POC.
  
   Maybe then we can look into implementing with Python?
  
   Craig
  
   On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote:
  
   I was thinking the other way around. Write it in python then optimize
   if it's necessary.
   On 06/14/2015 02:45 PM, chris holcombe wrote:
   Maybe we could write these in C and setup python bindings for them.
   Thoughts?  I'm down with writing them in C.  I could use more practice.
  
   On 06/14/2015 02:36 PM, Joe Julian wrote:
   I would prefer python.
  
   On 06/14/2015 11:18 AM, Niels de Vos wrote:
   On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat
   wrote:
   On 12 June 2015 at 23:59, chris holcombe
   chris.holco...@canonical.com
   wrote:
  
   Yeah I have this repo but it's basically empty:
   https://github.com/cholcombe973/GlusterUtils
   AFAIK the plan is to collaborate through a git repo in
   github.com/gluster
   account. But anything that works should be good...
  
   And the choice of language seems to be python.
   Depending on the target systems, Python may not be suitable. There
   are
   cloud deployments that do not have Python installed. I think that
   even
   includes the minimal cloud images Fedora and CentOS provide. IMHO
   would
   be nice to be able to support those systems too, without pulling
   in too
   many dependencies.
  
   But, I'll leave it up to the people writing the code ;-)
  
   Cheers,
   Niels
  
   Best Regards,
   Vishwanath
  
   On 06/12/2015 11:27 AM, Craig Cabrey wrote:
  
   Chris,
  
   That sounds good to me.
  
   I already have started on implementation, just to get familiar
   with the
   codebase and GFAPI.
  
   Is there a public repo that we can use for collaboration?
  
   Craig
  
 On Jun 12, 2015, at 10:46 AM, chris holcombe 
   chris.holco...@canonical.com wrote:
  
   Craig,
  
   I was actually planning on building the same tool set. I would
   like to
   work with you also on this if that's ok.
  
   -Chris
  
   On 06/12/2015 10:43 AM, Jeff Darcy wrote:
  
   Hi everyone,
   This summer I am an intern at Facebook working on the
   Gluster team.
   Part of
   my project for the summer includes developing a set of
   coreutils that
   utilizes the Gluster C API natively.
  
   This project is similar in nature to the NFS coreutils that
   some of
   you may
   have heard about from the other Facebook engineers at the
   Gluster
   summit
   recently. I just wanted to reach out to the Gluster
   community to gather
   ideas, potential features, feedback, and direction.
  
   The initial set of utilities that I am developing includes
   the
   following:
  
   * cat
   * mkdir
   * put (read from stdin and write to a file)
   * mv
   * ls
   * rm
   * tail
  
   Again, any feedback will be welcome.
   Hi, Craig, and welcome to the project.  :)
  
   There seems to be some overlap with a proposal Ragahavendra
   Talur sent
   out
   a couple of days ago.

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Matthew McKeen

I agree, go would be perfect for these tools.

Static compilation makes deployment trivial.

On Sun, Jun 14, 2015, 9:50 PM Prashanth Pai p...@redhat.com wrote:

Regards,
-Prashanth Pai

Craig - Let us know when you push your code. I'll start lending a hand
as soon as I can.

On 06/14/2015 02:49 PM, Craig Cabrey wrote:
I've already started writing the utilities in C per my internship
project. I'll push these up when ready (most probably sometime this week)
as a POC.

Maybe then we can look into implementing with Python?

Craig

On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote:

I was thinking the other way around. Write it in python then optimize
if it's necessary.
On 06/14/2015 02:45 PM, chris holcombe wrote:
Maybe we could write these in C and setup python bindings for them.
Thoughts? I'm down with writing them in C. I could use more practice.

On 06/14/2015 02:36 PM, Joe Julian wrote:
I would prefer python.

On 06/14/2015 11:18 AM, Niels de Vos wrote:
On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat
wrote:
On 12 June 2015 at 23:59, chris holcombe
chris.holco...@canonical.com
wrote:

And the choice of language seems to be python.
Depending on the target systems, Python may not be suitable. There
are
cloud deployments that do not have Python installed. I think that
even
includes the minimal cloud images Fedora and CentOS provide. IMHO
would
be nice to be able to support those systems too, without pulling
in too
many dependencies.

But, I'll leave it up to the people writing the code ;-)

Cheers,
Niels

Best Regards,
Vishwanath

On 06/12/2015 11:27 AM, Craig Cabrey wrote:

Chris,

That sounds good to me.

I already have started on implementation, just to get familiar
with the
codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe
chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I would
like to
work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:

Hi everyone,
This summer I am an intern at Facebook working on the
Gluster team.
Part of
my project for the summer includes developing a set of
coreutils that
utilizes the Gluster C API natively.

This project is similar in nature to the NFS coreutils that
some of
you may
have heard about from the other Facebook engineers at the
Gluster
summit
recently. I just wanted to reach out to the Gluster
community to gather
ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing includes
the
following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.
Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra
Talur sent
out
a couple of days ago.

This seems like an excellent opportunity to collaborate.
Ideally, I
think
it would be useful to have both an FTP-client-like shell
and a set of
standalone one shot commands, based on as much common code
as
possible.

___
Gluster-devel mailing list
Gluster-devel@gluster.org

Re: [Gluster-devel] Gluster Coreutils

2015-06-14 Thread Prashanth Pai

Personally, I'd use Go which is performant as you put it. You could
reuse(read fork) this project: https://github.com/aisola/go-coreutils
And also leverage Kaushal's go bindings
(https://forge.gluster.org/gogfapi#more) which itself can grow along with
glusterfs-coreutils project.

Regards,
-Prashanth Pai

Craig - Let us know when you push your code. I'll start lending a hand
as soon as I can.

On 06/14/2015 02:49 PM, Craig Cabrey wrote:
I've already started writing the utilities in C per my internship project.
I'll push these up when ready (most probably sometime this week) as a POC.

Maybe then we can look into implementing with Python?

Craig

On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote:

I was thinking the other way around. Write it in python then optimize if
it's necessary.
On 06/14/2015 02:45 PM, chris holcombe wrote:
Maybe we could write these in C and setup python bindings for them.
Thoughts? I'm down with writing them in C. I could use more practice.

On 06/14/2015 02:36 PM, Joe Julian wrote:
I would prefer python.

On 06/14/2015 11:18 AM, Niels de Vos wrote:
On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote:
On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com
wrote:

But, I'll leave it up to the people writing the code ;-)

Cheers,
Niels

Best Regards,
Vishwanath

On 06/12/2015 11:27 AM, Craig Cabrey wrote:

Chris,

That sounds good to me.

I already have started on implementation, just to get familiar with
the
codebase and GFAPI.

Is there a public repo that we can use for collaboration?

Craig

On Jun 12, 2015, at 10:46 AM, chris holcombe
chris.holco...@canonical.com wrote:

Craig,

I was actually planning on building the same tool set. I would like
to
work with you also on this if that's ok.

-Chris

On 06/12/2015 10:43 AM, Jeff Darcy wrote:

Hi everyone,
This summer I am an intern at Facebook working on the Gluster
team.
Part of
my project for the summer includes developing a set of coreutils
that
utilizes the Gluster C API natively.

This project is similar in nature to the NFS coreutils that some
of
you may
have heard about from the other Facebook engineers at the Gluster
summit
recently. I just wanted to reach out to the Gluster community to
gather
ideas, potential features, feedback, and direction.

The initial set of utilities that I am developing includes the
following:

* cat
* mkdir
* put (read from stdin and write to a file)
* mv
* ls
* rm
* tail

Again, any feedback will be welcome.
Hi, Craig, and welcome to the project. :)

There seems to be some overlap with a proposal Ragahavendra Talur
sent
out
a couple of days ago.

This seems like an excellent opportunity to collaborate. Ideally,
I
think
it would be useful to have both an FTP-client-like shell and a
set of
standalone one shot commands, based on as much common code as
possible.

___
Gluster-devel mailing list
Gluster-devel@gluster.org

Re: [Gluster-devel] [Gluster-users] what changelog of data meaning

2015-06-14 Thread Ravishankar N


Hi,
The file on 192.168.7.241 seems to be of bigger size (47906816 bytes). 
If you are sure that is the source, you could delete the file and the 
.glusterfs hardlink  from 192.168.7.242 and do a stat filename from 
the mount to trigger the heal.

Hope this helps.
Ravi


On 06/14/2015 12:18 PM, ma...@sina.com wrote:

Hi all:
I user glusterfs3.4.I am in replication mode,192.168.7.242 
Broken network and networking

   follow:
I found this attribute in the file 624a2216-7f73-4981-bb66-0f3d5d470b4e:

trusted.afr.test1-client-0=0x0001

trusted.afr.test1-client-1=0x0001

Does this mean?Who can tell me the specific mean?

This phenomenon leads to the damage of files.

The official document said not clear


the log is:

192.168.7.241:

[root@localhost c4348213-c6c5-471d-9a38-f70a3271d11c]# cd 
/data/test1/f7c5abe5-8918-4fb8-813c-5ee140e7def7/images/c4348213-c6c5-471d-9a38-f70a3271d11c

[root@localhost c4348213-c6c5-471d-9a38-f70a3271d11c]# ll

total 1482080

-rw-rw. 2 mcvda kvm47906816 2015-06-14 11:26 
624a2216-7f73-4981-bb66-0f3d5d470b4e

-rw-rw. 2 mcvda kvm 1048576 2015-06-14 09:48 
624a2216-7f73-4981-bb66-0f3d5d470b4e.lease

-rw-r--r--. 2 mcvda kvm 268 2015-06-14 09:48 
624a2216-7f73-4981-bb66-0f3d5d470b4e.meta

-rw-rw. 7 mcvda kvm 10737418240 2015-06-13 19:00 
a82b3d77-49ad-4cf5-8ff9-9f877d221c94

-rw-rw. 7 mcvda kvm 1048576 2015-06-13 18:55 
a82b3d77-49ad-4cf5-8ff9-9f877d221c94.lease

-rw-r--r--. 7 mcvda kvm 279 2015-06-13 19:00 
a82b3d77-49ad-4cf5-8ff9-9f877d221c94.meta

[root@localhost c4348213-c6c5-471d-9a38-f70a3271d11c]# getfattr -d -e hex -m . 
624a2216-7f73-4981-bb66-0f3d5d470b4e

# file: 624a2216-7f73-4981-bb66-0f3d5d470b4e

security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000

trusted.afr.test1-client-0=0x

trusted.afr.test1-client-1=0x

trusted.gfid=0x7466dc61642f4e19b62406c7bed8d0d3

[root@localhost c4348213-c6c5-471d-9a38-f70a3271d11c]# hostname

Localhost.localdomain

192.168.7.242：

[root@localhost c4348213-c6c5-471d-9a38-f70a3271d11c]# pwd

/data/test1/f7c5abe5-8918-4fb8-813c-5ee140e7def7/images/c4348213-c6c5-471d-9a38-f70a3271d11c

[root@localhost c4348213-c6c5-471d-9a38-f70a3271d11c]# ll

total 1481876

-rw-rw. 2 mcvda kvm47775744 2015-06-14 11:25 
624a2216-7f73-4981-bb66-0f3d5d470b4e

-rw-rw. 2 mcvda kvm 1048576 2015-06-14 09:48 
624a2216-7f73-4981-bb66-0f3d5d470b4e.lease

-rw-r--r--. 2 mcvda kvm 268 2015-06-14 09:48 
624a2216-7f73-4981-bb66-0f3d5d470b4e.meta

-rw-rw. 7 mcvda kvm 10737418240 2015-06-13 19:00 
a82b3d77-49ad-4cf5-8ff9-9f877d221c94

-rw-rw. 7 mcvda kvm 1048576 2015-06-13 18:55 
a82b3d77-49ad-4cf5-8ff9-9f877d221c94.lease

-rw-r--r--. 7 mcvda kvm 279 2015-06-13 19:00 
a82b3d77-49ad-4cf5-8ff9-9f877d221c94.meta

[root@localhost c4348213-c6c5-471d-9a38-f70a3271d11c]# ^C

[root@localhost c4348213-c6c5-471d-9a38-f70a3271d11c]# getfattr -d -e hex -m . 
624a2216-7f73-4981-bb66-0f3d5d470b4e

# file: 624a2216-7f73-4981-bb66-0f3d5d470b4e

security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000

trusted.afr.test1-client-0=0x0001

trusted.afr.test1-client-1=0x0001

trusted.gfid=0x7466dc61642f4e19b62406c7bed8d0d3



ma...@sina.com


___
Gluster-users mailing list
gluster-us...@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users


___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] Gluster Coreutils

Re: [Gluster-devel] [Gluster-users] what changelog of data meaning

19 matches

Site Navigation

Mail list logo

Footer information