Re: [Gluster-users] Regarding 2.0.4 booster
Sudipto Mukhopadhyay wrote: Makes sense. Yes I am running the same program. I will be running couple of more tests to verify this. BTW. two more questions on the related topics: 1. How much of performance boost does booster provide? That it provides a performance boost is evident from some of our tests and from reports from users. The exact improvement really depends on various factors such as the volume configuration, the type of translators used, the network setup, etc. 2. does the following http://www.gluster.org/docs/index.php/BoosterConfiguration#Virtual_Mount _Points mean that from the application we always need to use absolute path to the files being operated? That is a good question. I've also considered the need to remove the dependency on absolute paths but the use cases have been limited or none, till now to help me evolve the exact behaviour. Could you please describe what exactly you have in mind? I could take it from there. One approach is to redirect file system operations into GlusterFS when booster sees a string identifier or a token prepended to a path. This token could be specified through the booster.conf file. Since there will be no / prepended to this string, it does not remain an absolute path anymore. Also, since this is a global string identifier for booster, it is very different from a relative path, so can be used from anywhere in the local file system tree, as long as booster knows where to redirect these operations. Thanks Shehjar Thanks and regards, Sudipto -Original Message- From: Shehjar Tikoo [mailto:shehj...@gluster.com] Sent: Monday, July 20, 2009 9:46 PM To: Sudipto Mukhopadhyay Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org Subject: Re: [Gluster-users] Regarding 2.0.4 booster Sudipto Mukhopadhyay wrote: Hi, After modifying the booster.conf, I started getting the logs under /tmp/booster.log but, I see the following error: [2009-07-20 12:24:58] D [booster.c:1025:booster_init] booster: booster is inited [2009-07-20 12:24:58] D [libglusterfsclient.c:1340:libgf_vmp_search_entry] libglusterfsclient: VMP Entry found: /mnt/glusterfs/abc.txt: /mnt/glusterfs/ [2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.16.80.53:6996, attached to remote volume 'afr'. [2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.16.80.53:6996, attached to remote volume 'afr'. [2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.16.80.55:6996, attached to remote volume 'afr'. [2009-07-20 12:24:58] D [libglusterfsclient-dentry.c:224:__do_path_resolve] libglusterfsclient-dentry: loc->parent(1) already present. sending lookup for 1//abc.txt [2009-07-20 12:24:58] D [libglusterfsclient-dentry.c:245:__do_path_resolve] libglusterfsclient-dentry: resolved path(/abc.txt) till 1(/). sending lookup for remaining path [2009-07-20 12:24:58] D [libglusterfsclient.c:1608:libgf_client_lookup_cbk] libglusterfsclient: 1: (op_num=0) /abc.txt => -1 (No such file or directory) [2009-07-20 12:24:58] E [libglusterfsclient.c:2447:glusterfs_glh_open] libglusterfsclient: path lookup failed for (/abc.txt) Assuming you're the using the same program as you'd pasted earlier, this last line is an error that says the file was not found in the file system when trying to open it. This is the reason why your program took the file creation branch in the "if" block. We can be sure about this error if you could confirm, before running your test program, whether the file really did not exist on the backend. Regards -Shehjar Can you please explain the above errors and what is that causing these errors? Thanks and regards, Sudipto -Original Message- From: Sudipto Mukhopadhyay Sent: Monday, July 20, 2009 3:59 PM To: Shehjar Tikoo Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org Subject: RE: [Gluster-users] Regarding 2.0.4 booster Hi Shehjar, The contents in booster.conf are in two separate lines. I will try out the test again by merging the contents of booster.conf into one single line after I get my nodes back. Thanks and regards, Sudipto -Original Message- From: Shehjar Tikoo [mailto:shehj...@gluster.com] Sent: Thursday, July 16, 2009 10:08 PM To: Sudipto Mukhopadhyay Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org Subject: Re: [Gluster-users] Regarding 2.0.4 booster Sudipto Mukhopadhyay wrote: My mistake I meant booster log is not getting generated. Thanks and regards, Sudipto Hi A few questions. Please see inlined text. -Original Message- From: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] On Behalf Of Sudipto Mukhopadhyay Sent: Tuesday, July 14, 2009 2:07 PM To: Shehjar Tikoo Cc: av...@gluster.com; gluster-users@gl
Re: [Gluster-users] Regarding 2.0.4 booster
Makes sense.
Yes I am running the same program.
I will be running couple of more tests to verify this.
BTW. two more questions on the related topics:
1. How much of performance boost does booster provide?
2. does the following
http://www.gluster.org/docs/index.php/BoosterConfiguration#Virtual_Mount
_Points
mean that from the application we always need to use absolute path to
the files being operated?
Thanks and regards,
Sudipto
-Original Message-
From: Shehjar Tikoo [mailto:shehj...@gluster.com]
Sent: Monday, July 20, 2009 9:46 PM
To: Sudipto Mukhopadhyay
Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org
Subject: Re: [Gluster-users] Regarding 2.0.4 booster
Sudipto Mukhopadhyay wrote:
> Hi,
>
>
>
> After modifying the booster.conf, I started getting the logs under
> /tmp/booster.log but, I see the following error:
>
>
>
>
>
> [2009-07-20 12:24:58] D [booster.c:1025:booster_init] booster: booster
> is inited
>
> [2009-07-20 12:24:58] D
> [libglusterfsclient.c:1340:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry found: /mnt/glusterfs/abc.txt: /mnt/glusterfs/
>
> [2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk]
> remote1: Connected to 10.16.80.53:6996, attached to remote volume
'afr'.
>
> [2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk]
> remote1: Connected to 10.16.80.53:6996, attached to remote volume
'afr'.
>
> [2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk]
> remote2: Connected to 10.16.80.55:6996, attached to remote volume
'afr'.
>
> [2009-07-20 12:24:58] D
> [libglusterfsclient-dentry.c:224:__do_path_resolve]
> libglusterfsclient-dentry: loc->parent(1) already present. sending
> lookup for 1//abc.txt
>
> [2009-07-20 12:24:58] D
> [libglusterfsclient-dentry.c:245:__do_path_resolve]
> libglusterfsclient-dentry: resolved path(/abc.txt) till 1(/). sending
> lookup for remaining path
>
> [2009-07-20 12:24:58] D
> [libglusterfsclient.c:1608:libgf_client_lookup_cbk]
libglusterfsclient:
> 1: (op_num=0) /abc.txt => -1 (No such file or directory)
>
> [2009-07-20 12:24:58] E [libglusterfsclient.c:2447:glusterfs_glh_open]
> libglusterfsclient: path lookup failed for (/abc.txt)
>
Assuming you're the using the same program as you'd pasted earlier,
this last line is an error that says the file was not found in
the file system when trying to open it. This is the reason why
your program took the file creation branch in the "if" block.
We can be sure about this error if you could confirm, before running
your test program, whether the file really did not exist on the backend.
Regards
-Shehjar
>
>
>
>
> Can you please explain the above errors and what is that causing these
> errors?
>
>
>
> Thanks and regards,
>
> Sudipto
>
>
>
>
>
>
>
> -Original Message-
> From: Sudipto Mukhopadhyay
> Sent: Monday, July 20, 2009 3:59 PM
> To: Shehjar Tikoo
> Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org
> Subject: RE: [Gluster-users] Regarding 2.0.4 booster
>
>
>
> Hi Shehjar,
>
>
>
> The contents in booster.conf are in two separate lines.
>
> I will try out the test again by merging the contents of booster.conf
> into one single line after I get my nodes back.
>
>
>
> Thanks and regards,
>
> Sudipto
>
>
>
> -Original Message-
>
> From: Shehjar Tikoo [mailto:shehj...@gluster.com]
>
> Sent: Thursday, July 16, 2009 10:08 PM
>
> To: Sudipto Mukhopadhyay
>
> Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org
>
> Subject: Re: [Gluster-users] Regarding 2.0.4 booster
>
>
>
> Sudipto Mukhopadhyay wrote:
>
>> My mistake I meant booster log is not getting generated.
>
>>
>
>> Thanks and regards,
>
>> Sudipto
>
>
>
>
>
> Hi
>
>
>
> A few questions. Please see inlined text.
>
>
>
>>
>
>> -Original Message-
>
>> From: gluster-users-boun...@gluster.org
>
>> [mailto:gluster-users-boun...@gluster.org] On Behalf Of Sudipto
>
>> Mukhopadhyay
>
>> Sent: Tuesday, July 14, 2009 2:07 PM
>
>> To: Shehjar Tikoo
>
>> Cc: av...@gluster.com; gluster-users@gluster.org
>
>> Subject: Re: [Gluster-users] Regarding 2.0.4 booster
>
>>
>
>> Hi Shehjar,
>
>>
>
>> Thanks for looking into this issue.
>
>> The file abc.txt is getting created; if you look at the C program;
the
>
>> following line is basically printing out the file handle on stdout:
>
>>
>
>> printf ("File handle %d\n",fh);
>
>>
>
>> But, the booster log is getting generated.
>
>>
>
>> Thanks and regards,
>
>> Sudipto
>
>>
>
>> -Original Message-
>
>> From: Shehjar Tikoo [mailto:shehj...@gluster.com]
>
>> Sent: Tuesday, July 14, 2009 2:34 AM
>
>> To: Sudipto Mukhopadhyay
>
>> Cc: gluster-users@gluster.org; av...@gluster.com
>
>> Subject: Re: [Gluster-users] Regarding 2.0.4 booster
>
>>
>
>> Sudipto Mukhopadhyay wrote:
>
>> > Hi,
>
>> >
>
>> >
>
>> >
>
>>
Re: [Gluster-users] Regarding 2.0.4 booster
Sudipto Mukhopadhyay wrote:
Hi,
After modifying the booster.conf, I started getting the logs under
/tmp/booster.log but, I see the following error:
[2009-07-20 12:24:58] D [booster.c:1025:booster_init] booster: booster
is inited
[2009-07-20 12:24:58] D
[libglusterfsclient.c:1340:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry found: /mnt/glusterfs/abc.txt: /mnt/glusterfs/
[2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk]
remote1: Connected to 10.16.80.53:6996, attached to remote volume 'afr'.
[2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk]
remote1: Connected to 10.16.80.53:6996, attached to remote volume 'afr'.
[2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk]
remote2: Connected to 10.16.80.55:6996, attached to remote volume 'afr'.
[2009-07-20 12:24:58] D
[libglusterfsclient-dentry.c:224:__do_path_resolve]
libglusterfsclient-dentry: loc->parent(1) already present. sending
lookup for 1//abc.txt
[2009-07-20 12:24:58] D
[libglusterfsclient-dentry.c:245:__do_path_resolve]
libglusterfsclient-dentry: resolved path(/abc.txt) till 1(/). sending
lookup for remaining path
[2009-07-20 12:24:58] D
[libglusterfsclient.c:1608:libgf_client_lookup_cbk] libglusterfsclient:
1: (op_num=0) /abc.txt => -1 (No such file or directory)
[2009-07-20 12:24:58] E [libglusterfsclient.c:2447:glusterfs_glh_open]
libglusterfsclient: path lookup failed for (/abc.txt)
Can you please explain the above errors and what is that causing these
errors?
The other messages are debug and informational messages. If you'd
like to reduce the verbosity of the log, please set the loglevel
parameter in the booster.conf to ERROR.
Regards
-Shehjar
Thanks and regards,
Sudipto
-Original Message-
From: Sudipto Mukhopadhyay
Sent: Monday, July 20, 2009 3:59 PM
To: Shehjar Tikoo
Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org
Subject: RE: [Gluster-users] Regarding 2.0.4 booster
Hi Shehjar,
The contents in booster.conf are in two separate lines.
I will try out the test again by merging the contents of booster.conf
into one single line after I get my nodes back.
Thanks and regards,
Sudipto
-Original Message-
From: Shehjar Tikoo [mailto:shehj...@gluster.com]
Sent: Thursday, July 16, 2009 10:08 PM
To: Sudipto Mukhopadhyay
Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org
Subject: Re: [Gluster-users] Regarding 2.0.4 booster
Sudipto Mukhopadhyay wrote:
My mistake I meant booster log is not getting generated.
Thanks and regards,
Sudipto
Hi
A few questions. Please see inlined text.
-Original Message-
From: gluster-users-boun...@gluster.org
[mailto:gluster-users-boun...@gluster.org] On Behalf Of Sudipto
Mukhopadhyay
Sent: Tuesday, July 14, 2009 2:07 PM
To: Shehjar Tikoo
Cc: av...@gluster.com; gluster-users@gluster.org
Subject: Re: [Gluster-users] Regarding 2.0.4 booster
Hi Shehjar,
Thanks for looking into this issue.
The file abc.txt is getting created; if you look at the C program; the
following line is basically printing out the file handle on stdout:
printf ("File handle %d\n",fh);
But, the booster log is getting generated.
Thanks and regards,
Sudipto
-Original Message-
From: Shehjar Tikoo [mailto:shehj...@gluster.com]
Sent: Tuesday, July 14, 2009 2:34 AM
To: Sudipto Mukhopadhyay
Cc: gluster-users@gluster.org; av...@gluster.com
Subject: Re: [Gluster-users] Regarding 2.0.4 booster
Sudipto Mukhopadhyay wrote:
> Hi,
>
>
>
> I trying to run some tests w/booster client library and I had to
> upgrade the glusterfs to version 2.0.4 from 2.0.2 (due to LD_PRELOAD
> failures of the booster client library,
>
http://git.savannah.gnu.org/cgit/gluster.git/commit/?id=a3ece0caa52ad2ea
cf8a8691aaca53295cde972f).
>
>
>
>
>
> Now, w/version 2.0.4 the LD_PRELOAD works OK, but the booster logs
> are not generating and I am not sure whether booster is working or,
> not.
>
> I have the following booster.conf and client vol specification:
>
>
>
> $cat /etc/glusterfs/booster.conf
>
> /etc/glusterfs/glusterfs-client.vol /mnt/glusterfs glusterfs
>
> subvolume=brick,logfile=/tmp/booster.log,loglevel=DEBUG
>
Please confirm whether the above content in booster.conf is on
a single line or two separate lines. It should all be on one line for
the logfile setting to be associated with /mnt/glusterfs.
>
>
> $cat /etc/glusterfs/glusterfs-client.vol
>
> volume brick
>
> type protocol/client
>
> option transport-type tcp/client # for TCP/IP transport
>
> option remote-host 10.16.80.53 # IP address of the server
>
> option remote-subvolume afr # name of the remote
Re: [Gluster-users] Regarding 2.0.4 booster
Sudipto Mukhopadhyay wrote:
Hi,
After modifying the booster.conf, I started getting the logs under
/tmp/booster.log but, I see the following error:
[2009-07-20 12:24:58] D [booster.c:1025:booster_init] booster: booster
is inited
[2009-07-20 12:24:58] D
[libglusterfsclient.c:1340:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry found: /mnt/glusterfs/abc.txt: /mnt/glusterfs/
[2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk]
remote1: Connected to 10.16.80.53:6996, attached to remote volume 'afr'.
[2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk]
remote1: Connected to 10.16.80.53:6996, attached to remote volume 'afr'.
[2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk]
remote2: Connected to 10.16.80.55:6996, attached to remote volume 'afr'.
[2009-07-20 12:24:58] D
[libglusterfsclient-dentry.c:224:__do_path_resolve]
libglusterfsclient-dentry: loc->parent(1) already present. sending
lookup for 1//abc.txt
[2009-07-20 12:24:58] D
[libglusterfsclient-dentry.c:245:__do_path_resolve]
libglusterfsclient-dentry: resolved path(/abc.txt) till 1(/). sending
lookup for remaining path
[2009-07-20 12:24:58] D
[libglusterfsclient.c:1608:libgf_client_lookup_cbk] libglusterfsclient:
1: (op_num=0) /abc.txt => -1 (No such file or directory)
[2009-07-20 12:24:58] E [libglusterfsclient.c:2447:glusterfs_glh_open]
libglusterfsclient: path lookup failed for (/abc.txt)
Assuming you're the using the same program as you'd pasted earlier,
this last line is an error that says the file was not found in
the file system when trying to open it. This is the reason why
your program took the file creation branch in the "if" block.
We can be sure about this error if you could confirm, before running
your test program, whether the file really did not exist on the backend.
Regards
-Shehjar
Can you please explain the above errors and what is that causing these
errors?
Thanks and regards,
Sudipto
-Original Message-
From: Sudipto Mukhopadhyay
Sent: Monday, July 20, 2009 3:59 PM
To: Shehjar Tikoo
Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org
Subject: RE: [Gluster-users] Regarding 2.0.4 booster
Hi Shehjar,
The contents in booster.conf are in two separate lines.
I will try out the test again by merging the contents of booster.conf
into one single line after I get my nodes back.
Thanks and regards,
Sudipto
-Original Message-
From: Shehjar Tikoo [mailto:shehj...@gluster.com]
Sent: Thursday, July 16, 2009 10:08 PM
To: Sudipto Mukhopadhyay
Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org
Subject: Re: [Gluster-users] Regarding 2.0.4 booster
Sudipto Mukhopadhyay wrote:
My mistake I meant booster log is not getting generated.
Thanks and regards,
Sudipto
Hi
A few questions. Please see inlined text.
-Original Message-
From: gluster-users-boun...@gluster.org
[mailto:gluster-users-boun...@gluster.org] On Behalf Of Sudipto
Mukhopadhyay
Sent: Tuesday, July 14, 2009 2:07 PM
To: Shehjar Tikoo
Cc: av...@gluster.com; gluster-users@gluster.org
Subject: Re: [Gluster-users] Regarding 2.0.4 booster
Hi Shehjar,
Thanks for looking into this issue.
The file abc.txt is getting created; if you look at the C program; the
following line is basically printing out the file handle on stdout:
printf ("File handle %d\n",fh);
But, the booster log is getting generated.
Thanks and regards,
Sudipto
-Original Message-
From: Shehjar Tikoo [mailto:shehj...@gluster.com]
Sent: Tuesday, July 14, 2009 2:34 AM
To: Sudipto Mukhopadhyay
Cc: gluster-users@gluster.org; av...@gluster.com
Subject: Re: [Gluster-users] Regarding 2.0.4 booster
Sudipto Mukhopadhyay wrote:
> Hi,
>
>
>
> I trying to run some tests w/booster client library and I had to
> upgrade the glusterfs to version 2.0.4 from 2.0.2 (due to LD_PRELOAD
> failures of the booster client library,
>
http://git.savannah.gnu.org/cgit/gluster.git/commit/?id=a3ece0caa52ad2ea
cf8a8691aaca53295cde972f).
>
>
>
>
>
> Now, w/version 2.0.4 the LD_PRELOAD works OK, but the booster logs
> are not generating and I am not sure whether booster is working or,
> not.
>
> I have the following booster.conf and client vol specification:
>
>
>
> $cat /etc/glusterfs/booster.conf
>
> /etc/glusterfs/glusterfs-client.vol /mnt/glusterfs glusterfs
>
> subvolume=brick,logfile=/tmp/booster.log,loglevel=DEBUG
>
Please confirm whether the above content in booster.conf is on
a single line or two separate lines. It should all be on one line for
the logfile setting to be associated with /mnt/glusterfs.
>
>
> $cat /etc/glusterfs/glusterfs-client.vol
>
> volume brick
Re: [Gluster-users] Regarding 2.0.4 booster
Hi,
After modifying the booster.conf, I started getting the logs under
/tmp/booster.log but, I see the following error:
[2009-07-20 12:24:58] D [booster.c:1025:booster_init] booster: booster
is inited
[2009-07-20 12:24:58] D
[libglusterfsclient.c:1340:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry found: /mnt/glusterfs/abc.txt: /mnt/glusterfs/
[2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk]
remote1: Connected to 10.16.80.53:6996, attached to remote volume 'afr'.
[2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk]
remote1: Connected to 10.16.80.53:6996, attached to remote volume 'afr'.
[2009-07-20 12:24:58] N [client-protocol.c:5559:client_setvolume_cbk]
remote2: Connected to 10.16.80.55:6996, attached to remote volume 'afr'.
[2009-07-20 12:24:58] D
[libglusterfsclient-dentry.c:224:__do_path_resolve]
libglusterfsclient-dentry: loc->parent(1) already present. sending
lookup for 1//abc.txt
[2009-07-20 12:24:58] D
[libglusterfsclient-dentry.c:245:__do_path_resolve]
libglusterfsclient-dentry: resolved path(/abc.txt) till 1(/). sending
lookup for remaining path
[2009-07-20 12:24:58] D
[libglusterfsclient.c:1608:libgf_client_lookup_cbk] libglusterfsclient:
1: (op_num=0) /abc.txt => -1 (No such file or directory)
[2009-07-20 12:24:58] E [libglusterfsclient.c:2447:glusterfs_glh_open]
libglusterfsclient: path lookup failed for (/abc.txt)
Can you please explain the above errors and what is that causing these
errors?
Thanks and regards,
Sudipto
-Original Message-
From: Sudipto Mukhopadhyay
Sent: Monday, July 20, 2009 3:59 PM
To: Shehjar Tikoo
Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org
Subject: RE: [Gluster-users] Regarding 2.0.4 booster
Hi Shehjar,
The contents in booster.conf are in two separate lines.
I will try out the test again by merging the contents of booster.conf
into one single line after I get my nodes back.
Thanks and regards,
Sudipto
-Original Message-
From: Shehjar Tikoo [mailto:shehj...@gluster.com]
Sent: Thursday, July 16, 2009 10:08 PM
To: Sudipto Mukhopadhyay
Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org
Subject: Re: [Gluster-users] Regarding 2.0.4 booster
Sudipto Mukhopadhyay wrote:
> My mistake I meant booster log is not getting generated.
>
> Thanks and regards,
> Sudipto
Hi
A few questions. Please see inlined text.
>
> -Original Message-
> From: gluster-users-boun...@gluster.org
> [mailto:gluster-users-boun...@gluster.org] On Behalf Of Sudipto
> Mukhopadhyay
> Sent: Tuesday, July 14, 2009 2:07 PM
> To: Shehjar Tikoo
> Cc: av...@gluster.com; gluster-users@gluster.org
> Subject: Re: [Gluster-users] Regarding 2.0.4 booster
>
> Hi Shehjar,
>
> Thanks for looking into this issue.
> The file abc.txt is getting created; if you look at the C program; the
> following line is basically printing out the file handle on stdout:
>
> printf ("File handle %d\n",fh);
>
> But, the booster log is getting generated.
>
> Thanks and regards,
> Sudipto
>
> -Original Message-
> From: Shehjar Tikoo [mailto:shehj...@gluster.com]
> Sent: Tuesday, July 14, 2009 2:34 AM
> To: Sudipto Mukhopadhyay
> Cc: gluster-users@gluster.org; av...@gluster.com
> Subject: Re: [Gluster-users] Regarding 2.0.4 booster
>
> Sudipto Mukhopadhyay wrote:
>> Hi,
>>
>>
>>
>> I trying to run some tests w/booster client library and I had to
>> upgrade the glusterfs to version 2.0.4 from 2.0.2 (due to LD_PRELOAD
>> failures of the booster client library,
>>
>
http://git.savannah.gnu.org/cgit/gluster.git/commit/?id=a3ece0caa52ad2ea
> cf8a8691aaca53295cde972f).
>>
>>
>>
>>
>>
>> Now, w/version 2.0.4 the LD_PRELOAD works OK, but the booster logs
>> are not generating and I am not sure whether booster is working or,
>> not.
>>
>> I have the following booster.conf and client vol specification:
>>
>>
>>
>> $cat /etc/glusterfs/booster.conf
>>
>> /etc/glusterfs/glusterfs-client.vol /mnt/glusterfs glusterfs
>>
>> subvolume=brick,logfile=/tmp/booster.log,loglevel=DEBUG
>>
Please confirm whether the above content in booster.conf is on
a single line or two separate lines. It should all be on one line for
the logfile setting to be associated with /mnt/glusterfs.
>>
>>
>> $cat /etc/glusterfs/glusterfs-client.vol
>>
>> volume brick
>>
>> type protocol/client
>>
>> option transport-type tcp/client # for TCP/IP transport
>>
>> option remote-host 10.16.80.53 # IP address of the server
>>
>> option remote-subvolume afr # name of the remote volume
>>
>> end-volume
>>
>>
>>
>> volume writebehind
>>
>> type performance/write-behind
>>
>> option window-size 1MB
>>
>> subvolumes brick
>>
>> end-volume
>>
>>
>>
>>
>>
>> I have written a simple program to test few system calls and the
>> booster
Re: [Gluster-users] Stable version of Gluster 2.04?
On Mon, 20 Jul 2009 08:46:16 -0700 Anand Avati wrote: > > Nevertheless I would not say it is "stable". At least I can crash it within > > minutes to days of runtime. > > Can you report the crash you faced in 2.0.4? If possible file a crash > bug with the backtrace in bugs.gluster.com. > Thanks > > Avati You cannot count on that. It is not possible to get this piece of software stable by waiting for crash reports. Quite some of the problems do not produce core dumps or regular dumpable crashes. Examples: Our testbed consists of two servers (replicated standard setup) and two clients. If you start two continously running bonnies on both clients you will experience some hangs or offline situations by one or even both servers and hanging client filesystems. This always happens within 5 days of continuous runs. If you untar a standard kernel source on a client you will notice that in at least 5 out of ten runs tar exits with previous errors. If tar exits ok, try to make the kernel. Then you will notice that it complains about quite some filedates in the future. (The same archive works well on any local fs of course). I cannot dump these problems, I only can tell you to check them out for yourselves. They are all quite easily reproducable on a standard setup based on opensuse 11.1. -- Regards, Stephan ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Regarding 2.0.4 booster
Hi Shehjar,
The contents in booster.conf are in two separate lines.
I will try out the test again by merging the contents of booster.conf
into one single line after I get my nodes back.
Thanks and regards,
Sudipto
-Original Message-
From: Shehjar Tikoo [mailto:shehj...@gluster.com]
Sent: Thursday, July 16, 2009 10:08 PM
To: Sudipto Mukhopadhyay
Cc: serv...@gluster.com; av...@gluster.com; gluster-users@gluster.org
Subject: Re: [Gluster-users] Regarding 2.0.4 booster
Sudipto Mukhopadhyay wrote:
> My mistake I meant booster log is not getting generated.
>
> Thanks and regards,
> Sudipto
Hi
A few questions. Please see inlined text.
>
> -Original Message-
> From: gluster-users-boun...@gluster.org
> [mailto:gluster-users-boun...@gluster.org] On Behalf Of Sudipto
> Mukhopadhyay
> Sent: Tuesday, July 14, 2009 2:07 PM
> To: Shehjar Tikoo
> Cc: av...@gluster.com; gluster-users@gluster.org
> Subject: Re: [Gluster-users] Regarding 2.0.4 booster
>
> Hi Shehjar,
>
> Thanks for looking into this issue.
> The file abc.txt is getting created; if you look at the C program; the
> following line is basically printing out the file handle on stdout:
>
> printf ("File handle %d\n",fh);
>
> But, the booster log is getting generated.
>
> Thanks and regards,
> Sudipto
>
> -Original Message-
> From: Shehjar Tikoo [mailto:shehj...@gluster.com]
> Sent: Tuesday, July 14, 2009 2:34 AM
> To: Sudipto Mukhopadhyay
> Cc: gluster-users@gluster.org; av...@gluster.com
> Subject: Re: [Gluster-users] Regarding 2.0.4 booster
>
> Sudipto Mukhopadhyay wrote:
>> Hi,
>>
>>
>>
>> I trying to run some tests w/booster client library and I had to
>> upgrade the glusterfs to version 2.0.4 from 2.0.2 (due to LD_PRELOAD
>> failures of the booster client library,
>>
>
http://git.savannah.gnu.org/cgit/gluster.git/commit/?id=a3ece0caa52ad2ea
> cf8a8691aaca53295cde972f).
>>
>>
>>
>>
>>
>> Now, w/version 2.0.4 the LD_PRELOAD works OK, but the booster logs
>> are not generating and I am not sure whether booster is working or,
>> not.
>>
>> I have the following booster.conf and client vol specification:
>>
>>
>>
>> $cat /etc/glusterfs/booster.conf
>>
>> /etc/glusterfs/glusterfs-client.vol /mnt/glusterfs glusterfs
>>
>> subvolume=brick,logfile=/tmp/booster.log,loglevel=DEBUG
>>
Please confirm whether the above content in booster.conf is on
a single line or two separate lines. It should all be on one line for
the logfile setting to be associated with /mnt/glusterfs.
>>
>>
>> $cat /etc/glusterfs/glusterfs-client.vol
>>
>> volume brick
>>
>> type protocol/client
>>
>> option transport-type tcp/client # for TCP/IP transport
>>
>> option remote-host 10.16.80.53 # IP address of the server
>>
>> option remote-subvolume afr # name of the remote volume
>>
>> end-volume
>>
>>
>>
>> volume writebehind
>>
>> type performance/write-behind
>>
>> option window-size 1MB
>>
>> subvolumes brick
>>
>> end-volume
>>
>>
>>
>>
>>
>> I have written a simple program to test few system calls and the
>> booster functionality:
>>
>> int main() {
>>
>>
>>
>> int fh;
>>
>> char buffer[65];
>>
>>
>>
>> fh = open("/mnt/glusterfs/abc.txt",O_WRONLY);
>>
>> if (fh == -1) {
>>
>> fh = creat("/mnt/glusterfs/abc.txt",O_WRONLY);
>>
>> }
>>
>> printf ("File handle %d\n",fh);
>>
>> close(fh);
>>
>>
>>
>> return 0;
>>
>> }
>>
>>
>>
>> When I run my program with LD_PRELOAD option, I get the following
>> message:
>>
>>
>>
>> LD_PRELOAD="/usr/local/lib/glusterfs/glusterfs-booster.so"
>> /root/fstest/a.out
>>
>> [2009-07-13 16:19:02] E
>> [libglusterfsclient.c:2447:glusterfs_glh_open] libglusterfsclient:
>> path lookup failed for (/abc.txt)
>>
Is the above log message the only message that is being output? Were
there more lines that resembled this log line that you probably
removed for the purpose of this email?
Thanks
Shehjar
>> File handle 4
>>
>>
>>
>> And there is no /tmp/booster.log created. The above log is only
>> observed while creating the file (in case abc.txt is not present).
>>
>> Could you please advice on the booster config file and let me know
>> why I am not seeing any booster log?
>>
>>
> I'll check why the booster log is not getting generated.
> In the mean time, can you check if the file abc.txt really does not
> get created on the backend?
> If open is failing, it looks like the fd 4 is being returned by
> creat call.
>
> -Shehjar
>
>
>> Appreciate your help.
>>
>>
>>
>> Thanks and regards,
>>
>> Sudipto
>>
>>
>>
>>
>>
>>
>>
>>
>>
>
>>
>>
>> ___ Gluster-users mailing
>> list Gluster-users@gluster.org
>> http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
>
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
>
___
Gluster-u
Re: [Gluster-users] Stable version of Gluster 2.04?
> Nevertheless I would not say it is "stable". At least I can crash it within > minutes to days of runtime. Can you report the crash you faced in 2.0.4? If possible file a crash bug with the backtrace in bugs.gluster.com. Thanks Avati ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] Couple of pre-install questions
Heya all, I'm currently evaluating potential solutions for storage, for a high performance cluster that's going to be running virtualization/web applications. Main concerns are reliability and scalability, so Gluster's definitely of great interest. Right now, I've got three Sun x4500's (connected via Infiniband) to play with. Figuring on using those as bricks, running OpenSolaris/ZFS. After reading docs/various how-to's, I'm fairly certain it wouldn't be that difficult to set two of these up in a sort of raid 10 config, and expand in the future via adding additional pairs of servers. Wondering if there's any potential configuration that would allow for more of a distributed replication/redundancy as opposed to direct mirroring. Thanks, -- -- Gary Gogick senior systems administrator | workhabit,inc. // email: g...@workhabit.com | web: http://www.workhabit.com // office: 866-workhabit | fax: 919-552-9690 -- ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Delayed Replication + Realtime Locking
- "Mathew Eis" wrote: > 1) Is the above possible with the current Gluster translators? I've > experimented with various combinations of translators, including > replicate, nufa, writebehind, and io-threads, and while I have been > able to improve performance of some operations, many others are still > taking place at WAN speed. This should be possible with the replicate translator. Replicate returns successfully to the application as soon as a write succeeds on atleast one subvolume. So, in effect, the write over WAN should happen in the background. You should also set the read-subvolume to be the local server, so that reads are served from there. However, currently there is one feature that makes a setup like this somewhat untenable. When a file is self healing, all access to it will be blocked. Self-heal over WAN could turn out to be quite slow for large files. There are two improvements planned for the 2.1 release which will make your configuration possible: 1) Self heal in the background. With this only writes to the currently self-healing region of a file will be blocked. 2) rsync algorithm for self-heal. This will be much more efficient in terms of data transferred over the network. Vikas ___ Gluster-users mailing list Gluster-users@gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
