Re: [Gluster-users] Memory leak with glusterfs NFS on 3.2.6

[Xavier Normand]

Hi Philip,I do have about the same problem that you describe. There is my setup:Gluster: Two bricks running gluster 3.2.6Clients:4 clients running native gluster fuse client.2 clients running nfs clientMy nfs client are not doing that much traffic but i was able to view after a couple days that the brick used to mount the nfs is having memory issue.i can provide more info as needed to help correct the problem.Thank'sXavierLe 2012-06-12 à 08:18, Philip Poten a écrit :2012/6/12 Dan Bretherton :I wonder if this memory leak is the cause of the NFS performance degradationI reported in April.That's probable, since the performance does go down for us too whenthe glusterfs process reaches a large percentage of RAM. My initialguess was that it's the file system cache that's being eradicated,thus iowait increases. But a closer look at our munin graphs implies,that it's also the user space that eats more and more CPUproportionally with RAM:http://imgur.com/a/8YfhQThere are two restarts of the whole gluster process family visible onthose graphs: one a week ago at the very beginning (white in thememory graph, as munin couldn't fork all it needed), and oneyesterday. The drop between 8 and 9 was due to a problemv unrelated togluster.Pranith: I just made one dump, tomorrow I'll make one more and mailthem both to you so that you can compare them. While I just restartedyesterday, the leak should be visible, as the process grows a fewhundred MB every day.thanks for the fast reply,Philip___Gluster-users mailing listGluster-users@gluster.orghttp://gluster.org/cgi-bin/mailman/listinfo/gluster-users___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Re: [Gluster-users] Gluster client can't connect to Gluster volume

[Xavier Normand]

Hi

Do you have selinux enable?

Envoyé de mon iPhone

Le 2012-05-05 à 00:27, Eric  a écrit :

> Hi, All:
> 
> I've built a Gluster-based storage cluster on a pair of CentOS 5.7 (i386) 
> VM's. The nodes are using Gluster 3.2.6 (from source) and the host is using 
> Gluster 3.0.0 (from the Mageia package repositories):
> 
> [eric@node1 ~]$ sudo /usr/local/sbin/gluster --version
> glusterfs 3.2.6 built on May  3 2012 15:53:02
> 
> [eric@localhost ~]$ rpm -qa | grep glusterfs
> glusterfs-common-3.0.0-2.mga1
> glusterfs-client-3.0.0-2.mga1
> glusterfs-server-3.0.0-2.mga1
> libglusterfs0-3.0.0-2.mga1
> 
> None of the systems (i.e., neither the two storage nodes nor the client) can 
> connect to Port 6996 of the cluster (node1.example.com & node2.example.com) 
> but the two storage nodes can mount the shared volume using the Gluster 
> helper and/or NFS:
> 
> [eric@node1 ~]$ sudo /sbin/lsmod | grep fuse
> 
> [eric@node1 ~]$ sudo /sbin/modprobe fuse
> 
> [eric@node1 ~]$ sudo /sbin/lsmod | grep fuse
> fuse   49237  0 
> 
> [eric@node1 ~]$ sudo mount -t glusterfs node1:/mirror-1 /mnt
> 
> [eric@node1 ~]$ sudo grep gluster /etc/mtab 
> glusterfs#node1:/mirror-1 /mnt fuse 
> rw,allow_other,default_permissions,max_read=131072 0 0
> 
> ...but the host system is only able to connect using NFS:
> 
> [eric@localhost ~]$ sudo glusterfs --debug -f /tmp/glusterfs.vol /mnt
> [2012-05-04 19:09:09] D [glusterfsd.c:424:_get_specfp] glusterfs: loading 
> volume file /tmp/glusterfs.vol
> 
> Version  : glusterfs 3.0.0 built on Apr 10 2011 19:12:54
> git: 2.0.1-886-g8379edd
> Starting Time: 2012-05-04 19:09:09
> Command line : glusterfs --debug -f /tmp/glusterfs.vol /mnt 
> PID  : 30159
> System name  : Linux
> Nodename : localhost.localdomain
> Kernel Release : 2.6.38.8-desktop586-10.mga
> Hardware Identifier: i686
> 
> Given volfile:
> +--+
>   1: volume mirror-1
>   2:  type protocol/client
>   3:  option transport-type tcp
>   4:  option remote-host node1.example.com
>   5:  option remote-subvolume mirror-1
>   6: end-volume
> +--+
> [2012-05-04 19:09:09] D [glusterfsd.c:1335:main] glusterfs: running in pid 
> 30159
> [2012-05-04 19:09:09] D [client-protocol.c:6581:init] mirror-1: defaulting 
> frame-timeout to 30mins
> [2012-05-04 19:09:09] D [client-protocol.c:6592:init] mirror-1: defaulting 
> ping-timeout to 42
> [2012-05-04 19:09:09] D [transport.c:145:transport_load] transport: attempt 
> to load file /usr/lib/glusterfs/3.0.0/transport/socket.so
> [2012-05-04 19:09:09] D [transport.c:145:transport_load] transport: attempt 
> to load file /usr/lib/glusterfs/3.0.0/transport/socket.so
> [2012-05-04 19:09:09] D [client-protocol.c:7005:notify] mirror-1: got 
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2012-05-04 19:09:09] D [client-protocol.c:7005:notify] mirror-1: got 
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2012-05-04 19:09:09] D [client-protocol.c:7005:notify] mirror-1: got 
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2012-05-04 19:09:09] D [client-protocol.c:7005:notify] mirror-1: got 
> GF_EVENT_PARENT_UP, attempting connect on transport
> [2012-05-04 19:09:09] N [glusterfsd.c:1361:main] glusterfs: Successfully 
> started
> [2012-05-04 19:09:09] E [socket.c:760:socket_connect_finish] mirror-1: 
> connection to  failed (Connection refused)
> [2012-05-04 19:09:09] D [fuse-bridge.c:3079:fuse_thread_proc] fuse:  
> pthread_cond_timedout returned non zero value ret: 0 errno: 0
> [2012-05-04 19:09:09] N [fuse-bridge.c:2931:fuse_init] glusterfs-fuse: FUSE 
> inited with protocol versions: glusterfs 7.13 kernel 7.16
> [2012-05-04 19:09:09] E [socket.c:760:socket_connect_finish] mirror-1: 
> connection to  failed (Connection refused)
> 
> I've read through the Troubleshooting section of the Gluster Administration 
> Guide and the Gluster User Guide but can't seem to resolve the problem. (See 
> my post on the Mageia Forum for all the troubleshooting details: 
> https://forums.mageia.org/en/viewtopic.php?f=7&t=2358&p=17517)
> 
> What might be causing this?
> 
> TIA,
> Eric Pretorious
> Truckee, CA
> 
> https://forums.mageia.org/en/viewtopic.php?f=7&t=2358&p=17517
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Re: [Gluster-users] Influence Load Balancing

[Xavier Normand]

Hi,

I would suggest mounting clients using NFS on a specific server. Using NFS all 
read and write will point to that server and replicated by the server if needed.

Hope this help!

Xavier

Le 2012-04-27 à 13:11, Philip a écrit :

> Hi,
> 
> I am trying to perform a brick replacement but for some reason the
> regular traffic seems to have a bad influence on this operation.
> Suppose I have two servers, is it possible to direct all regular
> traffic to a specific server so the other server has no load and can
> use all resources to perform the replacement?
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

[Gluster-users] Need advice for choosing proper glusterfs cluster hardware

[Xavier Normand]

Hi,

I'm in a process to our NFS / DRDB setup to a more scalable glusterfs cluster. 
I would like to some advise on what would be the best hardware match to fit 
both speed and storage. Currently our actual setup fit's out need for speed, 
but adding storage in that kind of setup a pain!

Current setup:
2 servers [ Active / Passive ]
Quad Core 2.4
Raid 10 [ 8 * 600GB SAS 3 GB/s  ]
2.2 TB usable space
client protocol: NFS

What i plan to use:
2 servers [ Distributed replicate ]
i5 - Quad Core - 3,3Ghz
Raid 10 [ 4 * 2TB SATA ]
3.72 TB usable space
Client protocol: glusterfs

The big question! Should i use more servers with less disk space to get the 
same speed. Or i will probably get the same speed as my actual NFS setup. We 
host a lot of small files that will be read by our fontend servers. 

Thank's

Xavier Normand___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Re: [Gluster-users] trouble rebalancing volume

[Xavier Normand]

I saw two deb file on gluster.org! did you use the one with rdma support?
cause i saw some strange "no such file ..." in your log file
"/usr/lib/glusterfs/3.2.5/rpc-transport/rdma.so:
cannot open shared object file: No such file or directory"?
*Xavier Normand*
Administrateur Système
De Marque inc.
418 658-1910 #229


On Fri, Mar 9, 2012 at 11:23 AM, Brian Cipriano wrote:

>  Strange! Our procedures are almost exactly the same.
>
> I did use the .deb file from gluster.org.
>
> The only possible difference is that my bricks are mounted differently. My
> bricks are mounted within /gluster:
>
> /gluster/brick0001
> /gluster/brick0002
>
> and so on.
>
>
> - brian
>
> On 3/9/12 11:19 AM, Xavier Normand wrote:
>
> Hi Brian,
>
>  i replicate you setup and try to rebalance. I didn't have any of your
> issue.
>
>  There is what i did:
>
>  1. Install a Ubuntu 10.04 LTS 64Bit
> 2. Install GlusterFS using the .deb file
> 3. Add two drive two 1TB each format in ext4 mount on /data1 & /data2
> 4. Create a volume in glusterfs [ volume create data transport tcp
> glustertest:/data1 ]
> 5. Start the volume et mount it on the same server on /media
> 6. Copy a bunch on file on it.
> 7. Add the other drive in the volume [ volume add-brick data
> glustertest:/data2 ]
> 8. Rebalance [ volume rebalance data start ]
>
>  Are you using the .deb file on gluster.org?
>
> *Xavier*
>
>
> On Fri, Mar 9, 2012 at 10:57 AM, Brian Cipriano wrote:
>
>>  10.04 LTS, 64-bit.
>>
>>
>> On 3/9/12 10:57 AM, Xavier Normand wrote:
>>
>> What version of Ubuntu are you using? LTS? 32 or 64 bits?
>>
>> *Xavier Normand*
>> Administrateur Système
>> De Marque inc.
>> 418 658-1910 #229 <418%20658-1910%20%23229>
>>
>>
>> On Fri, Mar 9, 2012 at 10:30 AM, Brian Cipriano wrote:
>>
>>>  Sure thing. I believe these are them.
>>>
>>> The volume in question is called "west".
>>>
>>> - brian
>>>
>>>
>>> On 3/9/12 10:27 AM, shylesh kumar wrote:
>>>
>>> Hi Brian,
>>>
>>>  Could you please provide the rebalance and glusterd logs, that would
>>> help in debugging the problem.
>>>
>>>
>>>  Thanks,
>>> Shylesh
>>>
>>>
>>>
>>>
>>> On Fri, Mar 9, 2012 at 8:52 PM, Brian Cipriano wrote:
>>>
>>>> I've just confirmed that the same is happening on a totally different
>>>> Ubuntu machine. Doesn't seem to be confined to the machine.
>>>>
>>>> Could maybe be something I'm missing in the setup though? Some package
>>>> I haven't installed?
>>>>
>>>> - brian
>>>>
>>>>
>>>> On 3/9/12 9:59 AM, Brian Cipriano wrote:
>>>>
>>>>> Hi Shylesh - thanks for the reply.
>>>>>
>>>>> I've restarted a few times - glusterd, the volume, the machine itself.
>>>>> Same results.
>>>>>
>>>>> - brian
>>>>>
>>>>> On 3/9/12 12:46 AM, Shylesh Kumar Mohan wrote:
>>>>>
>>>>>> Hi Brian,
>>>>>>
>>>>>> Could you please restart glusterd and try again rebalancing.
>>>>>>
>>>>>>
>>>>>>
>>>>>> Thanks,
>>>>>> Shylesh
>>>>>>
>>>>>> - Original Message -
>>>>>> From: Brian Cipriano
>>>>>> To: gluster-users@gluster.org
>>>>>> Sent: Thu, 08 Mar 2012 18:08:22 -0500 (EST)
>>>>>> Subject: [Gluster-users] trouble rebalancing volume
>>>>>>
>>>>>> Hi all -
>>>>>>
>>>>>> I'm having issues rebalancing my layout/data across a two-brick
>>>>>> volume.
>>>>>> I'm on Gluster 3.2.5.
>>>>>>
>>>>>> I'm currently using a single Ubuntu 10.04 machine. Both bricks reside
>>>>>> on
>>>>>> this machine. Adding the brick went fine. Here's the volume's info:
>>>>>>
>>>>>> $ sudo gluster volume info
>>>>>> Volume Name: branch
>>>>>> Type: Distribute
>>>>>> Status: Started
>>>>>> Number of Bricks: 2
>>>>>> Transport-type: tcp
>>>>>> Bricks:
>>>>>> Brick1: syst

Re: [Gluster-users] trouble rebalancing volume

[Xavier Normand]

Hi Brian,

i replicate you setup and try to rebalance. I didn't have any of your issue.

There is what i did:

1. Install a Ubuntu 10.04 LTS 64Bit
2. Install GlusterFS using the .deb file
3. Add two drive two 1TB each format in ext4 mount on /data1 & /data2
4. Create a volume in glusterfs [ volume create data transport tcp
glustertest:/data1 ]
5. Start the volume et mount it on the same server on /media
6. Copy a bunch on file on it.
7. Add the other drive in the volume [ volume add-brick data
glustertest:/data2 ]
8. Rebalance [ volume rebalance data start ]

Are you using the .deb file on gluster.org?

*Xavier*


On Fri, Mar 9, 2012 at 10:57 AM, Brian Cipriano wrote:

>  10.04 LTS, 64-bit.
>
>
> On 3/9/12 10:57 AM, Xavier Normand wrote:
>
> What version of Ubuntu are you using? LTS? 32 or 64 bits?
>
> *Xavier Normand*
> Administrateur Système
> De Marque inc.
> 418 658-1910 #229
>
>
> On Fri, Mar 9, 2012 at 10:30 AM, Brian Cipriano wrote:
>
>>  Sure thing. I believe these are them.
>>
>> The volume in question is called "west".
>>
>> - brian
>>
>>
>> On 3/9/12 10:27 AM, shylesh kumar wrote:
>>
>> Hi Brian,
>>
>>  Could you please provide the rebalance and glusterd logs, that would
>> help in debugging the problem.
>>
>>
>>  Thanks,
>> Shylesh
>>
>>
>>
>>
>> On Fri, Mar 9, 2012 at 8:52 PM, Brian Cipriano wrote:
>>
>>> I've just confirmed that the same is happening on a totally different
>>> Ubuntu machine. Doesn't seem to be confined to the machine.
>>>
>>> Could maybe be something I'm missing in the setup though? Some package I
>>> haven't installed?
>>>
>>> - brian
>>>
>>>
>>> On 3/9/12 9:59 AM, Brian Cipriano wrote:
>>>
>>>> Hi Shylesh - thanks for the reply.
>>>>
>>>> I've restarted a few times - glusterd, the volume, the machine itself.
>>>> Same results.
>>>>
>>>> - brian
>>>>
>>>> On 3/9/12 12:46 AM, Shylesh Kumar Mohan wrote:
>>>>
>>>>> Hi Brian,
>>>>>
>>>>> Could you please restart glusterd and try again rebalancing.
>>>>>
>>>>>
>>>>>
>>>>> Thanks,
>>>>> Shylesh
>>>>>
>>>>> - Original Message -
>>>>> From: Brian Cipriano
>>>>> To: gluster-users@gluster.org
>>>>> Sent: Thu, 08 Mar 2012 18:08:22 -0500 (EST)
>>>>> Subject: [Gluster-users] trouble rebalancing volume
>>>>>
>>>>> Hi all -
>>>>>
>>>>> I'm having issues rebalancing my layout/data across a two-brick volume.
>>>>> I'm on Gluster 3.2.5.
>>>>>
>>>>> I'm currently using a single Ubuntu 10.04 machine. Both bricks reside
>>>>> on
>>>>> this machine. Adding the brick went fine. Here's the volume's info:
>>>>>
>>>>> $ sudo gluster volume info
>>>>> Volume Name: branch
>>>>> Type: Distribute
>>>>> Status: Started
>>>>> Number of Bricks: 2
>>>>> Transport-type: tcp
>>>>> Bricks:
>>>>> Brick1: system01:/gluster/brick0001
>>>>> Brick2: system01:/gluster/brick0002
>>>>>
>>>>> brick0001 has a bunch of files on it, brick0002 is empty. I'd like to
>>>>> rebalance the directory layout and data onto the new brick. But strange
>>>>> things happen when I try to do this.
>>>>>
>>>>> $ sudo gluster volume rebalance branch fix-layout status
>>>>> rebalance stopped
>>>>> $ sudo gluster volume rebalance branch fix-layout start
>>>>> Rebalance on branch is already started
>>>>> $ sudo gluster volume rebalance branch fix-layout status
>>>>> rebalance stopped
>>>>>
>>>>> Weird! I can't seem to get this to work.
>>>>>
>>>>> Am I doing some wrong, or is this some other issue?
>>>>>
>>>>> Thanks!
>>>>>
>>>>> - brian
>>>>> ___
>>>>> Gluster-users mailing list
>>>>> Gluster-users@gluster.org
>>>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>>>>
>>>>>
>>>> ___
>>>> Gluster-users mailing list
>>>> Gluster-users@gluster.org
>>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>>>
>>>
>>> ___
>>> Gluster-users mailing list
>>> Gluster-users@gluster.org
>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>>
>>
>>
>>
>>  --
>> Thanks & Regards
>> Shylesh Kumar M
>>
>>
>>
>>
>> ___
>> Gluster-users mailing list
>> Gluster-users@gluster.org
>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>
>>
>
>
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Re: [Gluster-users] trouble rebalancing volume

[Xavier Normand]

What version of Ubuntu are you using? LTS? 32 or 64 bits?

*Xavier Normand*
Administrateur Système
De Marque inc.
418 658-1910 #229


On Fri, Mar 9, 2012 at 10:30 AM, Brian Cipriano wrote:

>  Sure thing. I believe these are them.
>
> The volume in question is called "west".
>
> - brian
>
>
> On 3/9/12 10:27 AM, shylesh kumar wrote:
>
> Hi Brian,
>
>  Could you please provide the rebalance and glusterd logs, that would
> help in debugging the problem.
>
>
>  Thanks,
> Shylesh
>
>
>
>
> On Fri, Mar 9, 2012 at 8:52 PM, Brian Cipriano wrote:
>
>> I've just confirmed that the same is happening on a totally different
>> Ubuntu machine. Doesn't seem to be confined to the machine.
>>
>> Could maybe be something I'm missing in the setup though? Some package I
>> haven't installed?
>>
>> - brian
>>
>>
>> On 3/9/12 9:59 AM, Brian Cipriano wrote:
>>
>>> Hi Shylesh - thanks for the reply.
>>>
>>> I've restarted a few times - glusterd, the volume, the machine itself.
>>> Same results.
>>>
>>> - brian
>>>
>>> On 3/9/12 12:46 AM, Shylesh Kumar Mohan wrote:
>>>
>>>> Hi Brian,
>>>>
>>>> Could you please restart glusterd and try again rebalancing.
>>>>
>>>>
>>>>
>>>> Thanks,
>>>> Shylesh
>>>>
>>>> - Original Message -
>>>> From: Brian Cipriano
>>>> To: gluster-users@gluster.org
>>>> Sent: Thu, 08 Mar 2012 18:08:22 -0500 (EST)
>>>> Subject: [Gluster-users] trouble rebalancing volume
>>>>
>>>> Hi all -
>>>>
>>>> I'm having issues rebalancing my layout/data across a two-brick volume.
>>>> I'm on Gluster 3.2.5.
>>>>
>>>> I'm currently using a single Ubuntu 10.04 machine. Both bricks reside on
>>>> this machine. Adding the brick went fine. Here's the volume's info:
>>>>
>>>> $ sudo gluster volume info
>>>> Volume Name: branch
>>>> Type: Distribute
>>>> Status: Started
>>>> Number of Bricks: 2
>>>> Transport-type: tcp
>>>> Bricks:
>>>> Brick1: system01:/gluster/brick0001
>>>> Brick2: system01:/gluster/brick0002
>>>>
>>>> brick0001 has a bunch of files on it, brick0002 is empty. I'd like to
>>>> rebalance the directory layout and data onto the new brick. But strange
>>>> things happen when I try to do this.
>>>>
>>>> $ sudo gluster volume rebalance branch fix-layout status
>>>> rebalance stopped
>>>> $ sudo gluster volume rebalance branch fix-layout start
>>>> Rebalance on branch is already started
>>>> $ sudo gluster volume rebalance branch fix-layout status
>>>> rebalance stopped
>>>>
>>>> Weird! I can't seem to get this to work.
>>>>
>>>> Am I doing some wrong, or is this some other issue?
>>>>
>>>> Thanks!
>>>>
>>>> - brian
>>>> ___
>>>> Gluster-users mailing list
>>>> Gluster-users@gluster.org
>>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>>>
>>>>
>>> ___
>>> Gluster-users mailing list
>>> Gluster-users@gluster.org
>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>>
>>
>> ___
>> Gluster-users mailing list
>> Gluster-users@gluster.org
>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>
>
>
>
>  --
> Thanks & Regards
> Shylesh Kumar M
>
>
>
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>
>
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Re: [Gluster-users] trouble rebalancing volume

[Xavier Normand]

Hi Brian,

Do you have same size brick?

*Xavier*


On Fri, Mar 9, 2012 at 10:22 AM, Brian Cipriano wrote:

> I've just confirmed that the same is happening on a totally different
> Ubuntu machine. Doesn't seem to be confined to the machine.
>
> Could maybe be something I'm missing in the setup though? Some package I
> haven't installed?
>
> - brian
>
>
> On 3/9/12 9:59 AM, Brian Cipriano wrote:
>
>> Hi Shylesh - thanks for the reply.
>>
>> I've restarted a few times - glusterd, the volume, the machine itself.
>> Same results.
>>
>> - brian
>>
>> On 3/9/12 12:46 AM, Shylesh Kumar Mohan wrote:
>>
>>> Hi Brian,
>>>
>>> Could you please restart glusterd and try again rebalancing.
>>>
>>>
>>>
>>> Thanks,
>>> Shylesh
>>>
>>> - Original Message -
>>> From: Brian Cipriano
>>> To: gluster-users@gluster.org
>>> Sent: Thu, 08 Mar 2012 18:08:22 -0500 (EST)
>>> Subject: [Gluster-users] trouble rebalancing volume
>>>
>>> Hi all -
>>>
>>> I'm having issues rebalancing my layout/data across a two-brick volume.
>>> I'm on Gluster 3.2.5.
>>>
>>> I'm currently using a single Ubuntu 10.04 machine. Both bricks reside on
>>> this machine. Adding the brick went fine. Here's the volume's info:
>>>
>>> $ sudo gluster volume info
>>> Volume Name: branch
>>> Type: Distribute
>>> Status: Started
>>> Number of Bricks: 2
>>> Transport-type: tcp
>>> Bricks:
>>> Brick1: system01:/gluster/brick0001
>>> Brick2: system01:/gluster/brick0002
>>>
>>> brick0001 has a bunch of files on it, brick0002 is empty. I'd like to
>>> rebalance the directory layout and data onto the new brick. But strange
>>> things happen when I try to do this.
>>>
>>> $ sudo gluster volume rebalance branch fix-layout status
>>> rebalance stopped
>>> $ sudo gluster volume rebalance branch fix-layout start
>>> Rebalance on branch is already started
>>> $ sudo gluster volume rebalance branch fix-layout status
>>> rebalance stopped
>>>
>>> Weird! I can't seem to get this to work.
>>>
>>> Am I doing some wrong, or is this some other issue?
>>>
>>> Thanks!
>>>
>>> - brian
>>> __**_
>>> Gluster-users mailing list
>>> Gluster-users@gluster.org
>>> http://gluster.org/cgi-bin/**mailman/listinfo/gluster-users
>>>
>>>
>> __**_
>> Gluster-users mailing list
>> Gluster-users@gluster.org
>> http://gluster.org/cgi-bin/**mailman/listinfo/gluster-users
>>
>
> __**_
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://gluster.org/cgi-bin/**mailman/listinfo/gluster-users
>
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

[Gluster-users] Rsync error when brick become online after a reboot / cash

[Xavier Normand]

I'm currently doing some HA testing on glusterfs and i notice a problem
when a cluster node become online after a reboot or a crash. There is my
setup:

 Volume Name: data
Type: Replicate
Status: Started
Number of Bricks: 2
Transport-type: tcp
Bricks:
Brick1: gluster1:/data
Brick2: gluster2:/data

 Before starting rsync, i make sure glusterd is closed on brick1. I start
the rsync " about 160 MB " and right after the rsync begin, i start
glusterd on brick1. After a couple seconds, rsync show "rsync: rename
"/mount/file/path/file.sh.sMZV6w" -> "/source/file/path/file.sh": No such
file or directory (2)"

 On brick1 gluster log : [2012-03-07 10:18:22.82195] I
[server3_1-fops.c:259:server_inodelk_cbk] 0-data-server: 907653: INODELK
/local/brick/path/file/fie.sh (0) ==> -1 (No such file or directory)

 If i check in the gluster mount the file isn't there!

 Any clue?
*Xavier Normand*
___
Gluster-users mailing list
Gluster-users@gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users