Re: [Gluster-users] Memory usage high on client

2010-04-14 Thread Krzysztof Strasburger
On Wed, Apr 14, 2010 at 06:33:15AM +0200, Krzysztof Strasburger wrote: > On Wed, Apr 14, 2010 at 09:22:09AM +1000, Chris Jin wrote: > > Hi, I got one more test today. The copying has already run for 24 hours > > and the memory usage is about 800MB, 39.4% of the total. But there is no > > external I

Re: [Gluster-users] Memory usage high on client

2010-04-14 Thread Krzysztof Strasburger
I forgot to add that all tests were performed with glusterfs 2.0.10rc1 (as 3.0 has no working unify), but the inode/dentry management seems to be the same in 3.0. Krzysztof ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bi

Re: [Gluster-users] Memory usage high on client

2010-04-14 Thread Vijay Bellur
Krzysztof Strasburger wrote: I forgot to add that all tests were performed with glusterfs 2.0.10rc1 (as 3.0 has no working unify), but the inode/dentry management seems to be the same in 3.0. Thanks for these inputs, Krzysztof. We are on this and will update you as soon as we have more to sha

[Gluster-users] Maintainance mode for bricks

2010-04-14 Thread Fred Stober
Dear all, Is there an easy way to put a storage brick, which is part of a dht volume, into some kind of read-only maintainance mode, while keeping the whole dht volume in read/write state? Currently it almost works, but files are still scheduled to go to the server in maintainance mode and in t

Re: [Gluster-users] Maintainance mode for bricks

2010-04-14 Thread Tejas N. Bhise
Fred, Would you like to tell us more about the use case ? Like why would you want to do this ? If we take a brick out, it would not be possible to get it back in ( with the existing data ). Regards, Tejas. - Original Message - From: "Fred Stober" To: gluster-users@gluster.org Sent: We

Re: [Gluster-users] Maintainance mode for bricks

2010-04-14 Thread Fred Stober
On Wednesday 14 April 2010, Tejas N. Bhise wrote: > Fred, > > Would you like to tell us more about the use case ? Like why would you want > to do this ? If we take a brick out, it would not be possible to get it > back in ( with the existing data ). Ok, here is our use case: We have a small test s

Re: [Gluster-users] Maintainance mode for bricks

2010-04-14 Thread Tejas N. Bhise
ok .. so if I understand correctly, you want to *replace* an existing export by a new export on a new machine, while keeping all data online and keep the source export of the replace in read mode so it can be copied off. Are there other processes also doing a read off the read only export/sub-vo

Re: [Gluster-users] Maintainance mode for bricks

2010-04-14 Thread Fred Stober
Dear Tejas, On Wednesday 14 April 2010, Tejas N. Bhise wrote: > ok .. so if I understand correctly, you want to *replace* an existing > export by a new export on a new machine, while keeping all data online and > keep the source export of the replace in read mode so it can be copied off. Exactly.

Re: [Gluster-users] Maintainance mode for bricks

2010-04-14 Thread Tejas N. Bhise
Ok. and how many clients mount these volume(s) .. asking so I can understand how many need to remount if config is changed. - Original Message - From: "Fred Stober" To: "Tejas N. Bhise" Cc: gluster-users@gluster.org Sent: Wednesday, April 14, 2010 7:00:56 PM Subject: Re: [Gluster-users

Re: [Gluster-users] Monitoring gluster with nagios - was Re: [Gluster-devel] Gluster health/status

2010-04-14 Thread phil cryer
Ian Very nice, IMO this should be added to the Gluster wiki. P On Tue, Apr 13, 2010 at 5:07 PM, Ian Rogers wrote: > > Answering my own question, hope these instructions are useful - > http://www.sirgroane.net/2010/04/monitoring-gluster-with-nagios/ > > Cheers, > > Ian > > On 09/04/2010 06:01, Ia

Re: [Gluster-users] Maintainance mode for bricks

2010-04-14 Thread Fred Stober
Dear Tejas, On Wednesday 14 April 2010, Tejas N. Bhise wrote: > Ok. and how many clients mount these volume(s) .. asking so I can > understand how many need to remount if config is changed. The file system is currently mounted on ~25 of our computing nodes and 5 portal machines. Cheers, Fred --

Re: [Gluster-users] Configuration suggestions (aka poor/slow performance on new hardware)

2010-04-14 Thread Ramiro Magallanes
El lun, 29-03-2010 a las 12:38 +0100, Ed W escribió: > I don't see this as a gluster issue - it's a fundamental limitation > of > whether you want an ack for network based operations? Many people > switch to fiberchannel or similar for the io for exactly this > reason. > If you can drop the la

Re: [Gluster-users] Maintainance mode for bricks

2010-04-14 Thread Ian Rogers
On 14/04/2010 13:20, Fred Stober wrote: On Wednesday 14 April 2010, Tejas N. Bhise wrote: Fred, Would you like to tell us more about the use case ? Like why would you want to do this ? If we take a brick out, it would not be possible to get it back in ( with the existing data ). Ok,

[Gluster-users] Exporting nfs share with glusterfs?

2010-04-14 Thread carlopmart
Hi all, Is it possible to use a nfs share to serve as a glusterfs server process?? For example: I have a host that mounts a nfs share from a solaris server under /mnt. Can I use this /mnt directory for a glusterfs server?? Thanks. -- CL Martinez carlopmart {at} gmail {d0t} com __

Re: [Gluster-users] Exporting nfs share with glusterfs?

2010-04-14 Thread Vikas Gorur
On Apr 14, 2010, at 9:03 AM, carlopmart wrote: > Hi all, > > Is it possible to use a nfs share to serve as a glusterfs server process?? > For example: I have a host that mounts a nfs share from a solaris server > under /mnt. Can I use this /mnt directory for a glusterfs server?? This will not

Re: [Gluster-users] Exporting nfs share with glusterfs?

2010-04-14 Thread Burnash, James
NFS v4 supports extended attributes DISCLAIMER: This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail, you are hereby notified

Re: [Gluster-users] Memory usage high on server sides

2010-04-14 Thread Chris Jin
Hi Krzysztof, Thanks for your replies. And you are right, the server process should be glusterfsd. But I did mean servers. After two days copying, the two processes took almost 70% of the total memory. I am just thinking one more process will bring our servers down. $ps auxf USER PID %CPU %M

Re: [Gluster-users] Memory usage high on server sides

2010-04-14 Thread Tejas N. Bhise
Hi Chris, Just to confirm, from the server vol file from your previous post, you are not even using any performance translators on the server side, is that correct ? And the only major activity is the copying ? Regards, Tejas. - Original Message - From: "Chris Jin" To: "Krzysztof Str

Re: [Gluster-users] Memory usage high on server sides

2010-04-14 Thread Chris Jin
Hi Tejas, > Just to confirm, from the server vol file from your previous post, > you are not even using any performance translators on the server side, > is that correct ? Only io-threads. the vol files were generated from gluster-volgen. I just changed directories and listen ports. > > And t

Re: [Gluster-users] Memory usage high on server sides

2010-04-14 Thread Tejas N. Bhise
Hi Chris, I would like your help in debugging this further. To start with, I would like to get the system information and the test information. You mentioned you are copying data from your old system to the new system. The new system has 3 servers. Problems you saw - 1) High memory usage on c

Re: [Gluster-users] Memory usage high on server sides

2010-04-14 Thread Tejas N. Bhise
Thanks, Chris. So no caching performance translators were used - that's what I wanted to check. I sent another mail about more debug information. Can you please have a look and respond when you get some time. Thanks for all your help. Regards, Tejas. - Original Message - From: "Chris J

Re: [Gluster-users] Memory usage high on server sides

2010-04-14 Thread Chris Jin
Hi Tejas, > Problems you saw - > > 1) High memory usage on client where gluster volume is mounted Memory usage for clients is 0% after copying. $ps auxf USER PID %CPU %MEMVSZ RSS TTY STAT START TIME COMMAND root 19692 1.3 0.0 262148 6980 ?Ssl Apr12 61:33 /sbin

Re: [Gluster-users] Maintainance mode for bricks

2010-04-14 Thread Tejas N. Bhise
Thanks, Ian. Fred - the method Ian describes, using self heal, is a good way of doing it while maintaining gluster semantics and not playing around directly with the backend. In a future release, with dynamic volume management, one would be able to do such things with simple commands with havin

Re: [Gluster-users] Memory usage high on server sides

2010-04-14 Thread Tejas N. Bhise
Thanks, Chris. This is very good information to start with. To summarize this, when you copy lot of small files from nfs mount to glusterfs mount, the copy is slow and at the end of it you see the glusterfs servers still holding a lot of memory after the copy is done. The clients do seem to rele

Re: [Gluster-users] Memory usage high on server sides

2010-04-14 Thread Tejas N. Bhise
Chris, By the way, after the copy is done, how is the system responding to regular access ? In the sense, was the problem with copy also carried forward as more trouble seen with subsequent access of data over glusterfs ? Regards, Tejas. - Original Message - From: "Chris Jin" To: "Tejas

Re: [Gluster-users] Memory usage high on server sides

2010-04-14 Thread Chris Jin
Tejas, We still have hundreds of GBs to copy, and have not put the new file system into the test. So far the clients works all fine. I mean the commands like ls, mkdir, touch, and etc. Thanks again for your time. regards, Chris On Wed, 2010-04-14 at 23:04 -0600, Tejas N. Bhise wrote: > Chris,