[Gluster-users] Increased performance for small files with debug/trace translator?

2010-08-03 Thread Major Hayden
This has stumped me beyond belief. I'm actually getting *much better* small file performance with debug/trace added into the client-side volfile than without it. Here's what I did to test it: 1) Downloaded latest.tar.gz (current Wordpress tarball from wordpress.org) 2) tar xzf latest.tar.g

Re: [Gluster-users] Increased performance for small files with debug/trace translator?

2010-08-03 Thread Jeff Darcy
On 08/03/2010 10:24 AM, Major Hayden wrote: > Initial test with my normal client volfile: > Client volfile: http://pastie.org/1072935 > untar: 32.999s > removal: 4.540s > > Second test with debug/trace translator enabled: > Client volfile: http://pastie.org/1072951 > untar: 6.077s > re

Re: [Gluster-users] Increased performance for small files with debug/trace translator?

2010-08-03 Thread Major Hayden
On Aug 3, 2010, at 14:49, Jeff Darcy wrote: > On 08/03/2010 10:24 AM, Major Hayden wrote: >> Initial test with my normal client volfile: >> Client volfile: http://pastie.org/1072935 >> untar: 32.999s >> removal: 4.540s >> >> Second test with debug/trace translator enabled: >> Client volfile:

Re: [Gluster-users] Increased performance for small files with debug/trace translator?

2010-08-03 Thread Barry Jaspan
On Tue, Aug 3, 2010 at 3:49 PM, Jeff Darcy wrote: > It turns out that > when the trace translator is enabled in the client volfile, it becomes > the lowest and thus the one that's mounted . . . Is this considered a bug? I thought the trace translator was supposed to be enableable at any level o

Re: [Gluster-users] Increased performance for small files with debug/trace translator?

2010-08-03 Thread Vikas Gorur
On Aug 3, 2010, at 1:31 PM, Barry Jaspan wrote: > Is this considered a bug? I thought the trace translator was supposed to be > enableable at any level of the translator stack, including multiple levels, > so you could debug calls across any translator. That's correct. What happened here is tha

[Gluster-users] Split Brain?

2010-08-03 Thread Count Zero
I am seeing a lot of those in my cluster client's log file: [2010-08-04 04:06:30] E [afr-self-heal-data.c:705:afr_sh_data_fix] replicate: Unable to self-heal contents of '/lib/wms-server.jar' (possible split-brain). Please delete the file from all but the preferred subvolume. How do I recover f

Re: [Gluster-users] Split Brain?

2010-08-03 Thread Ian Rogers
Do what it says in the error - though it's not very nice. Manually go on to each brick where /lib/wms-server.jar is stored, figure out which is the "correct" one and delete all the others (leaving just the one correct one). Then access the file from a client and it will be automatically repli

Re: [Gluster-users] Split Brain?

2010-08-03 Thread Tejas N. Bhise
Is this over the WAN replicated setup ? Or a local setup ? - Original Message - From: "Count Zero" To: "Gluster General Discussion List" Sent: Wednesday, August 4, 2010 8:38:02 AM Subject: [Gluster-users] Split Brain? I am seeing a lot of those in my cluster client's log file: [2010-08

Re: [Gluster-users] Split Brain?

2010-08-03 Thread Count Zero
It's local and is a standard AFR setup. I believe all the files are actually the same, but I'll verify this again. It just does this for a LOT of files, and they are all the same files (nothing has changed really). About WAN: I have mostly given up on WAN replication at the moment, so I use glu

[Gluster-users] GlusterFS CPU hit

2010-08-03 Thread Freddy Morgenstern
Hi, I am a GlusterFS newbee and I am experiencing the following problem: whenever I run the top command a process called glusterfsd is using over 15% of the CPU at all times and my %wa is usually over 15%. I find the %wa particularly worrisome because it's my understanding that this means tha

[Gluster-users] Gluster Storage Platform volume options

2010-08-03 Thread brock brown
I would just like some clarification on the different options for GSP storage volumes. None - this option distributes the files across all servers such that a file resides on some server but not necessarily on a specific server. If you have 4 servers, you can get 4x the volume space. *as a sid

Re: [Gluster-users] Split Brain?

2010-08-03 Thread Craig Carl
CountZ - Some questions to help us troubleshoot - What version of Gluster? What is your server /version/kernel? What is the on-disk filesystem? Can you md5sum the file on all the storage servers? Is it the same everywhere? How are you exporting Gluster (Gluster FS, NFS, CIFS, FTP, etc?) What vers

Re: [Gluster-users] Split Brain?

2010-08-03 Thread Count Zero
Hi Craig, The md5sum of the files was indeed the same, which is why I thought it was very peculiar. Basically, all my servers are clients & bricks, in an AFR configuration. The goal is to replicate the data as much as possible so it's available locally on all machines. However - I went throug

Re: [Gluster-users] GlusterFS CPU hit

2010-08-03 Thread Tejas N. Bhise
Freddy, If there is high iowait, the easiest way is to add more disks. With huge RAM and fast CPUs, the typical bottleneck that I have seen on scale out systems are disks and network. How many disks are you striping you volume ( lun ) across per server ? Regards, Tejas. - Original Messag