Re: [Gluster-users] GlusterFS Performance gigE

2010-09-15 Thread Henrique Haas
Hello Daniel, I am following the tips from techforce.com.br blog, those recommend many tunning options to speed up write and read of small files. http://www.techforce.com.br/news/linux_blog/glusterfs_tuning_small_files Bellow the files: *glusterfsd.vol* ~~

Re: [Gluster-users] GlusterFS Performance gigE

2010-09-15 Thread Roland Rabben
Since most servers come standard with two NIC's these days, an easy fix to improve write performance in a Distributed / Replicated setup is to have each server of a replicated pair on different sub-nets. On the client simply configure NIC 1 to handle traffic on subnet 1, and NIC 2 to handle traffi

Re: [Gluster-users] GlusterFS Performance gigE

2010-09-14 Thread Daniel Mons
On Tue, Sep 14, 2010 at 6:05 AM, Henrique Haas wrote: > My GlusterFS settings have used: > Server: storage/posix, features/locks, performance/io-threads > Client: 4 remote nodes > 2 Replicate > Write-Behind > IO-Threads > QuickRead >> Stat-Prefetch Are you able to share the config file with us?

Re: [Gluster-users] GlusterFS Performance gigE

2010-09-14 Thread Jacob Shucart
@gluster.org Subject: Re: [Gluster-users] GlusterFS Performance gigE Hello, I've tested with a mesh of performance translators, and use real data: My testing set have about 600K files, with files with 43KB on average, all JPEG files. The total size is about 19GB. The underline filesystem is

Re: [Gluster-users] GlusterFS Performance gigE

2010-09-13 Thread Henrique Haas
Hello, I've tested with a mesh of performance translators, and use real data: My testing set have about 600K files, with files with 43KB on average, all JPEG files. The total size is about 19GB. The underline filesystem is ext4, on its default settings of Ubuntu Server 10.04 (it are configured as

Re: [Gluster-users] GlusterFS Performance gigE

2010-09-13 Thread Jacob Shucart
] Sent: Saturday, September 11, 2010 10:21 AM To: Jacob Shucart Cc: gluster-users@gluster.org Subject: Re: [Gluster-users] GlusterFS Performance gigE Hello Jacob, Greater block sizes gave me much much better results, about 58MB/s on a 1GigE So.. my concern now is about smaller files be shared

Re: [Gluster-users] GlusterFS Performance gigE

2010-09-11 Thread Daniel Mons
On Sun, Sep 12, 2010 at 3:20 AM, Henrique Haas wrote: > Hello Jacob, > > Greater block sizes gave me much much better results, about *58MB/s* on a > 1GigE > So.. my concern now is about smaller files be shared using Gluster. > Any tunning tips for these kind of files (I'm using Ext4 and Glust

Re: [Gluster-users] GlusterFS Performance gigE

2010-09-11 Thread Henrique Haas
...@gluster.org] On Behalf Of Chris Layton > Sent: Friday, September 10, 2010 3:32 PM > To: Henrique Haas > Cc: gluster-users@gluster.org > Subject: Re: [Gluster-users] GlusterFS Performance gigE > > I agree something is wrong. > > Here is what I am getting on a more ISP g

Re: [Gluster-users] GlusterFS Performance gigE

2010-09-10 Thread Jacob Shucart
: gluster-users@gluster.org Subject: Re: [Gluster-users] GlusterFS Performance gigE I agree something is wrong. Here is what I am getting on a more ISP grade setup (but no SAN sadly) also with no Ethernet tuning : dd if=/dev/zero of=/usr/local/sites/test.test bs=1M count=64 64+0 records in 64+0

Re: [Gluster-users] GlusterFS Performance gigE

2010-09-10 Thread Chris Layton
I agree something is wrong. Here is what I am getting on a more ISP grade setup (but no SAN sadly) also with no Ethernet tuning : dd if=/dev/zero of=/usr/local/sites/test.test bs=1M count=64 64+0 records in 64+0 records out 67108864 bytes (67 MB) copied, 0.754847 seconds, 88.9 MB/s dd if=/dev/z

[Gluster-users] GlusterFS Performance gigE

2010-09-10 Thread Larry Bates
Larry Bates vitalEsafe, Inc. -- Message: 5 Date: Fri, 10 Sep 2010 13:16:52 -0300 From: Henrique Haas Subject: [Gluster-users] GlusterFS Performance gigE To: gluster-users@gluster.org Message-ID: Content-Type: text/plain; charset="iso-8859-1" Hello peo

Re: [Gluster-users] GlusterFS Performance gigE

2010-09-10 Thread Douglas Stanley
Wow, that doesn't sound right! I have a gluster cluster at home using old P4 hardware, and cheap soho off the shelf gigabit switches, and I can get ~35MB/s writes with dd: dd if=/dev/zero of=/vol/scratch/foo/test.img bs=1M count=64 64+0 records in 64+0 records out 67108864 bytes (67 MB) copied, 1.

[Gluster-users] GlusterFS Performance gigE

2010-09-10 Thread Henrique Haas
Hello people, For those have *GlusterFS running over GigE, what is the throughput you have for write data?* I have 3 nodes, running GNU/Linux Ubuntu Server 10.04, GlusterFS 3.0.2. The network is GigE, dedicated switch. I am experiencing maximum 2 MB/sec running a "dd" over a client mount point.