Re: [Gluster-users] gluster with xfs

2010-11-16 Thread Liam Slusser
Our smaller cluster, 60tb, stores media data and acts as our CDN feed system. Its a pretty simple setup, the front end is two Dell 1950 servers running Apache mounting gluster via the fuse client. We use bonded gigabit ethernet on the back side to two supermicro 4u 24 bay servers. Each server ha

Re: [Gluster-users] gluster with xfs

2010-11-15 Thread Rudi Ahlers
On Mon, Nov 15, 2010 at 5:01 PM, Craig Carl wrote: >   From a previous XFS & Gluster discussion - > > "The reason we usually recommend Ext3 instead of XFS is because the > implementation of extended attributes in Ext3 is significantly faster than > in XFS. GlusterFS makes use of extended attribute

Re: [Gluster-users] gluster with xfs

2010-11-15 Thread Craig Carl
On 11/15/2010 06:46 AM, David Lloyd wrote: Thanks for that. With the hardware we've got we're hoping to get an order of magnitude more throughput than that though. We have: 4 nodes 12 sata disks hardware raid in each node 10Gbit ethernet I'm getting over 1GByte/s reads and writes on the xfs fil

Re: [Gluster-users] gluster with xfs

2010-11-15 Thread Rudi Ahlers
On Mon, Nov 15, 2010 at 1:09 PM, Liam Slusser wrote: > We run two somewhat large gluster clusters in production on xfs with great > success.  I had to go with xfs as ext4 doesn't support large enough file > systems.  Make sure you mount your xfs partitions with 64bit inode support > and use only 6

Re: [Gluster-users] gluster with xfs

2010-11-15 Thread David Lloyd
Thanks for that. With the hardware we've got we're hoping to get an order of magnitude more throughput than that though. We have: 4 nodes 12 sata disks hardware raid in each node 10Gbit ethernet I'm getting over 1GByte/s reads and writes on the xfs filesystems locally. typical filesize will be 1

Re: [Gluster-users] gluster with xfs

2010-11-15 Thread Liam Slusser
We run two somewhat large gluster clusters in production on xfs with great success. I had to go with xfs as ext4 doesn't support large enough file systems. Make sure you mount your xfs partitions with 64bit inode support and use only 64bit OS's. I'm still running 2.0.9 however the performance is

[Gluster-users] gluster with xfs

2010-11-15 Thread David Lloyd
Hello, We're starting to set up a 4 node gluster system. I'm currently trying to decide on the low-level options, including what filesystem to use. For various reasons I would be more comfortable with XFS over ext4, but I read in the 'Introduction to Gluster' that 'XFS (can be slow)'. I haven't