On Wed, Sep 29, 2010 at 11:53 AM, James A. Peltier <jpelt...@sfu.ca> wrote: > > ----- Original Message ----- > | On Wednesday 29 September 2010, Boris Epstein wrote: > | > Hello all, > | > > | > I have just configured a 64-bit CentOS 5.5 machine to support an XFS > | > filesystem as specified in the subject line. The filesystem will be > | > used to > | > store an extremely large number of files (in the tens of millions). > | > Due to > | > its extremely large size, would there be any non-standard XFS > | > build/configuration options I should consider? > | > | I have created and tested filesystems larger than 25T using xfs on > | CentOS-5 > | (64-bit). I did not use any non-standard options. Do not attempt this > | on a > | 32-bit box. > | > | However, given the size of the device I assume that this is a raid of > | some > | sort. You'll want to make sure to run mkfs.xfs with the proper stripe > | parameters to get the alignment right. Also, you may want to make sure > | your > | LVM or partition table is properly aligned. > | > | Even with the above done right you may get worse performance than > | expected > | since "lots of small files" typically reads like "terrible > | performance". > | > | Finally I'd suggest you fill the filesystem and read it back > | (verifying what > | you wrote). This is, imho, a reasonable level of paranoia. > | > | /Peter > | > | > Thanks. > | > > | > Boris. > | > | _______________________________________________ > | CentOS mailing list > | CentOS@centos.org > | http://lists.centos.org/mailman/listinfo/centos > > On my 30+TB file systems all I've done is mkfs.xfs with stripe and width > parameters and they are very speedy. I've not done anything on the LVM side > and see no performance issues, but perhaps I need to investigate that some > more. :\ > > -- > James A. Peltier > Systems Analyst (FASNet), VIVARIUM Technical Director > Simon Fraser University - Burnaby Campus > Phone : 778-782-6573 > Fax : 778-782-3045 > E-Mail : jpelt...@sfu.ca > Website : http://www.fas.sfu.ca | http://vivarium.cs.sfu.ca > MSN : subatomic_s...@hotmail.com > > Does your OS has a man 8 lart? > http://www.xinu.nl/unix/humour/asr-manpages/lart.html > > > _______________________________________________ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos
Thanks James! I am wondering if I need to worry about stripe and width though as mine resides on a logical volume residing on a hardware-controlled RAID 6 device (i.e., one slice as far as the OS is concerned). Boris. _______________________________________________ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
