Re: [Lustre-discuss] how to baseline the performance of a Lustre cluster?

2011-08-01 Thread Christopher J. Morrone
On 07/18/2011 07:47 AM, Kevin Van Maren wrote: > While MPI can achieve 3.2GB/s data rates, I have never seen o2ib lnet > get that high. As I recall, > something ~2.5 is more typical. I saw ~3GB/s with lnet-selftest on QDR quite recently. One run was reporting ~3.1GB/s. Chris

Re: [Lustre-discuss] how to baseline the performance of a Lustre cluster?

2011-07-18 Thread Kevin Van Maren
Tim Carlson wrote: > On Fri, 15 Jul 2011, Theodore Omtzigt wrote: > > >> To me it looks very disappointing as we can get 3GB/s from the RAID >> controller aggregating a collection of raw SAS drives on the OSTs, and >> we should be able to get a peak of -5GB/s from QDR IB. >> >> First question: i

Re: [Lustre-discuss] how to baseline the performance of a Lustre cluster?

2011-07-18 Thread Tim Carlson
On Fri, 15 Jul 2011, Theodore Omtzigt wrote: > To me it looks very disappointing as we can get 3GB/s from the RAID > controller aggregating a collection of raw SAS drives on the OSTs, and > we should be able to get a peak of -5GB/s from QDR IB. > > First question: is this baseline reasonable? For

[Lustre-discuss] how to baseline the performance of a Lustre cluster?

2011-07-18 Thread Theodore Omtzigt
I got a basic Lustre cluster up and running and did two experiments: 1- using GbE as the interconnect 2- using QDR IB as interconnect Here are the simple performance results I collected using the pointers from the Lustre user guide: [root@22-82 ~]# ost-survey /mnt/lustre01 /usr/bin/ost-survey: