[Lustre-discuss] LNET Performance Issue

2012-02-15 Thread Barberi, Carl E
We are having issues with LNET performance over Infiniband. We have a configuration with a single MDT and six (6) OSTs. The Lustre client I am using to test is configured to use 6 stripes (lfs setstripe -c 6 /mnt/lustre). When I perform a test using the following command: dd

Re: [Lustre-discuss] LNET Performance Issue

2012-02-15 Thread Kevin Van Maren
Perhaps someone else here has a thought, but it does not make sense to me that loading SDP (which accelerates TCP traffic by by-passing the TCP stack) makes lnet faster if you are using @o2ib, and _not_ @tcp0 for your NIDs. Any chance you've configured both TCP and O2IB nids on the machine, and

Re: [Lustre-discuss] LNET Performance Issue

2012-02-15 Thread Barberi, Carl E
),o2ib1(ib1) Carl From: Kevin Van Maren [mailto:kvanma...@fusionio.com] Sent: Wednesday, February 15, 2012 3:25 PM To: Barberi, Carl E Cc: lustre-discuss@lists.Lustre.org Subject: EXTERNAL: Re: [Lustre-discuss] LNET Performance Issue Perhaps someone else here has a thought, but it does not make

Re: [Lustre-discuss] LNET Performance Issue

2012-02-15 Thread Tommi T
> lctl list_nids output for MDS: >   > 172.25.103.1@o2ib > 172.25.103.1@o2ib1 Is this a typo, o2ib1 should be 172.25.104.1 ? BR, Tommi ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustr

Re: [Lustre-discuss] LNET Performance Issue

2012-02-15 Thread Liang Zhen
Hi, I assume you are using "size=1M" for brw test right? performance could increase if you set "concurrency" while adding brw test, i.e: --concurrency=16 Liang On Feb 16, 2012, at 3:30 AM, Barberi, Carl E wrote: > We are having issues with LNET performance over Infiniband. We have a > configu