On 19/06/2013 18:47, Wendy Cheng wrote:
what kind of HW I would need to run it ?
The mlx4 driver supports memory windows as of kernel 3.9
Or.
--
To unsubscribe from this list: send the line unsubscribe linux-rdma in
the body of a message to majord...@vger.kernel.org
More majordomo info at
: NFS over RDMA benchmark
On Sun, Apr 28, 2013 at 06:28:16AM +, Yan Burman wrote:
On Wed, Apr 17, 2013 at 7:36 AM, Yan Burman
y...@mellanox.com
I've been trying to do some benchmarks for NFS over
RDMA and I seem to
only get about half of the bandwidth that the HW can give me.
My setup
On Sun, Apr 28, 2013 at 10:42:48AM -0400, J. Bruce Fields wrote:
On Sun, Apr 28, 2013 at 06:28:16AM +, Yan Burman wrote:
On Wed, Apr 17, 2013 at 7:36 AM, Yan Burman
y...@mellanox.com
I've been trying to do some benchmarks for NFS over RDMA
and I seem to
On 4/30/2013 1:09 AM, Yan Burman wrote:
I now get up to ~95K IOPS and 4.1GB/sec bandwidth.
...
ib_send_bw with intel iommu enabled did get up to 4.5GB/sec
BTW, you may want to verify that these are the same GB. Many
benchmarks say KB/MB/GB when they really mean KiB/MiB/GiB.
At GB/GiB, the
-Original Message-
From: Tom Talpey [mailto:t...@talpey.com]
Sent: Tuesday, April 30, 2013 16:05
To: Yan Burman
Cc: J. Bruce Fields; Wendy Cheng; Atchley, Scott; Tom Tucker; linux-
r...@vger.kernel.org; linux-...@vger.kernel.org; Or Gerlitz
Subject: Re: NFS over RDMA benchmark
-Original Message-
From: Tom Talpey [mailto:t...@talpey.com]
Sent: Tuesday, April 30, 2013 17:20
To: Yan Burman
Cc: J. Bruce Fields; Wendy Cheng; Atchley, Scott; Tom Tucker; linux-
r...@vger.kernel.org; linux-...@vger.kernel.org; Or Gerlitz
Subject: Re: NFS over RDMA benchmark
On 4/30/2013 10:23 AM, Yan Burman wrote:
-Original Message-
From: Tom Talpey [mailto:t...@talpey.com]
On Sun, Apr 28, 2013 at 06:28:16AM +, Yan Burman wrote:
I finally got up to 4.1GB/sec bandwidth with RDMA (ipoib-CM bandwidth is
also way higher now).
For some reason when I had
On Mon, Apr 29, 2013 at 10:09 PM, Yan Burman y...@mellanox.com wrote:
I finally got up to 4.1GB/sec bandwidth with RDMA (ipoib-CM bandwidth is also
way higher now).
For some reason when I had intel IOMMU enabled, the performance dropped
significantly.
I now get up to ~95K IOPS and
: Re: NFS over RDMA benchmark
On 4/30/2013 1:09 AM, Yan Burman wrote:
I now get up to ~95K IOPS and 4.1GB/sec bandwidth.
...
ib_send_bw with intel iommu enabled did get up to 4.5GB/sec
BTW, you may want to verify that these are the same GB. Many benchmarks
say KB/MB/GB when they really mean KiB
-Original Message-
From: Wendy Cheng [mailto:s.wendy.ch...@gmail.com]
Sent: Monday, April 29, 2013 08:35
To: J. Bruce Fields
Cc: Yan Burman; Atchley, Scott; Tom Tucker; linux-rdma@vger.kernel.org;
linux-...@vger.kernel.org; Or Gerlitz
Subject: Re: NFS over RDMA benchmark
On Sun
: NFS over RDMA benchmark
On Sun, Apr 28, 2013 at 7:42 AM, J. Bruce Fields bfie...@fieldses.org wrote:
On Wed, Apr 17, 2013 at 7:36 AM, Yan Burman
When running ib_send_bw, I get 4.3-4.5 GB/sec for block sizes 4-512K.
When I run fio over rdma mounted nfs, I get 260-2200MB/sec for the
same block
-...@vger.kernel.org; Or Gerlitz
Subject: Re: NFS over RDMA benchmark
On Sun, Apr 28, 2013 at 7:42 AM, J. Bruce Fields
bfie...@fieldses.org wrote:
On Wed, Apr 17, 2013 at 7:36 AM, Yan Burman
When running ib_send_bw, I get 4.3-4.5 GB/sec for block sizes 4-512K.
When I run fio over rdma mounted nfs, I
-Original Message-
From: J. Bruce Fields [mailto:bfie...@fieldses.org]
Sent: Sunday, April 28, 2013 17:43
To: Yan Burman
Cc: Wendy Cheng; Atchley, Scott; Tom Tucker; linux-rdma@vger.kernel.org;
linux-...@vger.kernel.org; Or Gerlitz
Subject: Re: NFS over RDMA benchmark
On Sun
-Original Message-
From: J. Bruce Fields [mailto:bfie...@fieldses.org]
Sent: Wednesday, April 24, 2013 18:27
To: Yan Burman
Cc: Wendy Cheng; Atchley, Scott; Tom Tucker; linux-rdma@vger.kernel.org;
linux-...@vger.kernel.org; Or Gerlitz
Subject: Re: NFS over RDMA benchmark
On Wed
On Sun, Apr 28, 2013 at 06:28:16AM +, Yan Burman wrote:
On Wed, Apr 17, 2013 at 7:36 AM, Yan Burman
y...@mellanox.com
I've been trying to do some benchmarks for NFS over RDMA
and I seem to
only get about half of the bandwidth that the HW can give me.
On Sun, Apr 28, 2013 at 7:42 AM, J. Bruce Fields bfie...@fieldses.org wrote:
On Wed, Apr 17, 2013 at 7:36 AM, Yan Burman
When running ib_send_bw, I get 4.3-4.5 GB/sec for block sizes 4-512K.
When I run fio over rdma mounted nfs, I get 260-2200MB/sec for the
same block sizes (4-512K).
On Wed, Apr 24, 2013 at 11:26 AM, Tom Talpey t...@talpey.com wrote:
On Wed, Apr 24, 2013 at 9:27 AM, Wendy Cheng s.wendy.ch...@gmail.com
wrote:
So I did a quick read on sunrpc/xprtrdma source (based on OFA 1.5.4.1
tar ball) ... Here is a random thought (not related to the rb tree
On 4/25/13 1:18 PM, Wendy Cheng wrote:
On Wed, Apr 24, 2013 at 11:26 AM, Tom Talpey t...@talpey.com wrote:
1)
The client slot count is not hard-coded, it can easily be changed by
writing a value to /proc and initiating a new mount. But I doubt that
increasing the slot table will improve
On 4/25/2013 1:18 PM, Wendy Cheng wrote:
On Wed, Apr 24, 2013 at 11:26 AM, Tom Talpey t...@talpey.com wrote:
On Wed, Apr 24, 2013 at 9:27 AM, Wendy Cheng s.wendy.ch...@gmail.com
wrote:
So I did a quick read on sunrpc/xprtrdma source (based on OFA 1.5.4.1
tar ball) ... Here is a random
On 4/25/2013 3:01 PM, Phil Pishioneri wrote:
On 4/25/13 1:18 PM, Wendy Cheng wrote:
On Wed, Apr 24, 2013 at 11:26 AM, Tom Talpey t...@talpey.com wrote:
1)
The client slot count is not hard-coded, it can easily be changed by
writing a value to /proc and initiating a new mount. But I doubt that
On 4/25/13 3:04 PM, Tom Talpey wrote:
On 4/25/2013 1:18 PM, Wendy Cheng wrote:
On Wed, Apr 24, 2013 at 11:26 AM, Tom Talpey t...@talpey.com wrote:
On Wed, Apr 24, 2013 at 9:27 AM, Wendy Cheng s.wendy.ch...@gmail.com
wrote:
So I did a quick read on sunrpc/xprtrdma source (based on OFA
On Thu, Apr 25, 2013 at 2:17 PM, Tom Tucker t...@opengridcomputing.com wrote:
The Mellanox driver uses red-black trees extensively for resource
management, e.g. QP ID, CQ ID, etc... When completions come in from the HW,
these are used to find the associated software data structures I believe.
On Thu, Apr 25, 2013 at 2:58 PM, Wendy Cheng s.wendy.ch...@gmail.com wrote:
On Thu, Apr 25, 2013 at 2:17 PM, Tom Tucker t...@opengridcomputing.com
wrote:
The Mellanox driver uses red-black trees extensively for resource
management, e.g. QP ID, CQ ID, etc... When completions come in from the
-Original Message-
From: J. Bruce Fields [mailto:bfie...@fieldses.org]
Sent: Wednesday, April 24, 2013 00:06
To: Yan Burman
Cc: Wendy Cheng; Atchley, Scott; Tom Tucker; linux-rdma@vger.kernel.org;
linux-...@vger.kernel.org; Or Gerlitz
Subject: Re: NFS over RDMA benchmark
On Thu
-...@vger.kernel.org; Or Gerlitz
Subject: Re: NFS over RDMA benchmark
On Thu, Apr 18, 2013 at 12:47:09PM +, Yan Burman wrote:
-Original Message-
From: Wendy Cheng [mailto:s.wendy.ch...@gmail.com]
Sent: Wednesday, April 17, 2013 21:06
To: Atchley, Scott
Cc: Yan Burman
; Atchley, Scott; Tom Tucker; linux-rdma@vger.kernel.org;
linux-...@vger.kernel.org; Or Gerlitz
Subject: Re: NFS over RDMA benchmark
On Thu, Apr 18, 2013 at 12:47:09PM +, Yan Burman wrote:
-Original Message-
From: Wendy Cheng [mailto:s.wendy.ch...@gmail.com
On Wed, Apr 24, 2013 at 8:26 AM, J. Bruce Fields bfie...@fieldses.org wrote:
On Wed, Apr 24, 2013 at 11:05:40AM -0400, J. Bruce Fields wrote:
On Wed, Apr 24, 2013 at 12:35:03PM +, Yan Burman wrote:
Perf top for the CPU with high tasklet count gives:
samples pcnt
On Wed, Apr 24, 2013 at 9:27 AM, Wendy Cheng s.wendy.ch...@gmail.com wrote:
On Wed, Apr 24, 2013 at 8:26 AM, J. Bruce Fields bfie...@fieldses.org wrote:
On Wed, Apr 24, 2013 at 11:05:40AM -0400, J. Bruce Fields wrote:
On Wed, Apr 24, 2013 at 12:35:03PM +, Yan Burman wrote:
Perf top
On 4/24/2013 2:04 PM, Wendy Cheng wrote:
On Wed, Apr 24, 2013 at 9:27 AM, Wendy Cheng s.wendy.ch...@gmail.com wrote:
On Wed, Apr 24, 2013 at 8:26 AM, J. Bruce Fields bfie...@fieldses.org wrote:
On Wed, Apr 24, 2013 at 11:05:40AM -0400, J. Bruce Fields wrote:
On Wed, Apr 24, 2013 at 12:35:03PM
-...@vger.kernel.org
Subject: Re: NFS over RDMA benchmark
On Wed, Apr 17, 2013 at 10:32 AM, Atchley, Scott atchle...@ornl.gov
wrote:
On Apr 17, 2013, at 1:15 PM, Wendy Cheng s.wendy.ch...@gmail.com
wrote:
On Wed, Apr 17, 2013 at 7:36 AM, Yan Burman y...@mellanox.com
wrote:
Hi
-Original Message-
From: Peng Tao [mailto:bergw...@gmail.com]
Sent: Friday, April 19, 2013 05:28
To: Yan Burman
Cc: J. Bruce Fields; Tom Tucker; linux-rdma@vger.kernel.org; linux-
n...@vger.kernel.org
Subject: Re: NFS over RDMA benchmark
On Wed, Apr 17, 2013 at 10:36 PM, Yan
-Original Message-
From: Wendy Cheng [mailto:s.wendy.ch...@gmail.com]
Sent: Wednesday, April 17, 2013 21:06
To: Atchley, Scott
Cc: Yan Burman; J. Bruce Fields; Tom Tucker; linux-rdma@vger.kernel.org;
linux-...@vger.kernel.org
Subject: Re: NFS over RDMA benchmark
On Wed, Apr 17
On Thu, Apr 18, 2013 at 5:47 AM, Yan Burman y...@mellanox.com wrote:
What do you suggest for benchmarking NFS?
I believe SPECsfs has been widely used by NFS (server) vendors to
position their product lines. Its workload was based on a real life
NFS deployment. I think it is more torward
From: Wendy Cheng
Sent: 4/18/2013 9:16 AM
To: Yan Burman
Cc: Atchley, Scott; J. Bruce Fields; Tom Tucker; linux-rdma@vger.kernel.org;
linux-...@vger.kernel.org; Or Gerlitz
Subject: Re: NFS over RDMA benchmark
On Thu, Apr 18, 2013 at 5:47 AM, Yan Burman y
From: Wendy Cheng
Sent: 4/18/2013 9:16 AM
To: Yan Burman
Cc: Atchley, Scott; J. Bruce Fields; Tom Tucker; linux-rdma@vger.kernel.org;
linux-...@vger.kernel.org; Or Gerlitz
Subject: Re: NFS over RDMA benchmark
On Thu, Apr 18, 2013 at 5:47 AM, Yan Burman y...@mellanox.com wrote
On Wed, Apr 17, 2013 at 10:36 PM, Yan Burman y...@mellanox.com wrote:
Hi.
I've been trying to do some benchmarks for NFS over RDMA and I seem to only
get about half of the bandwidth that the HW can give me.
My setup consists of 2 servers each with 16 cores, 32Gb of memory, and
Mellanox
-...@vger.kernel.org; Or Gerlitz
Subject: Re: NFS over RDMA benchmark
On Thu, Apr 18, 2013 at 5:47 AM, Yan Burman y...@mellanox.com wrote:
What do you suggest for benchmarking NFS?
I believe SPECsfs has been widely used by NFS (server) vendors to
position their product lines. Its
On Wed, Apr 17, 2013 at 7:36 AM, Yan Burman y...@mellanox.com wrote:
Hi.
I've been trying to do some benchmarks for NFS over RDMA and I seem to only
get about half of the bandwidth that the HW can give me.
My setup consists of 2 servers each with 16 cores, 32Gb of memory, and
Mellanox
On Apr 17, 2013, at 1:15 PM, Wendy Cheng s.wendy.ch...@gmail.com wrote:
On Wed, Apr 17, 2013 at 7:36 AM, Yan Burman y...@mellanox.com wrote:
Hi.
I've been trying to do some benchmarks for NFS over RDMA and I seem to only
get about half of the bandwidth that the HW can give me.
My setup
On Wed, Apr 17, 2013 at 10:32 AM, Atchley, Scott atchle...@ornl.gov wrote:
On Apr 17, 2013, at 1:15 PM, Wendy Cheng s.wendy.ch...@gmail.com wrote:
On Wed, Apr 17, 2013 at 7:36 AM, Yan Burman y...@mellanox.com wrote:
Hi.
I've been trying to do some benchmarks for NFS over RDMA and I seem to
40 matches
Mail list logo
