To: omnios-discuss@lists.omniti.com
Subject: Re: [OmniOS-discuss] infiniband
On Mon, 10 Nov 2014 04:38:23 +
Rune Tipsmark r...@steait.net wrote:
What network throughput were you looking at before the tweaking?
Raised my performance from 5.2 gbps to 7.9 gbps (50% performance
increase)
--
Hilsen
0x p.ibp7
-Original Message-
From: Michael Rasmussen [mailto:m...@miras.org]
Sent: Wednesday, November 12, 2014 3:00 PM
To: Rune Tipsmark
Subject: Re: [OmniOS-discuss] infiniband
On Wed, 12 Nov 2014 22:35:46 +
Rune Tipsmark r...@steait.net wrote:
Did you try
-boun...@lists.omniti.com] On Behalf
Of Michael Rasmussen
Sent: Wednesday, November 12, 2014 3:48 PM
To: omnios-discuss@lists.omniti.com
Subject: Re: [OmniOS-discuss] infiniband
How exactly do you configure this?
Is a switch required?
On Wed, 12 Nov 2014 23:19:24 +
Rune Tipsmark r...@steait.net
On Thu, 13 Nov 2014 00:22:40 +
Rune Tipsmark r...@steait.net wrote:
ipadm create-addr -T static -a 10.98.0.10 p.ibp0/ipv4
ipadm create-addr -T static -a 10.99.0.10 p.ibp1/ipv4
ipadm create-addr -T static -a 10.98.0.12 p.ibp2/ipv4
ipadm create-addr -T static -a 10.99.0.12
On Thu, 13 Nov 2014 00:22:40 +
Rune Tipsmark r...@steait.net wrote:
ipadm create-addr -T static -a 10.98.0.10 p.ibp0/ipv4
ipadm create-addr -T static -a 10.99.0.10 p.ibp1/ipv4
ipadm create-addr -T static -a 10.98.0.12 p.ibp2/ipv4
ipadm create-addr -T static -a 10.99.0.12
Subject: Re: [OmniOS-discuss] infiniband
On Thu, 13 Nov 2014 00:22:40 +
Rune Tipsmark r...@steait.net wrote:
ipadm create-addr -T static -a 10.98.0.10 p.ibp0/ipv4 ipadm
create-addr -T static -a 10.99.0.10 p.ibp1/ipv4 ipadm create-addr
-T static -a 10.98.0.12 p.ibp2/ipv4
On Thu, 13 Nov 2014 01:59:20 +
Rune Tipsmark r...@steait.net wrote:
Not sure about IPMP, I would just use the same number of partitions on my ESX
and round robin the whole thing...
I don't use ESX so I will have to find out how this is done in Linux.
Do you have more info on the network
On Fri, 7 Nov 2014 23:49:51 +0100
Michael Rasmussen m...@miras.org wrote:
2) Performance is much slower than on Linux (Debian Stable). iperf
between two linux boxes shows 7.29 gbps which is max performance.
Between omnios an linux I am not able to pass 2.77 gbps which is
disappointing. Is
: [OmniOS-discuss] infiniband
On Mon, 10 Nov 2014 00:06:26 +0100
Michael Rasmussen m...@miras.org wrote:
This explains the difference in speed since 2.5GT/s x2 is roughly 3.5
gbps over IBoIP.
Can anybody explain why Omnios only uses 2 lains when PCIe slot and
HCA is capable of 8 lains?
Found
Hi all,
My endeavor into infiniband has proven to be a relatively easy task,
much easier than expected, however two problems is still unresolved
which is the reason to address this list.
1) Since I have dual port HCA's I first tried to configure both ports
on the same subnet looking for a way to
Hi all,
I have a dual port HCA where I need both ports on the same subnet. When
configuring on Linux in this situation you are instructed to configure
the interfaces to ignore arp using this setting:
net.ipv4.conf.ib0.arp_ignore=1
net.ipv4.conf.ib1.arp_ignore=1
What is the equivalent on omnios?
On Thu, Oct 23, 2014 at 10:36 PM, Michael Rasmussen m...@miras.org wrote:
On Fri, 24 Oct 2014 12:08:14 +1100
David Bomba turbo...@gmail.com wrote:
Correct, they are 40Gb/s cards.
I have heard same stories of problems with 40Gb/s cards on Linux and
FreeBSD. What it boils down to is that at
Hi all,
Is infiniband supported in r151012.
It is these cards I had in mind:
Voltaire 500 EX-D Dual Port Host Channel Adapter PCIe 20Gbps DDR
InfiniBand Card
--
Hilsen/Regards
Michael Rasmussen
Get my public GnuPG keys:
michael at rasmussen dot cc
yes, tavor and hermon drivers are present, and function well.
On 24 October 2014 10:19, Michael Rasmussen m...@miras.org wrote:
Hi all,
Is infiniband supported in r151012.
It is these cards I had in mind:
Voltaire 500 EX-D Dual Port Host Channel Adapter PCIe 20Gbps DDR
InfiniBand Card
On Oct 23, 2014, at 7:19 PM, Michael Rasmussen m...@miras.org wrote:
Hi all,
Is infiniband supported in r151012.
Only older cards.
It is these cards I had in mind:
Voltaire 500 EX-D Dual Port Host Channel Adapter PCIe 20Gbps DDR
InfiniBand Card
Do you know the PCI ID of that card? I
On Thu, 23 Oct 2014 19:25:47 -0400
Dan McDonald dan...@omniti.com wrote:
Only older cards.
By older cards do you the mean only 10 gbps cards?
It is these cards I had in mind:
Voltaire 500 EX-D Dual Port Host Channel Adapter PCIe 20Gbps DDR
InfiniBand Card
Do you know the PCI ID of
On Oct 23, 2014, at 7:49 PM, Michael Rasmussen m...@miras.org wrote:
On Thu, 23 Oct 2014 19:25:47 -0400
Dan McDonald dan...@omniti.com wrote:
Only older cards.
By older cards do you the mean only 10 gbps cards?
I mean there's been no active development in IB on illumos. Doesn't
I have had an issue with the Hermon driver and Mellanox ConnectX2 QDR
cards. On one system, I saw this in the log:
massive02-a hermon: [ID 492207 kern.info] hermon1: CQE RNR retry
counter exceeded
and the card went offline. Now, the interface does not even come up.
Three other identical systems
On Thu, 23 Oct 2014 20:02:16 -0400
Dan McDonald dan...@omniti.com wrote:
...buried in that output, I found a match:
-bash-4.3$ grep 15b3,634a /etc/driver_aliases
hermon pciex15b3,634a
-bash-4.3$
Nice. My winter project is saved;-)
I intend to convert storage and hypervisor
I have the exact same issue Ian.
I have multiple XenServers connected to OmniOS storage units. Under
specific circumstances, I get iscsi disconnects which prove fatal for the
XenServer host guests. These machines run a mixed bag of ConnectX and
ConnectX-2 cards
I have managed to get the system
Mellanox ConnectX-2 cards came in SDR (10Gbps) , DDR (20Gbps), and QDR
(40Gpbs) configs.
Ian
On Thu, Oct 23, 2014 at 5:57 PM, Michael Rasmussen m...@miras.org wrote:
On Fri, 24 Oct 2014 11:51:30 +1100
David Bomba turbo...@gmail.com wrote:
I have the exact same issue Ian.
I have multiple
Hey All
I was wondering if someone who has been using IB in their lab has any good
advice for someone just starting to integrate IB into their ZFS environment. I
have Connect-X (HCA) Card put into the host ( i do have a CX3 but i have heard
its not natively supported and there were issues
-discuss@lists.omniti.com
*Subject:* RE: [OmniOS-discuss] Infiniband In Omni
Also for infiniband you need a subnet manager, if your switch doesn’t have
a built in one you have to run like a linux box on the same network just
for traffic to work, as there wasn’t any I was able to find
23 matches
Mail list logo
