Re: [OmniOS-discuss] I can't add additional network card

2014-11-12 Thread Dan McDonald
So let me get this straight -- booting the r151012 live CD lets you see two ixgbe ports and four igb ports? But the installed system only lets you see two igb ports and two ixgbe ports? What does dladm show-ether have to say? And since two of the igbs appear not to be attached, can you grep

Re: [OmniOS-discuss] omnios and mpip

2014-11-12 Thread Dan McDonald
On Nov 8, 2014, at 6:51 AM, Michael Rasmussen m...@miras.org wrote: Hi all, How does omnios support mpip? You mean IPMP, right? Please share the output of ifconfig -a, dladm show-link, and netstat -rnv for starters. Dan ___ OmniOS-discuss

Re: [OmniOS-discuss] omnios and mpip

2014-11-12 Thread Michael Rasmussen
On Wed, 12 Nov 2014 12:42:12 -0600 Dan McDonald dan...@omniti.com wrote: You're not using IPMP, it appears you're using link aggregation. No, I had to drop IPMP on infiniband since I were only able to have it work in active/passive mode. Link aggregation is used over the 2 Intel Gb nics

Re: [OmniOS-discuss] infiniband

2014-11-12 Thread Rune Tipsmark
Just applied it on my server, it doubled my write speeds over iSER from ESX - basically they are par with SRP now, just worse latency. Now I just gotta find out if there are tweaks to be done to ESX to improve further. Did you try creating more partitions say 4 partitions to see if it performs

Re: [OmniOS-discuss] slog limits write speed more than it should

2014-11-12 Thread Rune Tipsmark
http://www.fusionio.com/products/iodrive 160GB SLC -Original Message- From: Bob Friesenhahn [mailto:bfrie...@simple.dallas.tx.us] Sent: Wednesday, November 12, 2014 3:17 PM To: Rune Tipsmark Cc: omnios-discuss@lists.omniti.com Subject: Re: [OmniOS-discuss] slog limits write speed more

Re: [OmniOS-discuss] infiniband

2014-11-12 Thread Michael Rasmussen
How exactly do you configure this? Is a switch required? On Wed, 12 Nov 2014 23:19:24 + Rune Tipsmark r...@steait.net wrote: Multipath, round robin. You can create multiple IPoIB partitions... if you want 4 on each port dladm create-part -l ibp0 -P 0x p.ibp0 dladm create-part

Re: [OmniOS-discuss] infiniband

2014-11-12 Thread Rune Tipsmark
Nope, just a subnet manager... I would do something like this dladm create-part -l ibp0 -P 0x p.ibp0 dladm create-part -l ibp0 -P 0x p.ibp2 dladm create-part -l ibp0 -P 0x p.ibp4 dladm create-part -l ibp0 -P 0x p.ibp6 dladm create-part -l ibp1 -P 0x p.ibp1

Re: [OmniOS-discuss] infiniband

2014-11-12 Thread Michael Rasmussen
On Thu, 13 Nov 2014 00:22:40 + Rune Tipsmark r...@steait.net wrote: ipadm create-addr -T static -a 10.98.0.10 p.ibp0/ipv4 ipadm create-addr -T static -a 10.99.0.10 p.ibp1/ipv4 ipadm create-addr -T static -a 10.98.0.12 p.ibp2/ipv4 ipadm create-addr -T static -a 10.99.0.12

Re: [OmniOS-discuss] infiniband

2014-11-12 Thread Michael Rasmussen
On Thu, 13 Nov 2014 00:22:40 + Rune Tipsmark r...@steait.net wrote: ipadm create-addr -T static -a 10.98.0.10 p.ibp0/ipv4 ipadm create-addr -T static -a 10.99.0.10 p.ibp1/ipv4 ipadm create-addr -T static -a 10.98.0.12 p.ibp2/ipv4 ipadm create-addr -T static -a 10.99.0.12

Re: [OmniOS-discuss] infiniband

2014-11-12 Thread Rune Tipsmark
Yes /24 and I also do the same as you, diff subnets for each port, else its game over... -Original Message- From: OmniOS-discuss [mailto:omnios-discuss-boun...@lists.omniti.com] On Behalf Of Michael Rasmussen Sent: Wednesday, November 12, 2014 4:45 PM To: omnios-discuss@lists.omniti.com

Re: [OmniOS-discuss] infiniband

2014-11-12 Thread Michael Rasmussen
On Thu, 13 Nov 2014 01:59:20 + Rune Tipsmark r...@steait.net wrote: Not sure about IPMP, I would just use the same number of partitions on my ESX and round robin the whole thing... I don't use ESX so I will have to find out how this is done in Linux. Do you have more info on the network