Re: [OmniOS-discuss] Ang: Re: Ang: Re: infiniband

2014-10-24 Thread Chris Zembower
ConnectX-2 cards work very well with OmniOS, at least over SRP, and those HCA's can be found for next to nothing. Comstar rules. I feel there's some new momentum behind Infiniband, and hoping that a new driver for the latest hardware will end up in Illumos sometime in the near future (I'm willing t

Re: [OmniOS-discuss] Ang: Re: Ang: Re: infiniband

2014-10-24 Thread Greg Mason
Enabling IB support for our ZFS-based filers is important enough to us that we have made the decision to migrate away from OmniOS/Illumos over to FreeBSD. FreeBSD 9 has a partial OFED stack, FreeBSD 10 is further along, and development continues for IB support in FreeBSD. I’ve successfully teste

Re: [OmniOS-discuss] Ang: Re: Ang: Re: infiniband

2014-10-24 Thread Narayan Desai
On Fri, Oct 24, 2014 at 7:55 AM, Michael Rasmussen wrote: > > I think the issue here is that OpenSM is a single threaded application > so when the CPU which is assigned to it maxes out performance will > drop. So I guess it comes down to a trade-off between the > performance of the host CPU and t

Re: [OmniOS-discuss] Ang: Re: Ang: Re: infiniband

2014-10-24 Thread Ian Kaufman
I wonder if Nexenta has added more/better support for IB? I believe that Illumian 1.0 is finally out (after having run the Alpha for years), and I know that they did have some interest in supporting IB originally. If they have, then I would hope some of that support would make it back upstream. Ma

Re: [OmniOS-discuss] Ang: Re: Ang: Re: infiniband

2014-10-24 Thread Ian Kaufman
I use a QLogic 12300 with SM built in. I haven't had any issues, saving my cluster frontend's cycles for other things. Ian On Fri, Oct 24, 2014 at 7:55 AM, Michael Rasmussen wrote: > On Fri, 24 Oct 2014 13:17:39 +0200 > Johan Kragsterman wrote: > >> >> Well, I can only find one person in that t

Re: [OmniOS-discuss] Ang: Re: Ang: Re: infiniband

2014-10-24 Thread Michael Rasmussen
On Fri, 24 Oct 2014 13:17:39 +0200 Johan Kragsterman wrote: > > Well, I can only find one person in that thread that BELIEVES that running SM > on a switch is preferable to run OpenSM software. He hardly comes with any > documentation of this, and I can't see any other that agrees... > > But

[OmniOS-discuss] Ang: Re: Ang: Re: infiniband

2014-10-24 Thread Johan Kragsterman
-m...@miras.org skrev: - Till: Johan Kragsterman Från: m...@miras.org Datum: 2014-10-24 11:53 Kopia: omnios-discuss Ärende: Re: Ang: Re: [OmniOS-discuss] infiniband On 2014-10-24 08:37, Johan Kragsterman wrote: > > Hi, Michael! > > Interesting! Do you have any links to discussions or