Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

2014-11-02 Thread David Bomba
/~scottn/Lustre_ZFS_notes/lustre_zfs_srp_mirror.html http://www.ssec.wisc.edu/~scottn/Lustre_ZFS_notes/lustre_zfs_srp_mirror.html Br, Rune From: David Bomba [mailto:turbo...@gmail.com] Sent: Saturday, November 01, 2014 6:01 PM To: Rune Tipsmark Cc: omnios-discuss@lists.omniti.com Subject

Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

2014-11-01 Thread David Bomba
I usually mount a iSer target and perform ZFS send to the target. This was the best way to exploit the rdma bandwidth to its full potential. On 2 Nov 2014, at 11:45 am, Rune Tipsmark r...@steait.net mailto:r...@steait.net wrote: Hi all, Is it possible to do zfs send/recv via SRP or

Re: [OmniOS-discuss] infiniband

2014-10-23 Thread David Bomba
yes, tavor and hermon drivers are present, and function well. On 24 October 2014 10:19, Michael Rasmussen m...@miras.org wrote: Hi all, Is infiniband supported in r151012. It is these cards I had in mind: Voltaire 500 EX-D Dual Port Host Channel Adapter PCIe 20Gbps DDR InfiniBand Card

Re: [OmniOS-discuss] infiniband

2014-10-23 Thread David Bomba
I have the exact same issue Ian. I have multiple XenServers connected to OmniOS storage units. Under specific circumstances, I get iscsi disconnects which prove fatal for the XenServer host guests. These machines run a mixed bag of ConnectX and ConnectX-2 cards I have managed to get the system

[OmniOS-discuss] Comstar Disconnects under high load.

2014-05-12 Thread David Bomba
Hi guys, We have ~ 10 OmniOS powered ZFS storage arrays used to drive Virtual Machines under XenServer + VMWare using Infiniband interconnect. Our usual recipe is to use either LSI HBA or Areca Cards in pass through mode using internal drives SAS drives.. This has worked flawlessly with

Re: [OmniOS-discuss] Comstar Disconnects under high load.

2014-05-12 Thread David Bomba
, at 6:13 PM, David Bomba turbo...@gmail.com wrote: Hi guys, We have ~ 10 OmniOS powered ZFS storage arrays used to drive Virtual Machines under XenServer + VMWare using Infiniband interconnect. Our usual recipe is to use either LSI HBA or Areca Cards in pass through mode using internal

Re: [OmniOS-discuss] Comstar Disconnects under high load.

2014-05-12 Thread David Bomba
. This smells like some problem in comstar's iscsi/iser driver. -nld On Mon, May 12, 2014 at 5:13 PM, David Bomba turbo...@gmail.com wrote: Hi guys, We have ~ 10 OmniOS powered ZFS storage arrays used to drive Virtual Machines under XenServer + VMWare using Infiniband interconnect. Our usual

Re: [OmniOS-discuss] iscsi timeouts

2014-01-21 Thread David Bomba
It looks like your NFS is dropping also ( but then recovering ), so I wouldn't be pinning the problem solely on iscsi. The problem could be anywhere from the network driver all the way back to the switch/cables etc. You'll need to go through each item methodically to find the root cause. On

[OmniOS-discuss] HP DL180 refuses to shutdown or reboot

2013-11-12 Thread David Bomba
Hi Guys, I've installed OmniOS on many HP DL180 G6 boxes with great success, however the latest server refuses to either reboot or shutdown. There are two configuration changes which differentiate this server from others, 1 a LSI-9201-8i HBA and 2 this server uses usb media for booting. The

Re: [OmniOS-discuss] areca or lsi

2013-07-18 Thread David Bomba
We use ARECA 1882 series cards in all our OmniOS storage servers. We moved from a Linux/GlusterFS environment to OmniOS/Comstar and our benchmarks have been very similar between the two using these controllers. I highly recommend them, they have been very reliable for us, and performance has

Re: [OmniOS-discuss] areca or lsi

2013-07-18 Thread David Bomba
High quality RAID cards don't just perform simple passthrough, even thou we would expect this to be all that is needed in a ZFS implementation. The controller will (at least in Areca's case) utilise writeback caching to improve performance, driver implementation is also a major factor in