Re: decent performance drop for SCSI LLD / SAN initiator when iommu is turned on

2013-05-07 Thread Or Gerlitz
On Tue, May 7, 2013 at 3:22 PM, Michael S. Tsirkin wrote: > But why isn't iommu=pt effective? > AFAIK the whole point of it was to give up on security > for host-controlled devices, but still get a > measure of security for assigned devices. Good questions, from the tests Yan did so far he didn'

Re: decent performance drop for SCSI LLD / SAN initiator when iommu is turned on

2013-05-07 Thread Or Gerlitz
On 07/05/2013 01:35, Alexander Duyck wrote: The Tx path ends up taking a performance hit if IOMMU is enabled. It just isn't as severe due to things like TSO. In testing done by some Mellanox folks I think they see major penalty on the RX side, but hardly nothing on the TX side, I'll check th

Re: decent performance drop for SCSI LLD / SAN initiator when iommu is turned on

2013-05-07 Thread Michael S. Tsirkin
On Mon, May 06, 2013 at 03:35:58PM -0700, Alexander Duyck wrote: > On 05/06/2013 02:39 PM, Or Gerlitz wrote: > > On Thu, May 2, 2013 at 4:56 AM, Michael S. Tsirkin wrote: > >> On Thu, May 02, 2013 at 02:11:15AM +0300, Or Gerlitz wrote: > >>> So we've noted that when configuring the kernel && booti

Re: decent performance drop for SCSI LLD / SAN initiator when iommu is turned on

2013-05-06 Thread Alexander Duyck
On 05/06/2013 02:39 PM, Or Gerlitz wrote: > On Thu, May 2, 2013 at 4:56 AM, Michael S. Tsirkin wrote: >> On Thu, May 02, 2013 at 02:11:15AM +0300, Or Gerlitz wrote: >>> So we've noted that when configuring the kernel && booting with intel >>> iommu set to on on a physical node (non VM, and without

Re: decent performance drop for SCSI LLD / SAN initiator when iommu is turned on

2013-05-06 Thread Or Gerlitz
On Thu, May 2, 2013 at 4:56 AM, Michael S. Tsirkin wrote: > > On Thu, May 02, 2013 at 02:11:15AM +0300, Or Gerlitz wrote: > > So we've noted that when configuring the kernel && booting with intel > > iommu set to on on a physical node (non VM, and without enabling SRIOV > > by the HW device driver

RE: decent performance drop for SCSI LLD / SAN initiator when iommu is turned on

2013-05-05 Thread Yan Burman
t;> To: Or Gerlitz > >> Cc: Roland Dreier; io...@lists.linux-foundation.org; Yan Burman; > >> linux- r...@vger.kernel.org > >> Subject: Re: decent performance drop for SCSI LLD / SAN initiator > >> when iommu is turned on > >> > >> On Thu, Ma

Re: decent performance drop for SCSI LLD / SAN initiator when iommu is turned on

2013-05-03 Thread Don Dutile
drop for SCSI LLD / SAN initiator when iommu is turned on On Thu, May 02, 2013 at 02:11:15AM +0300, Or Gerlitz wrote: Hi Roland, IOMMU folks, So we've noted that when configuring the kernel&& booting with intel iommu set to on on a physical node (non VM, and without enabling SR

RE: decent performance drop for SCSI LLD / SAN initiator when iommu is turned on

2013-05-02 Thread Yan Burman
> -Original Message- > From: Michael S. Tsirkin [mailto:m...@redhat.com] > Sent: Thursday, May 02, 2013 04:56 > To: Or Gerlitz > Cc: Roland Dreier; io...@lists.linux-foundation.org; Yan Burman; linux- > r...@vger.kernel.org > Subject: Re: decent performance dr

Re: decent performance drop for SCSI LLD / SAN initiator when iommu is turned on

2013-05-01 Thread Michael S. Tsirkin
On Thu, May 02, 2013 at 02:11:15AM +0300, Or Gerlitz wrote: > Hi Roland, IOMMU folks, > > So we've noted that when configuring the kernel && booting with intel > iommu set to on on a physical node (non VM, and without enabling SRIOV > by the HW device driver) raw performance of the iSER (iSCSI RDM

Re: decent performance drop for SCSI LLD / SAN initiator when iommu is turned on

2013-05-01 Thread Roland Dreier
On Wed, May 1, 2013 at 4:11 PM, Or Gerlitz wrote: > This was done over kernel 3.5.x, I will re-run tomorrow with latest > upstream and send the top perf hits for both cases, but does this > rings some bells? basically it makes sense for some extra latency, but > I didn't expect the IOPS and BW dro