Re: Is ixgbe usable with SR-IOV?

2013-12-05 Thread Jack Vogel
OK, very different kettle of fish from anything that's been tested :)
Let me talk about it with some people tomorrow and see what we
can do.

Jack



On Thu, Dec 5, 2013 at 12:30 AM, Colin Percival wrote:

> On 12/05/13 00:18, Jack Vogel wrote:
> > Unfortunately its a feature that was implemented, and worked, but it
> > has not had a lot of use I suspect, and it has been in a limited number
> > of setups. I know nothing about this Amazon provided hosting, is it
> > linux/kvm or xen?
> >
> > I can see if we can get something set up and check it here.
>
> This is Xen, running in this case using HVM: http://aws.amazon.com/ec2/
>
> --
> Colin Percival
> Security Officer Emeritus, FreeBSD | The power to serve
> Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid
>
>
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: Is ixgbe usable with SR-IOV?

2013-12-05 Thread Colin Percival
On 12/05/13 00:18, Jack Vogel wrote:
> Unfortunately its a feature that was implemented, and worked, but it
> has not had a lot of use I suspect, and it has been in a limited number
> of setups. I know nothing about this Amazon provided hosting, is it
> linux/kvm or xen?
> 
> I can see if we can get something set up and check it here.

This is Xen, running in this case using HVM: http://aws.amazon.com/ec2/

-- 
Colin Percival
Security Officer Emeritus, FreeBSD | The power to serve
Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid

___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: Is ixgbe usable with SR-IOV?

2013-12-05 Thread Jack Vogel
Unfortunately its a feature that was implemented, and worked, but it
has not had a lot of use I suspect, and it has been in a limited number
of setups. I know nothing about this Amazon provided hosting, is it
linux/kvm or xen?

I can see if we can get something set up and check it here.

Jack




On Wed, Dec 4, 2013 at 10:13 PM, Colin Percival wrote:

> Hi Jack,
>
> On 12/04/13 10:21, Jack Vogel wrote:
> > Yes, the ixv code was specifically written to work in a guest with
> SRIOV, however
> > our internal testing did not use DHCP, what if you assign it an address,
> will it
> > work then?
>
> Hard-coding an IP address doesn't work either.  Or rather, I can assign it
> an
> address, but it continues to not pass packets.
>
> Are there any diagnostic tunables/sysctls I should try turning on?  Since
> this
> is in EC2 I'm unfortunately limited to "printf-style" debugging.
>
> --
> Colin Percival
> Security Officer Emeritus, FreeBSD | The power to serve
> Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid
>
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: Is ixgbe usable with SR-IOV?

2013-12-04 Thread Colin Percival
Hi Jack,

On 12/04/13 10:21, Jack Vogel wrote:
> Yes, the ixv code was specifically written to work in a guest with SRIOV, 
> however
> our internal testing did not use DHCP, what if you assign it an address, will 
> it
> work then?

Hard-coding an IP address doesn't work either.  Or rather, I can assign it an
address, but it continues to not pass packets.

Are there any diagnostic tunables/sysctls I should try turning on?  Since this
is in EC2 I'm unfortunately limited to "printf-style" debugging.

-- 
Colin Percival
Security Officer Emeritus, FreeBSD | The power to serve
Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"


Re: Is ixgbe usable with SR-IOV?

2013-12-04 Thread Jack Vogel
Yes, the ixv code was specifically written to work in a guest with SRIOV,
however
our internal testing did not use DHCP, what if you assign it an address,
will it work
then?

Jack



On Sun, Dec 1, 2013 at 8:10 PM, Colin Percival  wrote:

> Hi Xen people & jfv,
>
> Amazon's new "C3" instance type has support for SR-IOV using ixgbe
> hardware;
> our driver looks like it should support this, but when I turn it on it
> doesn't
> seem to work.  Boot dmesg: http://pastebin.com/1Kkpfzbi
>
> The virtual hardware is recognized:
> > ix0:  1.1.4> mem 0xf300-0xf3003fff,0xf3004000-0xf3007fff at device 3.0 on pci0
> > ix0: Using MSIX interrupts with 2 vectors
> > ix0: Ethernet address: 02:91:23:76:38:77
>
> And we seem to be able to send packets, but never see any responses:
> > ix0: link state changed to UP
> > Starting Network: lo0 ix0.
> > lo0: flags=8049 metric 0 mtu 16384
> > options=63
> > inet6 ::1 prefixlen 128
> > inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
> > inet 127.0.0.1 netmask 0xff00
> > nd6 options=21
> > ix0: flags=8843 metric 0 mtu 1500
> >
> options=401bb
> > ether 02:91:23:76:38:77
> > nd6 options=29
> > media: Ethernet autoselect
> > status: active
> > Starting devd.
> > Starting dhclient.
> > DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 8
> > DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 12
> > DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 12
> > DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 9
> > DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 10
> > DHCPDISCOVER on ix0 to 255.255.255.255 port 67 interval 10
> > No DHCPOFFERS received.
>
> Under exactly the same Xen configuration except with SR-IOV turned off and
> EC2 presenting a Xen netback to us instead, the DHCP works just fine.
>
> Has anyone managed to use {FreeBSD, SR-IOV, ixgbe, Xen}?  Was any magic
> necessary in order to make it work?
>
> --
> Colin Percival
> Security Officer Emeritus, FreeBSD | The power to serve
> Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid
>
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "freebsd-xen-unsubscr...@freebsd.org"