Hi all,
I spent some time today trying to figure out what is causing my networking
problems in domU on xVM hosts with bge adapters.
Connectivity is fine between dom0 and domU. Connectivity to other machines on
the LAN doesn't work as expected. I'm experiencing the same problems on Dell
Latitude D410, Dell Latitude D610, Dell Precision 380.
Everything works expected in the same domU when the xVM host is using e1000g
driver (tested with the hardware Intel adapter in Precision 380 and with the
virtual adapter in VMware Fusion).
Here is the log of what I have tested:
172.30.1.1 - 'ultra' - my workstation
172.30.1.6 - 'xvm1' - xVM host, bge network adapter, Dell Latitude D610 xVM
172.30.1.9 - 'xvm2' - xVM host, e1000g network adapter, VMware Fusion VM
running on my Mac
172.30.1.10 - 'vm0' - xVM guest, the disk image is on the workstation and
accessed over NFS
All machines are running snv_91 OpenSolaris bits.
/dev/lofi/1 is assigned to the same disk image file on both xVM hosts
The config file used to create the VM:
name = "opensolaris"
memory = "512"
disk = ['phy:/dev/lofi/1,0,w']
vif = ['']
[EMAIL PROTECTED] ~]# ifconfig bge0
bge0: flags=201004843<UP,BROADCAST,RUNNING,MULTICAST,DHCP,IPv4,CoS> mtu 1500
index 2
inet 172.30.1.6 netmask ffffff00 broadcast 172.30.1.255
ether 0:12:3f:18:56:6f
[EMAIL PROTECTED] ~]# svccfg -s xvm/xend listprop config/default-nic
config/default-nic astring bge0
[EMAIL PROTECTED] ~]# ifconfig e1000g0
e1000g0: flags=201004843<UP,BROADCAST,RUNNING,MULTICAST,DHCP,IPv4,CoS> mtu 1500
index 2
inet 172.30.1.9 netmask ffffff00 broadcast 172.30.1.255
ether 0:c:29:20:a1:f1
[EMAIL PROTECTED] ~]# svccfg -s xvm/xend listprop config/default-nic
config/default-nic astring e1000g0
Behavior when the domU is running on xvm2 (host is using e1000g driver):
domU actually got a different IP address from DHCP. I have changed it manually
to 172.30.1.10 from the console.
[EMAIL PROTECTED] ~]$ pfexec arp -d 172.30.1.10
172.30.1.10 (172.30.1.10) deleted
[EMAIL PROTECTED] ~]$ ping -s 172.30.1.10
PING 172.30.1.10: 56 data bytes
64 bytes from 172.30.1.10: icmp_seq=0. time=1.015 ms
64 bytes from 172.30.1.10: icmp_seq=1. time=0.797 ms
64 bytes from 172.30.1.10: icmp_seq=2. time=0.838 ms
^C
----172.30.1.10 PING Statistics----
3 packets transmitted, 3 packets received, 0% packet loss
round-trip (ms) min/avg/max/stddev = 0.797/0.883/1.015/0.116
[EMAIL PROTECTED] ~]$ ssh 172.30.1.10
Last login: Sat Jul 5 20:24:24 2008 from 172.30.1.1
Sun Microsystems Inc. SunOS 5.11 snv_91 January 2008
[EMAIL PROTECTED] ~]$
ICMP and SSH works as expected.
Behavior when the domU is running on xvm1 (host is using bge driver):
The domU didn't get the IP address from DHCP. I set it to 172.30.1.10 manually.
I have removed the /etc/resolv.conf file to avoid any DNS related delays.
[EMAIL PROTECTED] ~]$ pfexec arp -d 172.30.1.10
172.30.1.10 (172.30.1.10) deleted
[EMAIL PROTECTED] ~]$ ping -s 172.30.1.10
PING 172.30.1.10: 56 data bytes
64 bytes from 172.30.1.10: icmp_seq=0. time=0.847 ms
64 bytes from 172.30.1.10: icmp_seq=1. time=0.393 ms
64 bytes from 172.30.1.10: icmp_seq=2. time=0.450 ms
^C
----172.30.1.10 PING Statistics----
3 packets transmitted, 3 packets received, 0% packet loss
round-trip (ms) min/avg/max/stddev = 0.393/0.563/0.847/0.247
[EMAIL PROTECTED] ~]$ ssh 172.30.1.10
^C
Nothing happens... :(
As the networking works fine between dom0 and domU I have ssh'd to the vm
though the xVM host an started tcpdump. Below is the traffic log from when I
was trying to connect to the domU from my workstation. Some outgoing and
incoming SSH packets can be actually seen on the xnf0 interface but the session
doesn't work unfortunately.
[EMAIL PROTECTED] ~]$ ssh -t xvm1 ssh 172.30.1.10
Last login: Sat Jul 5 19:31:20 2008 from xvm1.chochlik.n
Sun Microsystems Inc. SunOS 5.11 snv_91 January 2008
[EMAIL PROTECTED] ~]$ pfexec su -
Sun Microsystems Inc. SunOS 5.11 snv_91 January 2008
[EMAIL PROTECTED] ~]# tcpdump -ni xnf0 host 172.30.1.1 and port 22
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on xnf0, link-type EN10MB (Ethernet), capture size 68 bytes
19:31:45.838418 IP 172.30.1.1.60128 > 172.30.1.10.22: S 372405969:372405969(0)
win 49640 <mss 1460,nop,wscale 0,nop,nop,sackOK>
19:31:45.838461 IP 172.30.1.10.22 > 172.30.1.1.60128: S 243913573:243913573(0)
ack 372405970 win 49640 <mss 1460,nop,wscale 0,nop,nop,sackOK>
19:31:49.208606 IP 172.30.1.10.22 > 172.30.1.1.60128: S 243913573:243913573(0)
ack 372405970 win 49640 <mss 1460,nop,wscale 0,nop,nop,sackOK>
19:31:49.212219 IP 172.30.1.1.60128 > 172.30.1.10.22: S 372405969:372405969(0)
win 49640 <mss 1460,nop,wscale 0,nop,nop,sackOK>
19:31:49.212238 IP 172.30.1.10.22 > 172.30.1.1.60128: . ack 1 win 49640
19:31:54.708596 IP 172.30.1.10.22 > 172.30.1.1.57788: FP
233294542:233294562(20) ack 361904448 win 49640
19:31:55.968644 IP 172.30.1.10.22 > 172.30.1.1.60128: S 243913573:243913573(0)
ack 372405970 win 49640 <mss 1460,nop,wscale 0,nop,nop,sackOK>
19:31:55.971742 IP 172.30.1.1.60128 > 172.30.1.10.22: S 372405969:372405969(0)
win 49640 <mss 1460,nop,wscale 0,nop,nop,sackOK>
19:31:55.971759 IP 172.30.1.10.22 > 172.30.1.1.60128: . ack 1 win 49640
19:32:01.911418 IP 172.30.1.1.57788 > 172.30.1.10.22: F 0:0(0) ack 0 win 49640
19:32:01.911452 IP 172.30.1.10.22 > 172.30.1.1.57788: . ack 1 win 49640
19:32:09.479182 IP 172.30.1.10.22 > 172.30.1.1.60128: S 243913573:243913573(0)
ack 372405970 win 49640 <mss 1460,nop,wscale 0,nop,nop,sackOK>
19:32:09.479806 IP 172.30.1.1.60128 > 172.30.1.10.22: S 372405969:372405969(0)
win 49640 <mss 1460,nop,wscale 0,nop,nop,sackOK>
19:32:09.479807 IP 172.30.1.1.60128 > 172.30.1.10.22: . ack 1 win 49640
19:32:09.479827 IP 172.30.1.10.22 > 172.30.1.1.60128: . ack 1 win 49640
19:32:09.503181 IP 172.30.1.10.22 > 172.30.1.1.60128: P 1:21(20) ack 1 win 49640
19:32:11.566084 IP 172.30.1.1.60128 > 172.30.1.10.22: F 1:1(0) ack 1 win 49640
19:32:11.566117 IP 172.30.1.10.22 > 172.30.1.1.60128: . ack 2 win 49640
19:32:11.566607 IP 172.30.1.10.22 > 172.30.1.1.60128: F 21:21(0) ack 2 win 49640
Thanks for reading!
Any help would be really appreciated. Please let me know what I can do to help
diagnose the problem. I can re-run the tests, capture the traffic again, etc.
Thank you,
Andrzej
This message posted from opensolaris.org
_______________________________________________
networking-discuss mailing list
[email protected]
