Re: [Openstack] VMs unable to communicate between each other using their floating IPs
Hi Razique, If I get your 1st question correctly, the answer is I am unable to ping the VMs from the compute node. The fixed IPs are reachable from the controller node. For the remaining questions, if it is not inconvenient to you can I know what are the precise details and how should I get and share them across? Thanks, Krishnaprasad From: Razique Mahroua [mailto:razique.mahr...@gmail.com] Sent: Montag, 28. Oktober 2013 17:55 To: Narayanan, Krishnaprasad Cc: openstack@lists.openstack.org Subject: Re: [Openstack] VMs unable to communicate between each other using their floating IPs OK can you show us: * The fixed IP you are trying to reach. From the compute node it is running on, are you able to ping it? * $iptables -L -nv -t nat * What is the floating IP ; does it appear on the iptables' output command? * If you run $ip addr sh | grep $IP do you see the floating IP? (assuming you are using a multi_host mode, is that the case?) Regards, Razique On Oct 28, 2013, at 1:59, Narayanan, Krishnaprasad naray...@uni-mainz.demailto:naray...@uni-mainz.de wrote: Hi Razique, They are located on different compute nodes and allow incoming connections. The VMs that I referred have a fixed IP address. I could see the eth0 interface and it has the fixed IP address. Thanks, Krishnaprasad From: Razique Mahroua [mailto:razique.mahr...@gmail.com] Sent: Sonntag, 27. Oktober 2013 21:11 To: Narayanan, Krishnaprasad Subject: Re: [Openstack] VMs unable to communicate between each other using their floating IPs Are all located on the same compute node? And all the instances allow incoming connection? Finally make sure the instance you cannot reach have a private IP assigned (not through the dash but check the logs to make sure the instance has indeed an interface up ; usually eth0) - Razique On Oct 27, 2013, at 9:48, Narayanan, Krishnaprasad naray...@uni-mainz.demailto:naray...@uni-mainz.de wrote: I could see a strange behavior. I restarted the nova-compute and nova-network. I was able to reach certain floating IPs and few was not. Can I know the reason behind this and some pointers to get rid of this problem? From: Razique Mahroua [mailto:razique.mahr...@gmail.com] Sent: Sonntag, 27. Oktober 2013 17:26 To: Narayanan, Krishnaprasad Cc: Oleg Gelbukh; openstack@lists.openstack.orgmailto:openstack@lists.openstack.org Subject: Re: [Openstack] VMs unable to communicate between each other using their floating IPs I think that restarting the nova-network and nova-compute services would be sufficient :) On Oct 27, 2013, at 9:14, Narayanan, Krishnaprasad naray...@uni-mainz.demailto:naray...@uni-mainz.de wrote: Hi, Thanks for your response. I don't see this setting in my nova.conf. Will it be possible for you to describe the complete command of recreating the floating IPs with -interface flag? Regards, Krishnaprasad From: Oleg Gelbukh [mailto:ogelb...@mirantis.com] Sent: Sonntag, 27. Oktober 2013 16:40 To: Narayanan, Krishnaprasad Cc: openstack@lists.openstack.orgmailto:openstack@lists.openstack.org Subject: Re: [Openstack] VMs unable to communicate between each other using their floating IPs Narayan, Are you using multi-host? Is 'public_interface' in your nova.conf set? Recently we've had similar situation with a customer. Turned out that traffic going from VM's fixed IP to floating IP of another VM on the same physical host never gets to public interface and thus never SNATed, and response never gets back. We fixed it by unsetting 'public_interface' and re-creating floating IPs with --interface=public_interface flag. It ensures that all packets from VMs are source-translated, and also that floating IPs are assigned to correct interface. Hope that helps. -- Best regards, Oleg Gelbukh Mirantis Labs On Fri, Oct 25, 2013 at 11:41 PM, Narayanan, Krishnaprasad naray...@uni-mainz.demailto:naray...@uni-mainz.de wrote: Hi all, Im my OpenStack setup, i am using nova-network to manage the networks. I could see that the VMs are unable to communicate between each other via their floating IPs. Can I know what is the reason and how to get rid of the problem? Thanks, Krishnaprasad ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.orgmailto:openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.orgmailto:openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] VMs unable to communicate between each other using their floating IPs
Hi Razique, They are located on different compute nodes and allow incoming connections. The VMs that I referred have a fixed IP address. I could see the eth0 interface and it has the fixed IP address. Thanks, Krishnaprasad From: Razique Mahroua [mailto:razique.mahr...@gmail.com] Sent: Sonntag, 27. Oktober 2013 21:11 To: Narayanan, Krishnaprasad Subject: Re: [Openstack] VMs unable to communicate between each other using their floating IPs Are all located on the same compute node? And all the instances allow incoming connection? Finally make sure the instance you cannot reach have a private IP assigned (not through the dash but check the logs to make sure the instance has indeed an interface up ; usually eth0) - Razique On Oct 27, 2013, at 9:48, Narayanan, Krishnaprasad naray...@uni-mainz.demailto:naray...@uni-mainz.de wrote: I could see a strange behavior. I restarted the nova-compute and nova-network. I was able to reach certain floating IPs and few was not. Can I know the reason behind this and some pointers to get rid of this problem? From: Razique Mahroua [mailto:razique.mahr...@gmail.com] Sent: Sonntag, 27. Oktober 2013 17:26 To: Narayanan, Krishnaprasad Cc: Oleg Gelbukh; openstack@lists.openstack.orgmailto:openstack@lists.openstack.org Subject: Re: [Openstack] VMs unable to communicate between each other using their floating IPs I think that restarting the nova-network and nova-compute services would be sufficient :) On Oct 27, 2013, at 9:14, Narayanan, Krishnaprasad naray...@uni-mainz.demailto:naray...@uni-mainz.de wrote: Hi, Thanks for your response. I don't see this setting in my nova.conf. Will it be possible for you to describe the complete command of recreating the floating IPs with -interface flag? Regards, Krishnaprasad From: Oleg Gelbukh [mailto:ogelb...@mirantis.com] Sent: Sonntag, 27. Oktober 2013 16:40 To: Narayanan, Krishnaprasad Cc: openstack@lists.openstack.orgmailto:openstack@lists.openstack.org Subject: Re: [Openstack] VMs unable to communicate between each other using their floating IPs Narayan, Are you using multi-host? Is 'public_interface' in your nova.conf set? Recently we've had similar situation with a customer. Turned out that traffic going from VM's fixed IP to floating IP of another VM on the same physical host never gets to public interface and thus never SNATed, and response never gets back. We fixed it by unsetting 'public_interface' and re-creating floating IPs with --interface=public_interface flag. It ensures that all packets from VMs are source-translated, and also that floating IPs are assigned to correct interface. Hope that helps. -- Best regards, Oleg Gelbukh Mirantis Labs On Fri, Oct 25, 2013 at 11:41 PM, Narayanan, Krishnaprasad naray...@uni-mainz.demailto:naray...@uni-mainz.de wrote: Hi all, Im my OpenStack setup, i am using nova-network to manage the networks. I could see that the VMs are unable to communicate between each other via their floating IPs. Can I know what is the reason and how to get rid of the problem? Thanks, Krishnaprasad ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.orgmailto:openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.orgmailto:openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] VMs unable to communicate between each other using their floating IPs
OK can you show us: • The fixed IP you are trying to reach. From the compute node it is running on, are you able to ping it? • $iptables -L -nv -t nat • What is the floating IP ; does it appear on the iptables’ output command? • If you run $ip addr sh | grep $IP do you see the floating IP? (assuming you are using a multi_host mode, is that the case?) Regards, Razique On Oct 28, 2013, at 1:59, Narayanan, Krishnaprasad naray...@uni-mainz.de wrote: Hi Razique, They are located on different compute nodes and allow incoming connections. The VMs that I referred have a fixed IP address. I could see the eth0 interface and it has the fixed IP address. Thanks, Krishnaprasad From: Razique Mahroua [mailto:razique.mahr...@gmail.com] Sent: Sonntag, 27. Oktober 2013 21:11 To: Narayanan, Krishnaprasad Subject: Re: [Openstack] VMs unable to communicate between each other using their floating IPs Are all located on the same compute node? And all the instances allow incoming connection? Finally make sure the instance you cannot reach have a private IP assigned (not through the dash but check the logs to make sure the instance has indeed an interface up ; usually eth0) - Razique On Oct 27, 2013, at 9:48, Narayanan, Krishnaprasad naray...@uni-mainz.de wrote: I could see a strange behavior. I restarted the nova-compute and nova-network. I was able to reach certain floating IPs and few was not. Can I know the reason behind this and some pointers to get rid of this problem? From: Razique Mahroua [mailto:razique.mahr...@gmail.com] Sent: Sonntag, 27. Oktober 2013 17:26 To: Narayanan, Krishnaprasad Cc: Oleg Gelbukh; openstack@lists.openstack.org Subject: Re: [Openstack] VMs unable to communicate between each other using their floating IPs I think that restarting the nova-network and nova-compute services would be sufficient :) On Oct 27, 2013, at 9:14, Narayanan, Krishnaprasad naray...@uni-mainz.de wrote: Hi, Thanks for your response. I don’t see this setting in my nova.conf. Will it be possible for you to describe the complete command of recreating the floating IPs with –interface flag? Regards, Krishnaprasad From: Oleg Gelbukh [mailto:ogelb...@mirantis.com] Sent: Sonntag, 27. Oktober 2013 16:40 To: Narayanan, Krishnaprasad Cc: openstack@lists.openstack.org Subject: Re: [Openstack] VMs unable to communicate between each other using their floating IPs Narayan, Are you using multi-host? Is 'public_interface' in your nova.conf set? Recently we've had similar situation with a customer. Turned out that traffic going from VM's fixed IP to floating IP of another VM on the same physical host never gets to public interface and thus never SNATed, and response never gets back. We fixed it by unsetting 'public_interface' and re-creating floating IPs with --interface=public_interface flag. It ensures that all packets from VMs are source-translated, and also that floating IPs are assigned to correct interface. Hope that helps. -- Best regards, Oleg Gelbukh Mirantis Labs On Fri, Oct 25, 2013 at 11:41 PM, Narayanan, Krishnaprasad naray...@uni-mainz.de wrote: Hi all, Im my OpenStack setup, i am using nova-network to manage the networks. I could see that the VMs are unable to communicate between each other via their floating IPs. Can I know what is the reason and how to get rid of the problem? Thanks, Krishnaprasad ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack signature.asc Description: Message signed with OpenPGP using GPGMail ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Re: [Openstack] VMs unable to communicate between each other using their floating IPs
Narayan, Are you using multi-host? Is 'public_interface' in your nova.conf set? Recently we've had similar situation with a customer. Turned out that traffic going from VM's fixed IP to floating IP of another VM on the same physical host never gets to public interface and thus never SNATed, and response never gets back. We fixed it by unsetting 'public_interface' and re-creating floating IPs with --interface=public_interface flag. It ensures that all packets from VMs are source-translated, and also that floating IPs are assigned to correct interface. Hope that helps. -- Best regards, Oleg Gelbukh Mirantis Labs On Fri, Oct 25, 2013 at 11:41 PM, Narayanan, Krishnaprasad naray...@uni-mainz.de wrote: Hi all, ** ** Im my OpenStack setup, i am using nova-network to manage the networks. I could see that the VMs are unable to communicate between each other via their floating IPs. ** ** Can I know what is the reason and how to get rid of the problem? ** ** Thanks, Krishnaprasad ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack ___ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
