Hello Palash, Thanks for the response. The VR should have one NIC on your VXLAN overlay (guest) network and one on the public network. Please login to the hypervisors to ensure the vNICs of your VM, VTEP IF, VR, bridge are on an expected MTU of exactly 1500 bytes. Also for the Public network, your VR's NIC should be having the same MTU as your physical interface (or bridge). Please also ensure you have IGMP snooping turned on, on your switches (because it is better to have); and as a quick test, can you try moving your VR to the same host where your VM resides and test if that works? If you still observe loss with VMs and VRs being in the same host, please inspect your Public Network on the uplinks for issues.
*T**ip: *We also use VXLAN with multicast in our production but we make use of Jumbo Frames on Hypervisors (MTU: 9000). CloudStack creates our TEPs, vNICs, bridges with MTU 8950 and VMs, VRs are configured to use 1500 MTU by default inside the guest OS. Your issue may not exactly be with MTU but something else. Regards, Jayanth ------------------------------ *From:* Palash Biswas <[email protected]> *Sent:* Monday, January 15, 2024 10:53:38 AM *To:* [email protected] <[email protected]> *Subject:* Re: Disconnections to VMs from Public Network and VXLAN Hi Jayanth, The transfers work between VMs residing in different hypervisors when using Guest network. Hypervisor physical interface is set at MTU 1550 The transfers failed when attempting to connect using Public network which is using VLAN and different physical network from the Guest network. Besides file transfer using port 22, port 3389 (Windows RDP) also failed. Regards, Palash On Mon, 15 Jan 2024 at 9:08 AM, Jayanth Reddy <[email protected]> wrote: > Hello Palash, > > Please confirm if the file transfers work between VMs residing in > different hypervisors. I hope you've already considered the overhead of 50 > bytes for VXLAN and have already set atleast 1550 as MTU at your physdev > interface used for VTEP communication among hypervisors. > > Thanks, > Jayanth Reddy > > ________________________________ > From: Palash Biswas <[email protected]> > Sent: Monday, January 15, 2024 8:54:02 AM > To: [email protected] <[email protected]> > Subject: Disconnections to VMs from Public Network and VXLAN > > Hi Community, > > We have set up Cloudstack using VXLAN (and Multicast). > > VXLAN = Guest Network VLAN = Management and Public Network (Using different > Physical Network) VLAN = Storage Network (Using Linstor SDS) > > Our VMs can ping each other. But the moment we have a file transfer to the > VMs from the public internet, the connections keeps disconnecting. > > We've been spending few days on this issue. Any ideas where we could look > at? > > Regards, > Palash > >
