Hi, I just remembered about my testing setup with the MTU 1550 set. The virtual interfaces of VMs and VRs have 1500 and I don't see any issues with the file transfers which make use of TCP over the Public Networks. Please analyze your uplinks.
Thanks, Jayanth On Mon, Jan 15, 2024 at 11:58 AM Jayanth Reddy <jayanthreddy5...@gmail.com> wrote: > Hello Palash, > Thanks for the response. The VR should have one NIC on your VXLAN overlay > (guest) network and one on the public network. Please login to the > hypervisors to ensure the vNICs of your VM, VTEP IF, VR, bridge are on an > expected MTU of exactly 1500 bytes. Also for the Public network, your VR's > NIC should be having the same MTU as your physical interface (or bridge). > Please also ensure you have IGMP snooping turned on, on your switches > (because it is better to have); and as a quick test, can you try moving > your VR to the same host where your VM resides and test if that works? If > you still observe loss with VMs and VRs being in the same host, please > inspect your Public Network on the uplinks for issues. > > *T**ip: *We also use VXLAN with multicast in our production but we make > use of Jumbo Frames on Hypervisors (MTU: 9000). CloudStack creates our > TEPs, vNICs, bridges with MTU 8950 and VMs, VRs are configured to use 1500 > MTU by default inside the guest OS. Your issue may not exactly be with MTU > but something else. > > Regards, > Jayanth > ------------------------------ > *From:* Palash Biswas <palash...@gmail.com> > *Sent:* Monday, January 15, 2024 10:53:38 AM > *To:* users@cloudstack.apache.org <users@cloudstack.apache.org> > *Subject:* Re: Disconnections to VMs from Public Network and VXLAN > > Hi Jayanth, > > The transfers work between VMs residing in different hypervisors when using > Guest network. Hypervisor physical interface is set at MTU 1550 > > The transfers failed when attempting to connect using Public network which > is using VLAN and different physical network from the Guest network. > Besides file transfer using port 22, port 3389 (Windows RDP) also failed. > > Regards, > Palash > > > On Mon, 15 Jan 2024 at 9:08 AM, Jayanth Reddy <jayanthreddy5...@gmail.com> > wrote: > > > Hello Palash, > > > > Please confirm if the file transfers work between VMs residing in > > different hypervisors. I hope you've already considered the overhead of > 50 > > bytes for VXLAN and have already set atleast 1550 as MTU at your physdev > > interface used for VTEP communication among hypervisors. > > > > Thanks, > > Jayanth Reddy > > > > ________________________________ > > From: Palash Biswas <palash...@gmail.com> > > Sent: Monday, January 15, 2024 8:54:02 AM > > To: users@cloudstack.apache.org <users@cloudstack.apache.org> > > Subject: Disconnections to VMs from Public Network and VXLAN > > > > Hi Community, > > > > We have set up Cloudstack using VXLAN (and Multicast). > > > > VXLAN = Guest Network VLAN = Management and Public Network (Using > different > > Physical Network) VLAN = Storage Network (Using Linstor SDS) > > > > Our VMs can ping each other. But the moment we have a file transfer to > the > > VMs from the public internet, the connections keeps disconnecting. > > > > We've been spending few days on this issue. Any ideas where we could look > > at? > > > > Regards, > > Palash > > > > > >
