try to leave datagramm mode, do not change mtu. <http://mtu.it> it looks like gluster is connected over the tcp/ipoib. you might get packets drops with mtu> 2k. as i remember you should tune your ib switch for the mtu size,at least on the mellanox managed switch.
if the gluster connected over rdma it should not use any of tcp settings. Is your mount -l shows that the gluster mounted with .rdma? btw opensm should run only once, the others are going to stay in the standby mode. <housemo...@squeakz.net> schrieb am Mo., 13. Aug. 2018, 20:13: > I am trying to setup gluster using Infiniband and mounting it in RDMA > mode. I have created a network hook so that it configures the interfaces as > MTU=65520 and CONNECTED_MODE=yes. I have a second server doing NFS with > RDMA over Infiniband with some VMs on it. When I try and transfer files to > the gluster storage it is taking a while and I am seeing the message “VDSM > {hostname} command GetGlusterVolumeHealInfoVDS failed: Message timeout > which can be caused by communication issues” This is usually followed by > “Host {hostname} is not responding. It will stay in Connecting state for a > grace period of 60 seconds and after that an attempt to fence the host will > be issued.” I just installed the Infiniband hardware. The switch is a > Qlogic 12200-18 with QLE7340 single port Infiniband cards in each of the 3 > servers. The error message varies on which of the 3 nodes it comes from. > Each of the 3 servers is running the opensm service. > _______________________________________________ > Users mailing list -- users@ovirt.org > To unsubscribe send an email to users-le...@ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/KGR2CL7M34IHL6XJPHUYUSNJCKF63UQS/ >
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/NPGM2HWSTKOQJIRAFF2WJSAOHF5RB4Q5/