Re: [Gluster-users] [Q] Successful Gluster Peer Probe via GRE tunnel, but State returns Accepted peer request (Connected/Disconnected)
Hi Atin, Looks like Humble is busy currently, Could you share the workaround that you may know. Thanks,-Tohru On Monday, September 7, 2015 9:43 PM, Atin Mukherjeewrote: + Humble Considering you had recently faced a similar problem, you could share the work around. On 09/08/2015 09:15 AM, Tohru_Kao wrote: > Hi all, > > This is regarding using Gluster 3.7.4 with GRE tunnel between 2 Ubuntu > (14.04.3) VMs. > > ### Observation > > After Gluster Peer Probe success, Status returns few thing strange: > > #1: the State as "Accepted peer request (Connected/Disconnected)”. > #2: IP address return is the Tunnel IP, not probed host IP. > > * Environments and GRE commands I applied are listed below. > * GRE tunnel settings are done by > referring http://ask.xmodulo.com/create-gre-tunnel-linux.html > > ### Questions > > Q1: > Do I need to add/set additional parameters in glusterd.vol because of > GRE ? > > Q2: > Are my GRE tunnel command settings wrong ? or missing some commands? > > Any idea? > > Appreciate any comments or pointers. > > ### Note: > * Peer Probe via external IPs works properly. > > Thank in Advance. > -JaCoder > > ## Environment and Commands ## > Environment: > U1: external ip address: 172.16.213.128 internal network: > 169.254.0.0/24 > U2: external ip address: 172.16.213.129 internal network: > 169.254.1.0/24 > > ### Output of ‘gluster peer probe’ and status > > On U1 > # gluster peer probe 169.254.1.1 > peer probe: success. > > # gluster peer status > Number of Peers: 1 > > Hostname: 169.254.1.1 > Uuid: b6519618-e3aa-4307-afce-8f3d0dae39fc > State: Accepted peer request (Connected) > --- > On U2 > > # gluster peer status > Number of Peers: 1 > > Hostname: 10.10.10.1 > Uuid: 2306591b-25d6-41cf-ba50-db30ef0687bb > State: Accepted peer request (Disconnected) > > > ### glusterd.vol Files > On U1 > > # cat /etc/glusterfs/glusterd.vol > volume management > type mgmt/glusterd > option working-directory /var/lib/glusterd > option transport.socket.bind-address 169.254.0.1 > option transport-type socket,rdma > option transport.socket.keepalive-time 10 > option transport.socket.keepalive-interval 2 > option transport.socket.read-fail-log off > option ping-timeout 30 > # option base-port 49152 > end-volume > > --- > On U2 > > # cat /etc/glusterfs/glusterd.vol > volume management > type mgmt/glusterd > option working-directory /var/lib/glusterd > option transport.socket.bind-address 169.254.1.1 > option transport-type socket,rdma > option transport.socket.keepalive-time 10 > option transport.socket.keepalive-interval 2 > option transport.socket.read-fail-log off > option ping-timeout 30 > # option base-port 49152 > end-volume > > ### Output of ‘ifconfig | inet' > > On U1 > # ifconfig | grep inet > inet addr:172.16.213.128 Bcast:172.16.213.255 Mask:255.255.255.0 > inet addr:169.254.0.1 Bcast:169.254.0.255 Mask:255.255.255.0 > inet addr:127.0.0.1 Mask:255.0.0.0 > inet addr:10.10.10.1 P-t-P:10.10.10.1 Mask:255.255.255.0 > > On U2 > # ifconfig | grep inet > inet addr:172.16.213.129 Bcast:172.16.213.255 Mask:255.255.255.0 > inet addr:169.254.1.1 Bcast:169.254.1.255 Mask:255.255.255.0 > inet addr:127.0.0.1 Mask:255.0.0.0 > inet addr:10.10.10.2 P-t-P:10.10.10.2 Mask:255.255.255.0 > > > ### Applied GRE Tunnel Commands > On U1 > > modprobe ip_gre > ip tunnel add test-gre mode gre remote 172.16.213.129 > local 172.16.213.128 ttl 255 > ip link set test-gre up > ip addr add 10.10.10.1/24 dev test-gre > ip route add 169.254.1.0/24 dev test-gre > > On U2 > > modprobe ip_gre > ip tunnel add test-gre mode gre remote 172.16.213.128 > local 172.16.213.129 ttl 255 > ip link set test-gre up > ip addr add 10.10.10.2/24 dev test-gre > ip route add 169.254.0.0/24 dev test-gre > > ### Output of 'ip route show' > On U1 > > # ip route show > default via 172.16.213.2 dev eth0 > 10.10.10.0/24 dev test-gre proto kernel scope link src 10.10.10.1 > 169.254.0.0/24 dev ux-br0 proto kernel scope link src 169.254.0.1 > 169.254.1.0/24 dev test-gre scope link > 172.16.213.0/24 dev eth0 proto kernel scope link src 172.16.213.128 > > # ping 169.254.1.1 > PING 169.254.1.1 (169.254.1.1) 56(84) bytes of data. > 64 bytes from 169.254.1.1: icmp_seq=1 ttl=64 time=0.340 ms > 64 bytes from 169.254.1.1: icmp_seq=2 ttl=64 time=0.305 ms > > --- > On U2 > > # ip route show > default via 172.16.213.2 dev eth0 > 10.10.10.0/24 dev test-gre proto kernel scope link src 10.10.10.2 > 169.254.0.0/24 dev test-gre scope link > 169.254.1.0/24 dev ux-br0 proto kernel scope link src 169.254.1.1 > 172.16.213.0/24 dev eth0 proto kernel scope link src 172.16.213.100 > > # ping 169.254.0.1 > PING 169.254.0.1 (169.254.0.1) 56(84) bytes of data. > 64 bytes from 169.254.0.1: icmp_seq=1 ttl=64 time=0.720
Re: [Gluster-users] [Q] Successful Gluster Peer Probe via GRE tunnel, but State returns Accepted peer request (Connected/Disconnected)
On 09/14/2015 01:37 AM, Tohru_Kao wrote: > > Hi Atin, > > Looks like Humble is busy currently, > > Could you share the workaround that you may know. I am not aware of the workaround, otherwise I would have shared that already :) I will follow up with him to get the workaround posted. Cheers, Atin > > Thanks, > -Tohru > > > > > On Monday, September 7, 2015 9:43 PM, Atin Mukherjee >wrote: > > > + Humble > > Considering you had recently faced a similar problem, you could share > the work around. > > On 09/08/2015 09:15 AM, Tohru_Kao wrote: >> Hi all, >> >> This is regarding using Gluster 3.7.4 with GRE tunnel between 2 Ubuntu >> (14.04.3) VMs. >> >> ### Observation >> >> After Gluster Peer Probe success, Status returns few thing strange: >> >> #1: the State as "Accepted peer request (Connected/Disconnected)”. >> #2: IP address return is the Tunnel IP, not probed host IP. >> >> * Environments and GRE commands I applied are listed below. >> * GRE tunnel settings are done by >> referring http://ask.xmodulo.com/create-gre-tunnel-linux.html >> >> ### Questions >> >> Q1: >> Do I need to add/set additional parameters in glusterd.vol because of >> GRE ? >> >> Q2: >> Are my GRE tunnel command settings wrong ? or missing some commands? >> >> Any idea? >> >> Appreciate any comments or pointers. >> >> ### Note: >> * Peer Probe via external IPs works properly. >> >> Thank in Advance. >> -JaCoder >> >> ## Environment and Commands ## >> Environment: >> U1: external ip address: 172.16.213.128 internal network: >> 169.254.0.0/24 >> U2: external ip address: 172.16.213.129 internal network: >> 169.254.1.0/24 >> >> ### Output of ‘gluster peer probe’ and status >> >> On U1 >> # gluster peer probe 169.254.1.1 >> peer probe: success. >> >> # gluster peer status >> Number of Peers: 1 >> >> Hostname: 169.254.1.1 >> Uuid: b6519618-e3aa-4307-afce-8f3d0dae39fc >> State: Accepted peer request (Connected) >> --- >> On U2 >> >> # gluster peer status >> Number of Peers: 1 >> >> Hostname: 10.10.10.1 >> Uuid: 2306591b-25d6-41cf-ba50-db30ef0687bb >> State: Accepted peer request (Disconnected) >> >> >> ### glusterd.vol Files >> On U1 >> >> # cat /etc/glusterfs/glusterd.vol >> volume management >>type mgmt/glusterd >>option working-directory /var/lib/glusterd >>option transport.socket.bind-address 169.254.0.1 >>option transport-type socket,rdma >>option transport.socket.keepalive-time 10 >>option transport.socket.keepalive-interval 2 >>option transport.socket.read-fail-log off >>option ping-timeout 30 >> # option base-port 49152 >> end-volume >> >> --- >> On U2 >> >> # cat /etc/glusterfs/glusterd.vol >> volume management >>type mgmt/glusterd >>option working-directory /var/lib/glusterd >>option transport.socket.bind-address 169.254.1.1 >>option transport-type socket,rdma >>option transport.socket.keepalive-time 10 >>option transport.socket.keepalive-interval 2 >>option transport.socket.read-fail-log off >>option ping-timeout 30 >> # option base-port 49152 >> end-volume >> >> ### Output of ‘ifconfig | inet' >> >> On U1 >> # ifconfig | grep inet >> inet addr:172.16.213.128 Bcast:172.16.213.255 > Mask:255.255.255.0 >> inet addr:169.254.0.1 Bcast:169.254.0.255 Mask:255.255.255.0 >> inet addr:127.0.0.1 Mask:255.0.0.0 >> inet addr:10.10.10.1 P-t-P:10.10.10.1 Mask:255.255.255.0 >> >> On U2 >> # ifconfig | grep inet >> inet addr:172.16.213.129 Bcast:172.16.213.255 > Mask:255.255.255.0 >> inet addr:169.254.1.1 Bcast:169.254.1.255 Mask:255.255.255.0 >> inet addr:127.0.0.1 Mask:255.0.0.0 >> inet addr:10.10.10.2 P-t-P:10.10.10.2 Mask:255.255.255.0 >> >> >> ### Applied GRE Tunnel Commands >> On U1 >> >> modprobe ip_gre >> ip tunnel add test-gre mode gre remote 172.16.213.129 >> local 172.16.213.128 ttl 255 >> ip link set test-gre up >> ip addr add 10.10.10.1/24 dev test-gre >> ip route add 169.254.1.0/24 dev test-gre >> >> On U2 >> >> modprobe ip_gre >> ip tunnel add test-gre mode gre remote 172.16.213.128 >> local 172.16.213.129 ttl 255 >> ip link set test-gre up >> ip addr add 10.10.10.2/24 dev test-gre >> ip route add 169.254.0.0/24 dev test-gre >> >> ### Output of 'ip route show' >> On U1 >> >> # ip route show >> default via 172.16.213.2 dev eth0 >> 10.10.10.0/24 dev test-gre proto kernel scope link src 10.10.10.1 >> 169.254.0.0/24 dev ux-br0 proto kernel scope link src 169.254.0.1 >> 169.254.1.0/24 dev test-gre scope link >> 172.16.213.0/24 dev eth0 proto kernel scope link src 172.16.213.128 >> >> # ping 169.254.1.1 >> PING 169.254.1.1 (169.254.1.1) 56(84) bytes of data. >> 64 bytes from 169.254.1.1: icmp_seq=1 ttl=64 time=0.340 ms >> 64 bytes from 169.254.1.1: icmp_seq=2 ttl=64 time=0.305 ms >> >> --- >> On U2 >> >> # ip route show >> default via 172.16.213.2 dev eth0 >> 10.10.10.0/24 dev test-gre proto kernel scope
Re: [Gluster-users] [Q] Successful Gluster Peer Probe via GRE tunnel, but State returns Accepted peer request (Connected/Disconnected)
+ Humble Considering you had recently faced a similar problem, you could share the work around. On 09/08/2015 09:15 AM, Tohru_Kao wrote: > Hi all, > > This is regarding using Gluster 3.7.4 with GRE tunnel between 2 Ubuntu > (14.04.3) VMs. > > ### Observation > > After Gluster Peer Probe success, Status returns few thing strange: > > #1: the State as "Accepted peer request (Connected/Disconnected)”. > #2: IP address return is the Tunnel IP, not probed host IP. > > * Environments and GRE commands I applied are listed below. > * GRE tunnel settings are done by > referring http://ask.xmodulo.com/create-gre-tunnel-linux.html > > ### Questions > > Q1: > Do I need to add/set additional parameters in glusterd.vol because of > GRE ? > > Q2: > Are my GRE tunnel command settings wrong ? or missing some commands? > > Any idea? > > Appreciate any comments or pointers. > > ### Note: > * Peer Probe via external IPs works properly. > > Thank in Advance. > -JaCoder > > ## Environment and Commands ## > Environment: > U1: external ip address: 172.16.213.128 internal network: > 169.254.0.0/24 > U2: external ip address: 172.16.213.129 internal network: > 169.254.1.0/24 > > ### Output of ‘gluster peer probe’ and status > > On U1 > # gluster peer probe 169.254.1.1 > peer probe: success. > > # gluster peer status > Number of Peers: 1 > > Hostname: 169.254.1.1 > Uuid: b6519618-e3aa-4307-afce-8f3d0dae39fc > State: Accepted peer request (Connected) > --- > On U2 > > # gluster peer status > Number of Peers: 1 > > Hostname: 10.10.10.1 > Uuid: 2306591b-25d6-41cf-ba50-db30ef0687bb > State: Accepted peer request (Disconnected) > > > ### glusterd.vol Files > On U1 > > # cat /etc/glusterfs/glusterd.vol > volume management > type mgmt/glusterd > option working-directory /var/lib/glusterd > option transport.socket.bind-address 169.254.0.1 > option transport-type socket,rdma > option transport.socket.keepalive-time 10 > option transport.socket.keepalive-interval 2 > option transport.socket.read-fail-log off > option ping-timeout 30 > # option base-port 49152 > end-volume > > --- > On U2 > > # cat /etc/glusterfs/glusterd.vol > volume management > type mgmt/glusterd > option working-directory /var/lib/glusterd > option transport.socket.bind-address 169.254.1.1 > option transport-type socket,rdma > option transport.socket.keepalive-time 10 > option transport.socket.keepalive-interval 2 > option transport.socket.read-fail-log off > option ping-timeout 30 > # option base-port 49152 > end-volume > > ### Output of ‘ifconfig | inet' > > On U1 > # ifconfig | grep inet > inet addr:172.16.213.128 Bcast:172.16.213.255 Mask:255.255.255.0 > inet addr:169.254.0.1 Bcast:169.254.0.255 Mask:255.255.255.0 > inet addr:127.0.0.1 Mask:255.0.0.0 > inet addr:10.10.10.1 P-t-P:10.10.10.1 Mask:255.255.255.0 > > On U2 > # ifconfig | grep inet > inet addr:172.16.213.129 Bcast:172.16.213.255 Mask:255.255.255.0 > inet addr:169.254.1.1 Bcast:169.254.1.255 Mask:255.255.255.0 > inet addr:127.0.0.1 Mask:255.0.0.0 > inet addr:10.10.10.2 P-t-P:10.10.10.2 Mask:255.255.255.0 > > > ### Applied GRE Tunnel Commands > On U1 > > modprobe ip_gre > ip tunnel add test-gre mode gre remote 172.16.213.129 > local 172.16.213.128 ttl 255 > ip link set test-gre up > ip addr add 10.10.10.1/24 dev test-gre > ip route add 169.254.1.0/24 dev test-gre > > On U2 > > modprobe ip_gre > ip tunnel add test-gre mode gre remote 172.16.213.128 > local 172.16.213.129 ttl 255 > ip link set test-gre up > ip addr add 10.10.10.2/24 dev test-gre > ip route add 169.254.0.0/24 dev test-gre > > ### Output of 'ip route show' > On U1 > > # ip route show > default via 172.16.213.2 dev eth0 > 10.10.10.0/24 dev test-gre proto kernel scope link src 10.10.10.1 > 169.254.0.0/24 dev ux-br0 proto kernel scope link src 169.254.0.1 > 169.254.1.0/24 dev test-gre scope link > 172.16.213.0/24 dev eth0 proto kernel scope link src 172.16.213.128 > > # ping 169.254.1.1 > PING 169.254.1.1 (169.254.1.1) 56(84) bytes of data. > 64 bytes from 169.254.1.1: icmp_seq=1 ttl=64 time=0.340 ms > 64 bytes from 169.254.1.1: icmp_seq=2 ttl=64 time=0.305 ms > > --- > On U2 > > # ip route show > default via 172.16.213.2 dev eth0 > 10.10.10.0/24 dev test-gre proto kernel scope link src 10.10.10.2 > 169.254.0.0/24 dev test-gre scope link > 169.254.1.0/24 dev ux-br0 proto kernel scope link src 169.254.1.1 > 172.16.213.0/24 dev eth0 proto kernel scope link src 172.16.213.100 > > # ping 169.254.0.1 > PING 169.254.0.1 (169.254.0.1) 56(84) bytes of data. > 64 bytes from 169.254.0.1: icmp_seq=1 ttl=64 time=0.720 ms > 64 bytes from 169.254.0.1: icmp_seq=2 ttl=64 time=0.298 ms > > > === End === > > > > ___ > Gluster-users mailing list >