[Gluster-users] [Q] Successful Gluster Peer Probe via GRE tunnel, but State returns Accepted peer request (Connected/Disconnected)
Atin Mukherjee
amukherj at redhat.com
Tue Sep 8 04:43:28 UTC 2015
+ Humble
Considering you had recently faced a similar problem, you could share
the work around.
On 09/08/2015 09:15 AM, Tohru_Kao wrote:
> Hi all,
>
> This is regarding using Gluster 3.7.4 with GRE tunnel between 2 Ubuntu
> (14.04.3) VMs.
>
> ### Observation
>
> After Gluster Peer Probe success, Status returns few thing strange:
>
> #1: the State as "Accepted peer request (Connected/Disconnected)”.
> #2: IP address return is the Tunnel IP, not probed host IP.
>
> * Environments and GRE commands I applied are listed below.
> * GRE tunnel settings are done by
> referring http://ask.xmodulo.com/create-gre-tunnel-linux.html
>
> ### Questions
>
> Q1:
> Do I need to add/set additional parameters in glusterd.vol because of
> GRE ?
>
> Q2:
> Are my GRE tunnel command settings wrong ? or missing some commands?
>
> Any idea?
>
> Appreciate any comments or pointers.
>
> ### Note:
> * Peer Probe via external IPs works properly.
>
> Thank in Advance.
> -JaCoder
>
> ############## Environment and Commands ##############
> Environment:
> U1: external ip address: 172.16.213.128 internal network:
> 169.254.0.0/24
> U2: external ip address: 172.16.213.129 internal network:
> 169.254.1.0/24
>
> ### Output of ‘gluster peer probe’ and status
>
> On U1
> # gluster peer probe 169.254.1.1
> peer probe: success.
>
> # gluster peer status
> Number of Peers: 1
>
> Hostname: 169.254.1.1
> Uuid: b6519618-e3aa-4307-afce-8f3d0dae39fc
> State: Accepted peer request (Connected)
> ---
> On U2
>
> # gluster peer status
> Number of Peers: 1
>
> Hostname: 10.10.10.1
> Uuid: 2306591b-25d6-41cf-ba50-db30ef0687bb
> State: Accepted peer request (Disconnected)
>
>
> ### glusterd.vol Files
> On U1
>
> # cat /etc/glusterfs/glusterd.vol
> volume management
> type mgmt/glusterd
> option working-directory /var/lib/glusterd
> option transport.socket.bind-address 169.254.0.1
> option transport-type socket,rdma
> option transport.socket.keepalive-time 10
> option transport.socket.keepalive-interval 2
> option transport.socket.read-fail-log off
> option ping-timeout 30
> # option base-port 49152
> end-volume
>
> ---
> On U2
>
> # cat /etc/glusterfs/glusterd.vol
> volume management
> type mgmt/glusterd
> option working-directory /var/lib/glusterd
> option transport.socket.bind-address 169.254.1.1
> option transport-type socket,rdma
> option transport.socket.keepalive-time 10
> option transport.socket.keepalive-interval 2
> option transport.socket.read-fail-log off
> option ping-timeout 30
> # option base-port 49152
> end-volume
>
> ### Output of ‘ifconfig | inet'
>
> On U1
> # ifconfig | grep inet
> inet addr:172.16.213.128 Bcast:172.16.213.255 Mask:255.255.255.0
> inet addr:169.254.0.1 Bcast:169.254.0.255 Mask:255.255.255.0
> inet addr:127.0.0.1 Mask:255.0.0.0
> inet addr:10.10.10.1 P-t-P:10.10.10.1 Mask:255.255.255.0
>
> On U2
> # ifconfig | grep inet
> inet addr:172.16.213.129 Bcast:172.16.213.255 Mask:255.255.255.0
> inet addr:169.254.1.1 Bcast:169.254.1.255 Mask:255.255.255.0
> inet addr:127.0.0.1 Mask:255.0.0.0
> inet addr:10.10.10.2 P-t-P:10.10.10.2 Mask:255.255.255.0
>
>
> ### Applied GRE Tunnel Commands
> On U1
>
> modprobe ip_gre
> ip tunnel add test-gre mode gre remote 172.16.213.129
> local 172.16.213.128 ttl 255
> ip link set test-gre up
> ip addr add 10.10.10.1/24 dev test-gre
> ip route add 169.254.1.0/24 dev test-gre
>
> On U2
>
> modprobe ip_gre
> ip tunnel add test-gre mode gre remote 172.16.213.128
> local 172.16.213.129 ttl 255
> ip link set test-gre up
> ip addr add 10.10.10.2/24 dev test-gre
> ip route add 169.254.0.0/24 dev test-gre
>
> ### Output of 'ip route show'
> On U1
>
> # ip route show
> default via 172.16.213.2 dev eth0
> 10.10.10.0/24 dev test-gre proto kernel scope link src 10.10.10.1
> 169.254.0.0/24 dev ux-br0 proto kernel scope link src 169.254.0.1
> 169.254.1.0/24 dev test-gre scope link
> 172.16.213.0/24 dev eth0 proto kernel scope link src 172.16.213.128
>
> # ping 169.254.1.1
> PING 169.254.1.1 (169.254.1.1) 56(84) bytes of data.
> 64 bytes from 169.254.1.1: icmp_seq=1 ttl=64 time=0.340 ms
> 64 bytes from 169.254.1.1: icmp_seq=2 ttl=64 time=0.305 ms
>
> ---
> On U2
>
> # ip route show
> default via 172.16.213.2 dev eth0
> 10.10.10.0/24 dev test-gre proto kernel scope link src 10.10.10.2
> 169.254.0.0/24 dev test-gre scope link
> 169.254.1.0/24 dev ux-br0 proto kernel scope link src 169.254.1.1
> 172.16.213.0/24 dev eth0 proto kernel scope link src 172.16.213.100
>
> # ping 169.254.0.1
> PING 169.254.0.1 (169.254.0.1) 56(84) bytes of data.
> 64 bytes from 169.254.0.1: icmp_seq=1 ttl=64 time=0.720 ms
> 64 bytes from 169.254.0.1: icmp_seq=2 ttl=64 time=0.298 ms
>
>
> === End ===
>
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
>
More information about the Gluster-users
mailing list