[Gluster-users] [Q] Successful Gluster Peer Probe via GRE tunnel, but State returns Accepted peer request (Connected/Disconnected)

Tohru_Kao jacoder at yahoo.com
Sun Sep 13 20:07:35 UTC 2015


Hi Atin,
Looks like Humble is busy currently,
Could you share the workaround that you may know.
Thanks,-Tohru
 


     On Monday, September 7, 2015 9:43 PM, Atin Mukherjee <amukherj at redhat.com> wrote:
   

 + Humble

Considering you had recently faced a similar problem, you could share
the work around.

On 09/08/2015 09:15 AM, Tohru_Kao wrote:
> Hi all,
> 
> This is regarding using Gluster 3.7.4 with GRE tunnel between 2 Ubuntu
> (14.04.3) VMs.
> 
> ### Observation
> 
> After Gluster Peer Probe success, Status returns few thing strange:
> 
> #1: the State as "Accepted peer request (Connected/Disconnected)”.
> #2: IP address return is the Tunnel IP, not probed host IP.
> 
> * Environments and GRE commands I applied are listed below.
> * GRE tunnel settings are done by
> referring http://ask.xmodulo.com/create-gre-tunnel-linux.html
> 
> ### Questions
> 
> Q1:
>  Do I need to add/set additional parameters in glusterd.vol  because of
> GRE ?
> 
> Q2:
>  Are my GRE tunnel command settings wrong ? or missing some commands?
> 
> Any idea?
> 
> Appreciate any comments or pointers.
> 
> ### Note:
> * Peer Probe via external IPs works properly.
> 
> Thank in Advance.
> -JaCoder
> 
> ##############  Environment and Commands ############## 
> Environment:
>  U1: external ip address:  172.16.213.128  internal network:
> 169.254.0.0/24
>  U2: external ip address:  172.16.213.129  internal network:
> 169.254.1.0/24
> 
> ### Output of ‘gluster peer probe’ and status
> 
> On U1
> # gluster peer probe 169.254.1.1
> peer probe: success. 
> 
> # gluster peer status
> Number of Peers: 1
> 
> Hostname: 169.254.1.1
> Uuid: b6519618-e3aa-4307-afce-8f3d0dae39fc
> State: Accepted peer request (Connected)
> ---
> On U2
> 
> # gluster peer status
> Number of Peers: 1
> 
> Hostname: 10.10.10.1
> Uuid: 2306591b-25d6-41cf-ba50-db30ef0687bb
> State: Accepted peer request (Disconnected)
> 
> 
> ### glusterd.vol Files
> On U1
> 
> # cat /etc/glusterfs/glusterd.vol 
> volume management
>    type mgmt/glusterd
>    option working-directory /var/lib/glusterd
>    option transport.socket.bind-address 169.254.0.1
>    option transport-type socket,rdma
>    option transport.socket.keepalive-time 10
>    option transport.socket.keepalive-interval 2
>    option transport.socket.read-fail-log off
>    option ping-timeout 30
> #  option base-port 49152
> end-volume
> 
> ---
> On U2
> 
> # cat /etc/glusterfs/glusterd.vol 
> volume management
>    type mgmt/glusterd
>    option working-directory /var/lib/glusterd
>    option transport.socket.bind-address 169.254.1.1
>    option transport-type socket,rdma
>    option transport.socket.keepalive-time 10
>    option transport.socket.keepalive-interval 2
>    option transport.socket.read-fail-log off
>    option ping-timeout 30
> #  option base-port 49152
> end-volume
> 
> ### Output of ‘ifconfig | inet'
> 
> On U1
> # ifconfig | grep inet
>          inet addr:172.16.213.128  Bcast:172.16.213.255  Mask:255.255.255.0
>          inet addr:169.254.0.1  Bcast:169.254.0.255  Mask:255.255.255.0
>          inet addr:127.0.0.1  Mask:255.0.0.0
>          inet addr:10.10.10.1  P-t-P:10.10.10.1  Mask:255.255.255.0
> 
> On U2
> # ifconfig | grep inet
>          inet addr:172.16.213.129  Bcast:172.16.213.255  Mask:255.255.255.0
>          inet addr:169.254.1.1  Bcast:169.254.1.255  Mask:255.255.255.0
>          inet addr:127.0.0.1  Mask:255.0.0.0
>          inet addr:10.10.10.2  P-t-P:10.10.10.2  Mask:255.255.255.0
> 
> 
> ### Applied GRE Tunnel Commands
> On U1
> 
> modprobe ip_gre
> ip tunnel add test-gre mode gre remote 172.16.213.129
> local 172.16.213.128 ttl 255
> ip link set test-gre up
> ip addr add 10.10.10.1/24 dev test-gre
> ip route add 169.254.1.0/24 dev test-gre
> 
> On U2
> 
> modprobe ip_gre
> ip tunnel add test-gre mode gre remote 172.16.213.128
> local 172.16.213.129 ttl 255
> ip link set test-gre up
> ip addr add 10.10.10.2/24 dev test-gre
> ip route add 169.254.0.0/24 dev test-gre
> 
> ### Output of 'ip route show'
> On U1
> 
> # ip route show
> default via 172.16.213.2 dev eth0 
> 10.10.10.0/24 dev test-gre  proto kernel  scope link  src 10.10.10.1 
> 169.254.0.0/24 dev ux-br0  proto kernel  scope link  src 169.254.0.1 
> 169.254.1.0/24 dev test-gre  scope link 
> 172.16.213.0/24 dev eth0  proto kernel  scope link  src 172.16.213.128 
> 
> # ping 169.254.1.1
> PING 169.254.1.1 (169.254.1.1) 56(84) bytes of data.
> 64 bytes from 169.254.1.1: icmp_seq=1 ttl=64 time=0.340 ms
> 64 bytes from 169.254.1.1: icmp_seq=2 ttl=64 time=0.305 ms
> 
> ---
> On U2
> 
> # ip route show
> default via 172.16.213.2 dev eth0 
> 10.10.10.0/24 dev test-gre  proto kernel  scope link  src 10.10.10.2 
> 169.254.0.0/24 dev test-gre  scope link 
> 169.254.1.0/24 dev ux-br0  proto kernel  scope link  src 169.254.1.1 
> 172.16.213.0/24 dev eth0  proto kernel  scope link  src 172.16.213.100
> 
> # ping 169.254.0.1
> PING 169.254.0.1 (169.254.0.1) 56(84) bytes of data.
> 64 bytes from 169.254.0.1: icmp_seq=1 ttl=64 time=0.720 ms
> 64 bytes from 169.254.0.1: icmp_seq=2 ttl=64 time=0.298 ms
> 
> 
> === End ===
> 
> 
> 
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
> 


  
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150913/a68cdd1e/attachment.html>


More information about the Gluster-users mailing list