<div dir="ltr">I always used IP addresses instead of names when I added a peer. In the gluster peer status, I do see IP:<div><p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[root@DC-MTL-NAS-01 ~]# gluster peer status</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Number of Peers: 2</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:14px"><span style="font-variant-ligatures:no-common-ligatures"></span><br></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Hostname: XXX.XXX.XXX.12</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Uuid: ec1e10c1-0e38-4d2a-ab51-50fb0c67b6ee</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">State: Peer in Cluster (Connected)</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:14px"><span style="font-variant-ligatures:no-common-ligatures"></span><br></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Hostname: XXX.XXX.XXX.13</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Uuid: eef75e55-170a-4621-9d6e-3b5c3a6e5561</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">State: Accepted peer request (Disconnected)</span></p></div><div><span style="font-variant-ligatures:no-common-ligatures"><br></span></div><div><span style="font-variant-ligatures:no-common-ligatures">I can ping those IPs from any server.</span></div><div><span style="font-variant-ligatures:no-common-ligatures"><br></span></div><div><span style="font-variant-ligatures:no-common-ligatures">From the Server 3 Gluster logs, I can see this:</span></div><div><span style="font-variant-ligatures:no-common-ligatures"><p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.012446] I [MSGID: 100030] [glusterfsd.c:2503:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.10.6 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO)</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.020739] I [MSGID: 106478] [glusterd.c:1449:init] 0-management: Maximum allowed open file descriptors set to 65536</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.020796] I [MSGID: 106479] [glusterd.c:1496:init] 0-management: Using /var/lib/glusterd as working directory</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.029673] E [rpc-transport.c:283:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.10.6/rpc-transport/rdma.so: cannot open shared object file: No such file or directory</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.029702] W [rpc-transport.c:287:rpc_transport_load] 0-rpc-transport: volume &#39;rdma.management&#39;: transport-type &#39;rdma&#39; is not valid or not found on this machine</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.029715] W [rpcsvc.c:1661:rpcsvc_create_listener] 0-rpc-service: cannot create listener, initing the transport failed</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.029731] E [MSGID: 106243] [glusterd.c:1720:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.032226] I [MSGID: 106228] [glusterd.c:500:glusterd_check_gsync_present] 0-glusterd: geo-replication module not installed in the system [No such file or directory]</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.032816] I [MSGID: 106513] [glusterd-store.c:2201:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 31000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.042393] I [MSGID: 106498] [glusterd-handler.c:3669:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.042474] W [MSGID: 106062] [glusterd-handler.c:3466:glusterd_transport_inet_options_build] 0-glusterd: Failed to get tcp-user-timeout</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.042501] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.082295] E [MSGID: 101075] [common-utils.c:307:gf_resolve_ip6] 0-resolver: getaddrinfo failed (Name or service not known)</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.082331] E [name.c:262:af_inet_client_get_remote_sockaddr] 0-management: DNS resolution failed on host dc-mtl-nas-01.elemenai.lan</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.082563] I [MSGID: 106544] [glusterd.c:158:glusterd_uuid_init] 0-management: retrieved UUID: eef75e55-170a-4621-9d6e-3b5c3a6e5561</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.082589] I [MSGID: 106004] [glusterd-handler.c:5888:__glusterd_peer_rpc_notify] 0-management: Peer &lt;server1.domain.lan&gt; (&lt;3e190322-78f1-4ef6-80f7-8f48d51c2263&gt;), in state &lt;Accepted peer request&gt;, has disconnected from glusterd.</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.117581] E [MSGID: 106187] [glusterd-store.c:4566:glusterd_resolve_all_bricks] 0-glusterd: resolve brick failed in restore</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.117658] E [MSGID: 101019] [xlator.c:503:xlator_init] 0-management: Initialization of volume &#39;management&#39; failed, review your volfile again</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.117678] E [MSGID: 101066] [graph.c:325:glusterfs_graph_init] 0-management: initializing translator failed</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.117696] E [MSGID: 101176] [graph.c:681:glusterfs_graph_activate] 0-graph: init failed</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 12:31:33.118208] W [glusterfsd.c:1360:cleanup_and_exit] (--&gt;/usr/sbin/glusterd(glusterfs_volumes_init+0xfd) [0x7f1a34ba1bcd] --&gt;/usr/sbin/glusterd(glusterfs_process_volfp+0x1b1) [0x7f1a34ba1a71] --&gt;/usr/sbin/glusterd(cleanup_and_exit+0x6b) [0x7f1a34ba0f5b] ) 0-: received signum (1), shutting down</span></p></span></div><div class="gmail_extra"><br></div><div class="gmail_extra"><span style="color:rgb(40,254,20);font-family:&#39;Andale Mono&#39;;font-size:12px;background-color:rgba(0,0,0,0.901961)">server1.domain.lan</span><span style="background-color:rgb(255,255,255)">: Is the server 1 FQDN (not the ip address).</span></div><div class="gmail_extra"><span style="background-color:rgb(255,255,255)"><br></span></div><div class="gmail_extra"><span style="background-color:rgb(255,255,255)">Ludwig</span></div><div class="gmail_extra"><span style="background-color:rgb(255,255,255)"><br></span></div><div class="gmail_extra"><div class="gmail_quote">On Tue, Oct 24, 2017 at 2:16 AM, Bartosz Zięba <span dir="ltr">&lt;<a href="mailto:kontakt@avatat.pl" target="_blank">kontakt@avatat.pl</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex"><div dir="auto">Are you shure about possibility to resolve all node names on all other nodes?<div>You need to use names used previously in Gluster - check their by ‚gluster peer status’ or ‚gluster pool list’.</div><div><br></div><div>Regards,</div><div>Bartosz</div><div><br><div><br>Wiadomość napisana przez Ludwig Gamache &lt;<a href="mailto:ludwig@elementai.com" target="_blank">ludwig@elementai.com</a>&gt; w dniu 24.10.2017, o godz. 03:13:<br><br></div><div><div class="gmail-h5"><blockquote type="cite"><div><div dir="ltr">All,<div><br></div><div>I am trying to add a third peer to my gluster install. The first 2 nodes are running since many months and have gluster 3.10.3-1.</div><div><br></div><div>I recently installed the 3rd node and gluster 3.10.6-1. I was able to start the gluster daemon on it. After, I tried to add the peer from one of the 2 previous server (gluster peer probe IPADDRESS).</div><div><br></div><div>That first peer started the communication with the 3rd peer. At that point, peer status were messed up. Server 1 saw both other servers as connected. Server 2 only saw server 1 as connected and did not have server 3 as a peer. Server 3 only had server 1 as a peer and saw it as disconnected.</div><div><br></div><div>I also found errors in the gluster logs of server 3 that could not be done:</div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[2017-10-24 00:15:20.090462] E [name.c:262:af_inet_client_<wbr>get_remote_sockaddr] 0-management: DNS resolution failed on host HOST3.DOMAIN.lan</span></p></div><div><div><br></div>I rebooted node 3 and now gluster does not even restart on that node. It keeps giving Name resolution problems. The 2 other nodes are active.</div><div><br></div><div>However, I can ping the 3 servers (one from each others) using their DNS names.</div><div><br></div><div>Any idea about what to look at?</div></div>
</div></blockquote></div></div><blockquote type="cite"><div><span>______________________________<wbr>_________________</span><br><span>Gluster-users mailing list</span><br><span><a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a></span><br><span><a href="http://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a></span></div></blockquote></div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><span style="color:rgb(136,136,136)">Ludwig Gamache</span><br><div style="color:rgb(136,136,136)"><div dir="ltr"><div dir="ltr"><div>IT Director - Element AI</div><div>4200 St-Laurent, suite 1200</div><div>514-704-0564</div></div></div></div></div></div></div></div>
</div></div>