<div style="line-height:1.7;color:#000000;font-size:14px;font-family:Arial"><div style="margin: 0;">Hi:</div><div style="margin: 0;"> The firewall has been confirmed to be closed. </div><div style="margin: 0;"> The following is the startup log£¬and the ports of both nodes are 24017£º</div><div style="margin: 0;"> Final graph: </div><div style="margin: 0;"> +------------------------------------------------------------------------------+ </div><div style="margin: 0;"> 1: volume management </div><div style="margin: 0;"> 2: type mgmt/glusterd </div><div style="margin: 0;"> 3: option rpc-auth.auth-glusterfs on </div><div style="margin: 0;"> 4: option rpc-auth.auth-unix on </div><div style="margin: 0;"> 5: option rpc-auth.auth-null on</div><div style="margin: 0;"> 6: option rpc-auth-allow-insecure on</div><div style="margin: 0;"> 7: option transport.listen-backlog 1024</div><div style="margin: 0;"> 8: option max-port 60999</div><div style="margin: 0;"> 9: option base-port 49252</div><div style="margin: 0;"> 10: option event-threads 1</div><div style="margin: 0;"> 11: option ping-timeout 0</div><div style="margin: 0;"> 12: option transport.rdma.listen-port 24008</div><div style="margin: 0;"> 13: option transport.socket.listen-port 24017</div><div style="margin: 0;"> 14: option transport.socket.read-fail-log off</div><div style="margin: 0;"> 15: option transport.socket.keepalive-interval 2</div><div style="margin: 0;"> 16: option transport.socket.keepalive-time 10</div><div style="margin: 0;"> 17: option transport-type rdma</div><div style="margin: 0;"> 18: option working-directory /var/lib/glusterd</div><div style="margin: 0;"> 19: end-volume </div><div style="margin: 0;"> 20: </div><div style="margin: 0;"> +------------------------------------------------------------------------------+</div><div style="margin: 0;"> [2020-12-08 05:44:37.300602] I [MSGID: 101190] [event-epoll.c:682:event_dispatch_epoll_worker] 0-epoll: Started thread with index 0</div><div style="margin: 0;"><br></div><div style="margin: 0;"> And the following is the log displayed after executing the command ¡°gluster peer probe dev2¡±. It shows that the connected port is 24007. Is this port hard-coded?</div><div style="margin: 0;"><br></div><div style="margin: 0;"> [2020-12-08 05:45:23.136309] I [MSGID: 106487] [glusterd-handler.c:1082:__glusterd_handle_cli_probe] 0-glusterd: Received CLI probe req dev2 24007 </div><div style="margin: 0;">[2020-12-08 05:45:23.138990] I [MSGID: 106128] [glusterd-handler.c:3541:glusterd_probe_begin] 0-glusterd: Unable to find peerinfo for host: dev2 (24007) </div><div style="margin: 0;">[2020-12-08 05:45:23.208257] W [MSGID: 106061] [glusterd-handler.c:3315:glusterd_transport_inet_options_build] 0-glusterd: Failed to get tcp-user-timeout </div><div style="margin: 0;">[2020-12-08 05:45:23.208387] I [rpc-clnt.c:1014:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600</div><div style="margin: 0;">[2020-12-08 05:45:23.255375] I [MSGID: 106498] [glusterd-handler.c:3470:glusterd_friend_add] 0-management: connect returned 0 </div><div style="margin: 0;">[2020-12-08 05:45:23.260180] I [MSGID: 106004] [glusterd-handler.c:6204:__glusterd_peer_rpc_notify] 0-management: Peer <dev2> (<00000000-0000-0000-0000-000000000000>), in state <Establishing Connection>, has disconnected from glusterd. </div><div style="margin: 0;">[2020-12-08 05:45:23.260997] I [MSGID: 106599] [glusterd-nfs-svc.c:161:glusterd_nfssvc_reconfigure] 0-management: nfs/server.so xlator is not installed </div><div style="margin: 0;">[2020-12-08 05:45:23.261412] I [MSGID: 106544] [glusterd.c:152:glusterd_uuid_init] 0-management: retrieved UUID: 769fa9d7-a204-4c44-a15e-b5eac367e322 </div><div style="margin: 0;">[2020-12-08 05:45:23.261480] I [rpc-clnt.c:1014:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600</div><div style="margin: 0;">[2020-12-08 05:45:23.261737] I [MSGID: 106131] [glusterd-proc-mgmt.c:86:glusterd_proc_stop] 0-management: quotad already stopped </div><div style="margin: 0;">[2020-12-08 05:45:23.261780] I [MSGID: 106568] [glusterd-svc-mgmt.c:265:glusterd_svc_stop] 0-management: quotad service is stopped </div><div style="margin: 0;">[2020-12-08 05:45:23.261915] I [rpc-clnt.c:1014:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600</div><div style="margin: 0;">[2020-12-08 05:45:23.262039] I [MSGID: 106131] [glusterd-proc-mgmt.c:86:glusterd_proc_stop] 0-management: bitd already stopped </div><div style="margin: 0;">[2020-12-08 05:45:23.262064] I [MSGID: 106568] [glusterd-svc-mgmt.c:265:glusterd_svc_stop] 0-management: bitd service is stopped </div><div style="margin: 0;">[2020-12-08 05:45:23.262110] I [rpc-clnt.c:1014:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600</div><div style="margin: 0;">[2020-12-08 05:45:23.262289] I [MSGID: 106131] [glusterd-proc-mgmt.c:86:glusterd_proc_stop] 0-management: scrub already stopped </div><div style="margin: 0;">[2020-12-08 05:45:23.262331] I [MSGID: 106568] [glusterd-svc-mgmt.c:265:glusterd_svc_stop] 0-management: scrub service is stopped</div><div style="margin: 0;"><br></div><p style="margin: 0;"><br></p><p style="margin: 0;"><br></p><div style="position:relative;zoom:1"></div><div id="divNeteaseMailCard"></div><p style="margin: 0;"><br></p><p>ÔÚ 2020-12-08 05:01:12£¬"Strahil Nikolov" <hunter86_bg@yahoo.com> дµÀ£º</p><blockquote id="isReplyContent" style="PADDING-LEFT: 1ex; MARGIN: 0px 0px 0px 0.8ex; BORDER-LEFT: #ccc 1px solid"><div>Are you sure that the firewall is open. Usually , there could be a firewall inbetween the nodes.</div><div><br></div><div>Also, you can run a tcpdump on nodeA and issue a peer probe from NodeB and see if there is anything hitting it.</div><div><br></div><div>What about enabling trace logs and checking for any clues. You can find details about the log level at :
<a href="https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3/html/administration_guide/configuring_the_log_level
Best">https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3/html/administration_guide/configuring_the_log_level
Best</a> Regards,</div><div>Strahil Nikolov</div><div><br></div><div>§£ 10:07 +0800 §ß§Ñ 07.12.2020 (§á§ß), sky §ß§Ñ§á§Ú§ã§Ñ:</div><blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div style="line-height:1.7;color:#000000;font-size:14px;font-family:Arial"><div style="margin: 0;">Hi: </div><div style="margin: 0;">1. The ports of both nodes are changed to 24017</div><div style="margin: 0;">2. After installation, change the port and start directly (non-restart)</div><div style="margin: 0;">3. I tried, but the nodes in the pool cannot connect after restarting. The log shows an attempt to connect to the default port</div><div style="margin: 0;"><br></div><div style="margin: 0;">Steps(both node1 and node2)</div><div style="margin: 0;"> # yum install glusterfs glusterfs-server glusterfs-fuse</div><div style="margin: 0;"> # vim <span style="font-family: arial; white-space: pre-wrap;">/etc/glusterfs/glusterd.vol</span></div><div style="margin: 0;"><span style="font-family: arial; white-space: pre-wrap;"> ....</span></div><div style="margin: 0;"><span style="font-family: arial; white-space: pre-wrap;"> </span><span style="font-family: arial; white-space: pre-wrap;">option transport.socket.listen-port 24017</span></div><div style="margin: 0;"><span style="font-family: arial; white-space: pre-wrap;"> ....</span></div><div style="margin: 0;"><span style="font-family: arial; white-space: pre-wrap;"> # systemctl start glusterd</span></div><div style="margin: 0;"><span style="font-family: arial; white-space: pre-wrap;"><br></span></div><div style="margin: 0;"><span style="font-family: arial; white-space: pre-wrap;"> # </span><span style="font-family: arial; white-space: pre-wrap;">gluster peer probe node2</span></div><div style="margin: 0;"><span style="font-family: arial; white-space: pre-wrap;"> </span><span style="font-family: arial; white-space: pre-wrap;">Probe returned with Transport endpoint is not connected</span></div><div style="margin: 0;"><span style="font-family: arial; white-space: pre-wrap;"><br></span></div><div style="margin: 0;">After changing the port back to 24007 and restarting, the connection is normal</div><p style="margin: 0;"><br></p><p style="margin: 0;"><br></p><p style="margin: 0;"><br></p><p style="margin: 0;"><br></p><div style="position:relative;zoom:1"></div><div></div><p style="margin: 0;"><br></p><br><pre>ÔÚ 2020-12-06 19:27:01£¬"Strahil Nikolov" <hunter86_bg@yahoo.com> дµÀ£º</pre><pre>>Did you change the port on both nodes ?</pre><pre>>Did you restart glusterd on both nodes (the one you do peer probe and the other one that is being probed) ?</pre><pre>></pre><pre>>Have you tried to first peer probe and then change the port on all nodes in the pool ?</pre><pre>></pre><pre>></pre><pre>>Best Regards,</pre><pre>>Strahil Nikolov</pre><pre>></pre><pre>></pre><pre>></pre><pre>></pre><pre>></pre><pre>>§£ §á§Ö§ä§ì§Ü, 4 §Õ§Ö§Ü§Ö§Þ§Ó§â§Ú 2020 §Ô., 12:18:42 §¤§â§Ú§ß§å§Ú§é+2, sky <x_hsky@163.com> §ß§Ñ§á§Ú§ã§Ñ: </pre><pre>></pre><pre>></pre><pre>></pre><pre>></pre><pre>></pre><pre>>linux version: cenots 7.5 </pre><pre>>gluster verison: 7.5.1</pre><pre>>/etc/glusterfs/glusterd.vol: </pre><pre>>volume management</pre><pre>> type mgmt/glusterd</pre><pre>> option working-directory /var/lib/glusterd</pre><pre>> option transport-type socket,rdma</pre><pre>> option transport.socket.keepalive-time 10</pre><pre>> option transport.socket.keepalive-interval 2</pre><pre>> option transport.socket.read-fail-log off</pre><pre>> option transport.socket.listen-port 24017</pre><pre>> option transport.rdma.listen-port 24008</pre><pre>> option ping-timeout 0</pre><pre>> option event-threads 1</pre><pre>># option lock-timer 180</pre><pre>># option transport.address-family inet6</pre><pre>> option base-port 49252</pre><pre>> option max-port 60999</pre><pre>>end-volume</pre><pre>></pre><pre>>I started normally after changing the ports on both nodes(port from 24007 to 24017), but I cannot add nodes through the ¡®gluster peer probe node2¡® command,</pre><pre>>It always prompts me: </pre><pre>> Probe returned with Transport endpoint is not connected</pre><pre>></pre><pre>></pre><pre>></pre><pre>></pre><pre>></pre><pre>></pre><pre>></pre><pre>></pre><pre>></pre><pre>></pre><pre>></pre><pre>> </pre><pre>></pre><pre>></pre><pre>> </pre><pre>>________</pre><pre>></pre><pre>></pre><pre>></pre><pre>>Community Meeting Calendar:</pre><pre>></pre><pre>>Schedule -</pre><pre>>Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC</pre><pre>>Bridge: https://meet.google.com/cpu-eiue-hvk</pre><pre>>Gluster-users mailing list</pre><pre>>Gluster-users@gluster.org</pre><pre>>https://lists.gluster.org/mailman/listinfo/gluster-users</pre></div><br><br><span title="neteasefooter"><p> </p></span></blockquote>
</blockquote></div><br><br><span title="neteasefooter"><p> </p></span>