<div dir="ltr"><div><div><div><div><br></div>Could you please send me the output of command "sysctl net.ipv4.ip_local_reserved_ports".<br></div>Apart from output of command please send the logs to look into the issue.<br><br></div>Thanks<br></div>Gaurav<br><div><div><div><pre class="gmail-bz_comment_text gmail-bz_wrap_comment_text" id="gmail-comment_text_5"><br><br></pre></div></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jun 15, 2017 at 4:28 PM, Atin Mukherjee <span dir="ltr"><<a href="mailto:amukherj@redhat.com" target="_blank">amukherj@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">+Gaurav, he is the author of the patch, can you please comment here?<br><br></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jun 15, 2017 at 3:28 PM, Guy Cukierman <span dir="ltr"><<a href="mailto:guyc@elminda.com" target="_blank">guyc@elminda.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div link="blue" vlink="purple" lang="EN-US">
<div class="m_-4861554712758113811m_2773536363885439252WordSection1">
<p class="MsoNormal">Thanks, but my current settings are:<u></u><u></u></p>
<p class="MsoNormal">net.ipv4.ip_local_reserved_por<wbr>ts = 30000-32767<u></u><u></u></p>
<p class="MsoNormal">net.ipv4.ip_local_port_range = 32768 60999<u></u><u></u></p>
<p class="MsoNormal">meaning the reserved ports are already in the short int range, so maybe I misunderstood something? or is it a different issue?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b>From:</b> Atin Mukherjee [mailto:<a href="mailto:amukherj@redhat.com" target="_blank">amukherj@redhat.com</a>] <br>
<b>Sent:</b> Thursday, June 15, 2017 10:56 AM<br>
<b>To:</b> Guy Cukierman <<a href="mailto:guyc@elminda.com" target="_blank">guyc@elminda.com</a>><br>
<b>Cc:</b> <a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a><br>
<b>Subject:</b> Re: [Gluster-users] gluster peer probe failing<u></u><u></u></p><div><div class="m_-4861554712758113811h5">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal"><a href="https://review.gluster.org/#/c/17494/" target="_blank">https://review.gluster.org/#/c<wbr>/17494/</a> will it and the next update of 3.10 should have this fix.<br>
<br>
<u></u><u></u></p>
<pre>If sysctl net.ipv4.ip_local_reserved_por<wbr>ts has any value > short int range then this would be a problem with the current version. <br>Would you be able to reset the reserved ports temporarily to get this going?<br> <u></u><u></u></pre>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Wed, Jun 14, 2017 at 8:32 PM, Guy Cukierman <<a href="mailto:guyc@elminda.com" target="_blank">guyc@elminda.com</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal">Hi,<u></u><u></u></p>
<p class="MsoNormal">I have a gluster (version 3.10.2) server running on a 3 node (centos7) cluster.<u></u><u></u></p>
<p class="MsoNormal">Firewalld and SELinux are disabled, and I see I can telnet from each node to the other on port 24007.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">When I try to create the first peering by running on node1 the command:<u></u><u></u></p>
<p class="MsoNormal">gluster peer probe <node2 ip address><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">I get the error:<u></u><u></u></p>
<p class="MsoNormal">“Connection failed. Please check if gluster daemon is operational.”<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">And Glusterd.log shows:<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">[2017-06-14 14:46:09.927510] I [MSGID: 106487] [glusterd-handler.c:1242:__glu<wbr>sterd_handle_cli_probe] 0-glusterd: Received CLI probe req 192.168.1.17 24007<u></u><u></u></p>
<p class="MsoNormal">[2017-06-14 14:46:09.928560] I [MSGID: 106129] [glusterd-handler.c:3690:glust<wbr>erd_probe_begin] 0-glusterd: Unable to find peerinfo for host: 192.168.1.17 (24007)<u></u><u></u></p>
<p class="MsoNormal">[2017-06-14 14:46:09.930783] W [MSGID: 106062] [glusterd-handler.c:3466:glust<wbr>erd_transport_inet_options_<wbr>build] 0-glusterd: Failed to get tcp-user-timeout<u></u><u></u></p>
<p class="MsoNormal">[2017-06-14 14:46:09.930837] I [rpc-clnt.c:1059:rpc_clnt_conn<wbr>ection_init] 0-management: setting frame-timeout to 600<u></u><u></u></p>
<p class="MsoNormal">pending frames:<u></u><u></u></p>
<p class="MsoNormal">frame : type(0) op(0)<u></u><u></u></p>
<p class="MsoNormal">patchset: git://<a href="http://git.gluster.org/glusterfs.git" target="_blank">git.gluster.org/glusterf<wbr>s.git</a><u></u><u></u></p>
<p class="MsoNormal">signal received: 11<u></u><u></u></p>
<p class="MsoNormal">time of crash:<u></u><u></u></p>
<p class="MsoNormal">2017-06-14 14:46:09<u></u><u></u></p>
<p class="MsoNormal">configuration details:<u></u><u></u></p>
<p class="MsoNormal">argp 1<u></u><u></u></p>
<p class="MsoNormal">backtrace 1<u></u><u></u></p>
<p class="MsoNormal">dlfcn 1<u></u><u></u></p>
<p class="MsoNormal">libpthread 1<u></u><u></u></p>
<p class="MsoNormal">llistxattr 1<u></u><u></u></p>
<p class="MsoNormal">setfsid 1<u></u><u></u></p>
<p class="MsoNormal">spinlock 1<u></u><u></u></p>
<p class="MsoNormal">epoll.h 1<u></u><u></u></p>
<p class="MsoNormal">xattr.h 1<u></u><u></u></p>
<p class="MsoNormal">st_atim.tv_nsec 1<u></u><u></u></p>
<p class="MsoNormal">package-string: glusterfs 3.10.3<u></u><u></u></p>
<p class="MsoNormal">/lib64/libglusterfs.so.0(_gf_m<wbr>sg_backtrace_nomem+0xa0)[0x7f6<wbr>9625da4d0]<u></u><u></u></p>
<p class="MsoNormal">/lib64/libglusterfs.so.0(gf_pr<wbr>int_trace+0x324)[0x7f69625e3dd<wbr>4]<u></u><u></u></p>
<p class="MsoNormal">/lib64/libc.so.6(+0x35250)[0x7<wbr>f6960cbe250]<u></u><u></u></p>
<p class="MsoNormal">/lib64/libglusterfs.so.0(gf_po<wbr>rts_reserved+0x15c)[0x7f69625e<wbr>444c]<u></u><u></u></p>
<p class="MsoNormal">/lib64/libglusterfs.so.0(gf_pr<wbr>ocess_reserved_ports+0xbe)[0x7<wbr>f69625e470e]<u></u><u></u></p>
<p class="MsoNormal">/usr/lib64/glusterfs/3.10.3/rp<wbr>c-transport/socket.so(+0xd158)<wbr>[0x7f6954568158]<u></u><u></u></p>
<p class="MsoNormal">/usr/lib64/glusterfs/3.10.3/rp<wbr>c-transport/socket.so(client_<wbr>bind+0x93)[0x7f69545685a3]<u></u><u></u></p>
<p class="MsoNormal">/usr/lib64/glusterfs/3.10.3/rp<wbr>c-transport/socket.so(+0xa875)<wbr>[0x7f6954565875]<u></u><u></u></p>
<p class="MsoNormal">/lib64/libgfrpc.so.0(rpc_clnt_<wbr>reconnect+0xc9)[0x7f69623a3f89<wbr>]<u></u><u></u></p>
<p class="MsoNormal">/lib64/libgfrpc.so.0(rpc_clnt_<wbr>start+0x39)[0x7f69623a4049]<u></u><u></u></p>
<p class="MsoNormal">/usr/lib64/glusterfs/3.10.3/xl<wbr>ator/mgmt/glusterd.so(+0x24218<wbr>)[0x7f69570f9218]<u></u><u></u></p>
<p class="MsoNormal">/usr/lib64/glusterfs/3.10.3/xl<wbr>ator/mgmt/glusterd.so(+0x24843<wbr>)[0x7f69570f9843]<u></u><u></u></p>
<p class="MsoNormal">/usr/lib64/glusterfs/3.10.3/xl<wbr>ator/mgmt/glusterd.so(+0x24ae0<wbr>)[0x7f69570f9ae0]<u></u><u></u></p>
<p class="MsoNormal">/usr/lib64/glusterfs/3.10.3/xl<wbr>ator/mgmt/glusterd.so(+0x27890<wbr>)[0x7f69570fc890]<u></u><u></u></p>
<p class="MsoNormal">/usr/lib64/glusterfs/3.10.3/xl<wbr>ator/mgmt/glusterd.so(+0x27e20<wbr>)[0x7f69570fce20]<u></u><u></u></p>
<p class="MsoNormal">/usr/lib64/glusterfs/3.10.3/xl<wbr>ator/mgmt/glusterd.so(+0x20f5e<wbr>)[0x7f69570f5f5e]<u></u><u></u></p>
<p class="MsoNormal">/lib64/libglusterfs.so.0(synct<wbr>ask_wrap+0x10)[0x7f6962611750]<u></u><u></u></p>
<p class="MsoNormal">/lib64/libc.so.6(+0x46cf0)[0x7<wbr>f6960ccfcf0]<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">And a file is create under /var/lib/glusterd/peers/<node2 ip address> which contains:<u></u><u></u></p>
<p class="MsoNormal">uuid=00000000-0000-0000-0000-0<wbr>00000000000<u></u><u></u></p>
<p class="MsoNormal">state=0<u></u><u></u></p>
<p class="MsoNormal">hostname1=192.168.1.17<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">and the glusterd daemon exits and I cannot restart it until I delete this file from the peers folder.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Any idea what is wrong?<u></u><u></u></p>
<p class="MsoNormal">thanks!<u></u><u></u></p>
</div>
</div>
<p class="MsoNormal"><br>
______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-users</a><u></u><u></u></p>
</blockquote>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div></div></div>
</div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>