<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=windows-1252">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<br>
Hi Soumya,<br>
<br>
We just had the opportunity to try the option of disabling the
kernel-NFS and restarting glusterd to start gNFS. However the
gluster demon crashes immediately on startup. What additional
information besides what we provide below would help debugging this?<br>
<br>
Thanks,<br>
<br>
Pat<br>
<div class="moz-forward-container"><br>
<br>
-------- Forwarded Message --------
<table class="moz-email-headers-table" border="0" cellspacing="0"
cellpadding="0">
<tbody>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">Subject:
</th>
<td>gluster-nfs crashing on start</td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">Date: </th>
<td>Mon, 7 Aug 2017 16:05:09 +0000</td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">From: </th>
<td>Steve Postma <a class="moz-txt-link-rfc2396E" href="mailto:SPostma@ztechnet.com"><SPostma@ztechnet.com></a></td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">To: </th>
<td>Pat Haley <a class="moz-txt-link-rfc2396E" href="mailto:phaley@mit.edu"><phaley@mit.edu></a></td>
</tr>
</tbody>
</table>
<br>
<br>
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
<div id="divtagdefaultwrapper"
style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;"
dir="ltr">
<div>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><b>To
disable kernal-nfs and enable nfs through Gluster we:</b></p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt">gluster
volume set data-volume nfs.export-volumes on<br>
gluster volume set data-volume nfs.disable off</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><span>/etc/init.d/glusterd
stop</span></p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><span></span><br>
</p>
<div>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:12.0pt;color:black">
service nfslock stop</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:12.0pt;color:black">
service rpcgssd stop</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:12.0pt;color:black">
service rpcidmapd stop</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:12.0pt;color:black">
service portmap stop</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:12.0pt;color:black">
service nfs stop</p>
</div>
<br>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"> <span>/etc/init.d/glusterd
stop</span></p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><b>the
<span>/var/log/glusterfs/nfs.log</span> immediately
reports a crash:</b></p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><b><br>
</b></p>
<div>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">[root@mseas-data2
glusterfs]# cat nfs.log</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">[2017-08-07
15:20:16.327026] I [MSGID: 100030]
[glusterfsd.c:2332:main] 0-/usr/sbin/glusterfs: Started
running /usr/sbin/glusterfs version 3.7.11 (args:
/usr/sbin/glusterfs -s localhost --volfile-id gluster/nfs
-p /var/lib/glusterd/nfs/run/nfs.pid -l
/var/log/glusterfs/nfs.log -S
/var/run/gluster/7db74f19472511d20849e471bf224c1a.socket)</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">[2017-08-07
15:20:16.345166] I [MSGID: 101190]
[event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll:
Started thread with index 1</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">[2017-08-07
15:20:16.351290] I
[rpcsvc.c:2215:rpcsvc_set_outstanding_rpc_limit]
0-rpc-service: Configured rpc.outstanding-rpc-limit with
value 16</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">pending
frames:</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">frame
: type(0) op(0)</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">patchset:
git://git.gluster.com/glusterfs.git</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">signal
received: 11</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">time
of crash:</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">2017-08-07
15:20:17</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">configuration
details:</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">argp
1</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">backtrace
1</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">dlfcn
1</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">libpthread
1</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">llistxattr
1</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">setfsid
1</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">spinlock
1</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">epoll.h
1</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">xattr.h
1</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">st_atim.tv_nsec
1</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">package-string:
glusterfs 3.7.11</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/libglusterfs.so.0(_gf_msg_backtrace_nomem+0xb8)[0x3889625a18]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/libglusterfs.so.0(gf_print_trace+0x32f)[0x38896456af]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/lib64/libc.so.6[0x34a1c32660]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/lib64/libc.so.6[0x34a1d3382f]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(+0x53307)[0x7f8d071b3307]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(exp_file_parse+0x302)[0x7f8d071b3742]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(mnt3_auth_set_exports_auth+0x45)[0x7f8d071b47a5]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(_mnt3_init_auth_params+0x91)[0x7f8d07183e41]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(mnt3svc_init+0x218)[0x7f8d07184228]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(nfs_init_versions+0xd7)[0x7f8d07174a37]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(init+0x77)[0x7f8d071767c7]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/libglusterfs.so.0(xlator_init+0x52)[0x3889622a82]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/libglusterfs.so.0(glusterfs_graph_init+0x31)[0x3889669aa1]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/libglusterfs.so.0(glusterfs_graph_activate+0x57)[0x3889669bd7]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/sbin/glusterfs(glusterfs_process_volfp+0xed)[0x405c0d]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/sbin/glusterfs(mgmt_getspec_cbk+0x312)[0x40dbd2]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0xa5)[0x3889e0f7b5]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x1a1)[0x3889e10891]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/libgfrpc.so.0(rpc_transport_notify+0x28)[0x3889e0bbd8]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/glusterfs/3.7.11/rpc-transport/socket.so(+0x94cd)[0x7f8d088e04cd]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/glusterfs/3.7.11/rpc-transport/socket.so(+0xa79d)[0x7f8d088e179d]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/usr/lib64/libglusterfs.so.0[0x388968b2f0]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/lib64/libpthread.so.0[0x34a2007aa1]</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/lib64/libc.so.6(clone+0x6d)[0x34a1ce8aad]</p>
</div>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<div>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">[root@mseas-data2
glusterfs]# gluster volume info</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt"> </p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">Volume
Name: data-volume</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">Type:
Distribute</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">Volume
ID: c162161e-2a2d-4dac-b015-f31fd89ceb18</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">Status:
Started</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">Number
of Bricks: 2</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">Transport-type:
tcp</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">Bricks:</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">Brick1:
mseas-data2:/mnt/brick1</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">Brick2:
mseas-data2:/mnt/brick2</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">Options
Reconfigured:</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">nfs.export-volumes:
on</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">nfs.disable:
off</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">performance.readdir-ahead:
on</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">diagnostics.brick-sys-log-level:
WARNING</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">nfs.exports-auth-enable:
on</p>
</div>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<p
style="margin:0in;margin-left:.375in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<div>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">"/var/lib/glusterd/nfs/exports"</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt">/gdata
172.16.1.0/255.255.255.0(rw)</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt"><br>
</p>
<p style="margin:0in;font-family:Calibri;font-size:11.0pt"><b>What
else can we do to identify why this is failing?</b><b><br>
</b>
</p>
<b>
</b></div>
<b>
</b><br>
</div>
<br>
</div>
</div>
</body>
</html>