<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p>Soumya,</p>
<p>its <br>
</p>
<p><br>
</p>
<p></p>
<div>[root@mseas-data2 ~]# glusterfs --version<br>
glusterfs 3.7.11 built on Apr 27 2016 14:09:20<br>
Repository revision: git://git.gluster.com/glusterfs.git<br>
Copyright (c) 2006-2013 Red Hat, Inc. <http://www.redhat.com/><br>
GlusterFS comes with ABSOLUTELY NO WARRANTY.<br>
It is licensed to you under your choice of the GNU Lesser<br>
General Public License, version 3 or any later version (LGPLv3<br>
or later), or the GNU General Public License, version 2 (GPLv2),<br>
in all cases as published by the Free Software Foundation.<br>
[root@mseas-data2 ~]#<br>
</div>
<p></p>
<p><br>
</p>
<p>Thanks,</p>
<p>Steve<br>
</p>
<br>
<br>
<div style="color: rgb(0, 0, 0);">
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Soumya Koduri <skoduri@redhat.com><br>
<b>Sent:</b> Tuesday, August 8, 2017 1:37 AM<br>
<b>To:</b> Pat Haley; Niels de Vos<br>
<b>Cc:</b> gluster-users@gluster.org; Pranith Kumar Karampuri; Ben Turner; Ravishankar N; Raghavendra Gowdappa; Niels de Vos; Steve Postma<br>
<b>Subject:</b> Re: [Gluster-users] Slow write times to gluster disk</font>
<div> </div>
</div>
<div><br>
<br>
----- Original Message -----<br>
> From: "Pat Haley" <<a href="mailto:phaley@mit.edu>">phaley@mit.edu></a><br>
> To: "Soumya Koduri" <<a href="mailto:skoduri@redhat.com>">skoduri@redhat.com></a>,
<a href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a>, "Pranith Kumar Karampuri" <<a href="mailto:pkarampu@redhat.com>">pkarampu@redhat.com></a><br>
> Cc: "Ben Turner" <<a href="mailto:bturner@redhat.com>">bturner@redhat.com></a>, "Ravishankar N" <<a href="mailto:ravishankar@redhat.com>">ravishankar@redhat.com></a>, "Raghavendra Gowdappa"<br>
> <<a href="mailto:rgowdapp@redhat.com>">rgowdapp@redhat.com></a>, "Niels de Vos" <<a href="mailto:ndevos@redhat.com>">ndevos@redhat.com></a>, "Steve Postma" <<a href="mailto:SPostma@ztechnet.com>">SPostma@ztechnet.com></a><br>
> Sent: Monday, August 7, 2017 9:52:48 PM<br>
> Subject: Re: [Gluster-users] Slow write times to gluster disk<br>
> <br>
> <br>
> Hi Soumya,<br>
> <br>
> We just had the opportunity to try the option of disabling the<br>
> kernel-NFS and restarting glusterd to start gNFS. However the gluster<br>
> demon crashes immediately on startup. What additional information<br>
> besides what we provide below would help debugging this?<br>
> <br>
<br>
Which version of glusterfs are you using? There were few regressions caused (all fixed now in master branch atleast) by recent changes in mount codepath.<br>
<br>
Request Niels to comment.<br>
<br>
Thanks,<br>
Soumya<br>
<br>
<br>
> Thanks,<br>
> <br>
> Pat<br>
> <br>
> <br>
> -------- Forwarded Message --------<br>
> Subject: gluster-nfs crashing on start<br>
> Date: Mon, 7 Aug 2017 16:05:09 +0000<br>
> From: Steve Postma <<a href="mailto:SPostma@ztechnet.com>">SPostma@ztechnet.com></a><br>
> To: Pat Haley <<a href="mailto:phaley@mit.edu>">phaley@mit.edu></a><br>
> <br>
> <br>
> <br>
> *To disable kernal-nfs and enable nfs through Gluster we:*<br>
> <br>
> <br>
> gluster volume set data-volume nfs.export-volumes on<br>
> gluster volume set data-volume nfs.disable off<br>
> <br>
> /etc/init.d/glusterd stop<br>
> <br>
> <br>
> service nfslock stop<br>
> <br>
> service rpcgssd stop<br>
> <br>
> service rpcidmapd stop<br>
> <br>
> service portmap stop<br>
> <br>
> service nfs stop<br>
> <br>
> <br>
> /etc/init.d/glusterd stop<br>
> <br>
> <br>
> <br>
> <br>
> *the /var/log/glusterfs/nfs.log immediately reports a crash:*<br>
> <br>
> *<br>
> *<br>
> <br>
> [<a href="mailto:root@mseas-data2">root@mseas-data2</a> glusterfs]# cat nfs.log<br>
> <br>
> [2017-08-07 15:20:16.327026] I [MSGID: 100030] [glusterfsd.c:2332:main]<br>
> 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version<br>
> 3.7.11 (args: /usr/sbin/glusterfs -s localhost --volfile-id gluster/nfs<br>
> -p /var/lib/glusterd/nfs/run/nfs.pid -l /var/log/glusterfs/nfs.log -S<br>
> /var/run/gluster/7db74f19472511d20849e471bf224c1a.socket)<br>
> <br>
> [2017-08-07 15:20:16.345166] I [MSGID: 101190]<br>
> [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread<br>
> with index 1<br>
> <br>
> [2017-08-07 15:20:16.351290] I<br>
> [rpcsvc.c:2215:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service:<br>
> Configured rpc.outstanding-rpc-limit with value 16<br>
> <br>
> pending frames:<br>
> <br>
> frame : type(0) op(0)<br>
> <br>
> patchset: git://git.gluster.com/glusterfs.git<br>
> <br>
> signal received: 11<br>
> <br>
> time of crash:<br>
> <br>
> 2017-08-07 15:20:17<br>
> <br>
> configuration details:<br>
> <br>
> argp 1<br>
> <br>
> backtrace 1<br>
> <br>
> dlfcn 1<br>
> <br>
> libpthread 1<br>
> <br>
> llistxattr 1<br>
> <br>
> setfsid 1<br>
> <br>
> spinlock 1<br>
> <br>
> epoll.h 1<br>
> <br>
> xattr.h 1<br>
> <br>
> st_atim.tv_nsec 1<br>
> <br>
> package-string: glusterfs 3.7.11<br>
> <br>
> /usr/lib64/libglusterfs.so.0(_gf_msg_backtrace_nomem+0xb8)[0x3889625a18]<br>
> <br>
> /usr/lib64/libglusterfs.so.0(gf_print_trace+0x32f)[0x38896456af]<br>
> <br>
> /lib64/libc.so.6[0x34a1c32660]<br>
> <br>
> /lib64/libc.so.6[0x34a1d3382f]<br>
> <br>
> /usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(+0x53307)[0x7f8d071b3307]<br>
> <br>
> /usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(exp_file_parse+0x302)[0x7f8d071b3742]<br>
> <br>
> /usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(mnt3_auth_set_exports_auth+0x45)[0x7f8d071b47a5]<br>
> <br>
> /usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(_mnt3_init_auth_params+0x91)[0x7f8d07183e41]<br>
> <br>
> /usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(mnt3svc_init+0x218)[0x7f8d07184228]<br>
> <br>
> /usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(nfs_init_versions+0xd7)[0x7f8d07174a37]<br>
> <br>
> /usr/lib64/glusterfs/3.7.11/xlator/nfs/server.so(init+0x77)[0x7f8d071767c7]<br>
> <br>
> /usr/lib64/libglusterfs.so.0(xlator_init+0x52)[0x3889622a82]<br>
> <br>
> /usr/lib64/libglusterfs.so.0(glusterfs_graph_init+0x31)[0x3889669aa1]<br>
> <br>
> /usr/lib64/libglusterfs.so.0(glusterfs_graph_activate+0x57)[0x3889669bd7]<br>
> <br>
> /usr/sbin/glusterfs(glusterfs_process_volfp+0xed)[0x405c0d]<br>
> <br>
> /usr/sbin/glusterfs(mgmt_getspec_cbk+0x312)[0x40dbd2]<br>
> <br>
> /usr/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0xa5)[0x3889e0f7b5]<br>
> <br>
> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x1a1)[0x3889e10891]<br>
> <br>
> /usr/lib64/libgfrpc.so.0(rpc_transport_notify+0x28)[0x3889e0bbd8]<br>
> <br>
> /usr/lib64/glusterfs/3.7.11/rpc-transport/socket.so(+0x94cd)[0x7f8d088e04cd]<br>
> <br>
> /usr/lib64/glusterfs/3.7.11/rpc-transport/socket.so(+0xa79d)[0x7f8d088e179d]<br>
> <br>
> /usr/lib64/libglusterfs.so.0[0x388968b2f0]<br>
> <br>
> /lib64/libpthread.so.0[0x34a2007aa1]<br>
> <br>
> /lib64/libc.so.6(clone+0x6d)[0x34a1ce8aad]<br>
> <br>
> <br>
> <br>
> <br>
> <br>
> <br>
> [<a href="mailto:root@mseas-data2">root@mseas-data2</a> glusterfs]# gluster volume info<br>
> <br>
> Volume Name: data-volume<br>
> <br>
> Type: Distribute<br>
> <br>
> Volume ID: c162161e-2a2d-4dac-b015-f31fd89ceb18<br>
> <br>
> Status: Started<br>
> <br>
> Number of Bricks: 2<br>
> <br>
> Transport-type: tcp<br>
> <br>
> Bricks:<br>
> <br>
> Brick1: mseas-data2:/mnt/brick1<br>
> <br>
> Brick2: mseas-data2:/mnt/brick2<br>
> <br>
> Options Reconfigured:<br>
> <br>
> nfs.export-volumes: on<br>
> <br>
> nfs.disable: off<br>
> <br>
> performance.readdir-ahead: on<br>
> <br>
> diagnostics.brick-sys-log-level: WARNING<br>
> <br>
> nfs.exports-auth-enable: on<br>
> <br>
> <br>
> <br>
> "/var/lib/glusterd/nfs/exports"<br>
> <br>
> /gdata 172.16.1.0/255.255.255.0(rw)<br>
> <br>
> <br>
> <br>
> <br>
> *What else can we do to identify why this is failing?**<br>
> *<br>
> <br>
> **<br>
> **<br>
> <br>
> <br>
<hr>
<table id="container-table" style="width:100%; font-family:Arial,Helvetica,sans-serif; font-size:12px; color:#000000">
<tbody>
<tr>
<td>
<table id="header-table" style="width:100%; font-size:12px; color:#000000">
<tbody>
<tr>
<td style="color:#5D5F8F; font-weight:bold">Total Control Panel</td>
<td style="text-align:right"><a href="https://asp.reflexion.net/login?domain=ztechnet.com">Login</a></td>
</tr>
</tbody>
</table>
</td>
</tr>
<tr>
<td>
<table id="main-content-table" style="width:100%">
<tbody>
<tr>
<td style="width:30%; vertical-align:top">
<table id="from-to-table" style="font-size:12px; color:#000000">
<tbody>
<tr>
<td>To: <a href="https://asp.reflexion.net/address-properties?aID=11541174&domain=ztechnet.com">
spostma@ztechnet.com</a></td>
</tr>
<tr>
<td>From: skoduri@redhat.com</td>
</tr>
</tbody>
</table>
</td>
<td style="vertical-align:top">
<table id="actions-table" style="font-size:12px; color:#000000; width:100%">
<tbody>
<tr>
<td style="vertical-align:top">Message Score: 1</td>
<td>High (60): <span style="color:#00FF00">Pass</span></td>
</tr>
<tr>
<td>My Spam Blocking Level: Medium</td>
<td>Medium (75): <span style="color:#00FF00">Pass</span></td>
</tr>
<tr>
<td></td>
<td>Low (90): <span style="color:#00FF00">Pass</span></td>
</tr>
<tr>
<td><a href="https://asp.reflexion.net/FooterAction?ver=3&bl-sender-address=1&hID=22715781184&domain=ztechnet.com">Block</a> this sender /
<a href="https://asp.reflexion.net/FooterAction?ver=3&ent=1&bl-sender-address=1&hID=22715781184&domain=ztechnet.com">
Block</a> this sender enterprise-wide</td>
<td></td>
</tr>
<tr>
<td><a href="https://asp.reflexion.net/FooterAction?ver=3&bl-sender-domain=1&hID=22715781184&domain=ztechnet.com">Block</a> redhat.com /
<a href="https://asp.reflexion.net/FooterAction?ver=3&ent=1&bl-sender-domain=1&hID=22715781184&domain=ztechnet.com">
Block</a> redhat.com enterprise-wide</td>
<td></td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
<tr>
<td>
<table id="cause-stament-table" style="font-style:italic; font-size:12px; color:#000000">
<tbody>
<tr>
<td>This message was delivered because the content filter score did not exceed your filter level.</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
</body>
</html>