<div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Aug 29, 2019 at 2:50 PM Shreyansh Shah <<a href="mailto:shreyansh.shah@alpha-grep.com">shreyansh.shah@alpha-grep.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi,<div>Running on cloud centos7.5 VM, same machine has gluster volume mounted at 2 endpoints (read/write), say A and B. Gluster version server is 5.3 and on client is 3.12.2.</div><div>B is used very rarely and only for light reads. Mount A failed when our processes were running, but B was still present and could access data through B but not through A.</div><div><br></div><div>Here is the trace from /var/log/glusterfs:</div><div>The message "E [MSGID: 101191] [event-epoll.c:671:event_dispatch_epoll_worker] 0-epoll: Failed to dispatch handler" repeated 968 times between [2019-08-28 20:40:59.654898] and [2019-08-28 20:41:36.417335]<br></div><div>pending frames:<br>frame : type(1) op(FSTAT)<br>frame : type(1) op(READ)<br>frame : type(1) op(READ)<br>frame : type(1) op(READ)<br>frame : type(1) op(READ)<br>frame : type(1) op(READ)<br>frame : type(1) op(READ)<br>frame : type(1) op(READ)<br>frame : type(0) op(0)<br>patchset: git://<a href="http://git.gluster.org/glusterfs.git" target="_blank">git.gluster.org/glusterfs.git</a><br>signal received: 11<br>time of crash: <br>2019-08-28 20:41:37<br>configuration details:<br>argp 1<br>backtrace 1<br>dlfcn 1<br>libpthread 1<br>llistxattr 1<br>setfsid 1<br>spinlock 1<br>epoll.h 1<br>xattr.h 1<br>st_atim.tv_nsec 1<br>package-string: glusterfs 5.3<br>/lib64/libglusterfs.so.0(+0x26610)[0x7fea89c32610]<br>/lib64/libglusterfs.so.0(gf_print_trace+0x334)[0x7fea89c3cb84]<br>/lib64/libc.so.6(+0x36340)[0x7fea88295340]<br>/lib64/libpthread.so.0(pthread_mutex_lock+0x0)[0x7fea88a97c30]<br>/lib64/libglusterfs.so.0(__gf_free+0x12c)[0x7fea89c5dc3c]<br>/lib64/libglusterfs.so.0(rbthash_remove+0xd5)[0x7fea89c69d35]<br>/usr/lib64/glusterfs/5.3/xlator/performance/io-cache.so(+0xcace)[0x7fea7771dace]<br>/usr/lib64/glusterfs/5.3/xlator/performance/io-cache.so(+0xcdd7)[0x7fea7771ddd7]<br>/usr/lib64/glusterfs/5.3/xlator/performance/io-cache.so(+0xcfc5)[0x7fea7771dfc5]<br>/usr/lib64/glusterfs/5.3/xlator/performance/io-cache.so(+0xf0ca)[0x7fea777200ca]<br>/usr/lib64/glusterfs/5.3/xlator/performance/read-ahead.so(+0xa6a1)[0x7fea77b426a1]<br>/usr/lib64/glusterfs/5.3/xlator/performance/read-ahead.so(+0xaa6f)[0x7fea77b42a6f]<br>/usr/lib64/glusterfs/5.3/xlator/performance/read-ahead.so(+0xb0ce)[0x7fea77b430ce]<br>/lib64/libglusterfs.so.0(default_readv_cbk+0x180)[0x7fea89cbb8e0]<br>/usr/lib64/glusterfs/5.3/xlator/cluster/distribute.so(+0x81c1a)[0x7fea77dc9c1a]<br>/usr/lib64/glusterfs/5.3/xlator/protocol/client.so(+0x6d636)[0x7fea7c307636]<br>/lib64/libgfrpc.so.0(+0xec70)[0x7fea899fec70]<br>/lib64/libgfrpc.so.0(+0xf043)[0x7fea899ff043]<br>/lib64/libgfrpc.so.0(rpc_transport_notify+0x23)[0x7fea899faf23]<br>/usr/lib64/glusterfs/5.3/rpc-transport/socket.so(+0xa37b)[0x7fea7e5e637b]<br>/lib64/libglusterfs.so.0(+0x8aa49)[0x7fea89c96a49]<br>/lib64/libpthread.so.0(+0x7dd5)[0x7fea88a95dd5]<br>/lib64/libc.so.6(clone+0x6d)[0x7fea8835d02d]<br></div><div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail-m_-1000602177412884840gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><font face="arial, helvetica, sans-serif">Regards,<br>Shreyansh Shah</font></div></div></div></div></div></div></div></div></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><font face="arial, helvetica, sans-serif">Regards,<br>Shreyansh Shah</font></div></div></div></div></div></div></div>