[Gluster-users] [Glusterfs-client] Glusterfs client crashed

[Binh Pham Van]

Hi,

We have a problem with glusterfs client. This is detail information:
- OS: CentOS Linux release 7.2.1511
- glusterfs server and client version: 3.7.11
- the error when glusterfs-client carsh:

[2016-12-07 02:40:55.219009] E [MSGID: 108008]
[afr-transaction.c:1989:afr_transaction] 0-cloudbkf01-replicate-0: Failing
WRITE on gfid 9cb4e123-d742-46be-8d9f-584fbd57f24f: split-brain observed.
[Input/output error]
The message "E [MSGID: 108008] [afr-transaction.c:1989:afr_transaction]
0-cloudbkf01-replicate-0: Failing WRITE on gfid
9cb4e123-d742-46be-8d9f-584fbd57f24f: split-brain observed. [Input/output
error]" repeated 25 times between [2016-12-07 02:40:55.219009] and
[2016-12-07 02:41:20.068359]
pending frames:
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(1) op(FLUSH)
frame : type(1) op(OPEN)
frame : type(0) op(0)
frame : type(1) op(FLUSH)
frame : type(1) op(FLUSH)
frame : type(1) op(OPEN)
frame : type(0) op(0)
frame : type(1) op(FLUSH)
frame : type(1) op(OPEN)
frame : type(0) op(0)
frame : type(1) op(FLUSH)
frame : type(1) op(OPEN)
frame : type(0) op(0)
frame : type(1) op(OPEN)
frame : type(1) op(OPEN)
frame : type(0) op(0)
frame : type(1) op(OPEN)
frame : type(1) op(OPEN)
frame : type(0) op(0)
frame : type(1) op(FLUSH)
frame : type(1) op(OPEN)
frame : type(1) op(FLUSH)
frame : type(1) op(LOOKUP)
frame : type(1) op(OPEN)
frame : type(1) op(OPEN)
frame : type(1) op(OPEN)
frame : type(1) op(OPEN)
frame : type(1) op(OPEN)
frame : type(1) op(OPEN)
frame : type(1) op(OPEN)
frame : type(1) op(OPEN)
frame : type(1) op(FLUSH)
frame : type(1) op(OPEN)
frame : type(1) op(OPEN)
frame : type(1) op(OPEN)
frame : type(1) op(OPEN)
frame : type(0) op(0)
patchset: git://git.gluster.com/glusterfs.git
signal received: 6
time of crash:
2016-12-07 02:45:17
configuration details:
argp 1
backtrace 1
dlfcn 1
libpthread 1
llistxattr 1
setfsid 1
spinlock 1
epoll.h 1
xattr.h 1
st_atim.tv_nsec 1
package-string: glusterfs 3.7.11
/lib64/libglusterfs.so.0(_gf_msg_backtrace_nomem+0xc2)[0x7f9adf1e7072]
/lib64/libglusterfs.so.0(gf_print_trace+0x31d)[0x7f9adf20366d]
/lib64/libc.so.6(+0x35670)[0x7f9add8d5670]
/lib64/libc.so.6(gsignal+0x37)[0x7f9add8d55f7]
/lib64/libc.so.6(abort+0x148)[0x7f9add8d6ce8]
/lib64/libc.so.6(+0x75317)[0x7f9add915317]
/lib64/libc.so.6(+0x7d023)[0x7f9add91d023]
/lib64/libglusterfs.so.0(data_destroy+0x55)[0x7f9adf1dee85]
/lib64/libglusterfs.so.0(dict_destroy+0x40)[0x7f9adf1df600]
/usr/lib64/glusterfs/3.7.11/xlator/cluster/replicate.so(afr_local_cleanup+0x7b)[0x7f9ad128839b]
/usr/lib64/glusterfs/3.7.11/xlator/cluster/replicate.so(+0x4b72f)[0x7f9ad129072f]
/usr/lib64/glusterfs/3.7.11/xlator/cluster/replicate.so(afr_lookup_metadata_heal_check+0x224)[0x7f9ad1291024]
/usr/lib64/glusterfs/3.7.11/xlator/cluster/replicate.so(afr_lookup_cbk+0x24d)[0x7f9ad1291a9d]
/usr/lib64/glusterfs/3.7.11/xlator/protocol/client.so(client3_3_lookup_cbk+0x707)[0x7f9ad14da417]
/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)[0x7f9adefb5ab0]
/lib64/libgfrpc.so.0(rpc_clnt_notify+0x1bf)[0x7f9adefb5d6f]
/lib64/libgfrpc.so.0(rpc_transport_notify+0x23)[0x7f9adefb1853]
/usr/lib64/glusterfs/3.7.11/rpc-transport/socket.so(+0x6666)[0x7f9ad3bc1666]
/usr/lib64/glusterfs/3.7.11/rpc-transport/socket.so(+0x92c4)[0x7f9ad3bc42c4]
/lib64/libglusterfs.so.0(+0x87a4a)[0x7f9adf248a4a]
/lib64/libpthread.so.0(+0x7dc5)[0x7f9ade04fdc5]
/lib64/libc.so.6(clone+0x6d)[0x7f9add99628d]
---------

​We appreciate for your reply and hope you can help us fix this error.

Thanks and best regards,
​

-- 

*Phạm Văn Bình (Mr.)*

*System Engineer – GS Department*

*VNG Corporation*

182 Le Dai Hanh St., Ward 15, Dist. 11, Ho Chi Minh City, Vietnam

*T:* (+84 8) 3962 3888 (Ext: 6355) *M:* (+84) 1678 092 361

*F:* (+84 8) 3962 4666                  *E:* binhpv at vng.com.vn

*“*"*GS là team hỗ trợ kỹ thuật cho phát triển và vận hành game"**”*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20161207/f97c5e09/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 4924 bytes
Desc: not available
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20161207/f97c5e09/attachment.png>