[Gluster-devel] glusterfs reture errno 9(Bad file descriptor)

Tue Aug 26 08:27:39 UTC 2014

hi everyone: 

    I have  two device with volume info, occure write reture errno 9 when one device disconnect, then connect

Volume Name: vs_vol_rep2 
Type: Replicate 
Volume ID: 1ecffbb3-d400-4bf7-a2d2-712cf8c41ecd 
Status: Started 
Number of Bricks: 1x 2 = 2 
Transport-type: tcp
Bricks: 
Brick1: host-54bef70d852d:/sf/data/bd1ffdb9-d83d-4465-bbf6-c4bf57adf01c/92b97885-9152-4a2c-9587-d1f0273d66ac 
Brick2: host-54bef70d84f9:/sf/data/6c37007f-00a0-4987-931b-2bf66aba9a71/92b97885-9152-4a2c-9587-d1f0273d66ac 
Options Reconfigured: 
cluster.quorum-count: 2 
cluster.quorum-type: fixed 
performance.ssd-cache: disable 
nfs.disable: on

gluster.log as follow:

[2014-08-25 11:53:43.828739] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2495975: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:53:45.829111] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2495979: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:53:47.829424] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2495983: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:53:49.829720] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2495987: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:53:51.829997] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2495994: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:53:53.830268] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2495998: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:53:55.830578] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2496002: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:53:57.830883] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2496006: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:53:59.831175] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2496010: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:54:01.831404] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2496018: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:54:03.831747] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2496446: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:54:05.832099] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2496449: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:54:07.832339] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2496453: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:54:09.832682] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2496457: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:54:11.833027] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2496468: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:54:13.833326] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2496472: WRITE => -1 (Bad file descriptor) 
[2014-08-25 11:54:15.833674] W [fuse-bridge.c:2167:fuse_writev_cbk] 0-glusterfs-fuse: 2496476: WRITE => -1 (Bad file descriptor) 

stack as follow:

Breakpoint 1, fuse_writev_cbk (frame=0x7fcea4424afc, cookie=0x7fcea45ea388, this=0x25a5a90, op_ret=-1, op_errno=9, stbuf=0x0, postbuf=0x0, xdata=0x0) at fuse-bridge.c:2146 
2146 fuse-bridge.c: No such file or directory. 
(gdb) bt 
#0 fuse_writev_cbk (frame=0x7fcea4424afc, cookie=0x7fcea45ea388, this=0x25a5a90, op_ret=-1, op_errno=9, stbuf=0x0, postbuf=0x0, xdata=0x0) at fuse-bridge.c:2146 
#1 0x00007fce9bdf8474 in io_stats_writev_cbk (frame=0x7fcea45ea388, cookie=<optimized out>, this=<optimized out>, op_ret=-1, op_errno=9, prebuf=0x0, postbuf=0x0, xdata=0x0) 
at io-stats.c:1371 
#2 0x00007fcea021af8f in mdc_writev_cbk (frame=0x7fcea45ecddc, cookie=<optimized out>, this=<optimized out>, op_ret=-1, op_errno=<optimized out>, prebuf=0x0, postbuf=0x0, 
xdata=0x0) at md-cache.c:1488 
#3 0x00007fcea638776a in default_writev_cbk (frame=0x7fcea45ea02c, cookie=<optimized out>, this=<optimized out>, op_ret=-1, op_errno=9, prebuf=<optimized out>, postbuf=0x0, 
xdata=0x0) at defaults.c:215 
#4 0x00007fcea638776a in default_writev_cbk (frame=0x7fcea45ec06c, cookie=<optimized out>, this=<optimized out>, op_ret=-1, op_errno=9, prebuf=<optimized out>, postbuf=0x0, 
xdata=0x0) at defaults.c:215 
#5 0x00007fcea08397d5 in ioc_writev_cbk (frame=0x7fcea45eb9b4, cookie=<optimized out>, this=<optimized out>, op_ret=-1, op_errno=9, prebuf=0x0, postbuf=0x0, xdata=0x0) 
at io-cache.c:1219 
#6 0x00007fcea0a47f00 in ra_writev_cbk (frame=0x7fcea45ebc64, cookie=<optimized out>, this=<optimized out>, op_ret=-1, op_errno=9, prebuf=0x0, postbuf=0x0, xdata=0x0) 
at read-ahead.c:654 
#7 0x00007fcea0c577ed in wb_writev (frame=0x7fcea45ec724, this=<optimized out>, fd=<optimized out>, vector=0x265ca30, count=<optimized out>, offset=724992, flags=49154, 
iobref=0x2665420, xdata=0x0) at write-behind.c:1292 
#8 0x00007fcea0a4815b in ra_writev (frame=0x7fcea45ebc64, this=0x25c8190, fd=0x2625ec0, vector=0x265ca30, count=1, offset=724992, flags=49154, iobref=0x2665420, xdata=0x0) 
at read-ahead.c:682 
#9 0x00007fcea083954b in ioc_writev (frame=0x7fcea45eb9b4, this=0x25c9280, fd=0x2625ec0, vector=0x265ca30, count=1, offset=724992, flags=49154, iobref=0x2665420, xdata=0x0) 
at io-cache.c:1259 
#10 0x00007fcea062ed65 in qr_writev (frame=0x7fcea45ec06c, this=0x25ca300, fd=0x2625ec0, iov=0x265ca30, count=1, offset=724992, flags=49154, iobref=0x2665420, xdata=0x0) 
at quick-read.c:626 
#11 0x00007fcea6389f58 in default_writev_resume (frame=0x7fcea45ea02c, this=0x25cb420, fd=0x2625ec0, vector=0x265ca30, count=1, off=724992, flags=49154, iobref=0x2665420, 
xdata=0x0) at defaults.c:550 
#12 0x00007fcea63a1980 in call_resume_wind (stub=0x7fcea407dee8) at call-stub.c:2208 
#13 call_resume (stub=0x7fcea407dee8) at call-stub.c:2645 
#14 0x00007fcea04265f8 in open_and_resume (this=this at entry=0x25cb420, fd=fd at entry=0x2625ec0, stub=0x7fcea407dee8) at open-behind.c:236 
#15 0x00007fcea042791b in ob_writev (frame=0x7fcea45ea02c, this=0x25cb420, fd=0x2625ec0, iov=<optimized out>, count=<optimized out>, offset=<optimized out>, flags=49154, 
iobref=0x2665420, xdata=0x0) at open-behind.c:402 
#16 0x00007fcea0219258 in mdc_writev (frame=0x7fcea45ecddc, this=0x25cc560, fd=0x2625ec0, vector=0x2667fe0, count=1, offset=724992, flags=49154, iobref=0x2665420, xdata=0x0) 
at md-cache.c:1506 
#17 0x00007fce9bdf053c in io_stats_writev (frame=0x7fcea45ea388, this=0x25cd630, fd=0x2625ec0, vector=0x2667fe0, count=1, offset=724992, flags=49154, iobref=0x2665420, xdata=0x0) 
at io-stats.c:2091 
#18 0x00007fcea3bea0a0 in fuse_write_resume (state=0x26678e0) at fuse-bridge.c:2203 
#19 0x00007fcea3bdd126 in fuse_resolve_done (state=<optimized out>) at fuse-resolve.c:663 
#20 fuse_resolve_all (state=<optimized out>) at fuse-resolve.c:692 
#21 0x00007fcea3bdce58 in fuse_resolve (state=0x26678e0) at fuse-resolve.c:649 
#22 0x00007fcea3bdd16e in fuse_resolve_all (state=<optimized out>) at fuse-resolve.c:688 
#23 fuse_resolve_all (state=<optimized out>) at fuse-resolve.c:674 
#24 0x00007fcea3bdca21 in fuse_resolve_continue (state=state at entry=0x26678e0) at fuse-resolve.c:708 
#25 0x00007fcea3bdcc8e in fuse_resolve_fd (state=0x26678e0) at fuse-resolve.c:561 
#26 fuse_resolve (state=0x26678e0) at fuse-resolve.c:638 
#27 0x00007fcea3bdd14e in fuse_resolve_all (state=<optimized out>) at fuse-resolve.c:681 
#28 0x00007fcea3bdd608 in fuse_resolve_and_resume (state=0x26678e0, fn=0x7fcea3be9e10 <fuse_write_resume>) at fuse-resolve.c:721 
#29 0x00007fcea3bf5028 in fuse_thread_proc (data=0x25a5a90) at fuse-bridge.c:4609 
#30 0x00007fcea5d26b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 
#31 0x00007fcea568ca7d in clone () from /lib/x86_64-linux-gnu/libc.so.6 
#32 0x0000000000000000 in ?? ()

Did anyone met?

everybody_enjoy at 163.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-devel/attachments/20140826/cb99c529/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: err.txt
Type: application/octet-stream
Size: 19610 bytes
Desc: not available
URL: <http://supercolony.gluster.org/pipermail/gluster-devel/attachments/20140826/cb99c529/attachment-0001.obj>