[Gluster-devel] Testing server down in replicated volume

[Emmanuel Dreyfus]

Hi everybody

After the last fix in NetBSD FUSE (cf NULL loc in posix_acl_truncate),
glusterfs release-3.3 now behaves quite nicely on NetBSD. I have been
able to build stuff in a replicated glusterfs volume for a few hours,
and it seems much faster than 3.2.6.

However things turn badly when I tried to kill glusterfsd on a server.
Since the volume is replicated, I would have expected the build to carry
on unaffected. but this is now what happens: a ENOTCONN is raised up to
the processes using the glusterfs volume:

In file included from /pfs/manu/netbsd/usr/src/sys/sys/signal.h:114,
    from /pfs/manu/netbsd/usr/src/sys/sys/param.h:150,                 
    from
/pfs/manu/netbsd/usr/src/lib/libc/../../common/lib/libc/net/__cmsg_align
bytes.c:40:
/pfs/manu/netbsd/usr/src/sys/sys/siginfo.h:35:54: error:
/pfs/manu/netbsd/usr/src/lib/libc/../../common/lib/libc/arch/i386/string
/machine/signal.h: Socket is not connected

Is it the intended behavior? 

Here is the client log:

[2012-05-28 05:48:27.440017] W [socket.c:195:__socket_rwv] 
   0-pfs-client-1: writev failed (Broken pipe)
[2012-05-28 05:48:27.440989] W [socket.c:195:__socket_rwv]  
   0-pfs-client-1: readv failed (Connection reset by peer)
[2012-05-28 05:48:27.441496] W 
   [socket.c:1512:__socket_proto_state_machine] 0-pfs-client-1: reading
   from socket failed. Error (Connection reset by peer), peer 
   (193.54.82.98:24011)
[2012-05-28 05:48:27.441825] E [rpc-clnt.c:373:saved_frames_unwind]  
   0-pfs-client-1: forced unwinding frame type(GlusterFS 3.1) 
   op(INODELK(29)) called at 2012-05-28 05:48:27.439249 (xid=0x1715867x)
[2012-05-28 05:48:27.442222] W 
   [client3_1-fops.c:1495:client3_1_inodelk_cbk] 0-pfs-client-1: remote
   operation failed: Socket is not connected
[2012-05-28 05:48:27.442528] E [rpc-clnt.c:373:saved_frames_unwind]  
   0-pfs-client-1: forced unwinding frame type(GlusterFS 3.1) 
   op(SETATTR(38)) called at 2012-05-28 05:48:27.440397 (xid=0x1715868x)
[2012-05-28 05:48:27.442971] W 
   [client3_1-fops.c:1954:client3_1_setattr_cbk] 0-pfs-client-1: remote
   operation failed: Socket is not connected
(and so on with other saved_frames_unwind)


-- 
Emmanuel Dreyfus
http://hcpnet.free.fr/pubz
manu at netbsd.org