[Gluster-users] Error writing to disperse volume with direct io option

[이태화]

Hi, I have tested Disperse volume.

so I perform a test using "dd"


I'm using 4 nodes. and nodes are connected through 10g network.

*Volume creation & mount command:*
root at node1:~# gluster vol create disp_vol disperse 4 redundancy 1
10gnode1:/node/dispv 10gnode2:/node/dispv 10gnode3:/node/dispv
10gnode4:/node/dispv
This configuration is not optimal on most workloads. Do you want to use it
? (y/n) y
volume create: disp_vol: success: please start the volume to access data
root at node1:~# gluster vol start disp_vol
volume start: disp_vol: success
root at node1:~# mount -t glusterfs 10gnode1:/disp_vol /mnt/gluster

*Test command & error message:*
root at node1:~# dd if=/dev/zero of=/mnt/gluster/test.io.1 oflag=direct
bs=1024k count=1024
dd: error writing ‘/mnt/gluster/test.io.1’: Invalid argument
dd: closing output file ‘/mnt/gluster/test.io.1’: Invalid argument


To recognize why, I saw logs. but I didn't know reasons.

*Warning messages in /var/log/glusterfs/mnt-gluster.log*
[2015-09-18 00:39:38.460320] W [MSGID: 114031]
[client-rpc-fops.c:904:client3_3_writev_cbk] 0-disp_vol-client-2: remote
operation failed [Invalid argument]
[2015-09-18 00:39:38.460320] W [MSGID: 114031]
[client-rpc-fops.c:904:client3_3_writev_cbk] 0-disp_vol-client-1: remote
operation failed [Invalid argument]
[2015-09-18 00:39:38.464081] W [MSGID: 114031]
[client-rpc-fops.c:904:client3_3_writev_cbk] 0-disp_vol-client-3: remote
operation failed [Invalid argument]
[2015-09-18 00:39:38.464297] W [MSGID: 114031]
[client-rpc-fops.c:904:client3_3_writev_cbk] 0-disp_vol-client-0: remote
operation failed [Invalid argument]
[2015-09-18 00:39:38.464459] W [fuse-bridge.c:2240:fuse_writev_cbk]
0-glusterfs-fuse: 18: WRITE => -1 (Invalid argument)
[2015-09-18 00:39:38.464643] W [fuse-bridge.c:2240:fuse_writev_cbk]
0-glusterfs-fuse: 19: WRITE => -1 (Invalid argument)
[2015-09-18 00:39:38.464801] W [fuse-bridge.c:2240:fuse_writev_cbk]
0-glusterfs-fuse: 20: WRITE => -1 (Invalid argument)
[2015-09-18 00:39:38.464958] W [fuse-bridge.c:2240:fuse_writev_cbk]
0-glusterfs-fuse: 21: WRITE => -1 (Invalid argument)
[2015-09-18 00:39:38.465114] W [fuse-bridge.c:2240:fuse_writev_cbk]
0-glusterfs-fuse: 22: WRITE => -1 (Invalid argument)
[2015-09-18 00:39:38.465278] W [fuse-bridge.c:2240:fuse_writev_cbk]
0-glusterfs-fuse: 23: WRITE => -1 (Invalid argument)
[2015-09-18 00:39:38.465433] W [fuse-bridge.c:2240:fuse_writev_cbk]
0-glusterfs-fuse: 24: WRITE => -1 (Invalid argument)
[2015-09-18 00:39:38.465585] W [fuse-bridge.c:2240:fuse_writev_cbk]
0-glusterfs-fuse: 25: WRITE => -1 (Invalid argument)
[2015-09-18 00:39:38.465529] W [MSGID: 114031]
[client-rpc-fops.c:904:client3_3_writev_cbk] 0-disp_vol-client-0: remote
operation failed [Invalid argument]
[2015-09-18 00:39:38.465863] W [MSGID: 114031]
[client-rpc-fops.c:904:client3_3_writev_cbk] 0-disp_vol-client-1: remote
operation failed [Invalid argument]
[2015-09-18 00:39:38.465890] W [fuse-bridge.c:690:fuse_truncate_cbk]
0-glusterfs-fuse: 26: FTRUNCATE() ERR => -1 (Invalid argument)
[2015-09-18 00:39:38.466192] W [MSGID: 114031]
[client-rpc-fops.c:904:client3_3_writev_cbk] 0-disp_vol-client-2: remote
operation failed [Invalid argument]
[2015-09-18 00:39:38.466353] W [MSGID: 114031]
[client-rpc-fops.c:904:client3_3_writev_cbk] 0-disp_vol-client-3: remote
operation failed [Invalid argument]
[2015-09-18 00:39:38.467464] W [MSGID: 114031]
[client-rpc-fops.c:904:client3_3_writev_cbk] 0-disp_vol-client-0: remote
operation failed [Invalid argument]
[2015-09-18 00:39:38.467848] W [MSGID: 114031]
[client-rpc-fops.c:904:client3_3_writev_cbk] 0-disp_vol-client-1: remote
operation failed [Invalid argument]
---- repeated ----
[2015-09-18 00:39:38.473542] W [fuse-bridge.c:1230:fuse_err_cbk]
0-glusterfs-fuse: 27: FLUSH() ERR => -1 (Invalid argument)


I need your help. anything about this is fine.

If you need some environment informations, I'm ready to inform that.

Thanks
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150918/401ab42c/attachment.html>