[Gluster-users] KVM guest I/O errors with xfs backed gluster volumes

[Jacob Yundt]

> Try setting "performance.read-ahead off"

No dice, I still get similar errors I/O errors on the client with
"performance.read-ahead off".  Snippet from the glusterfsd brick log:

[2013-07-16 11:15:03.610652] E [posix.c:1940:posix_readv] 0-xfs-posix:
read failed on fd=0x22a72fc: Invalid argument
[2013-07-16 11:15:03.610739] I
[server-rpc-fops.c:1489:server_readv_cbk] 0-xfs-server: 401: READV 0
(c709280b-d1f2-4965-9f0b-a93a4507525a) ==> (Invalid argument)
[2013-07-16 11:15:03.610816] T [rpcsvc.c:1081:rpcsvc_submit_generic]
0-rpc-service: Tx message: 116
[2013-07-16 11:15:03.610882] T
[rpcsvc.c:707:rpcsvc_record_build_header] 0-rpc-service: Reply fraglen
140, payload: 116, rpc hdr: 24
[2013-07-16 11:15:03.611040] D [socket.c:463:__socket_rwv]
0-tcp.xfs-server: would have passed zero length to read/write
[2013-07-16 11:15:03.611106] T [rpcsvc.c:1118:rpcsvc_submit_generic]
0-rpc-service: submitted reply for rpc-message (XID: 0x401x, Program:
GlusterFS 3.3, ProgVers: 330, Proc: 12) to rpc-transport
(tcp.xfs-server)
[2013-07-16 11:15:03.616071] T [rpcsvc.c:498:rpcsvc_handle_rpc_call]
0-rpcsvc: Client port: 1021
[2013-07-16 11:15:03.616142] T
[rpcsvc-auth.c:321:rpcsvc_auth_request_init] 0-rpc-service: Auth
handler: AUTH_GLUSTERFS-v2
[2013-07-16 11:15:03.616204] T [rpcsvc.c:388:rpcsvc_request_create]
0-rpc-service: received rpc-message (XID: 0x192, Ver: 2, Program:
1298437, ProgVers: 330, Proc: 12) from rpc-transport (tcp.xfs-server)
[2013-07-16 11:15:03.616272] T
[auth-glusterfs.c:216:auth_glusterfs_v2_authenticate] 0-rpc-service:
Auth Info: pid: 11976, uid: 107, gid: 107, owner: 3d7fb05261b6d484
[2013-07-16 11:15:03.616333] T [rpcsvc.c:214:rpcsvc_program_actor]
0-rpc-service: Actor found: GlusterFS 3.3 - READ
[2013-07-16 11:15:03.616546] D [io-threads.c:326:iot_schedule]
0-xfs-io-threads: READ scheduled as slow fop
[2013-07-16 11:15:03.616677] E [posix.c:1940:posix_readv] 0-xfs-posix:
read failed on fd=0x22a72fc: Invalid argument

Let me know if you'd like to see the strace or full server/client logs.

-Jacob