[Gluster-users] Mounting replicated volume fails - terminating upon getting ENODEV when reading /dev/fuse

[Sankaravadivel Sivarajan]

  I have two storage servers running on Amazon Linux. I created a
replicated volume with these storage servers(glustervol)

I am trying to mount the volume on a Oracle Linux(I get this when I run
cat /etc/*-release -  Oracle Linux Server release 6.1
Red Hat Enterprise Linux Server release 6.1 (Santiago)
)
The mount fails with the following error

Mount failed. Please check the log file for more details.

the mount log looks like this

[2013-07-03 15:12:55.818849] D [client.c:2043:client_rpc_notify]
0-glustervol-client-0: got RPC_CLNT_CONNECT
[2013-07-03 15:12:55.818908] D [client-handshake.c:184:client_start_ping]
0-glustervol-client-0: returning as transport is already disconnected OR
there are no frames (1 || 1)
[2013-07-03 15:12:55.820335] I
[client-handshake.c:1636:select_server_supported_programs]
0-glustervol-client-0: Using Program GlusterFS 3.3.1, Num (1298437),
Version (330)
[2013-07-03 15:12:55.820393] D [client-handshake.c:184:client_start_ping]
0-glustervol-client-0: returning as transport is already disconnected OR
there are no frames (1 || 1)
[2013-07-03 15:12:55.821791] D
[client-handshake.c:1407:client_setvolume_cbk] 0-glustervol-client-0:
clnt-lk-version = 1, server-lk-version = 0
[2013-07-03 15:12:55.821816] I
[client-handshake.c:1433:client_setvolume_cbk] 0-glustervol-client-0:
Connected to10.96.37.122:24009, attached to remote volume '/export/brick1'.
[2013-07-03 15:12:55.821831] I
[client-handshake.c:1445:client_setvolume_cbk] 0-glustervol-client-0:
Server and Client lk-version numbers are not same, reopening the fds
[2013-07-03 15:12:55.821845] D
[client-handshake.c:1295:client_post_handshake] 0-glustervol-client-0: No
fds to open - notifying all parents child up
[2013-07-03 15:12:55.821861] D
[client-handshake.c:489:client_set_lk_version] 0-glustervol-client-0:
Sending SET_LK_VERSION
[2013-07-03 15:12:55.821918] D [fuse-bridge.c:4209:notify] 0-fuse: got
event 5 on graph 0
[2013-07-03 15:12:55.830939] I [fuse-bridge.c:4191:fuse_graph_setup]
0-fuse: switched to graph 0
[2013-07-03 15:12:55.831144] I
[client-handshake.c:453:client_set_lk_version_cbk] 0-glustervol-client-0:
Server lk version = 1
[2013-07-03 15:12:55.831191] D [fuse-bridge.c:3888:fuse_get_mount_status]
0-fuse: mount status is 0
[2013-07-03 15:12:55.831267] D [fuse-bridge.c:3999:fuse_thread_proc]
0-glusterfs-fuse: terminating upon getting ENODEV when reading /dev/fuse
[2013-07-03 15:12:55.831293] I [fuse-bridge.c:4091:fuse_thread_proc]
0-fuse: unmounting /mnt/gluster
[2013-07-03 15:12:55.831754] W [glusterfsd.c:831:cleanup_and_exit]
(-->/lib64/libc.so.6(clone+0x6d) [0x3a358e890d]
(-->/lib64/libpthread.so.0() [0x3a36007851]
(-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x405d4d]))) 0-:
received signum (15), shutting down
[2013-07-03 15:12:55.831786] D
[glusterfsd-mgmt.c:2178:glusterfs_mgmt_pmap_signout] 0-fsd-mgmt: portmapper
signout arguments not given
[2013-07-03 15:12:55.831810] I [fuse-bridge.c:4648:fini] 0-fuse: Unmounting
'/mnt/gluster'.

and the brick log looks like this

[2013-07-03 19:13:02.423625] D [server-handshake.c:434:server_setvolume]
0-glustervol-server: Connected to ip-10-86-131-26.ec2.internal-
24598-2013/07/03-15:12:51:785215-glustervol-client-0-0
[2013-07-03 19:13:02.423734] D [login.c:47:gf_auth] 0-auth/login: username
not found, returning DONT-CARE
[2013-07-03 19:13:02.423756] D [addr.c:205:gf_auth] 0-/export/brick1:
allowed = "*", received addr = "10.86.131.26"
[2013-07-03 19:13:02.423775] I [server-handshake.c:571:server_setvolume]
0-glustervol-server: accepted client from ip-10-86-131-26.ec2.internal-
24598-2013/07/03-15:12:51:785215-glustervol-client-0-0 (version: 3.3.1)
[2013-07-03 19:13:02.438619] D [socket.c:184:__socket_rwv]
0-tcp.glustervol-server: EOF from peer 10.86.131.26:1014
[2013-07-03 19:13:02.438708] D [socket.c:1798:socket_event_handler]
0-transport: disconnecting now
[2013-07-03 19:13:02.438783] I [server.c:703:server_rpc_notify]
0-glustervol-server: disconnecting connectionfrom
ip-10-86-131-26.ec2.internal-24598-2013/07/03-15:12:51:
785215-glustervol-client-0-0
[2013-07-03 19:13:02.438803] I [server-helpers.c:741:server_connection_put]
0-glustervol-server: Shutting down connection ip-10-86-131-26.ec2.internal-
24598-2013/07/03-15:12:51:785215-glustervol-client-0-0
[2013-07-03 19:13:02.438841] I [server-helpers.c:629:server_connection_destroy]
0-glustervol-server: destroyed connection of ip-10-86-131-26.ec2.internal-
24598-2013/07/03-15:12:51:785215-glustervol-client-0-0

When I try to mount the same volume on Amazon Linux it succeeds.

I am using gluster v3.3.1

I installed gluster on Oracle Linux from the following location

http://download.gluster.org/pub/gluster/glusterfs/3.3/3.3.1/RHEL/epel-6Server/x86_64/

Searched the forum, but couldn't find anything relevant to this.

Any help appreciated.

Thanks
Sankar
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20130704/97f51406/attachment.html>