[Gluster-users] Issues with geo-rep

Thu Jul 7 21:34:52 UTC 2011

On 07/07/2011 21:32, Csaba Henk wrote:

> file, right (in that case it's not "slave log" but "master side gluster helper's log" :)) ? Can you re-post
> this log after setting the respective log level to DEBUG by the command


Hi

This is the content of 
ssh%3A%2F%2Froot%40192.168.1.32%3Agluster%3A%2F%2F127.0.0.1%3Atest-volume.gluster.log 
on the master (192.168.1.30) in DEBUG log level:

[2011-07-07 23:20:40.580366] D [xlator.c:1245:xlator_dynload] 0-xlator: 
dlsym(reconfigure) on /usr/lib/glusterfs/3.2.1/xlator/mount/fuse.so: 
undefined symbol: reconfigure -- neglecting
[2011-07-07 23:20:40.580542] D [xlator.c:1251:xlator_dynload] 0-xlator: 
dlsym(validate_options) on 
/usr/lib/glusterfs/3.2.1/xlator/mount/fuse.so: undefined symbol: 
validate_options -- neglecting
[2011-07-07 23:20:40.580610] D [glusterfsd.c:314:create_fuse_mount] 0-: 
fuse direct io type 2
[2011-07-07 23:20:40.580688] E [mount.c:532:fuse_mount_sys] 
0-glusterfs-fuse: cannot open /dev/fuse (No such file or directory)
[2011-07-07 23:20:40.580738] I [mount.c:639:gf_fuse_mount] 
0-glusterfs-fuse: direct mount failed (No such file or directory), retry 
to mount via fusermount
[2011-07-07 23:20:40.587808] E [mount.c:669:gf_fuse_mount] 
0-glusterfs-fuse: mount failed
[2011-07-07 23:20:40.587880] E [xlator.c:1390:xlator_init] 0-fuse: 
Initialization of volume 'fuse' failed, review your volfile again
[2011-07-07 23:20:40.587892] D [glusterfsd.c:320:create_fuse_mount] 0-: 
failed to initialize fuse translator
[2011-07-07 23:20:56.330767] D [xlator.c:1245:xlator_dynload] 0-xlator: 
dlsym(reconfigure) on /usr/lib/glusterfs/3.2.1/xlator/mount/fuse.so: 
undefined symbol: reconfigure -- neglecting
[2011-07-07 23:20:56.330933] D [xlator.c:1251:xlator_dynload] 0-xlator: 
dlsym(validate_options) on 
/usr/lib/glusterfs/3.2.1/xlator/mount/fuse.so: undefined symbol: 
validate_options -- neglecting
[2011-07-07 23:20:56.331013] D [glusterfsd.c:314:create_fuse_mount] 0-: 
fuse direct io type 2
[2011-07-07 23:20:56.331091] E [mount.c:532:fuse_mount_sys] 
0-glusterfs-fuse: cannot open /dev/fuse (No such file or directory)
[2011-07-07 23:20:56.331141] I [mount.c:639:gf_fuse_mount] 
0-glusterfs-fuse: direct mount failed (No such file or directory), retry 
to mount via fusermount
[2011-07-07 23:20:56.338303] E [mount.c:669:gf_fuse_mount] 
0-glusterfs-fuse: mount failed
[2011-07-07 23:20:56.338380] E [xlator.c:1390:xlator_init] 0-fuse: 
Initialization of volume 'fuse' failed, review your volfile again
[2011-07-07 23:20:56.338392] D [glusterfsd.c:320:create_fuse_mount] 0-: 
failed to initialize fuse translator


This is the content of 
d3e33c6b-0422-45f9-9dea-613a0d6cfacd\:gluster%3A%2F%2F127.0.0.1%3Atest-volume.gluster.log 
on the slave (192.168.1.32):

[2011-07-07 23:31:18.723550] I [fuse-bridge.c:3218:fuse_thread_proc] 
0-fuse: unmounting /tmp/gsyncd-aux-mount-4Y5c04
[2011-07-07 23:31:18.724447] W [glusterfsd.c:712:cleanup_and_exit] 
(-->/lib/libc.so.6(clone+0x6d) [0x7f6df6d6f02d] 
(-->/lib/libpthread.so.0(+0x68ba) [0x7f6df70078ba] 
(-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xc5) [0x7f6df7cd91b5]))) 
0-: received signum (15), shutting down
[2011-07-07 23:31:19.913152] W [write-behind.c:3029:init] 
0-test-volume-write-behind: disabling write-behind for first 0 bytes
[2011-07-07 23:31:19.921877] I [client.c:1935:notify] 
0-test-volume-client-0: parent translators are ready, attempting connect 
on transport
[2011-07-07 23:31:19.922422] I [client.c:1935:notify] 
0-test-volume-client-1: parent translators are ready, attempting connect 
on transport
Given volfile:
+------------------------------------------------------------------------------+
   1: volume test-volume-client-0
   2:     type protocol/client
   3:     option remote-host 192.168.1.32
   4:     option remote-subvolume /sharedspace
   5:     option transport-type tcp
   6: end-volume
   7:
   8: volume test-volume-client-1
   9:     type protocol/client
  10:     option remote-host 192.168.1.33
  11:     option remote-subvolume /sharedspace
  12:     option transport-type tcp
  13: end-volume
  14:
  15: volume test-volume-replicate-0
  16:     type cluster/replicate
  17:     subvolumes test-volume-client-0 test-volume-client-1
  18: end-volume
  19:
  20: volume test-volume-write-behind
  21:     type performance/write-behind
  22:     subvolumes test-volume-replicate-0
  23: end-volume
  24:
  25: volume test-volume-read-ahead
  26:     type performance/read-ahead
  27:     subvolumes test-volume-write-behind
  28: end-volume
  29:
  30: volume test-volume-io-cache
  31:     type performance/io-cache
  32:     subvolumes test-volume-read-ahead
  33: end-volume
  34:
  35: volume test-volume-quick-read
  36:     type performance/quick-read
  37:     subvolumes test-volume-io-cache
  38: end-volume
  39:
  40: volume test-volume-stat-prefetch
  41:     type performance/stat-prefetch
  42:     subvolumes test-volume-quick-read
  43: end-volume
  44:
  45: volume test-volume
  46:     type debug/io-stats
  47:     option latency-measurement off
  48:     option count-fop-hits off
  49:     subvolumes test-volume-stat-prefetch
  50: end-volume

+------------------------------------------------------------------------------+
[2011-07-07 23:31:19.923390] I [rpc-clnt.c:1531:rpc_clnt_reconfig] 
0-test-volume-client-0: changing port to 24009 (from 0)
[2011-07-07 23:31:19.924266] I [rpc-clnt.c:1531:rpc_clnt_reconfig] 
0-test-volume-client-1: changing port to 24009 (from 0)
[2011-07-07 23:31:23.914694] I 
[client-handshake.c:1082:select_server_supported_programs] 
0-test-volume-client-0: Using Program GlusterFS-3.1.0, Num (1298437), 
Version (310)
[2011-07-07 23:31:23.917203] I 
[client-handshake.c:1082:select_server_supported_programs] 
0-test-volume-client-1: Using Program GlusterFS-3.1.0, Num (1298437), 
Version (310)
[2011-07-07 23:31:23.917381] I 
[client-handshake.c:913:client_setvolume_cbk] 0-test-volume-client-0: 
Connected to 192.168.1.32:24009, attached to remote volume '/sharedspace'.
[2011-07-07 23:31:23.917436] I [afr-common.c:2591:afr_notify] 
0-test-volume-replicate-0: Subvolume 'test-volume-client-0' came back 
up; going online.
[2011-07-07 23:31:23.918928] I 
[client-handshake.c:913:client_setvolume_cbk] 0-test-volume-client-1: 
Connected to 192.168.1.33:24009, attached to remote volume '/sharedspace'.
[2011-07-07 23:31:23.932745] I [fuse-bridge.c:3316:fuse_graph_setup] 
0-fuse: switched to graph 0
[2011-07-07 23:31:23.933474] I [fuse-bridge.c:2897:fuse_init] 
0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 
kernel 7.13
[2011-07-07 23:31:23.934218] I [afr-common.c:902:afr_fresh_lookup_cbk] 
0-test-volume-replicate-0: added root inode

Thanks for your help,
Carl Chenet