[2017-08-24 03:11:41.788873] I [fuse-bridge.c:5888:fini] 0-fuse: Closing fuse connection to '/mnt/gluster-brick'. [2017-08-24 03:12:03.414124] I [MSGID: 100030] [glusterfsd.c:2476:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.11.3 (args: /usr/sbin/glusterfs --direct-io-mode=disable --volfile-server=storage-2 --volfile-server=storage-1 --volfile-id=/gv0 /mnt/gluster-brick) [2017-08-24 03:12:03.420831] W [MSGID: 101002] [options.c:954:xl_opt_validate] 0-glusterfs: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction [2017-08-24 03:12:03.421921] I [MSGID: 101190] [event-epoll.c:602:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2017-08-24 03:12:03.426425] I [afr.c:94:fix_quorum_options] 0-gv0-replicate-0: reindeer: incoming qtype = none [2017-08-24 03:12:03.426446] I [afr.c:116:fix_quorum_options] 0-gv0-replicate-0: reindeer: quorum_count = 0 [2017-08-24 03:12:03.427776] I [MSGID: 101190] [event-epoll.c:602:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 [2017-08-24 03:12:03.428245] W [MSGID: 101174] [graph.c:361:_log_if_unknown_option] 0-gv0-readdir-ahead: option 'parallel-readdir' is not recognized [2017-08-24 03:12:03.428542] I [MSGID: 114020] [client.c:2360:notify] 0-gv0-client-0: parent translators are ready, attempting connect on transport [2017-08-24 03:12:03.428947] I [MSGID: 114020] [client.c:2360:notify] 0-gv0-client-1: parent translators are ready, attempting connect on transport Final graph: +------------------------------------------------------------------------------+ 1: volume gv0-client-0 2: type protocol/client 3: option ping-timeout 42 4: option remote-host storage-1 5: option remote-subvolume /data/brick 6: option transport-type socket 7: option transport.address-family inet 8: option username 17aeb9b3-ff6e-45f9-bf02-64abeedaa52a 9: option password 0a1d62d6-522c-4c3b-b2fe-1143be28e5f2 10: option transport.tcp-user-timeout 0 11: option transport.socket.keepalive-time 20 12: option transport.socket.keepalive-interval 2 13: option transport.socket.keepalive-count 9 14: option send-gids true 15: end-volume 16: 17: volume gv0-client-1 18: type protocol/client 19: option ping-timeout 42 20: option remote-host storage-2 21: option remote-subvolume /data/brick 22: option transport-type socket 23: option transport.address-family inet 24: option username 17aeb9b3-ff6e-45f9-bf02-64abeedaa52a 25: option password 0a1d62d6-522c-4c3b-b2fe-1143be28e5f2 26: option transport.tcp-user-timeout 0 27: option transport.socket.keepalive-time 20 28: option transport.socket.keepalive-interval 2 29: option transport.socket.keepalive-count 9 30: option send-gids true 31: end-volume 32: 33: volume gv0-replicate-0 34: type cluster/replicate 35: option afr-pending-xattr gv0-client-0,gv0-client-1 36: option use-compound-fops off 37: subvolumes gv0-client-0 gv0-client-1 38: end-volume 39: 40: volume gv0-dht 41: type cluster/distribute 42: option lock-migration off 43: subvolumes gv0-replicate-0 44: end-volume 45: 46: volume gv0-write-behind 47: type performance/write-behind 48: subvolumes gv0-dht 49: end-volume 50: 51: volume gv0-read-ahead 52: type performance/read-ahead 53: subvolumes gv0-write-behind 54: end-volume 55: 56: volume gv0-readdir-ahead 57: type performance/readdir-ahead 58: option parallel-readdir off 59: option rda-request-size 131072 60: option rda-cache-limit 10MB [2017-08-24 03:12:03.429709] I [rpc-clnt.c:2000:rpc_clnt_reconfig] 0-gv0-client-1: changing port to 49152 (from 0) 61: subvolumes gv0-read-ahead 62: end-volume 63: 64: volume gv0-io-cache 65: type performance/io-cache 66: subvolumes gv0-readdir-ahead 67: end-volume 68: 69: volume gv0-quick-read 70: type performance/quick-read 71: subvolumes gv0-io-cache 72: end-volume 73: 74: volume gv0-open-behind 75: type performance/open-behind 76: subvolumes gv0-quick-read 77: end-volume 78: 79: volume gv0-md-cache 80: type performance/md-cache 81: subvolumes gv0-open-behind 82: end-volume 83: 84: volume gv0 85: type debug/io-stats 86: option log-level INFO 87: option latency-measurement off 88: option count-fop-hits off 89: subvolumes gv0-md-cache 90: end-volume 91: 92: volume meta-autoload 93: type meta 94: subvolumes gv0 95: end-volume 96: +------------------------------------------------------------------------------+ [2017-08-24 03:12:03.430058] I [rpc-clnt.c:2000:rpc_clnt_reconfig] 0-gv0-client-0: changing port to 49152 (from 0) [2017-08-24 03:12:03.430362] I [MSGID: 114057] [client-handshake.c:1451:select_server_supported_programs] 0-gv0-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2017-08-24 03:12:03.430826] I [MSGID: 114057] [client-handshake.c:1451:select_server_supported_programs] 0-gv0-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330) [2017-08-24 03:12:03.431158] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-gv0-client-1: Connected to gv0-client-1, attached to remote volume '/data/brick'. [2017-08-24 03:12:03.431179] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-gv0-client-1: Server and Client lk-version numbers are not same, reopening the fds [2017-08-24 03:12:03.431246] I [MSGID: 108005] [afr-common.c:4879:__afr_handle_child_up_event] 0-gv0-replicate-0: Subvolume 'gv0-client-1' came back up; going online. [2017-08-24 03:12:03.431304] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-gv0-client-1: Server lk version = 1 [2017-08-24 03:12:03.431579] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-gv0-client-0: Connected to gv0-client-0, attached to remote volume '/data/brick'. [2017-08-24 03:12:03.431596] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-gv0-client-0: Server and Client lk-version numbers are not same, reopening the fds [2017-08-24 03:12:03.431772] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-gv0-client-0: Server lk version = 1 [2017-08-24 03:12:03.432841] I [fuse-bridge.c:4202:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.24 kernel 7.23 [2017-08-24 03:12:03.432857] I [fuse-bridge.c:4887:fuse_graph_sync] 0-fuse: switched to graph 0 [2017-08-24 03:12:03.433986] I [MSGID: 108031] [afr-common.c:2349:afr_local_discovery_cbk] 0-gv0-replicate-0: selecting local read_child gv0-client-1 [2017-08-24 03:12:03.434370] I [MSGID: 109063] [dht-layout.c:713:dht_layout_normalize] 0-gv0-dht: Found anomalies in / (gfid = 00000000-0000-0000-0000-000000000001). Holes=1 overlaps=0