[2016-03-10 10:17:10.061946] I [MSGID: 100030] [glusterfsd.c:2318:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.7.6 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level DEBUG) [2016-03-10 10:17:10.063656] D [MSGID: 0] [glusterfsd.c:1984:glusterfs_pidfile_update] 0-glusterfsd: pidfile /var/run/glusterd.pid updated with pid 2262 [2016-03-10 10:17:10.063825] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:17:10.064359] D [MSGID: 0] [glusterfsd.c:638:get_volfp] 0-glusterfsd: loading volume file /etc/glusterfs/glusterd.vol [2016-03-10 10:17:10.069108] I [MSGID: 106478] [glusterd.c:1350:init] 0-management: Maximum allowed open file descriptors set to 65536 [2016-03-10 10:17:10.069164] I [MSGID: 106479] [glusterd.c:1399:init] 0-management: Using /system/glusterd as working directory [2016-03-10 10:17:10.069532] D [MSGID: 0] [glusterd.c:410:glusterd_rpcsvc_options_build] 0-glusterd: listen-backlog value: 128 [2016-03-10 10:17:10.069855] D [rpcsvc.c:2317:rpcsvc_init] 0-rpc-service: RPC service inited. [2016-03-10 10:17:10.069898] D [rpcsvc.c:1874:rpcsvc_program_register] 0-rpc-service: New program registered: GF-DUMP, Num: 123451501, Ver: 1, Port: 0 [2016-03-10 10:17:10.069982] D [rpc-transport.c:288:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.6/rpc-transport/socket.so [2016-03-10 10:17:10.081052] D [socket.c:3845:socket_init] 0-socket.management: Configued transport.tcp-user-timeout=0 [2016-03-10 10:17:10.081088] D [socket.c:3928:socket_init] 0-socket.management: SSL support on the I/O path is NOT enabled [2016-03-10 10:17:10.081107] D [socket.c:3931:socket_init] 0-socket.management: SSL support for glusterd is NOT enabled [2016-03-10 10:17:10.081125] D [socket.c:3948:socket_init] 0-socket.management: using system polling thread [2016-03-10 10:17:10.081164] D [name.c:564:server_fill_address_family] 0-socket.management: option address-family not specified, defaulting to inet [2016-03-10 10:17:10.081395] D [rpcsvc.c:1874:rpcsvc_program_register] 0-rpc-service: New program registered: GlusterD svc peer, Num: 1238437, Ver: 2, Port: 0 [2016-03-10 10:17:10.081419] D [rpcsvc.c:1874:rpcsvc_program_register] 0-rpc-service: New program registered: GlusterD svc cli read-only, Num: 1238463, Ver: 2, Port: 0 [2016-03-10 10:17:10.081440] D [rpcsvc.c:1874:rpcsvc_program_register] 0-rpc-service: New program registered: GlusterD svc mgmt, Num: 1238433, Ver: 2, Port: 0 [2016-03-10 10:17:10.081474] D [rpcsvc.c:1874:rpcsvc_program_register] 0-rpc-service: New program registered: GlusterD svc mgmt v3, Num: 1238433, Ver: 3, Port: 0 [2016-03-10 10:17:10.081496] D [rpcsvc.c:1874:rpcsvc_program_register] 0-rpc-service: New program registered: Gluster Portmap, Num: 34123456, Ver: 1, Port: 0 [2016-03-10 10:17:10.081517] D [rpcsvc.c:1874:rpcsvc_program_register] 0-rpc-service: New program registered: Gluster Handshake, Num: 14398633, Ver: 2, Port: 0 [2016-03-10 10:17:10.081547] D [rpcsvc.c:1874:rpcsvc_program_register] 0-rpc-service: New program registered: Gluster MGMT Handshake, Num: 1239873, Ver: 1, Port: 0 [2016-03-10 10:17:10.081636] D [rpcsvc.c:2317:rpcsvc_init] 0-rpc-service: RPC service inited. [2016-03-10 10:17:10.081658] D [rpcsvc.c:1874:rpcsvc_program_register] 0-rpc-service: New program registered: GF-DUMP, Num: 123451501, Ver: 1, Port: 0 [2016-03-10 10:17:10.081698] D [rpc-transport.c:288:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.6/rpc-transport/socket.so [2016-03-10 10:17:10.081782] D [socket.c:3794:socket_init] 0-socket.management: disabling nodelay [2016-03-10 10:17:10.081808] D [socket.c:3845:socket_init] 0-socket.management: Configued transport.tcp-user-timeout=0 [2016-03-10 10:17:10.081833] D [socket.c:3928:socket_init] 0-socket.management: SSL support on the I/O path is NOT enabled [2016-03-10 10:17:10.081851] D [socket.c:3931:socket_init] 0-socket.management: SSL support for glusterd is NOT enabled [2016-03-10 10:17:10.081876] D [socket.c:3948:socket_init] 0-socket.management: using system polling thread [2016-03-10 10:17:10.082010] D [rpcsvc.c:1874:rpcsvc_program_register] 0-rpc-service: New program registered: GlusterD svc cli, Num: 1238463, Ver: 2, Port: 0 [2016-03-10 10:17:10.082033] D [rpcsvc.c:1874:rpcsvc_program_register] 0-rpc-service: New program registered: Gluster Handshake (CLI Getspec), Num: 14398633, Ver: 2, Port: 0 [2016-03-10 10:17:10.082121] D [MSGID: 0] [glusterd-utils.c:5974:glusterd_sm_tr_log_init] 0-glusterd: returning 0 [2016-03-10 10:17:10.082154] D [MSGID: 0] [glusterd.c:1691:init] 0-management: cannot get run-with-valgrind value [2016-03-10 10:17:10.085831] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:10.085861] D [MSGID: 0] [store.c:439:gf_store_handle_retrieve] 0-: Returning 0 [2016-03-10 10:17:10.086225] D [MSGID: 0] [store.c:307:gf_store_retrieve_value] 0-: key operating-version found [2016-03-10 10:17:10.086294] I [MSGID: 106513] [glusterd-store.c:2047:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 30706 [2016-03-10 10:17:10.086679] D [MSGID: 0] [glusterd-utils.c:512:glusterd_volinfo_new] 0-management: Returning 0 [2016-03-10 10:17:10.093600] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:10.093629] D [MSGID: 0] [store.c:439:gf_store_handle_retrieve] 0-: Returning 0 [2016-03-10 10:17:10.093680] D [MSGID: 0] [store.c:501:gf_store_iter_new] 0-: Returning with 0 [2016-03-10 10:17:10.093979] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094007] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = type value = 2 [2016-03-10 10:17:10.094045] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094071] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = count value = 2 [2016-03-10 10:17:10.094112] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094139] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = status value = 1 [2016-03-10 10:17:10.094180] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094206] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = sub_count value = 2 [2016-03-10 10:17:10.094243] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094269] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = stripe_count value = 1 [2016-03-10 10:17:10.094306] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094332] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = replica_count value = 2 [2016-03-10 10:17:10.094369] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094395] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = disperse_count value = 0 [2016-03-10 10:17:10.094432] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094468] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = redundancy_count value = 0 [2016-03-10 10:17:10.094511] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094537] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = version value = 54 [2016-03-10 10:17:10.094574] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094600] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = transport-type value = 0 [2016-03-10 10:17:10.094637] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094663] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = volume-id value = c11f1f13-64a0-4aca-98b5-91d609a4a18d [2016-03-10 10:17:10.094750] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094778] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = username value = 14b08558-77c8-4610-a4cc-2e2f79d8252f [2016-03-10 10:17:10.094822] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094849] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = password value = 92513bab-e703-48f0-b5f5-1f23d71d33d8 [2016-03-10 10:17:10.094887] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094913] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = op-version value = 3 [2016-03-10 10:17:10.094958] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.094984] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = client-op-version value = 3 [2016-03-10 10:17:10.095022] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.095048] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = quota-version value = 0 [2016-03-10 10:17:10.095087] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.095113] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = parent_volname value = N/A [2016-03-10 10:17:10.095151] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.095177] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = restored_from_snap value = 00000000-0000-0000-0000-000000000000 [2016-03-10 10:17:10.095217] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.095243] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = snap-max-hard-limit value = 256 [2016-03-10 10:17:10.095281] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.095307] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = performance.readdir-ahead value = on [2016-03-10 10:17:10.095380] D [MSGID: 0] [glusterd-store.c:2725:glusterd_store_update_volinfo] 0-management: Parsed as Volume-set:key=performance.readdir-ahead,value:on [2016-03-10 10:17:10.095419] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.095445] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = network.ping-timeout value = 4 [2016-03-10 10:17:10.095504] D [MSGID: 0] [glusterd-store.c:2725:glusterd_store_update_volinfo] 0-management: Parsed as Volume-set:key=network.ping-timeout,value:4 [2016-03-10 10:17:10.095542] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.095569] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = nfs.disable value = on [2016-03-10 10:17:10.095624] D [MSGID: 0] [glusterd-store.c:2725:glusterd_store_update_volinfo] 0-management: Parsed as Volume-set:key=nfs.disable,value:on [2016-03-10 10:17:10.095662] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.095688] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = brick-0 value = 10.32.1.144:-opt-lvmdir-c2-brick [2016-03-10 10:17:10.095728] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.095754] D [MSGID: 0] [glusterd-store.c:2567:glusterd_store_update_volinfo] 0-management: key = brick-1 value = 10.32.0.48:-opt-lvmdir-c2-brick [2016-03-10 10:17:10.095793] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with -1 [2016-03-10 10:17:10.095886] D [MSGID: 0] [store.c:501:gf_store_iter_new] 0-: Returning with 0 [2016-03-10 10:17:10.095941] D [MSGID: 0] [glusterd-utils.c:884:glusterd_brickinfo_new] 0-management: Returning 0 [2016-03-10 10:17:10.096002] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.096588] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0" repeated 22 times between [2016-03-10 10:17:10.096002] and [2016-03-10 10:17:10.096283] [2016-03-10 10:17:10.096587] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:10.096660] D [MSGID: 0] [store.c:439:gf_store_handle_retrieve] 0-: Returning 0 [2016-03-10 10:17:10.096708] D [MSGID: 0] [store.c:501:gf_store_iter_new] 0-: Returning with 0 [2016-03-10 10:17:10.096983] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.097137] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0" repeated 7 times between [2016-03-10 10:17:10.096983] and [2016-03-10 10:17:10.097123] [2016-03-10 10:17:10.097137] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with -1 [2016-03-10 10:17:10.097249] D [MSGID: 0] [glusterd-utils.c:884:glusterd_brickinfo_new] 0-management: Returning 0 [2016-03-10 10:17:10.097290] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:10.102628] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:10.102656] D [MSGID: 0] [store.c:439:gf_store_handle_retrieve] 0-: Returning 0 [2016-03-10 10:17:10.102706] D [MSGID: 0] [store.c:501:gf_store_iter_new] 0-: Returning with 0 [2016-03-10 10:17:10.103010] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:11.398948] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0" repeated 7 times between [2016-03-10 10:17:10.103010] and [2016-03-10 10:17:11.398930] [2016-03-10 10:17:11.398946] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with -1 [2016-03-10 10:17:11.399122] D [MSGID: 0] [glusterd-store.c:2402:glusterd_store_retrieve_bricks] 0-management: Returning with 0 [2016-03-10 10:17:11.400211] D [MSGID: 0] [glusterd-utils.c:2052:glusterd_volume_compute_cksum] 0-management: Returning with 0 [2016-03-10 10:17:11.408400] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:11.408562] D [MSGID: 0] [glusterd-store.c:4376:glusterd_store_retrieve_quota_version] 0-management: Version absent [2016-03-10 10:17:11.408594] D [MSGID: 0] [store.c:460:gf_store_handle_destroy] 0-: Returning 0 [2016-03-10 10:17:11.415091] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:11.415272] D [MSGID: 0] [glusterd-utils.c:2052:glusterd_volume_compute_cksum] 0-management: Returning with 0 [2016-03-10 10:17:11.421781] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:11.422028] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:11.436501] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:11.422109] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:11.436498] D [MSGID: 0] [store.c:460:gf_store_handle_destroy] 0-: Returning 0 [2016-03-10 10:17:11.436705] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:11.436733] D [MSGID: 0] [store.c:439:gf_store_handle_retrieve] 0-: Returning 0 [2016-03-10 10:17:11.436786] D [MSGID: 0] [store.c:501:gf_store_iter_new] 0-: Returning with 0 [2016-03-10 10:17:11.437149] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:11.437245] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0" repeated 3 times between [2016-03-10 10:17:11.437149] and [2016-03-10 10:17:11.437226] [2016-03-10 10:17:11.437244] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with -1 [2016-03-10 10:17:11.437372] D [MSGID: 0] [glusterd-store.c:3067:glusterd_store_retrieve_volumes] 0-management: Returning with 0 [2016-03-10 10:17:11.444234] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:11.444292] D [MSGID: 0] [store.c:439:gf_store_handle_retrieve] 0-: Returning 0 [2016-03-10 10:17:11.444345] D [MSGID: 0] [store.c:501:gf_store_iter_new] 0-: Returning with 0 [2016-03-10 10:17:11.444690] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:11.444735] D [MSGID: 0] [glusterd-utils.c:5974:glusterd_sm_tr_log_init] 0-glusterd: returning 0 [2016-03-10 10:17:11.444782] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:11.444832] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:11.444820] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:11.444831] D [MSGID: 0] [glusterd-peer-utils.c:458:glusterd_peer_hostname_new] 0-glusterd: Returning 0 [2016-03-10 10:17:11.444911] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with -1 [2016-03-10 10:17:11.444987] I [MSGID: 106498] [glusterd-handler.c:3579:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0 [2016-03-10 10:17:11.445135] D [MSGID: 0] [glusterd-handler.c:3391:glusterd_transport_inet_options_build] 0-glusterd: Returning 0 [2016-03-10 10:17:11.445205] I [rpc-clnt.c:984:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 [2016-03-10 10:17:11.445229] D [rpc-clnt.c:996:rpc_clnt_connection_init] 0-management: setting ping-timeout to 30 [2016-03-10 10:17:11.445259] D [rpc-transport.c:288:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.6/rpc-transport/socket.so [2016-03-10 10:17:11.445386] D [socket.c:3845:socket_init] 0-management: Configued transport.tcp-user-timeout=-1 [2016-03-10 10:17:11.445414] D [socket.c:3928:socket_init] 0-management: SSL support on the I/O path is NOT enabled [2016-03-10 10:17:11.445433] D [socket.c:3931:socket_init] 0-management: SSL support for glusterd is NOT enabled [2016-03-10 10:17:11.445464] D [socket.c:3948:socket_init] 0-management: using system polling thread [2016-03-10 10:17:11.447044] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:17:11.447085] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:17:11.447137] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 13, Invalid argument [2016-03-10 10:17:11.447161] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:17:11.447600] D [MSGID: 0] [glusterd-handler.c:3323:glusterd_rpc_create] 0-management: returning 0 [2016-03-10 10:17:11.447644] D [MSGID: 0] [glusterd-store.c:4118:glusterd_store_retrieve_peers] 0-management: Returning with 0 [2016-03-10 10:17:11.448129] D [MSGID: 0] [glusterd-store.c:3501:glusterd_store_retrieve_missed_snaps_list] 0-management: EOF for missed_snap_list [2016-03-10 10:17:11.448167] D [MSGID: 0] [glusterd-store.c:3607:glusterd_store_retrieve_snaps] 0-management: Returning with 0 [2016-03-10 10:17:11.448207] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:11.448237] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:11.448271] D [MSGID: 0] [glusterd-utils.c:925:glusterd_resolve_brick] 0-management: Returning 0 [2016-03-10 10:17:11.448600] D [MSGID: 0] [glusterd-peer-utils.c:133:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: 10.32.0.48 [2016-03-10 10:17:11.448710] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:11.449306] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:11.449392] D [MSGID: 0] [store.c:307:gf_store_retrieve_value] 0-: key UUID found [2016-03-10 10:17:11.449483] D [MSGID: 0] [glusterd-store.c:2122:glusterd_retrieve_uuid] 0-management: Returning 0 [2016-03-10 10:17:11.449549] I [MSGID: 106544] [glusterd.c:159:glusterd_uuid_init] 0-management: retrieved UUID: f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:17:11.449579] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:11.449606] D [MSGID: 0] [glusterd-utils.c:925:glusterd_resolve_brick] 0-management: Returning 0 [2016-03-10 10:17:11.449640] D [MSGID: 0] [glusterd-store.c:4339:glusterd_restore] 0-management: Returning 0 [2016-03-10 10:17:11.455122] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:11.455178] D [MSGID: 0] [store.c:439:gf_store_handle_retrieve] 0-: Returning 0 [2016-03-10 10:17:11.455234] D [MSGID: 0] [store.c:501:gf_store_iter_new] 0-: Returning with 0 [2016-03-10 10:17:11.455564] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with 0 [2016-03-10 10:17:11.455610] D [MSGID: 0] [store.c:613:gf_store_iter_get_next] 0-: Returning with -1 [2016-03-10 10:17:11.455677] D [MSGID: 0] [store.c:460:gf_store_handle_destroy] 0-: Returning 0 Final graph: [2016-03-10 10:17:11.455925] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 +------------------------------------------------------------------------------+ 1: volume management 2: type mgmt/glusterd 3: option rpc-auth.auth-glusterfs on 4: option rpc-auth.auth-unix on [2016-03-10 10:17:11.456014] E [socket.c:2278:socket_connect_finish] 0-management: connection to 10.32.1.144:24007 failed (Connection refused) 5: option rpc-auth.auth-null on 6: option rpc-auth-allow-insecure on [2016-03-10 10:17:11.456059] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected 7: option transport.socket.listen-backlog 128 [2016-03-10 10:17:11.456094] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now 8: option ping-timeout 30 9: option transport.socket.read-fail-log off 10: option transport.socket.keepalive-interval 2 11: option transport.socket.keepalive-time 10 12: option transport-type socket 13: option working-directory /system/glusterd 14: end-volume 15: +------------------------------------------------------------------------------+ [2016-03-10 10:17:11.456435] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-03-10 10:17:11.456511] I [MSGID: 101190] [event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 [2016-03-10 10:17:11.456631] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:17:11.456733] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:11.456780] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:17:11.456842] D [MSGID: 0] [glusterd-utils.c:173:glusterd_lock] 0-management: Cluster lock held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:17:11.456888] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=2 from gen=1 to slot->gen=2, fd=13, slot->fd=13 [2016-03-10 10:17:11.535024] I [MSGID: 106488] [glusterd-handler.c:1472:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req [2016-03-10 10:17:11.535115] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:11.535143] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:11.537908] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:11.537957] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:11.538034] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=2 from gen=4 to slot->gen=5, fd=7, slot->fd=7 [2016-03-10 10:17:11.584281] I [MSGID: 106488] [glusterd-handler.c:1472:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req [2016-03-10 10:17:11.584356] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:11.584385] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:11.586591] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:11.586629] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:11.586670] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=2 from gen=7 to slot->gen=8, fd=7, slot->fd=7 [2016-03-10 10:17:11.633067] D [MSGID: 0] [glusterd-handler.c:2050:__glusterd_handle_set_volume] 0-management: Received volume set request for volume c_glusterfs [2016-03-10 10:17:11.633318] D [MSGID: 0] [glusterd-op-sm.c:214:glusterd_generate_txn_id] 0-management: Transaction_id = 0c1394a4-7c48-4f15-b241-116d1eeaaa6e [2016-03-10 10:17:11.633369] D [MSGID: 0] [glusterd-op-sm.c:311:glusterd_set_txn_opinfo] 0-management: Successfully set opinfo for transaction ID : 0c1394a4-7c48-4f15-b241-116d1eeaaa6e [2016-03-10 10:17:11.633403] D [MSGID: 0] [glusterd-op-sm.c:318:glusterd_set_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:11.633434] D [MSGID: 0] [glusterd-syncop.c:1767:gd_sync_task_begin] 0-management: Transaction ID : 0c1394a4-7c48-4f15-b241-116d1eeaaa6e [2016-03-10 10:17:11.633502] D [MSGID: 0] [glusterd-locks.c:562:glusterd_mgmt_v3_lock] 0-management: Trying to acquire lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:17:11.634100] D [MSGID: 0] [glusterd-locks.c:618:glusterd_mgmt_v3_lock] 0-management: Lock for vol c_glusterfs successfully held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:17:11.634174] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:11.634203] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:11.634289] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:11.634317] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:11.634361] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:11.634389] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:11.634415] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:11.634441] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:11.634651] D [MSGID: 0] [glusterd-volgen.c:5913:glusterd_validate_brickreconf] 0-glusterd: Validating 10.32.1.144 [2016-03-10 10:17:11.635378] D [MSGID: 0] [glusterd-volgen.c:1268:server_check_marker_off] 0-glusterd: Returning 0 [2016-03-10 10:17:11.636997] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-posix: Validated options [2016-03-10 10:17:11.637480] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-trash: Validated options [2016-03-10 10:17:11.638238] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-changelog: Validated options [2016-03-10 10:17:11.638668] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-bitrot-stub: Validated options [2016-03-10 10:17:11.639142] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-access-control: Validated options [2016-03-10 10:17:11.639779] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-locks: Validated options [2016-03-10 10:17:11.640217] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-upcall: Validated options [2016-03-10 10:17:11.640742] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-io-threads: Validated options [2016-03-10 10:17:11.641476] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-marker: Validated options [2016-03-10 10:17:11.641833] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-barrier: Validated options [2016-03-10 10:17:11.642313] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-index: Validated options [2016-03-10 10:17:11.643108] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-quota: Validated options [2016-03-10 10:17:11.643418] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-worm: Validated options [2016-03-10 10:17:11.643748] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-read-only: Validated options [2016-03-10 10:17:11.644398] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-/opt/lvmdir/c2/brick: Validated options [2016-03-10 10:17:11.645794] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-server: Validated options [2016-03-10 10:17:11.646867] D [MSGID: 0] [glusterd-volgen.c:5899:validate_brickopts] 0-glusterd: Returning 0 [2016-03-10 10:17:11.646903] D [MSGID: 0] [glusterd-volgen.c:5913:glusterd_validate_brickreconf] 0-glusterd: Validating 10.32.0.48 [2016-03-10 10:17:11.647620] D [MSGID: 0] [glusterd-volgen.c:1268:server_check_marker_off] 0-glusterd: Returning 0 [2016-03-10 10:17:11.649076] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-posix: Validated options [2016-03-10 10:17:11.649513] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-trash: Validated options [2016-03-10 10:17:11.650244] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-changelog: Validated options [2016-03-10 10:17:11.650652] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-bitrot-stub: Validated options [2016-03-10 10:17:11.651070] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-access-control: Validated options [2016-03-10 10:17:11.651773] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-locks: Validated options [2016-03-10 10:17:11.652224] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-upcall: Validated options [2016-03-10 10:17:11.652750] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-io-threads: Validated options [2016-03-10 10:17:11.653486] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-marker: Validated options [2016-03-10 10:17:11.653817] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-barrier: Validated options [2016-03-10 10:17:11.654242] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-index: Validated options [2016-03-10 10:17:11.654896] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-quota: Validated options [2016-03-10 10:17:11.655134] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-worm: Validated options [2016-03-10 10:17:11.655410] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-read-only: Validated options [2016-03-10 10:17:11.656050] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-/opt/lvmdir/c2/brick: Validated options [2016-03-10 10:17:11.657439] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-server: Validated options [2016-03-10 10:17:11.658481] D [MSGID: 0] [glusterd-volgen.c:5899:validate_brickopts] 0-glusterd: Returning 0 [2016-03-10 10:17:11.658622] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:11.658653] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:11.658683] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.1.144:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:11.658710] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:11.659044] D [MSGID: 0] [glusterd-peer-utils.c:133:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: 10.32.0.48 [2016-03-10 10:17:11.659138] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:11.659699] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:11.659733] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:11.659761] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.0.48:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:11.659788] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:11.661491] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-client-7: Validated options [2016-03-10 10:17:11.661559] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-client-8: Validated options [2016-03-10 10:17:11.662940] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-replicate-0: Validated options [2016-03-10 10:17:11.664180] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-dht: Validated options [2016-03-10 10:17:11.664601] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-write-behind: Validated options [2016-03-10 10:17:11.664933] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-read-ahead: Validated options [2016-03-10 10:17:11.665177] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-readdir-ahead: Validated options [2016-03-10 10:17:11.665650] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-io-cache: Validated options [2016-03-10 10:17:11.666002] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-quick-read: Validated options [2016-03-10 10:17:11.666364] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-open-behind: Validated options [2016-03-10 10:17:11.666813] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-md-cache: Validated options [2016-03-10 10:17:11.667373] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs: Validated options [2016-03-10 10:17:11.668035] D [MSGID: 0] [glusterd-volgen.c:5876:validate_clientopts] 0-glusterd: Returning 0 [2016-03-10 10:17:11.668241] D [MSGID: 0] [glusterd-volgen.c:4809:build_nfs_graph] 0-glusterd: Returning 0 [2016-03-10 10:17:11.671107] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-nfs-server: Validated options [2016-03-10 10:17:11.671325] D [MSGID: 0] [glusterd-volgen.c:5853:validate_nfsopts] 0-management: Returning 0 [2016-03-10 10:17:11.671582] D [MSGID: 0] [glusterd-volgen.c:881:_xl_link_children] 0-management: glustershd:c_glusterfs-replicate-0 [2016-03-10 10:17:11.673032] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-client-7: Validated options [2016-03-10 10:17:11.673106] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-client-8: Validated options [2016-03-10 10:17:11.674480] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-c_glusterfs-replicate-0: Validated options [2016-03-10 10:17:11.674966] D [MSGID: 0] [options.c:1060:xlator_validate_rec] 0-glustershd: Validated options [2016-03-10 10:17:11.675185] D [MSGID: 0] [glusterd-volgen.c:5793:validate_shdopts] 0-glusterd: Returning 0 [2016-03-10 10:17:11.675218] D [MSGID: 0] [glusterd-volgen.c:6039:glusterd_validate_reconfopts] 0-glusterd: Returning 0 [2016-03-10 10:17:11.675273] D [MSGID: 0] [glusterd-op-sm.c:5515:glusterd_op_stage_validate] 0-management: OP = 11. Returning 0 [2016-03-10 10:17:11.675324] D [MSGID: 0] [glusterd-op-sm.c:7010:glusterd_op_bricks_select] 0-management: Returning 0 [2016-03-10 10:17:11.675353] D [MSGID: 0] [glusterd-syncop.c:1709:gd_brick_op_phase] 0-management: Sent op req to 0 bricks [2016-03-10 10:17:11.675782] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:11.675816] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:11.678584] D [MSGID: 0] [xlator.c:163:xlator_volopt_dynload] 0-xlator: Returning 0 [2016-03-10 10:17:11.678622] D [MSGID: 0] [glusterd-volgen.c:2663:_get_xlator_opt_key_from_vme] 0-glusterd: Returning 0 [2016-03-10 10:17:11.679652] D [MSGID: 0] [xlator.c:163:xlator_volopt_dynload] 0-xlator: Returning 0 [2016-03-10 10:17:11.679683] D [MSGID: 0] [glusterd-volgen.c:2663:_get_xlator_opt_key_from_vme] 0-glusterd: Returning 0 [2016-03-10 10:17:11.679983] I [rpc-clnt.c:984:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600 [2016-03-10 10:17:11.680005] D [rpc-clnt.c:1001:rpc_clnt_connection_init] 0-snapd: disable ping-timeout [2016-03-10 10:17:11.680035] D [rpc-transport.c:288:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.6/rpc-transport/socket.so [2016-03-10 10:17:11.680119] D [socket.c:3794:socket_init] 0-snapd: disabling nodelay [2016-03-10 10:17:11.680142] D [socket.c:3845:socket_init] 0-snapd: Configued transport.tcp-user-timeout=0 [2016-03-10 10:17:11.680168] D [socket.c:3928:socket_init] 0-snapd: SSL support on the I/O path is NOT enabled [2016-03-10 10:17:11.680185] D [socket.c:3931:socket_init] 0-snapd: SSL support for glusterd is NOT enabled [2016-03-10 10:17:11.680203] D [socket.c:3948:socket_init] 0-snapd: using system polling thread [2016-03-10 10:17:11.680318] D [MSGID: 0] [glusterd-snapd-svc.c:116:glusterd_snapdsvc_init] 0-management: Returning 0 [2016-03-10 10:17:11.680346] D [MSGID: 0] [glusterd-snapd-svc.c:140:glusterd_snapdsvc_manager] 0-management: snapd service initialized [2016-03-10 10:17:11.680379] D [MSGID: 0] [glusterd-snapshot-utils.c:3595:glusterd_is_snapd_enabled] 0-management: Key features.uss not present in the dict for volume c_glusterfs [2016-03-10 10:17:11.680735] D [MSGID: 0] [glusterd-snapd-svc.c:206:glusterd_snapdsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:11.680873] D [MSGID: 0] [glusterd-volgen.c:5109:generate_brick_volfiles] 0-management: Found a brick - 10.32.1.144:/opt/lvmdir/c2/brick [2016-03-10 10:17:11.681516] D [MSGID: 0] [glusterd-volgen.c:1268:server_check_marker_off] 0-glusterd: Returning 0 [2016-03-10 10:17:11.682476] D [MSGID: 0] [glusterd-volgen.c:5109:generate_brick_volfiles] 0-management: Found a brick - 10.32.0.48:/opt/lvmdir/c2/brick [2016-03-10 10:17:11.683141] D [MSGID: 0] [glusterd-volgen.c:1268:server_check_marker_off] 0-glusterd: Returning 0 [2016-03-10 10:17:11.683954] D [MSGID: 0] [glusterd-volgen.c:5120:generate_brick_volfiles] 0-management: Returning 0 [2016-03-10 10:17:11.684099] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:11.684129] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:11.684159] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.1.144:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:11.684193] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:11.684527] D [MSGID: 0] [glusterd-peer-utils.c:133:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: 10.32.0.48 [2016-03-10 10:17:11.684623] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:11.685202] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:11.685234] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:11.685262] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.0.48:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:11.685288] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:11.686825] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:11.686857] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:11.686885] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.1.144:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:11.686912] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:11.687186] D [MSGID: 0] [glusterd-peer-utils.c:133:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: 10.32.0.48 [2016-03-10 10:17:11.687278] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:11.687717] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:11.687749] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:11.687777] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.0.48:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:11.687805] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:11.689214] D [MSGID: 0] [glusterd-store.c:1058:glusterd_store_create_volume_dir] 0-management: Returning with 0 [2016-03-10 10:17:11.689369] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:11.698893] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 18 times between [2016-03-10 10:17:11.689369] and [2016-03-10 10:17:11.690388] [2016-03-10 10:17:11.698891] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:11.699130] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:11.699161] D [MSGID: 0] [glusterd-store.c:440:glusterd_store_snapd_write] 0-management: Returning 0 [2016-03-10 10:17:11.712642] D [MSGID: 0] [glusterd-store.c:503:glusterd_store_perform_snapd_store] 0-management: Returning 0 [2016-03-10 10:17:11.712688] D [MSGID: 0] [glusterd-store.c:568:glusterd_store_snapd_info] 0-management: Returning with 0 [2016-03-10 10:17:11.712759] D [MSGID: 0] [glusterd-store.c:753:_storeopts] 0-management: Storing in volinfo:key= nfs.disable, val=on [2016-03-10 10:17:11.712868] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:11.712905] D [MSGID: 0] [glusterd-store.c:753:_storeopts] 0-management: Storing in volinfo:key= network.ping-timeout, val=4 [2016-03-10 10:17:11.712982] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:11.713019] D [MSGID: 0] [glusterd-store.c:753:_storeopts] 0-management: Storing in volinfo:key= performance.readdir-ahead, val=on [2016-03-10 10:17:11.713105] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:11.713137] D [MSGID: 0] [glusterd-store.c:1104:glusterd_store_volinfo_write] 0-management: Returning 0 [2016-03-10 10:17:11.713222] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:11.713816] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 8 times between [2016-03-10 10:17:11.713222] and [2016-03-10 10:17:11.713812] [2016-03-10 10:17:11.713815] D [MSGID: 0] [glusterd-store.c:414:glusterd_store_brickinfo_write] 0-management: Returning 0 [2016-03-10 10:17:11.713892] D [MSGID: 0] [glusterd-store.c:464:glusterd_store_perform_brick_store] 0-management: Returning 0 [2016-03-10 10:17:11.713918] D [MSGID: 0] [glusterd-store.c:533:glusterd_store_brickinfo] 0-management: Returning with 0 [2016-03-10 10:17:11.714002] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:11.714545] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 8 times between [2016-03-10 10:17:11.714002] and [2016-03-10 10:17:11.714541] [2016-03-10 10:17:11.714544] D [MSGID: 0] [glusterd-store.c:414:glusterd_store_brickinfo_write] 0-management: Returning 0 [2016-03-10 10:17:11.714622] D [MSGID: 0] [glusterd-store.c:464:glusterd_store_perform_brick_store] 0-management: Returning 0 [2016-03-10 10:17:11.714649] D [MSGID: 0] [glusterd-store.c:533:glusterd_store_brickinfo] 0-management: Returning with 0 [2016-03-10 10:17:11.714676] D [MSGID: 0] [glusterd-store.c:1325:glusterd_store_brickinfos] 0-management: Returning 0 [2016-03-10 10:17:11.714702] D [MSGID: 0] [glusterd-store.c:1439:glusterd_store_perform_volume_store] 0-management: Returning 0 [2016-03-10 10:17:11.757359] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:11.757616] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 3 times between [2016-03-10 10:17:11.757359] and [2016-03-10 10:17:11.757611] [2016-03-10 10:17:11.757614] D [MSGID: 0] [glusterd-store.c:1383:glusterd_store_node_state_write] 0-management: Returning 0 [2016-03-10 10:17:11.772680] D [MSGID: 0] [glusterd-store.c:1411:glusterd_store_perform_node_state_store] 0-management: Returning 0 [2016-03-10 10:17:11.773187] D [MSGID: 0] [glusterd-utils.c:2052:glusterd_volume_compute_cksum] 0-management: Returning with 0 [2016-03-10 10:17:11.773221] D [MSGID: 0] [glusterd-store.c:1645:glusterd_store_volinfo] 0-management: Returning 0 [2016-03-10 10:17:11.773249] W [glusterd-nfs-svc.c:157:glusterd_nfssvc_reconfigure] 0-management: nfs_svc.name is empty using: nfs [2016-03-10 10:17:11.773269] I [glusterd-nfs-svc.c:159:glusterd_nfssvc_reconfigure] 0-management: copying nfs_svc_name to priv->nfs_svc.name: nfs [2016-03-10 10:17:11.773514] D [MSGID: 0] [glusterd-volgen.c:4809:build_nfs_graph] 0-glusterd: Returning 0 [2016-03-10 10:17:11.774961] D [MSGID: 0] [glusterd-utils.c:7307:glusterd_check_files_identical] 0-management: Returning with 0 [2016-03-10 10:17:11.775019] D [MSGID: 0] [glusterd-nfs-svc.c:209:glusterd_nfssvc_reconfigure] 0-management: Returning 0 [2016-03-10 10:17:11.775048] W [glusterd-shd-svc.c:203:glusterd_shdsvc_reconfigure] 0-management: shd_svc.name is empty using: glustershd [2016-03-10 10:17:11.775068] I [glusterd-shd-svc.c:205:glusterd_shdsvc_reconfigure] 0-management: copying shd_svc_name to priv->shd_svc.name: glustershd [2016-03-10 10:17:11.775528] W [dict.c:1452:dict_get_with_ref] (-->/usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(build_shd_graph-0xe1978) [0x3fff91fe4170] -->/usr/lib64/libglusterfs.so.0(dict_get_str_boolean-0xbd2e0) [0x3fff9564a1a8] -->/usr/lib64/libglusterfs.so.0(+0x33b84) [0x3fff95646b84] ) 0-dict: dict OR key (graph-check) is NULL [Invalid argument] [2016-03-10 10:17:11.775787] D [MSGID: 0] [glusterd-volgen.c:881:_xl_link_children] 0-management: glustershd:c_glusterfs-replicate-0 [2016-03-10 10:17:11.776824] D [MSGID: 0] [glusterd-utils.c:7307:glusterd_check_files_identical] 0-management: Returning with 0 [2016-03-10 10:17:11.777053] W [dict.c:1452:dict_get_with_ref] (-->/usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(build_shd_graph-0xe1978) [0x3fff91fe4170] -->/usr/lib64/libglusterfs.so.0(dict_get_str_boolean-0xbd2e0) [0x3fff9564a1a8] -->/usr/lib64/libglusterfs.so.0(+0x33b84) [0x3fff95646b84] ) 0-dict: dict OR key (graph-check) is NULL [Invalid argument] [2016-03-10 10:17:11.777264] D [MSGID: 0] [glusterd-volgen.c:881:_xl_link_children] 0-management: glustershd:c_glusterfs-replicate-0 [2016-03-10 10:17:11.782119] D [graph.c:769:is_graph_topology_equal] 0-glusterfsd-mgmt: graphs are equal [2016-03-10 10:17:11.782393] D [MSGID: 0] [glusterd-utils.c:7246:glusterd_check_topology_identical] 0-management: Returning with 0 [2016-03-10 10:17:11.782790] D [MSGID: 0] [glusterd-volgen.c:881:_xl_link_children] 0-management: glustershd:c_glusterfs-replicate-0 [2016-03-10 10:17:11.783998] D [MSGID: 0] [glusterd-shd-svc.c:78:glusterd_shdsvc_create_volfile] 0-management: Returning 0 [2016-03-10 10:17:11.784030] D [MSGID: 0] [glusterd-shd-svc.c:255:glusterd_shdsvc_reconfigure] 0-management: Returning 0 [2016-03-10 10:17:11.784807] I [rpc-clnt.c:984:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600 [2016-03-10 10:17:11.784830] D [rpc-clnt.c:1001:rpc_clnt_connection_init] 0-quotad: disable ping-timeout [2016-03-10 10:17:11.784858] D [rpc-transport.c:288:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.6/rpc-transport/socket.so [2016-03-10 10:17:11.784951] D [socket.c:3794:socket_init] 0-quotad: disabling nodelay [2016-03-10 10:17:11.784975] D [socket.c:3845:socket_init] 0-quotad: Configued transport.tcp-user-timeout=0 [2016-03-10 10:17:11.784999] D [socket.c:3928:socket_init] 0-quotad: SSL support on the I/O path is NOT enabled [2016-03-10 10:17:11.785018] D [socket.c:3931:socket_init] 0-quotad: SSL support for glusterd is NOT enabled [2016-03-10 10:17:11.785036] D [socket.c:3948:socket_init] 0-quotad: using system polling thread [2016-03-10 10:17:11.785100] D [MSGID: 0] [glusterd-svc-mgmt.c:109:glusterd_svc_init_common] 0-management: Returning 0 [2016-03-10 10:17:11.785129] D [MSGID: 0] [glusterd-quotad-svc.c:72:glusterd_quotadsvc_manager] 0-management: quotad service initialized [2016-03-10 10:17:11.785495] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: quotad already stopped [2016-03-10 10:17:11.786009] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:11.786087] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:11.786115] D [MSGID: 0] [glusterd-quotad-svc.c:111:glusterd_quotadsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:11.786142] D [MSGID: 0] [glusterd-quotad-svc.c:220:glusterd_quotadsvc_reconfigure] 0-management: Returning 0 [2016-03-10 10:17:11.786568] I [rpc-clnt.c:984:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600 [2016-03-10 10:17:11.786596] D [rpc-clnt.c:1001:rpc_clnt_connection_init] 0-bitd: disable ping-timeout [2016-03-10 10:17:11.786624] D [rpc-transport.c:288:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.6/rpc-transport/socket.so [2016-03-10 10:17:11.786699] D [socket.c:3794:socket_init] 0-bitd: disabling nodelay [2016-03-10 10:17:11.786722] D [socket.c:3845:socket_init] 0-bitd: Configued transport.tcp-user-timeout=0 [2016-03-10 10:17:11.786746] D [socket.c:3928:socket_init] 0-bitd: SSL support on the I/O path is NOT enabled [2016-03-10 10:17:11.786764] D [socket.c:3931:socket_init] 0-bitd: SSL support for glusterd is NOT enabled [2016-03-10 10:17:11.786782] D [socket.c:3948:socket_init] 0-bitd: using system polling thread [2016-03-10 10:17:11.786839] D [MSGID: 0] [glusterd-svc-mgmt.c:109:glusterd_svc_init_common] 0-management: Returning 0 [2016-03-10 10:17:11.786868] D [MSGID: 0] [glusterd-bitd-svc.c:84:glusterd_bitdsvc_manager] 0-management: BitD service initialized [2016-03-10 10:17:11.787195] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped [2016-03-10 10:17:11.787513] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:11.787569] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:11.787597] D [MSGID: 0] [glusterd-bitd-svc.c:109:glusterd_bitdsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:11.787623] D [MSGID: 0] [glusterd-bitd-svc.c:205:glusterd_bitdsvc_reconfigure] 0-management: Returning 0 [2016-03-10 10:17:11.788024] I [rpc-clnt.c:984:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600 [2016-03-10 10:17:11.788044] D [rpc-clnt.c:1001:rpc_clnt_connection_init] 0-scrub: disable ping-timeout [2016-03-10 10:17:11.788071] D [rpc-transport.c:288:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.6/rpc-transport/socket.so [2016-03-10 10:17:11.788144] D [socket.c:3794:socket_init] 0-scrub: disabling nodelay [2016-03-10 10:17:11.788167] D [socket.c:3845:socket_init] 0-scrub: Configued transport.tcp-user-timeout=0 [2016-03-10 10:17:11.788191] D [socket.c:3928:socket_init] 0-scrub: SSL support on the I/O path is NOT enabled [2016-03-10 10:17:11.788209] D [socket.c:3931:socket_init] 0-scrub: SSL support for glusterd is NOT enabled [2016-03-10 10:17:11.788227] D [socket.c:3948:socket_init] 0-scrub: using system polling thread [2016-03-10 10:17:11.788283] D [MSGID: 0] [glusterd-svc-mgmt.c:109:glusterd_svc_init_common] 0-management: Returning 0 [2016-03-10 10:17:11.788312] D [MSGID: 0] [glusterd-scrub-svc.c:79:glusterd_scrubsvc_manager] 0-management: scrub service initialized [2016-03-10 10:17:11.788637] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped [2016-03-10 10:17:11.788952] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:11.789009] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:11.789037] D [MSGID: 0] [glusterd-scrub-svc.c:104:glusterd_scrubsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:11.789070] D [MSGID: 0] [glusterd-scrub-svc.c:204:glusterd_scrubsvc_reconfigure] 0-management: Returning 0 [2016-03-10 10:17:11.789098] D [MSGID: 0] [glusterd-op-sm.c:2667:glusterd_op_set_volume] 0-management: returning 0 [2016-03-10 10:17:11.789173] D [MSGID: 0] [glusterd-op-sm.c:5642:glusterd_op_commit_perform] 0-management: Returning 0 [2016-03-10 10:17:11.789217] D [MSGID: 0] [glusterd-op-sm.c:4660:glusterd_op_modify_op_ctx] 0-management: op_ctx modification not required [2016-03-10 10:17:11.789260] D [MSGID: 0] [glusterd-locks.c:669:glusterd_mgmt_v3_unlock] 0-management: Trying to release lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:17:11.789299] D [MSGID: 0] [glusterd-locks.c:714:glusterd_mgmt_v3_unlock] 0-management: Lock for vol c_glusterfs successfully released [2016-03-10 10:17:11.789335] D [MSGID: 0] [glusterd-op-sm.c:255:glusterd_get_txn_opinfo] 0-management: Successfully got opinfo for transaction ID : 0c1394a4-7c48-4f15-b241-116d1eeaaa6e [2016-03-10 10:17:11.789363] D [MSGID: 0] [glusterd-op-sm.c:259:glusterd_get_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:11.789397] D [MSGID: 0] [glusterd-op-sm.c:360:glusterd_clear_txn_opinfo] 0-management: Successfully cleared opinfo for transaction ID : 0c1394a4-7c48-4f15-b241-116d1eeaaa6e [2016-03-10 10:17:11.789424] D [MSGID: 0] [glusterd-op-sm.c:364:glusterd_clear_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:11.789586] D [MSGID: 0] [glusterd-rpc-ops.c:205:glusterd_op_send_cli_response] 0-management: Returning 0 [2016-03-10 10:17:11.791555] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:11.791597] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:11.791638] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=2 from gen=10 to slot->gen=11, fd=7, slot->fd=7 [2016-03-10 10:17:11.838129] I [MSGID: 106488] [glusterd-handler.c:1472:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req [2016-03-10 10:17:11.838221] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:11.838249] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:11.840937] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:11.840980] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:11.841023] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=2 from gen=13 to slot->gen=14, fd=7, slot->fd=7 [2016-03-10 10:17:11.888189] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:17:11.890609] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:11.890648] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:11.890690] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=2 from gen=16 to slot->gen=17, fd=7, slot->fd=7 [2016-03-10 10:17:11.937553] D [MSGID: 0] [glusterd-volume-ops.c:503:__glusterd_handle_cli_start_volume] 0-management: Received start vol req for volume c_glusterfs [2016-03-10 10:17:11.937721] D [MSGID: 0] [glusterd-op-sm.c:214:glusterd_generate_txn_id] 0-management: Transaction_id = 4cf33ef0-97bf-4942-81b8-ce10c2b0a199 [2016-03-10 10:17:11.937764] D [MSGID: 0] [glusterd-op-sm.c:311:glusterd_set_txn_opinfo] 0-management: Successfully set opinfo for transaction ID : 4cf33ef0-97bf-4942-81b8-ce10c2b0a199 [2016-03-10 10:17:11.937794] D [MSGID: 0] [glusterd-op-sm.c:318:glusterd_set_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:11.937825] D [MSGID: 0] [glusterd-syncop.c:1767:gd_sync_task_begin] 0-management: Transaction ID : 4cf33ef0-97bf-4942-81b8-ce10c2b0a199 [2016-03-10 10:17:11.937870] D [MSGID: 0] [glusterd-locks.c:562:glusterd_mgmt_v3_lock] 0-management: Trying to acquire lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:17:11.938533] D [MSGID: 0] [glusterd-locks.c:618:glusterd_mgmt_v3_lock] 0-management: Lock for vol c_glusterfs successfully held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:17:11.938580] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:11.938608] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:11.938661] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:11.938690] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:11.938735] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:11.938765] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:11.938793] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:11.938820] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:11.938858] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:11.938887] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:11.938915] D [MSGID: 0] [glusterd-utils.c:925:glusterd_resolve_brick] 0-management: Returning 0 [2016-03-10 10:17:11.939246] D [MSGID: 0] [glusterd-peer-utils.c:133:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: 10.32.0.48 [2016-03-10 10:17:11.939343] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:11.939921] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:11.939956] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:11.939985] D [MSGID: 0] [glusterd-utils.c:925:glusterd_resolve_brick] 0-management: Returning 0 [2016-03-10 10:17:11.940063] D [MSGID: 0] [glusterd-op-sm.c:5515:glusterd_op_stage_validate] 0-management: OP = 5. Returning 0 [2016-03-10 10:17:11.940110] D [MSGID: 0] [glusterd-op-sm.c:7010:glusterd_op_bricks_select] 0-management: Returning 0 [2016-03-10 10:17:11.940141] D [MSGID: 0] [glusterd-syncop.c:1709:gd_brick_op_phase] 0-management: Sent op req to 0 bricks [2016-03-10 10:17:12.027694] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:12.027763] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:12.028198] W [common-utils.c:1685:gf_string2boolean] (-->/usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_op_commit_perform-0x135074) [0x3fff91f8d7bc] -->/usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_op_start_volume-0xb1c8c) [0x3fff9201502c] -->/usr/lib64/libglusterfs.so.0(gf_string2boolean-0x96cd8) [0x3fff95673018] ) 0-management: argument invalid [Invalid argument] [2016-03-10 10:17:12.028241] D [MSGID: 0] [glusterd-utils.c:4539:glusterd_brick_start] 0-management: returning 0 [2016-03-10 10:17:12.067030] D [MSGID: 0] [glusterd-handshake.c:414:glusterd_get_args_from_dict] 0-management: brick_name = /opt/lvmdir/c2/brick [2016-03-10 10:17:12.067116] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning -1 [2016-03-10 10:17:12.067266] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:12.067859] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:12.067913] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning -1 [2016-03-10 10:17:12.067944] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:12.067980] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:12.068081] D [MSGID: 0] [glusterd-handshake.c:841:__server_getspec] 0-management: Look for missing snap creates for /opt/lvmdir/c2/brick [2016-03-10 10:17:12.099149] I [MSGID: 106143] [glusterd-pmap.c:229:pmap_registry_bind] 0-pmap: adding brick /opt/lvmdir/c2/brick on port 49169 [2016-03-10 10:17:12.099336] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.1.144 [2016-03-10 10:17:12.101079] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.1.144 " repeated 2 times between [2016-03-10 10:17:12.099336] and [2016-03-10 10:17:12.100603] [2016-03-10 10:17:12.101078] D [MSGID: 0] [common-utils.c:3149:gf_is_local_addr] 0-management: 10.32.1.144 is not local [2016-03-10 10:17:12.101225] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:12.101640] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:12.103621] I [rpc-clnt.c:984:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 [2016-03-10 10:17:12.103652] D [rpc-clnt.c:1001:rpc_clnt_connection_init] 0-management: disable ping-timeout [2016-03-10 10:17:12.103680] D [rpc-transport.c:288:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.6/rpc-transport/socket.so [2016-03-10 10:17:12.103829] D [socket.c:3794:socket_init] 0-management: disabling nodelay [2016-03-10 10:17:12.103853] D [socket.c:3845:socket_init] 0-management: Configued transport.tcp-user-timeout=0 [2016-03-10 10:17:12.103878] D [socket.c:3928:socket_init] 0-management: SSL support on the I/O path is NOT enabled [2016-03-10 10:17:12.103897] D [socket.c:3931:socket_init] 0-management: SSL support for glusterd is NOT enabled [2016-03-10 10:17:12.103917] D [socket.c:3948:socket_init] 0-management: using system polling thread [2016-03-10 10:17:12.104040] D [MSGID: 0] [glusterd-handler.c:3323:glusterd_rpc_create] 0-management: returning 0 [2016-03-10 10:17:12.104074] D [MSGID: 0] [glusterd-utils.c:1572:glusterd_brick_connect] 0-glusterd: Returning 0 [2016-03-10 10:17:12.104122] D [MSGID: 0] [glusterd-utils.c:4539:glusterd_brick_start] 0-management: returning 0 [2016-03-10 10:17:12.104193] D [MSGID: 0] [glusterd-store.c:1058:glusterd_store_create_volume_dir] 0-management: Returning with 0 [2016-03-10 10:17:12.104439] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:12.105624] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 19 times between [2016-03-10 10:17:12.104439] and [2016-03-10 10:17:12.105620] [2016-03-10 10:17:12.105623] D [MSGID: 0] [glusterd-store.c:440:glusterd_store_snapd_write] 0-management: Returning 0 [2016-03-10 10:17:12.122388] D [MSGID: 0] [glusterd-store.c:503:glusterd_store_perform_snapd_store] 0-management: Returning 0 [2016-03-10 10:17:12.122472] D [MSGID: 0] [glusterd-store.c:568:glusterd_store_snapd_info] 0-management: Returning with 0 [2016-03-10 10:17:12.122556] D [MSGID: 0] [glusterd-store.c:753:_storeopts] 0-management: Storing in volinfo:key= nfs.disable, val=on [2016-03-10 10:17:12.122695] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:12.122734] D [MSGID: 0] [glusterd-store.c:753:_storeopts] 0-management: Storing in volinfo:key= network.ping-timeout, val=4 [2016-03-10 10:17:12.122813] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:12.122852] D [MSGID: 0] [glusterd-store.c:753:_storeopts] 0-management: Storing in volinfo:key= performance.readdir-ahead, val=on [2016-03-10 10:17:12.122939] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:12.122972] D [MSGID: 0] [glusterd-store.c:1104:glusterd_store_volinfo_write] 0-management: Returning 0 [2016-03-10 10:17:12.123058] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:12.123679] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 8 times between [2016-03-10 10:17:12.123058] and [2016-03-10 10:17:12.123675] [2016-03-10 10:17:12.123678] D [MSGID: 0] [glusterd-store.c:414:glusterd_store_brickinfo_write] 0-management: Returning 0 [2016-03-10 10:17:12.123757] D [MSGID: 0] [glusterd-store.c:464:glusterd_store_perform_brick_store] 0-management: Returning 0 [2016-03-10 10:17:12.123785] D [MSGID: 0] [glusterd-store.c:533:glusterd_store_brickinfo] 0-management: Returning with 0 [2016-03-10 10:17:12.123870] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:12.124406] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 8 times between [2016-03-10 10:17:12.123870] and [2016-03-10 10:17:12.124402] [2016-03-10 10:17:12.124405] D [MSGID: 0] [glusterd-store.c:414:glusterd_store_brickinfo_write] 0-management: Returning 0 [2016-03-10 10:17:12.124493] D [MSGID: 0] [glusterd-store.c:464:glusterd_store_perform_brick_store] 0-management: Returning 0 [2016-03-10 10:17:12.124521] D [MSGID: 0] [glusterd-store.c:533:glusterd_store_brickinfo] 0-management: Returning with 0 [2016-03-10 10:17:12.124548] D [MSGID: 0] [glusterd-store.c:1325:glusterd_store_brickinfos] 0-management: Returning 0 [2016-03-10 10:17:12.124576] D [MSGID: 0] [glusterd-store.c:1439:glusterd_store_perform_volume_store] 0-management: Returning 0 [2016-03-10 10:17:12.171723] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:12.171956] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 3 times between [2016-03-10 10:17:12.171723] and [2016-03-10 10:17:12.171951] [2016-03-10 10:17:12.171955] D [MSGID: 0] [glusterd-store.c:1383:glusterd_store_node_state_write] 0-management: Returning 0 [2016-03-10 10:17:12.187042] D [MSGID: 0] [glusterd-store.c:1411:glusterd_store_perform_node_state_store] 0-management: Returning 0 [2016-03-10 10:17:12.187758] D [MSGID: 0] [glusterd-utils.c:2052:glusterd_volume_compute_cksum] 0-management: Returning with 0 [2016-03-10 10:17:12.187794] D [MSGID: 0] [glusterd-store.c:1645:glusterd_store_volinfo] 0-management: Returning 0 [2016-03-10 10:17:12.187840] D [MSGID: 0] [glusterd-snapshot-utils.c:3595:glusterd_is_snapd_enabled] 0-management: Key features.uss not present in the dict for volume c_glusterfs [2016-03-10 10:17:12.187881] D [MSGID: 0] [glusterd-snapd-svc.c:206:glusterd_snapdsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:12.188078] I [rpc-clnt.c:984:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600 [2016-03-10 10:17:12.188101] D [rpc-clnt.c:1001:rpc_clnt_connection_init] 0-nfs: disable ping-timeout [2016-03-10 10:17:12.188135] D [rpc-transport.c:288:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.6/rpc-transport/socket.so [2016-03-10 10:17:12.188267] D [socket.c:3794:socket_init] 0-nfs: disabling nodelay [2016-03-10 10:17:12.188292] D [socket.c:3845:socket_init] 0-nfs: Configued transport.tcp-user-timeout=0 [2016-03-10 10:17:12.188324] D [socket.c:3928:socket_init] 0-nfs: SSL support on the I/O path is NOT enabled [2016-03-10 10:17:12.188397] D [socket.c:3931:socket_init] 0-nfs: SSL support for glusterd is NOT enabled [2016-03-10 10:17:12.188418] D [socket.c:3948:socket_init] 0-nfs: using system polling thread [2016-03-10 10:17:12.188510] D [MSGID: 0] [glusterd-svc-mgmt.c:109:glusterd_svc_init_common] 0-management: Returning 0 [2016-03-10 10:17:12.188541] D [MSGID: 0] [glusterd-nfs-svc.c:84:glusterd_nfssvc_manager] 0-management: nfs service initialized [2016-03-10 10:17:12.188845] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped [2016-03-10 10:17:12.189492] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:12.189562] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:12.189592] D [MSGID: 0] [glusterd-nfs-svc.c:135:glusterd_nfssvc_stop] 0-management: Returning 0 [2016-03-10 10:17:12.189797] D [MSGID: 0] [glusterd-volgen.c:4809:build_nfs_graph] 0-glusterd: Returning 0 [2016-03-10 10:17:12.190347] D [MSGID: 0] [glusterd-nfs-svc.c:106:glusterd_nfssvc_manager] 0-management: Returning 0 [2016-03-10 10:17:12.190510] I [rpc-clnt.c:984:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600 [2016-03-10 10:17:12.190533] D [rpc-clnt.c:1001:rpc_clnt_connection_init] 0-glustershd: disable ping-timeout [2016-03-10 10:17:12.190565] D [rpc-transport.c:288:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.6/rpc-transport/socket.so [2016-03-10 10:17:12.190652] D [socket.c:3794:socket_init] 0-glustershd: disabling nodelay [2016-03-10 10:17:12.190675] D [socket.c:3845:socket_init] 0-glustershd: Configued transport.tcp-user-timeout=0 [2016-03-10 10:17:12.190699] D [socket.c:3928:socket_init] 0-glustershd: SSL support on the I/O path is NOT enabled [2016-03-10 10:17:12.190718] D [socket.c:3931:socket_init] 0-glustershd: SSL support for glusterd is NOT enabled [2016-03-10 10:17:12.190737] D [socket.c:3948:socket_init] 0-glustershd: using system polling thread [2016-03-10 10:17:12.190798] D [MSGID: 0] [glusterd-svc-mgmt.c:109:glusterd_svc_init_common] 0-management: Returning 0 [2016-03-10 10:17:12.190828] D [MSGID: 0] [glusterd-shd-svc.c:98:glusterd_shdsvc_manager] 0-management: shd service initialized [2016-03-10 10:17:12.191134] D [MSGID: 0] [glusterd-volgen.c:881:_xl_link_children] 0-management: glustershd:c_glusterfs-replicate-0 [2016-03-10 10:17:12.192337] D [MSGID: 0] [glusterd-shd-svc.c:78:glusterd_shdsvc_create_volfile] 0-management: Returning 0 [2016-03-10 10:17:12.192640] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: glustershd already stopped [2016-03-10 10:17:12.193160] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:12.193226] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:12.193303] D [MSGID: 0] [glusterd-svc-mgmt.c:195:glusterd_svc_start] 0-management: Starting glustershd service [2016-03-10 10:17:12.201244] D [MSGID: 0] [glusterd-svc-mgmt.c:208:glusterd_svc_start] 0-management: Returning 0 [2016-03-10 10:17:12.201385] D [MSGID: 0] [glusterd-shd-svc.c:177:glusterd_shdsvc_start] 0-management: Returning 0 [2016-03-10 10:17:12.201560] W [socket.c:3009:socket_connect] 0-glustershd: Ignore failed connection attempt on , (No such file or directory) [2016-03-10 10:17:12.201659] D [MSGID: 0] [glusterd-shd-svc.c:139:glusterd_shdsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:12.201895] D [MSGID: 0] [glusterd-quotad-svc.c:111:glusterd_quotadsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:12.202017] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped [2016-03-10 10:17:12.202650] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:12.202742] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:12.202776] D [MSGID: 0] [glusterd-bitd-svc.c:109:glusterd_bitdsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:12.202939] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped [2016-03-10 10:17:12.203260] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:12.203334] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:12.203364] D [MSGID: 0] [glusterd-scrub-svc.c:104:glusterd_scrubsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:12.203640] D [MSGID: 0] [glusterd-op-sm.c:5642:glusterd_op_commit_perform] 0-management: Returning 0 [2016-03-10 10:17:12.203674] D [MSGID: 0] [glusterd-utils.c:7507:glusterd_aggr_brick_mount_dirs] 0-management: No brick_count present [2016-03-10 10:17:12.203720] D [MSGID: 0] [glusterd-op-sm.c:4660:glusterd_op_modify_op_ctx] 0-management: op_ctx modification not required [2016-03-10 10:17:12.203785] D [MSGID: 0] [glusterd-locks.c:669:glusterd_mgmt_v3_unlock] 0-management: Trying to release lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:17:12.203943] D [MSGID: 0] [glusterd-locks.c:714:glusterd_mgmt_v3_unlock] 0-management: Lock for vol c_glusterfs successfully released [2016-03-10 10:17:12.203981] D [MSGID: 0] [glusterd-op-sm.c:255:glusterd_get_txn_opinfo] 0-management: Successfully got opinfo for transaction ID : 4cf33ef0-97bf-4942-81b8-ce10c2b0a199 [2016-03-10 10:17:12.204008] D [MSGID: 0] [glusterd-op-sm.c:259:glusterd_get_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:12.204043] D [MSGID: 0] [glusterd-op-sm.c:360:glusterd_clear_txn_opinfo] 0-management: Successfully cleared opinfo for transaction ID : 4cf33ef0-97bf-4942-81b8-ce10c2b0a199 [2016-03-10 10:17:12.204069] D [MSGID: 0] [glusterd-op-sm.c:364:glusterd_clear_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:12.204284] D [MSGID: 0] [glusterd-rpc-ops.c:205:glusterd_op_send_cli_response] 0-management: Returning 0 [2016-03-10 10:17:12.204476] D [MSGID: 0] [glusterd-utils.c:1400:glusterd_volinfo_find_by_volume_id] 0-management: Volume c_glusterfs found [2016-03-10 10:17:12.204608] D [MSGID: 0] [glusterd-utils.c:884:glusterd_brickinfo_new] 0-management: Returning 0 [2016-03-10 10:17:12.204660] D [MSGID: 0] [glusterd-utils.c:1041:glusterd_brickinfo_new_from_brick] 0-management: Returning 0 [2016-03-10 10:17:12.205063] D [MSGID: 0] [glusterd-peer-utils.c:133:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: 10.32.0.48 [2016-03-10 10:17:12.205186] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:12.205817] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:12.205855] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:12.205891] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.0.48:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:12.205923] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:12.205955] D [MSGID: 0] [glusterd-utils.c:1359:glusterd_volume_brickinfo_get_by_brick] 0-glusterd: Returning 0 [2016-03-10 10:17:12.205989] D [MSGID: 0] [glusterd-handler.c:4897:__glusterd_brick_rpc_notify] 0-management: Connected to 10.32.0.48:/opt/lvmdir/c2/brick [2016-03-10 10:17:12.206030] D [MSGID: 0] [glusterd-utils.c:4869:glusterd_set_brick_status] 0-glusterd: Setting brick 10.32.0.48:/opt/lvmdir/c2/brick status to started [2016-03-10 10:17:12.206127] D [MSGID: 0] [glusterd-svc-mgmt.c:315:glusterd_svc_common_rpc_notify] 0-management: glustershd has connected with glusterd. [2016-03-10 10:17:12.206222] W [socket.c:588:__socket_rwv] 0-glustershd: readv on /var/run/gluster/b5a955fbd30abfb75ed6d5965f41d006.socket failed (Invalid argument) [2016-03-10 10:17:12.206248] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:12.206359] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:12.206384] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:12.206428] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=2 from gen=19 to slot->gen=20, fd=7, slot->fd=7 [2016-03-10 10:17:12.206701] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: /var/run/gluster/b5a955fbd30abfb75ed6d5965f41d006.socket: ping timer event already removed [2016-03-10 10:17:12.206753] I [MSGID: 106006] [glusterd-svc-mgmt.c:323:glusterd_svc_common_rpc_notify] 0-management: glustershd has disconnected from glusterd. [2016-03-10 10:17:12.206793] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=5 from gen=1 to slot->gen=2, fd=13, slot->fd=13 [2016-03-10 10:17:12.235796] D [MSGID: 0] [glusterd-handshake.c:409:glusterd_get_args_from_dict] 0-management: No brick name present [2016-03-10 10:17:12.235850] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning -1 [2016-03-10 10:17:12.235992] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 127.0.0.1 [2016-03-10 10:17:12.250714] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:12.250750] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:12.250795] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=5 from gen=4 to slot->gen=5, fd=13, slot->fd=13 [2016-03-10 10:17:12.406096] D [MSGID: 0] [glusterd-handshake.c:409:glusterd_get_args_from_dict] 0-management: No brick name present [2016-03-10 10:17:12.406153] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:12.406191] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:12.406315] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:12.406893] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:12.406953] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:12.406984] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:12.425165] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:12.425208] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:12.425244] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=1 to slot->gen=2, fd=15, slot->fd=15 [2016-03-10 10:17:15.065310] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:17:15.065375] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:17:15.065431] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:17:15.065469] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:17:15.066249] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.066286] D [MSGID: 0] [glusterd-handler.c:5042:__glusterd_peer_rpc_notify] 0-management: got RPC_CLNT_CONNECT [2016-03-10 10:17:15.066319] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.067016] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(+0x1a188)[0x3fff955fb188] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit-0x1a4d8)[0x3fff955f60a8] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_submit_request-0x129078)[0x3fff91f99de8] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:17:15.482339] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:15.482323] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.482338] D [MSGID: 0] [glusterd-handshake.c:2098:__glusterd_peer_dump_version_cbk] 0-management: Proceeding to op-version handshake with peer 10.32.1.144 [2016-03-10 10:17:15.482491] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.483083] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.483268] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.483319] D [MSGID: 0] [glusterd-handshake.c:1660:gd_validate_peer_op_version] 0-management: Peer 10.32.1.144 accepted [2016-03-10 10:17:15.483540] I [MSGID: 106163] [glusterd-handshake.c:1193:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 30706 [2016-03-10 10:17:15.483831] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:15.499817] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:15.483929] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:15.499816] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.499957] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:15.499948] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.499956] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_CONNECTED' [2016-03-10 10:17:15.500056] D [MSGID: 0] [glusterd-handshake.c:1613:glusterd_event_connected_inject] 0-glusterd: returning 0 [2016-03-10 10:17:15.500097] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.500131] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_CONNECTED' [2016-03-10 10:17:15.500164] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.500699] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:15.500210] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.500698] D [MSGID: 0] [glusterd-utils.c:2504:glusterd_add_volume_to_dict] 0-management: Returning with 0 [2016-03-10 10:17:15.501195] D [MSGID: 0] [glusterd-rpc-ops.c:1579:glusterd_rpc_friend_add] 0-glusterd: Returning 0 [2016-03-10 10:17:15.501228] D [MSGID: 0] [glusterd-sm.c:334:glusterd_ac_friend_add] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.501259] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.501300] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Peer in Cluster' to 'Peer in Cluster' due to event 'GD_FRIEND_EVENT_CONNECTED' [2016-03-10 10:17:15.501332] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:17:15.501364] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.501413] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.501694] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:15.501848] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:17:15.501694] and [2016-03-10 10:17:15.501843] [2016-03-10 10:17:15.501847] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.516740] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:17:15.516800] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.516930] I [MSGID: 106490] [glusterd-handler.c:2539:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:17:15.518213] E [MSGID: 101076] [common-utils.c:2954:gf_get_hostname_from_ip] 0-common-utils: Could not lookup hostname of 10.32.1.144 : Temporary failure in name resolution [2016-03-10 10:17:15.518276] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.518546] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_RCVD_FRIEND_REQ' [2016-03-10 10:17:15.518584] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.518617] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_RCVD_FRIEND_REQ' [2016-03-10 10:17:15.518651] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.518709] D [MSGID: 0] [glusterd-utils.c:2830:import_prdict_dict] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.518766] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:15.518799] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:15.518833] D [MSGID: 0] [glusterd-utils.c:2776:glusterd_compare_friend_volume] 0-management: Returning with ret: 0, status: 1 [2016-03-10 10:17:15.518866] D [MSGID: 0] [glusterd-utils.c:4078:glusterd_compare_friend_data] 0-management: Returning with ret: 0, status: 1 [2016-03-10 10:17:15.518972] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:15.532576] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_LOCAL_ACC' [2016-03-10 10:17:15.532750] I [MSGID: 106493] [glusterd-handler.c:3780:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.32.1.144 (0), ret: 0 [2016-03-10 10:17:15.532785] D [MSGID: 0] [glusterd-sm.c:911:glusterd_ac_handle_friend_add_req] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.532823] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.532864] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Peer in Cluster' to 'Peer in Cluster' due to event 'GD_FRIEND_EVENT_RCVD_FRIEND_REQ' [2016-03-10 10:17:15.532897] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:17:15.532931] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.532985] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.533261] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:15.533433] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:17:15.533261] and [2016-03-10 10:17:15.533427] [2016-03-10 10:17:15.533432] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.548825] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:17:15.548885] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.549267] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.549375] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_LOCAL_ACC' [2016-03-10 10:17:15.549408] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.549654] D [MSGID: 0] [glusterd-peer-utils.c:615:gd_add_friend_to_dict] 0-management: Returning 0 [2016-03-10 10:17:15.550075] D [MSGID: 0] [glusterd-rpc-ops.c:1674:glusterd_rpc_friend_update] 0-glusterd: Returning 0 [2016-03-10 10:17:15.550108] D [MSGID: 0] [glusterd-sm.c:590:glusterd_ac_send_friend_update] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.550226] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.550336] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Peer in Cluster' to 'Peer in Cluster' due to event 'GD_FRIEND_EVENT_LOCAL_ACC' [2016-03-10 10:17:15.550368] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:17:15.550493] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:15.550617] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.551260] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:15.551671] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:17:15.551260] and [2016-03-10 10:17:15.551665] [2016-03-10 10:17:15.551670] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.567418] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:17:15.567499] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:17:15.567763] D [MSGID: 0] [glusterd-utils.c:173:glusterd_lock] 0-management: Cluster lock held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:17:15.567922] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped [2016-03-10 10:17:15.568610] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:15.568711] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:15.568760] D [MSGID: 0] [glusterd-nfs-svc.c:135:glusterd_nfssvc_stop] 0-management: Returning 0 [2016-03-10 10:17:15.569077] D [MSGID: 0] [glusterd-volgen.c:4809:build_nfs_graph] 0-glusterd: Returning 0 [2016-03-10 10:17:15.569611] D [MSGID: 0] [glusterd-nfs-svc.c:106:glusterd_nfssvc_manager] 0-management: Returning 0 [2016-03-10 10:17:15.569965] D [MSGID: 0] [glusterd-volgen.c:881:_xl_link_children] 0-management: glustershd:c_glusterfs-replicate-0 [2016-03-10 10:17:15.571151] D [MSGID: 0] [glusterd-shd-svc.c:78:glusterd_shdsvc_create_volfile] 0-management: Returning 0 [2016-03-10 10:17:15.571317] D [MSGID: 0] [glusterd-proc-mgmt.c:87:glusterd_proc_stop] 0-management: Stopping glustershd daemon running in pid: 2448 [2016-03-10 10:17:15.581186] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:15.581238] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:15.581291] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=2 from gen=22 to slot->gen=23, fd=7, slot->fd=7 [2016-03-10 10:17:16.066088] D [socket.c:3021:socket_connect] 0-glustershd: connection attempt on /var/run/gluster/b5a955fbd30abfb75ed6d5965f41d006.socket failed, (Connection refused) [2016-03-10 10:17:16.572115] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: /var/run/gluster/b5a955fbd30abfb75ed6d5965f41d006.socket: ping timer event already removed [2016-03-10 10:17:16.572214] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:16.572318] D [MSGID: 0] [glusterd-svc-mgmt.c:195:glusterd_svc_start] 0-management: Starting glustershd service [2016-03-10 10:17:16.585270] D [MSGID: 0] [glusterd-svc-mgmt.c:208:glusterd_svc_start] 0-management: Returning 0 [2016-03-10 10:17:16.585408] D [MSGID: 0] [glusterd-shd-svc.c:177:glusterd_shdsvc_start] 0-management: Returning 0 [2016-03-10 10:17:16.585519] D [MSGID: 0] [glusterd-shd-svc.c:139:glusterd_shdsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:16.585707] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: quotad already stopped [2016-03-10 10:17:16.586348] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:16.586442] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:16.586489] D [MSGID: 0] [glusterd-quotad-svc.c:111:glusterd_quotadsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:16.586616] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped [2016-03-10 10:17:16.586953] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:16.587034] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:16.587067] D [MSGID: 0] [glusterd-bitd-svc.c:109:glusterd_bitdsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:16.587191] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped [2016-03-10 10:17:16.587531] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:16.587605] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:16.587638] D [MSGID: 0] [glusterd-scrub-svc.c:104:glusterd_scrubsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:16.587671] D [MSGID: 0] [glusterd-utils.c:4564:glusterd_restart_bricks] 0-management: starting the volume c_glusterfs [2016-03-10 10:17:16.587710] D [MSGID: 0] [glusterd-utils.c:4539:glusterd_brick_start] 0-management: returning 0 [2016-03-10 10:17:16.588030] D [MSGID: 0] [glusterd-utils.c:1572:glusterd_brick_connect] 0-glusterd: Returning 0 [2016-03-10 10:17:16.588065] D [MSGID: 0] [glusterd-utils.c:4539:glusterd_brick_start] 0-management: returning 0 [2016-03-10 10:17:16.588104] D [MSGID: 0] [glusterd-snapshot-utils.c:3595:glusterd_is_snapd_enabled] 0-management: Key features.uss not present in the dict for volume c_glusterfs [2016-03-10 10:17:16.588279] I [MSGID: 106493] [glusterd-rpc-ops.c:480:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: c6b64e36-76da-4e98-a616-48e0e52c7006, host: 10.32.1.144, port: 0 [2016-03-10 10:17:16.588355] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:16.588428] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_RCVD_ACC' [2016-03-10 10:17:16.588494] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:16.588529] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_RCVD_ACC' [2016-03-10 10:17:16.588561] D [MSGID: 0] [glusterd-sm.c:203:glusterd_ac_none] 0-glusterd: Returning with 0 [2016-03-10 10:17:16.588593] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:16.588639] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Peer in Cluster' to 'Peer in Cluster' due to event 'GD_FRIEND_EVENT_RCVD_ACC' [2016-03-10 10:17:16.588733] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:17:16.588767] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:16.588812] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:17:16.589059] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:16.589217] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:17:16.589059] and [2016-03-10 10:17:16.589211] [2016-03-10 10:17:16.589216] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:17:16.603382] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:17:16.603445] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:17:16.603649] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:16.603731] I [MSGID: 106492] [glusterd-handler.c:2715:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:17:16.603827] I [MSGID: 106502] [glusterd-handler.c:2760:__glusterd_handle_friend_update] 0-management: Received my uuid as Friend [2016-03-10 10:17:16.604110] D [MSGID: 0] [glusterd-svc-mgmt.c:315:glusterd_svc_common_rpc_notify] 0-management: glustershd has connected with glusterd. [2016-03-10 10:17:16.604183] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:16.604629] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: /var/run/gluster/b5a955fbd30abfb75ed6d5965f41d006.socket: ping timer event already removed [2016-03-10 10:17:16.604672] I [MSGID: 106493] [glusterd-rpc-ops.c:694:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:17:16.604827] I [MSGID: 106006] [glusterd-svc-mgmt.c:323:glusterd_svc_common_rpc_notify] 0-management: glustershd has disconnected from glusterd. [2016-03-10 10:17:16.604879] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=2 from gen=25 to slot->gen=26, fd=7, slot->fd=7 [2016-03-10 10:17:16.625018] D [MSGID: 0] [glusterd-handshake.c:409:glusterd_get_args_from_dict] 0-management: No brick name present [2016-03-10 10:17:16.625072] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning -1 [2016-03-10 10:17:16.625238] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 127.0.0.1 [2016-03-10 10:17:16.637046] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:16.637085] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:16.637126] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=1 to slot->gen=2, fd=17, slot->fd=17 [2016-03-10 10:17:16.810727] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:16.810776] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:16.810818] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=4 to slot->gen=5, fd=17, slot->fd=17 [2016-03-10 10:17:16.849172] I [MSGID: 106488] [glusterd-handler.c:1472:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req [2016-03-10 10:17:16.849302] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:16.849331] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:16.852073] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:16.852122] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:16.852175] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=7 to slot->gen=8, fd=17, slot->fd=17 [2016-03-10 10:17:16.909263] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:17:16.911769] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:16.911803] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:16.911847] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=10 to slot->gen=11, fd=17, slot->fd=17 [2016-03-10 10:17:16.966238] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:17:16.969148] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:16.969210] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:16.969262] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=13 to slot->gen=14, fd=17, slot->fd=17 [2016-03-10 10:17:17.021126] D [MSGID: 0] [glusterd-op-sm.c:214:glusterd_generate_txn_id] 0-management: Transaction_id = 2e895646-6ed4-4480-b0a5-502dd6095c3b [2016-03-10 10:17:17.021205] D [MSGID: 0] [glusterd-op-sm.c:311:glusterd_set_txn_opinfo] 0-management: Successfully set opinfo for transaction ID : 2e895646-6ed4-4480-b0a5-502dd6095c3b [2016-03-10 10:17:17.021241] D [MSGID: 0] [glusterd-op-sm.c:318:glusterd_set_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:17.021287] D [MSGID: 0] [glusterd-syncop.c:1767:gd_sync_task_begin] 0-management: Transaction ID : 2e895646-6ed4-4480-b0a5-502dd6095c3b [2016-03-10 10:17:17.021330] D [MSGID: 0] [glusterd-syncop.c:1807:gd_sync_task_begin] 0-glusterd: Failed to get volume name [2016-03-10 10:17:17.021410] D [MSGID: 0] [glusterd-op-sm.c:1695:glusterd_op_stage_status_volume] 0-management: Returning: 0 [2016-03-10 10:17:17.021446] D [MSGID: 0] [glusterd-op-sm.c:5515:glusterd_op_stage_validate] 0-management: OP = 18. Returning 0 [2016-03-10 10:17:17.021689] D [MSGID: 0] [glusterd-syncop.c:1312:gd_stage_op_phase] 0-management: Sent stage op req for 'Volume Status' to 1 peers [2016-03-10 10:17:17.024878] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.025051] D [MSGID: 0] [glusterd-op-sm.c:7010:glusterd_op_bricks_select] 0-management: Returning 0 [2016-03-10 10:17:17.025117] D [MSGID: 0] [glusterd-syncop.c:1709:gd_brick_op_phase] 0-management: Sent op req to 0 bricks [2016-03-10 10:17:17.025191] D [MSGID: 0] [glusterd-op-sm.c:3360:glusterd_op_status_volume] 0-management: Returning 0 [2016-03-10 10:17:17.025224] D [MSGID: 0] [glusterd-op-sm.c:5642:glusterd_op_commit_perform] 0-management: Returning 0 [2016-03-10 10:17:17.028486] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.028591] D [MSGID: 0] [glusterd-syncop.c:1449:gd_commit_op_phase] 0-management: Sent commit op req for 'Volume Status' to 1 peers [2016-03-10 10:17:17.028632] D [MSGID: 0] [glusterd-op-sm.c:4487:glusterd_op_modify_op_ctx] 0-management: op_ctx modification not required for status operation being performed [2016-03-10 10:17:17.028677] D [MSGID: 0] [glusterd-op-sm.c:255:glusterd_get_txn_opinfo] 0-management: Successfully got opinfo for transaction ID : 2e895646-6ed4-4480-b0a5-502dd6095c3b [2016-03-10 10:17:17.028708] D [MSGID: 0] [glusterd-op-sm.c:259:glusterd_get_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:17.028753] D [MSGID: 0] [glusterd-op-sm.c:360:glusterd_clear_txn_opinfo] 0-management: Successfully cleared opinfo for transaction ID : 2e895646-6ed4-4480-b0a5-502dd6095c3b [2016-03-10 10:17:17.028784] D [MSGID: 0] [glusterd-op-sm.c:364:glusterd_clear_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:17.028914] D [MSGID: 0] [glusterd-rpc-ops.c:205:glusterd_op_send_cli_response] 0-management: Returning 0 [2016-03-10 10:17:17.031852] I [MSGID: 106499] [glusterd-handler.c:4267:__glusterd_handle_status_volume] 0-management: Received status volume req for volume c_glusterfs [2016-03-10 10:17:17.032015] D [MSGID: 0] [glusterd-op-sm.c:214:glusterd_generate_txn_id] 0-management: Transaction_id = 83de6390-502d-48ae-9558-ca7657d99086 [2016-03-10 10:17:17.032067] D [MSGID: 0] [glusterd-op-sm.c:311:glusterd_set_txn_opinfo] 0-management: Successfully set opinfo for transaction ID : 83de6390-502d-48ae-9558-ca7657d99086 [2016-03-10 10:17:17.032099] D [MSGID: 0] [glusterd-op-sm.c:318:glusterd_set_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:17.032137] D [MSGID: 0] [glusterd-syncop.c:1767:gd_sync_task_begin] 0-management: Transaction ID : 83de6390-502d-48ae-9558-ca7657d99086 [2016-03-10 10:17:17.032194] D [MSGID: 0] [glusterd-locks.c:562:glusterd_mgmt_v3_lock] 0-management: Trying to acquire lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:17:17.032863] D [MSGID: 0] [glusterd-locks.c:618:glusterd_mgmt_v3_lock] 0-management: Lock for vol c_glusterfs successfully held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:17:17.033043] D [MSGID: 0] [glusterd-syncop.c:411:gd_syncop_mgmt_v3_lock] 0-glusterd: Returning 0 [2016-03-10 10:17:17.036503] D [MSGID: 0] [glusterd-syncop.c:1205:gd_lock_op_phase] 0-management: Sent lock op req for 'Volume Status' to 1 peers. Returning 0 [2016-03-10 10:17:17.036569] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.036613] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.036681] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.036713] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.036755] D [MSGID: 0] [glusterd-op-sm.c:1695:glusterd_op_stage_status_volume] 0-management: Returning: 0 [2016-03-10 10:17:17.036787] D [MSGID: 0] [glusterd-op-sm.c:5515:glusterd_op_stage_validate] 0-management: OP = 18. Returning 0 [2016-03-10 10:17:17.036904] D [MSGID: 0] [glusterd-syncop.c:1312:gd_stage_op_phase] 0-management: Sent stage op req for 'Volume Status' to 1 peers [2016-03-10 10:17:17.039884] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.040031] D [MSGID: 0] [glusterd-op-sm.c:7010:glusterd_op_bricks_select] 0-management: Returning 0 [2016-03-10 10:17:17.040067] D [MSGID: 0] [glusterd-syncop.c:1709:gd_brick_op_phase] 0-management: Sent op req to 0 bricks [2016-03-10 10:17:17.040120] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.040152] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.040373] D [MSGID: 0] [glusterd-snapshot-utils.c:3595:glusterd_is_snapd_enabled] 0-management: Key features.uss not present in the dict for volume c_glusterfs [2016-03-10 10:17:17.040481] D [MSGID: 0] [glusterd-utils.c:4342:glusterd_add_node_to_dict] 0-management: Returning 0 [2016-03-10 10:17:17.040841] D [MSGID: 0] [glusterd-op-sm.c:3360:glusterd_op_status_volume] 0-management: Returning 0 [2016-03-10 10:17:17.040876] D [MSGID: 0] [glusterd-op-sm.c:5642:glusterd_op_commit_perform] 0-management: Returning 0 [2016-03-10 10:17:17.045210] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.045595] D [MSGID: 0] [glusterd-syncop.c:1449:gd_commit_op_phase] 0-management: Sent commit op req for 'Volume Status' to 1 peers [2016-03-10 10:17:17.045658] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.045696] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.045747] D [MSGID: 0] [glusterd-op-sm.c:4244:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Got uuid /opt/lvmdir/c2/brick [2016-03-10 10:17:17.045791] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:17.045784] D [MSGID: 0] [glusterd-op-sm.c:4244:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Got uuid /opt/lvmdir/c2/brick [2016-03-10 10:17:17.045789] D [MSGID: 0] [glusterd-op-sm.c:4244:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Got uuid f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:17:17.045882] D [MSGID: 0] [glusterd-op-sm.c:4256:glusterd_op_volume_dict_uuid_to_hostname] 0-management: f4ebe3c5-b6a4-4795-98e0-732337f76faf -> localhost [2016-03-10 10:17:17.045920] D [MSGID: 0] [glusterd-op-sm.c:4244:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Got uuid c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:17:17.045957] D [MSGID: 0] [glusterd-op-sm.c:4256:glusterd_op_volume_dict_uuid_to_hostname] 0-management: c6b64e36-76da-4e98-a616-48e0e52c7006 -> 10.32.1.144 [2016-03-10 10:17:17.045995] D [MSGID: 0] [glusterd-op-sm.c:4270:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Returning 0 [2016-03-10 10:17:17.046162] D [MSGID: 0] [glusterd-syncop.c:510:gd_syncop_mgmt_v3_unlock] 0-glusterd: Returning 0 [2016-03-10 10:17:17.047310] D [MSGID: 0] [glusterd-syncop.c:1558:gd_unlock_op_phase] 0-management: Sent unlock op req for 'Volume Status' to 1 peers. Returning 0 [2016-03-10 10:17:17.047399] D [MSGID: 0] [glusterd-locks.c:669:glusterd_mgmt_v3_unlock] 0-management: Trying to release lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:17:17.047450] D [MSGID: 0] [glusterd-locks.c:714:glusterd_mgmt_v3_unlock] 0-management: Lock for vol c_glusterfs successfully released [2016-03-10 10:17:17.047512] D [MSGID: 0] [glusterd-op-sm.c:255:glusterd_get_txn_opinfo] 0-management: Successfully got opinfo for transaction ID : 83de6390-502d-48ae-9558-ca7657d99086 [2016-03-10 10:17:17.047543] D [MSGID: 0] [glusterd-op-sm.c:259:glusterd_get_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:17.047585] D [MSGID: 0] [glusterd-op-sm.c:360:glusterd_clear_txn_opinfo] 0-management: Successfully cleared opinfo for transaction ID : 83de6390-502d-48ae-9558-ca7657d99086 [2016-03-10 10:17:17.047615] D [MSGID: 0] [glusterd-op-sm.c:364:glusterd_clear_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:17.047827] D [MSGID: 0] [glusterd-rpc-ops.c:205:glusterd_op_send_cli_response] 0-management: Returning 0 [2016-03-10 10:17:17.050657] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:17.050712] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:17.050768] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=16 to slot->gen=17, fd=17, slot->fd=17 [2016-03-10 10:17:17.104301] I [MSGID: 106484] [glusterd-brick-ops.c:836:__glusterd_handle_remove_brick] 0-management: Received rem brick req [2016-03-10 10:17:17.104425] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.104470] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.104510] I [MSGID: 106062] [glusterd-brick-ops.c:914:__glusterd_handle_remove_brick] 0-management: request to change replica-count to 1 [2016-03-10 10:17:17.104574] D [MSGID: 0] [glusterd-brick-ops.c:1038:__glusterd_handle_remove_brick] 0-management: Remove brick count 1 brick: 10.32.1.144:/opt/lvmdir/c2/brick [2016-03-10 10:17:17.104627] D [MSGID: 0] [glusterd-utils.c:884:glusterd_brickinfo_new] 0-management: Returning 0 [2016-03-10 10:17:17.104670] D [MSGID: 0] [glusterd-utils.c:1041:glusterd_brickinfo_new_from_brick] 0-management: Returning 0 [2016-03-10 10:17:17.104722] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:17.104755] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:17.104788] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.1.144:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:17.104820] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:17.104854] D [MSGID: 0] [glusterd-utils.c:1359:glusterd_volume_brickinfo_get_by_brick] 0-glusterd: Returning 0 [2016-03-10 10:17:17.104970] D [MSGID: 0] [glusterd-op-sm.c:214:glusterd_generate_txn_id] 0-management: Transaction_id = 4c44fbaa-03d2-43e3-8236-c16f9ffb3377 [2016-03-10 10:17:17.105019] D [MSGID: 0] [glusterd-op-sm.c:311:glusterd_set_txn_opinfo] 0-management: Successfully set opinfo for transaction ID : 4c44fbaa-03d2-43e3-8236-c16f9ffb3377 [2016-03-10 10:17:17.105050] D [MSGID: 0] [glusterd-op-sm.c:318:glusterd_set_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:17.105089] D [MSGID: 0] [glusterd-syncop.c:1767:gd_sync_task_begin] 0-management: Transaction ID : 4c44fbaa-03d2-43e3-8236-c16f9ffb3377 [2016-03-10 10:17:17.105142] D [MSGID: 0] [glusterd-locks.c:562:glusterd_mgmt_v3_lock] 0-management: Trying to acquire lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:17:17.105768] D [MSGID: 0] [glusterd-locks.c:618:glusterd_mgmt_v3_lock] 0-management: Lock for vol c_glusterfs successfully held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:17:17.105952] D [MSGID: 0] [glusterd-syncop.c:411:gd_syncop_mgmt_v3_lock] 0-glusterd: Returning 0 [2016-03-10 10:17:17.110918] D [MSGID: 0] [glusterd-syncop.c:1205:gd_lock_op_phase] 0-management: Sent lock op req for 'Volume Remove brick' to 1 peers. Returning 0 [2016-03-10 10:17:17.111002] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.111035] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.111097] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.111125] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.111171] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.111200] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.111240] D [MSGID: 0] [glusterd-brick-ops.c:2084:glusterd_op_stage_remove_brick] 0-management: Returning 0 [2016-03-10 10:17:17.111270] D [MSGID: 0] [glusterd-op-sm.c:5515:glusterd_op_stage_validate] 0-management: OP = 9. Returning 0 [2016-03-10 10:17:17.111401] D [MSGID: 0] [glusterd-syncop.c:1312:gd_stage_op_phase] 0-management: Sent stage op req for 'Volume Remove brick' to 1 peers [2016-03-10 10:17:17.114985] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.115134] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.115194] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.115234] I [MSGID: 106062] [glusterd-op-sm.c:5745:glusterd_bricks_select_remove_brick] 0-management: force flag is not set [2016-03-10 10:17:17.115267] D [MSGID: 0] [glusterd-op-sm.c:7010:glusterd_op_bricks_select] 0-management: Returning 0 [2016-03-10 10:17:17.115299] D [MSGID: 0] [glusterd-syncop.c:1709:gd_brick_op_phase] 0-management: Sent op req to 0 bricks [2016-03-10 10:17:17.115877] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.115912] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.116345] W [dict.c:592:dict_unref] (-->/usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_op_commit_perform-0x1350d4) [0x3fff91f8d75c] -->/usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_op_remove_brick-0xa98b0) [0x3fff9201d6c0] -->/usr/lib64/libglusterfs.so.0(dict_unref-0xc08c0) [0x3fff95646520] ) 0-dict: dict is NULL [Invalid argument] [2016-03-10 10:17:17.116452] D [MSGID: 0] [glusterd-utils.c:884:glusterd_brickinfo_new] 0-management: Returning 0 [2016-03-10 10:17:17.116504] D [MSGID: 0] [glusterd-utils.c:1041:glusterd_brickinfo_new_from_brick] 0-management: Returning 0 [2016-03-10 10:17:17.116541] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:17.116574] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:17.116610] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.1.144:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:17.116641] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:17.116672] D [MSGID: 0] [glusterd-utils.c:1359:glusterd_volume_brickinfo_get_by_brick] 0-glusterd: Returning 0 [2016-03-10 10:17:17.116709] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:17.116751] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:17.116782] D [MSGID: 0] [glusterd-utils.c:925:glusterd_resolve_brick] 0-management: Returning 0 [2016-03-10 10:17:17.117303] D [MSGID: 0] [store.c:460:gf_store_handle_destroy] 0-: Returning 0 [2016-03-10 10:17:17.117335] D [MSGID: 0] [glusterd-store.c:620:glusterd_store_delete_brick] 0-management: Returning with 0 [2016-03-10 10:17:17.117390] D [MSGID: 0] [glusterd-utils.c:5542:glusterd_brick_stop] 0-management: returning 0 [2016-03-10 10:17:17.117422] D [MSGID: 0] [glusterd-brick-ops.c:1486:glusterd_op_perform_remove_brick] 0-glusterd: Returning 0 [2016-03-10 10:17:17.117466] I [MSGID: 106062] [glusterd-brick-ops.c:2556:glusterd_op_remove_brick] 0-management: changing replica count 2 to 1 on volume c_glusterfs [2016-03-10 10:17:17.117647] D [MSGID: 0] [glusterd-volgen.c:5109:generate_brick_volfiles] 0-management: Found a brick - 10.32.0.48:/opt/lvmdir/c2/brick [2016-03-10 10:17:17.118564] D [MSGID: 0] [glusterd-volgen.c:1268:server_check_marker_off] 0-glusterd: Returning 0 [2016-03-10 10:17:17.119698] D [MSGID: 0] [glusterd-volgen.c:5120:generate_brick_volfiles] 0-management: Returning 0 [2016-03-10 10:17:17.120261] D [MSGID: 0] [glusterd-peer-utils.c:133:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: 10.32.0.48 [2016-03-10 10:17:17.120374] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:17.121040] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:17.121081] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:17.121115] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.0.48:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:17.121153] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:17.123399] D [MSGID: 0] [glusterd-peer-utils.c:133:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: 10.32.0.48 [2016-03-10 10:17:17.123539] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:17.124107] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:17.124144] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:17.124177] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.0.48:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:17.124212] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:17.126133] D [MSGID: 0] [glusterd-store.c:1058:glusterd_store_create_volume_dir] 0-management: Returning with 0 [2016-03-10 10:17:17.126333] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:17.127635] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 19 times between [2016-03-10 10:17:17.126333] and [2016-03-10 10:17:17.127630] [2016-03-10 10:17:17.127633] D [MSGID: 0] [glusterd-store.c:440:glusterd_store_snapd_write] 0-management: Returning 0 [2016-03-10 10:17:17.143598] D [MSGID: 0] [glusterd-store.c:503:glusterd_store_perform_snapd_store] 0-management: Returning 0 [2016-03-10 10:17:17.143679] D [MSGID: 0] [glusterd-store.c:568:glusterd_store_snapd_info] 0-management: Returning with 0 [2016-03-10 10:17:17.143770] D [MSGID: 0] [glusterd-store.c:753:_storeopts] 0-management: Storing in volinfo:key= nfs.disable, val=on [2016-03-10 10:17:17.143925] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:17.143966] D [MSGID: 0] [glusterd-store.c:753:_storeopts] 0-management: Storing in volinfo:key= network.ping-timeout, val=4 [2016-03-10 10:17:17.144066] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:17.144111] D [MSGID: 0] [glusterd-store.c:753:_storeopts] 0-management: Storing in volinfo:key= performance.readdir-ahead, val=on [2016-03-10 10:17:17.144198] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:17.144233] D [MSGID: 0] [glusterd-store.c:1104:glusterd_store_volinfo_write] 0-management: Returning 0 [2016-03-10 10:17:17.144331] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:17.145012] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 8 times between [2016-03-10 10:17:17.144331] and [2016-03-10 10:17:17.145006] [2016-03-10 10:17:17.145010] D [MSGID: 0] [glusterd-store.c:414:glusterd_store_brickinfo_write] 0-management: Returning 0 [2016-03-10 10:17:17.145107] D [MSGID: 0] [glusterd-store.c:464:glusterd_store_perform_brick_store] 0-management: Returning 0 [2016-03-10 10:17:17.145139] D [MSGID: 0] [glusterd-store.c:533:glusterd_store_brickinfo] 0-management: Returning with 0 [2016-03-10 10:17:17.145170] D [MSGID: 0] [glusterd-store.c:1325:glusterd_store_brickinfos] 0-management: Returning 0 [2016-03-10 10:17:17.145202] D [MSGID: 0] [glusterd-store.c:1439:glusterd_store_perform_volume_store] 0-management: Returning 0 [2016-03-10 10:17:17.176039] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:17.176289] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 3 times between [2016-03-10 10:17:17.176039] and [2016-03-10 10:17:17.176283] [2016-03-10 10:17:17.176288] D [MSGID: 0] [glusterd-store.c:1383:glusterd_store_node_state_write] 0-management: Returning 0 [2016-03-10 10:17:17.190943] D [MSGID: 0] [glusterd-store.c:1411:glusterd_store_perform_node_state_store] 0-management: Returning 0 [2016-03-10 10:17:17.191713] D [MSGID: 0] [glusterd-utils.c:2052:glusterd_volume_compute_cksum] 0-management: Returning with 0 [2016-03-10 10:17:17.191756] D [MSGID: 0] [glusterd-store.c:1645:glusterd_store_volinfo] 0-management: Returning 0 [2016-03-10 10:17:17.191814] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped [2016-03-10 10:17:17.192537] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:17.192635] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:17.192670] D [MSGID: 0] [glusterd-nfs-svc.c:135:glusterd_nfssvc_stop] 0-management: Returning 0 [2016-03-10 10:17:17.192901] D [MSGID: 0] [glusterd-volgen.c:4809:build_nfs_graph] 0-glusterd: Returning 0 [2016-03-10 10:17:17.193416] D [MSGID: 0] [glusterd-nfs-svc.c:106:glusterd_nfssvc_manager] 0-management: Returning 0 [2016-03-10 10:17:17.193532] D [MSGID: 0] [glusterd-shd-svc.c:139:glusterd_shdsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:17.193735] D [MSGID: 0] [glusterd-quotad-svc.c:111:glusterd_quotadsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:17.193861] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped [2016-03-10 10:17:17.194413] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:17.194533] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:17.194568] D [MSGID: 0] [glusterd-bitd-svc.c:109:glusterd_bitdsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:17.194703] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped [2016-03-10 10:17:17.195073] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:17.195139] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:17.195173] D [MSGID: 0] [glusterd-scrub-svc.c:104:glusterd_scrubsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:17.195259] D [MSGID: 0] [glusterd-op-sm.c:5642:glusterd_op_commit_perform] 0-management: Returning 0 [2016-03-10 10:17:17.195533] D [MSGID: 0] [glusterd-handshake.c:409:glusterd_get_args_from_dict] 0-management: No brick name present [2016-03-10 10:17:17.195576] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.195612] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.195786] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:17.196434] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:17.196519] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.196554] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.202750] D [MSGID: 0] [glusterd-handshake.c:414:glusterd_get_args_from_dict] 0-management: brick_name = /opt/lvmdir/c2/brick [2016-03-10 10:17:17.202818] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning -1 [2016-03-10 10:17:17.203000] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:17.203724] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:17.203811] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning -1 [2016-03-10 10:17:17.203847] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:17.203879] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:17.203992] D [MSGID: 0] [glusterd-handshake.c:841:__server_getspec] 0-management: Look for missing snap creates for /opt/lvmdir/c2/brick [2016-03-10 10:17:17.204323] D [MSGID: 0] [glusterd-handshake.c:409:glusterd_get_args_from_dict] 0-management: No brick name present [2016-03-10 10:17:17.204366] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning -1 [2016-03-10 10:17:17.204533] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 127.0.0.1 [2016-03-10 10:17:17.207033] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:17.207077] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:17.207122] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=1 to slot->gen=2, fd=18, slot->fd=18 [2016-03-10 10:17:17.283504] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.283664] D [MSGID: 0] [glusterd-syncop.c:1449:gd_commit_op_phase] 0-management: Sent commit op req for 'Volume Remove brick' to 1 peers [2016-03-10 10:17:17.283719] D [MSGID: 0] [glusterd-op-sm.c:4660:glusterd_op_modify_op_ctx] 0-management: op_ctx modification not required [2016-03-10 10:17:17.283861] D [MSGID: 0] [glusterd-syncop.c:510:gd_syncop_mgmt_v3_unlock] 0-glusterd: Returning 0 [2016-03-10 10:17:17.287939] D [MSGID: 0] [glusterd-syncop.c:1558:gd_unlock_op_phase] 0-management: Sent unlock op req for 'Volume Remove brick' to 1 peers. Returning 0 [2016-03-10 10:17:17.288021] D [MSGID: 0] [glusterd-locks.c:669:glusterd_mgmt_v3_unlock] 0-management: Trying to release lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:17:17.288072] D [MSGID: 0] [glusterd-locks.c:714:glusterd_mgmt_v3_unlock] 0-management: Lock for vol c_glusterfs successfully released [2016-03-10 10:17:17.288118] D [MSGID: 0] [glusterd-op-sm.c:255:glusterd_get_txn_opinfo] 0-management: Successfully got opinfo for transaction ID : 4c44fbaa-03d2-43e3-8236-c16f9ffb3377 [2016-03-10 10:17:17.288149] D [MSGID: 0] [glusterd-op-sm.c:259:glusterd_get_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:17.288195] D [MSGID: 0] [glusterd-op-sm.c:360:glusterd_clear_txn_opinfo] 0-management: Successfully cleared opinfo for transaction ID : 4c44fbaa-03d2-43e3-8236-c16f9ffb3377 [2016-03-10 10:17:17.288227] D [MSGID: 0] [glusterd-op-sm.c:364:glusterd_clear_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:17:17.288370] D [MSGID: 0] [glusterd-rpc-ops.c:205:glusterd_op_send_cli_response] 0-management: Returning 0 [2016-03-10 10:17:17.290385] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:17.290432] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:17.290502] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=19 to slot->gen=20, fd=17, slot->fd=17 [2016-03-10 10:17:17.343370] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:17:17.345582] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:17.345620] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:17.345668] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=22 to slot->gen=23, fd=17, slot->fd=17 [2016-03-10 10:17:17.396336] I [MSGID: 106487] [glusterd-handler.c:1290:__glusterd_handle_cli_deprobe] 0-glusterd: Received CLI deprobe req [2016-03-10 10:17:17.396414] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:17.396467] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:17.396504] D [MSGID: 0] [glusterd-peer-utils.c:350:glusterd_chk_peers_connected_befriended] 0-management: Returning TRUE [2016-03-10 10:17:17.396542] D [MSGID: 0] [glusterd-utils.c:6763:glusterd_friend_contains_vol_bricks] 0-management: Returning 0 [2016-03-10 10:17:17.396580] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.396619] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_INIT_REMOVE_FRIEND' [2016-03-10 10:17:17.396654] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.396701] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_INIT_REMOVE_FRIEND' [2016-03-10 10:17:17.396742] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.396896] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:17.396782] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.396894] D [MSGID: 0] [glusterd-rpc-ops.c:1628:glusterd_rpc_friend_remove] 0-glusterd: Returning 0 [2016-03-10 10:17:17.396975] D [MSGID: 0] [glusterd-sm.c:491:glusterd_ac_send_friend_remove_req] 0-glusterd: Returning with 0 [2016-03-10 10:17:17.398034] I [MSGID: 106493] [glusterd-rpc-ops.c:598:__glusterd_friend_remove_cbk] 0-glusterd: Received ACC from uuid: c6b64e36-76da-4e98-a616-48e0e52c7006, host: 10.32.0.48, port: 0 [2016-03-10 10:17:17.398105] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.398143] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_REMOVE_FRIEND' [2016-03-10 10:17:17.398260] D [MSGID: 0] [glusterd-handler.c:4009:glusterd_xfer_cli_deprobe_resp] 0-management: Responded to CLI, ret: 0 [2016-03-10 10:17:17.398298] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.398331] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_REMOVE_FRIEND' [2016-03-10 10:17:17.398364] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:17.398401] D [MSGID: 0] [glusterd-utils.c:6763:glusterd_friend_contains_vol_bricks] 0-management: Returning 0 [2016-03-10 10:17:17.398433] D [MSGID: 0] [glusterd-utils.c:6799:glusterd_friend_remove_cleanup_vols] 0-management: Returning 0 [2016-03-10 10:17:17.398652] D [MSGID: 0] [glusterd-utils.c:173:glusterd_lock] 0-management: Cluster lock held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:17:17.398723] D [MSGID: 0] [glusterd-sm.c:188:glusterd_broadcast_friend_delete] 0-glusterd: Returning with 0 [2016-03-10 10:17:17.398965] D [MSGID: 0] [store.c:460:gf_store_handle_destroy] 0-: Returning 0 [2016-03-10 10:17:17.398997] D [MSGID: 0] [glusterd-store.c:3777:glusterd_store_delete_peerinfo] 0-management: Returning with 0 [2016-03-10 10:17:17.400648] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:17.400681] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:17.400726] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=25 to slot->gen=26, fd=17, slot->fd=17 [2016-03-10 10:17:17.461796] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:17:17.470721] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:17.470785] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:17.470838] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=28 to slot->gen=29, fd=17, slot->fd=17 [2016-03-10 10:17:17.543867] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:17:17.550861] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:17.550906] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:17.550950] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=31 to slot->gen=32, fd=17, slot->fd=17 [2016-03-10 10:17:17.603032] I [MSGID: 106487] [glusterd-handler.c:1178:__glusterd_handle_cli_probe] 0-glusterd: Received CLI probe req 10.32.1.144 24007 [2016-03-10 10:17:17.603255] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.1.144 [2016-03-10 10:17:17.604921] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.1.144 " repeated 2 times between [2016-03-10 10:17:17.603255] and [2016-03-10 10:17:17.604443] [2016-03-10 10:17:17.604920] D [MSGID: 0] [common-utils.c:3149:gf_is_local_addr] 0-management: 10.32.1.144 is not local [2016-03-10 10:17:17.605067] D [MSGID: 0] [glusterd-peer-utils.c:133:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: 10.32.1.144 [2016-03-10 10:17:17.605165] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:17.605162] D [MSGID: 0] [glusterd-peer-utils.c:133:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: 10.32.1.144 [2016-03-10 10:17:17.605165] D [MSGID: 0] [glusterd-peer-utils.c:247:glusterd_peerinfo_find] 0-management: Unable to find hostname: 10.32.1.144 [2016-03-10 10:17:17.605232] I [MSGID: 106129] [glusterd-handler.c:3600:glusterd_probe_begin] 0-glusterd: Unable to find peerinfo for host: 10.32.1.144 (24007) [2016-03-10 10:17:17.605265] D [MSGID: 0] [glusterd-peer-utils.c:458:glusterd_peer_hostname_new] 0-glusterd: Returning 0 [2016-03-10 10:17:17.605297] D [MSGID: 0] [glusterd-utils.c:5974:glusterd_sm_tr_log_init] 0-glusterd: returning 0 [2016-03-10 10:17:17.605343] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:17:17.617479] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:17.617793] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:17.617945] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:17:17.617793] and [2016-03-10 10:17:17.617940] [2016-03-10 10:17:17.617944] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:17:17.634151] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:17:17.634213] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:17:17.634299] D [MSGID: 0] [glusterd-handler.c:3391:glusterd_transport_inet_options_build] 0-glusterd: Returning 0 [2016-03-10 10:17:17.634356] I [rpc-clnt.c:984:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600 [2016-03-10 10:17:17.634379] D [rpc-clnt.c:996:rpc_clnt_connection_init] 0-management: setting ping-timeout to 30 [2016-03-10 10:17:17.634408] D [rpc-transport.c:288:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.6/rpc-transport/socket.so [2016-03-10 10:17:17.634579] D [socket.c:3845:socket_init] 0-management: Configued transport.tcp-user-timeout=-1 [2016-03-10 10:17:17.634608] D [socket.c:3928:socket_init] 0-management: SSL support on the I/O path is NOT enabled [2016-03-10 10:17:17.634627] D [socket.c:3931:socket_init] 0-management: SSL support for glusterd is NOT enabled [2016-03-10 10:17:17.634645] D [socket.c:3948:socket_init] 0-management: using system polling thread [2016-03-10 10:17:17.635271] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:17:17.635303] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:17:17.635362] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 18, Invalid argument [2016-03-10 10:17:17.635385] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:17:17.635632] D [MSGID: 0] [glusterd-handler.c:3323:glusterd_rpc_create] 0-management: returning 0 [2016-03-10 10:17:17.635663] I [MSGID: 106498] [glusterd-handler.c:3528:glusterd_friend_add] 0-management: connect returned 0 [2016-03-10 10:17:17.635692] D [MSGID: 0] [glusterd-handler.c:3642:glusterd_probe_begin] 0-glusterd: returning 100 [2016-03-10 10:17:17.636369] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Establishing Connection [2016-03-10 10:17:17.636403] D [MSGID: 0] [glusterd-handler.c:5042:__glusterd_peer_rpc_notify] 0-management: got RPC_CLNT_CONNECT [2016-03-10 10:17:17.636435] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Establishing Connection [2016-03-10 10:17:17.637056] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(+0x1a188)[0x3fff955fb188] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit-0x1a4d8)[0x3fff955f60a8] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_submit_request-0x129078)[0x3fff91f99de8] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:17:17.637212] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:17.637199] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Establishing Connection [2016-03-10 10:17:17.637212] D [MSGID: 0] [glusterd-handshake.c:2098:__glusterd_peer_dump_version_cbk] 0-management: Proceeding to op-version handshake with peer 10.32.1.144 [2016-03-10 10:17:17.637298] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Establishing Connection [2016-03-10 10:17:18.429128] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:18.429092] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Establishing Connection [2016-03-10 10:17:18.429126] D [MSGID: 0] [glusterd-handshake.c:1660:gd_validate_peer_op_version] 0-management: Peer 10.32.1.144 accepted [2016-03-10 10:17:18.446148] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Establishing Connection [2016-03-10 10:17:18.446237] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:18.446228] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Establishing Connection [2016-03-10 10:17:18.446237] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_CONNECTED' [2016-03-10 10:17:18.446322] D [MSGID: 0] [glusterd-handshake.c:1613:glusterd_event_connected_inject] 0-glusterd: returning 0 [2016-03-10 10:17:18.446373] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: 00000000-0000-0000-0000-000000000000 [2016-03-10 10:17:18.446411] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 0 [2016-03-10 10:17:18.446485] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_CONNECTED' [2016-03-10 10:17:18.446537] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 0 [2016-03-10 10:17:18.446681] D [MSGID: 0] [glusterd-rpc-ops.c:1477:glusterd_rpc_probe] 0-glusterd: Returning 0 [2016-03-10 10:17:18.446723] D [MSGID: 0] [glusterd-sm.c:413:glusterd_ac_friend_probe] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.446762] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: 00000000-0000-0000-0000-000000000000 [2016-03-10 10:17:18.446798] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 0 [2016-03-10 10:17:18.446849] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Establishing Connection' to 'Establishing Connection' due to event 'GD_FRIEND_EVENT_CONNECTED' [2016-03-10 10:17:18.446883] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:17:18.446921] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: 00000000-0000-0000-0000-000000000000 [2016-03-10 10:17:18.446955] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 0 [2016-03-10 10:17:18.447008] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.447307] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:18.447513] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:17:18.447307] and [2016-03-10 10:17:18.447507] [2016-03-10 10:17:18.447511] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.479705] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:17:18.479792] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.479969] I [MSGID: 106511] [glusterd-rpc-ops.c:256:__glusterd_probe_cbk] 0-management: Received probe resp from uuid: c6b64e36-76da-4e98-a616-48e0e52c7006, host: 10.32.1.144 [2016-03-10 10:17:18.480018] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: c6b64e36-76da-4e98-a616-48e0e52c7006, not found [2016-03-10 10:17:18.480057] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:17:18.480097] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 0 [2016-03-10 10:17:18.480139] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_INIT_FRIEND_REQ' [2016-03-10 10:17:18.480171] I [MSGID: 106511] [glusterd-rpc-ops.c:416:__glusterd_probe_cbk] 0-glusterd: Received resp to probe req [2016-03-10 10:17:18.480213] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Establishing Connection [2016-03-10 10:17:18.480249] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_INIT_FRIEND_REQ' [2016-03-10 10:17:18.480283] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Establishing Connection [2016-03-10 10:17:18.480715] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:18.480321] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Establishing Connection [2016-03-10 10:17:18.480714] D [MSGID: 0] [glusterd-utils.c:2504:glusterd_add_volume_to_dict] 0-management: Returning with 0 [2016-03-10 10:17:18.481305] D [MSGID: 0] [glusterd-rpc-ops.c:1579:glusterd_rpc_friend_add] 0-glusterd: Returning 0 [2016-03-10 10:17:18.481355] D [MSGID: 0] [glusterd-sm.c:334:glusterd_ac_friend_add] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.481393] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Establishing Connection [2016-03-10 10:17:18.481438] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Establishing Connection' to 'Probe Sent to Peer' due to event 'GD_FRIEND_EVENT_INIT_FRIEND_REQ' [2016-03-10 10:17:18.481497] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:17:18.481531] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Probe Sent to Peer [2016-03-10 10:17:18.481589] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.481642] D [MSGID: 0] [store.c:460:gf_store_handle_destroy] 0-: Returning 0 [2016-03-10 10:17:18.500530] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:18.500867] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:18.501044] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:17:18.500867] and [2016-03-10 10:17:18.501038] [2016-03-10 10:17:18.501043] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.545585] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:17:18.545665] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.546551] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Probe Sent to Peer [2016-03-10 10:17:18.602609] I [MSGID: 106493] [glusterd-rpc-ops.c:480:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: c6b64e36-76da-4e98-a616-48e0e52c7006, host: 10.32.1.144, port: 0 [2016-03-10 10:17:18.602680] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Probe Sent to Peer [2016-03-10 10:17:18.602715] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_RCVD_ACC' [2016-03-10 10:17:18.602832] D [MSGID: 0] [glusterd-handler.c:3915:glusterd_xfer_cli_probe_resp] 0-management: Responded to CLI, ret: 0 [2016-03-10 10:17:18.602865] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Probe Sent to Peer [2016-03-10 10:17:18.602893] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_RCVD_ACC' [2016-03-10 10:17:18.602920] D [MSGID: 0] [glusterd-sm.c:203:glusterd_ac_none] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.602947] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Probe Sent to Peer [2016-03-10 10:17:18.602979] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Probe Sent to Peer' to 'Accepted peer request' due to event 'GD_FRIEND_EVENT_RCVD_ACC' [2016-03-10 10:17:18.603006] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:17:18.603034] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Accepted peer request [2016-03-10 10:17:18.603092] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.603358] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:18.603522] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:17:18.603358] and [2016-03-10 10:17:18.603517] [2016-03-10 10:17:18.603521] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.605844] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:18.605904] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:18.605961] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=34 to slot->gen=35, fd=17, slot->fd=17 [2016-03-10 10:17:18.641313] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:17:18.641388] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.642780] I [MSGID: 106163] [glusterd-handshake.c:1193:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 30706 [2016-03-10 10:17:18.643179] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:18.693595] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:17:18.643270] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:18.693593] I [MSGID: 106490] [glusterd-handler.c:2884:__glusterd_handle_probe_query] 0-glusterd: Received probe from uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:17:18.694079] E [MSGID: 101076] [common-utils.c:2954:gf_get_hostname_from_ip] 0-common-utils: Could not lookup hostname of 10.32.1.144 : Temporary failure in name resolution [2016-03-10 10:17:18.694121] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Accepted peer request [2016-03-10 10:17:18.694226] I [MSGID: 106493] [glusterd-handler.c:2947:__glusterd_handle_probe_query] 0-glusterd: Responded to 10.32.1.144, op_ret: 0, op_errno: 0, ret: 0 [2016-03-10 10:17:18.719605] I [MSGID: 106490] [glusterd-handler.c:2539:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:17:18.720026] E [MSGID: 101076] [common-utils.c:2954:gf_get_hostname_from_ip] 0-common-utils: Could not lookup hostname of 10.32.1.144 : Temporary failure in name resolution [2016-03-10 10:17:18.720071] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Accepted peer request [2016-03-10 10:17:18.720289] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_RCVD_FRIEND_REQ' [2016-03-10 10:17:18.720322] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Accepted peer request [2016-03-10 10:17:18.720356] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_RCVD_FRIEND_REQ' [2016-03-10 10:17:18.720387] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Accepted peer request [2016-03-10 10:17:18.720437] D [MSGID: 0] [glusterd-utils.c:2830:import_prdict_dict] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.720500] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:18.720530] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:18.720583] D [MSGID: 0] [glusterd-utils.c:2757:glusterd_compare_friend_volume] 0-management: quota checksum absent for volume c_glusterfs in peer 10.32.1.144's response [2016-03-10 10:17:18.720613] D [MSGID: 0] [glusterd-utils.c:2776:glusterd_compare_friend_volume] 0-management: Returning with ret: 0, status: 1 [2016-03-10 10:17:18.720641] D [MSGID: 0] [glusterd-utils.c:4078:glusterd_compare_friend_data] 0-management: Returning with ret: 0, status: 1 [2016-03-10 10:17:18.745569] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_LOCAL_ACC' [2016-03-10 10:17:18.745770] I [MSGID: 106493] [glusterd-handler.c:3780:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.32.1.144 (0), ret: 0 [2016-03-10 10:17:18.745805] D [MSGID: 0] [glusterd-sm.c:911:glusterd_ac_handle_friend_add_req] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.745841] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Accepted peer request [2016-03-10 10:17:18.745877] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Accepted peer request' to 'Accepted peer request' due to event 'GD_FRIEND_EVENT_RCVD_FRIEND_REQ' [2016-03-10 10:17:18.745907] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:17:18.745935] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Accepted peer request [2016-03-10 10:17:18.745979] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.746359] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:18.746646] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:17:18.746359] and [2016-03-10 10:17:18.746640] [2016-03-10 10:17:18.746644] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.775729] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:17:18.775804] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.775977] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Accepted peer request [2016-03-10 10:17:18.776008] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_LOCAL_ACC' [2016-03-10 10:17:18.776037] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Accepted peer request [2016-03-10 10:17:18.776178] D [MSGID: 0] [glusterd-peer-utils.c:615:gd_add_friend_to_dict] 0-management: Returning 0 [2016-03-10 10:17:18.776344] D [MSGID: 0] [glusterd-rpc-ops.c:1674:glusterd_rpc_friend_update] 0-glusterd: Returning 0 [2016-03-10 10:17:18.776373] D [MSGID: 0] [glusterd-sm.c:590:glusterd_ac_send_friend_update] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.776410] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Accepted peer request [2016-03-10 10:17:18.776526] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Accepted peer request' to 'Peer in Cluster' due to event 'GD_FRIEND_EVENT_LOCAL_ACC' [2016-03-10 10:17:18.776556] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:17:18.776591] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:18.776647] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.776977] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:18.777135] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:17:18.776977] and [2016-03-10 10:17:18.777130] [2016-03-10 10:17:18.777134] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.815511] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:17:18.815575] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:17:18.815669] I [MSGID: 106493] [glusterd-rpc-ops.c:694:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:17:18.817240] D [MSGID: 0] [glusterd-snapshot-utils.c:3595:glusterd_is_snapd_enabled] 0-management: Key features.uss not present in the dict for volume c_glusterfs [2016-03-10 10:17:18.817950] D [MSGID: 0] [glusterd-utils.c:173:glusterd_lock] 0-management: Cluster lock held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:17:18.818116] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:18.818152] I [MSGID: 106492] [glusterd-handler.c:2715:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:17:18.818212] I [MSGID: 106502] [glusterd-handler.c:2760:__glusterd_handle_friend_update] 0-management: Received my uuid as Friend [2016-03-10 10:17:19.670521] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:17:19.679225] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:19.679313] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:19.679449] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=37 to slot->gen=38, fd=17, slot->fd=17 [2016-03-10 10:17:19.808631] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:17:19.815199] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:19.815250] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:19.815345] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=40 to slot->gen=41, fd=17, slot->fd=17 [2016-03-10 10:17:19.937544] I [MSGID: 106482] [glusterd-brick-ops.c:442:__glusterd_handle_add_brick] 0-management: Received add brick req [2016-03-10 10:17:19.937725] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:19.937778] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:19.937849] I [MSGID: 106062] [glusterd-brick-ops.c:494:__glusterd_handle_add_brick] 0-management: replica-count is 2 [2016-03-10 10:17:19.937902] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:19.937959] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:19.938014] I [MSGID: 106447] [glusterd-brick-ops.c:240:gd_addbr_validate_replica_count] 0-management: Changing the type of volume c_glusterfs from 'distribute' to 'replica' [2016-03-10 10:17:19.938239] D [MSGID: 0] [glusterd-locks.c:562:glusterd_mgmt_v3_lock] 0-management: Trying to acquire lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:17:19.939035] D [MSGID: 0] [glusterd-locks.c:618:glusterd_mgmt_v3_lock] 0-management: Lock for vol c_glusterfs successfully held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:17:19.939098] D [MSGID: 0] [glusterd-locks.c:512:glusterd_multiple_mgmt_v3_lock] 0-management: Returning 0 [2016-03-10 10:17:19.944951] D [MSGID: 0] [glusterd-mgmt.c:554:glusterd_mgmt_v3_initiate_lockdown] 0-management: Sent lock op req for Add brick to 1 peers. Returning 0 [2016-03-10 10:17:19.945103] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:19.945163] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:19.945305] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:19.945374] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:19.945449] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:19.945519] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:19.945659] D [MSGID: 0] [glusterd-utils.c:884:glusterd_brickinfo_new] 0-management: Returning 0 [2016-03-10 10:17:19.945738] D [MSGID: 0] [glusterd-utils.c:1041:glusterd_brickinfo_new_from_brick] 0-management: Returning 0 [2016-03-10 10:17:19.945853] D [MSGID: 0] [glusterd-utils.c:512:glusterd_volinfo_new] 0-management: Returning 0 [2016-03-10 10:17:19.945920] D [MSGID: 0] [glusterd-utils.c:815:glusterd_volume_brickinfos_delete] 0-management: Returning 0 [2016-03-10 10:17:19.945990] D [MSGID: 0] [store.c:460:gf_store_handle_destroy] 0-: Returning 0 [2016-03-10 10:17:19.946058] D [MSGID: 0] [glusterd-utils.c:859:glusterd_volinfo_delete] 0-management: Returning 0 [2016-03-10 10:17:19.946137] D [MSGID: 0] [glusterd-utils.c:884:glusterd_brickinfo_new] 0-management: Returning 0 [2016-03-10 10:17:19.946212] D [MSGID: 0] [glusterd-utils.c:1041:glusterd_brickinfo_new_from_brick] 0-management: Returning 0 [2016-03-10 10:17:19.946291] D [MSGID: 0] [glusterd-utils.c:512:glusterd_volinfo_new] 0-management: Returning 0 [2016-03-10 10:17:19.946346] D [MSGID: 0] [glusterd-utils.c:815:glusterd_volume_brickinfos_delete] 0-management: Returning 0 [2016-03-10 10:17:19.946402] D [MSGID: 0] [store.c:460:gf_store_handle_destroy] 0-: Returning 0 [2016-03-10 10:17:19.946474] D [MSGID: 0] [glusterd-utils.c:859:glusterd_volinfo_delete] 0-management: Returning 0 [2016-03-10 10:17:19.946539] D [MSGID: 0] [glusterd-utils.c:884:glusterd_brickinfo_new] 0-management: Returning 0 [2016-03-10 10:17:19.946615] D [MSGID: 0] [glusterd-utils.c:1041:glusterd_brickinfo_new_from_brick] 0-management: Returning 0 [2016-03-10 10:17:19.946659] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:19.946689] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:19.946722] D [MSGID: 0] [glusterd-utils.c:925:glusterd_resolve_brick] 0-management: Returning 0 [2016-03-10 10:17:19.946779] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:17:19.946849] D [MSGID: 0] [glusterd-utils.c:5656:glusterd_new_brick_validate] 0-management: returning 0 [2016-03-10 10:17:19.946937] D [MSGID: 0] [glusterd-brick-ops.c:1741:glusterd_op_stage_add_brick] 0-management: Returning 0 [2016-03-10 10:17:19.947006] D [MSGID: 0] [glusterd-mgmt.c:198:gd_mgmt_v3_pre_validate_fn] 0-management: OP = 8. Returning 0 [2016-03-10 10:17:19.956846] D [MSGID: 0] [glusterd-mgmt.c:893:glusterd_mgmt_v3_pre_validate] 0-management: Sent pre valaidation req for Add brick to 1 peers. Returning 0 [2016-03-10 10:17:19.956945] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:19.956994] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:19.957065] I [MSGID: 106062] [glusterd-brick-ops.c:1268:glusterd_op_perform_add_bricks] 0-management: replica-count is set 2 [2016-03-10 10:17:19.957096] I [MSGID: 106062] [glusterd-brick-ops.c:1273:glusterd_op_perform_add_bricks] 0-management: type is set 2, need to change it [2016-03-10 10:17:19.957181] D [MSGID: 0] [glusterd-utils.c:884:glusterd_brickinfo_new] 0-management: Returning 0 [2016-03-10 10:17:19.957233] D [MSGID: 0] [glusterd-utils.c:1041:glusterd_brickinfo_new_from_brick] 0-management: Returning 0 [2016-03-10 10:17:19.957303] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:19.957355] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:19.957411] D [MSGID: 0] [glusterd-utils.c:925:glusterd_resolve_brick] 0-management: Returning 0 [2016-03-10 10:17:19.957482] D [MSGID: 0] [glusterd-brick-ops.c:113:add_brick_at_right_order] 0-management: brick:/opt/lvmdir/c2/brick index=1, count=0 [2016-03-10 10:17:19.958033] D [MSGID: 0] [glusterd-volgen.c:5109:generate_brick_volfiles] 0-management: Found a brick - 10.32.0.48:/opt/lvmdir/c2/brick [2016-03-10 10:17:19.960468] D [MSGID: 0] [glusterd-volgen.c:1268:server_check_marker_off] 0-glusterd: Returning 0 [2016-03-10 10:17:19.963038] D [MSGID: 0] [glusterd-volgen.c:5109:generate_brick_volfiles] 0-management: Found a brick - 10.32.1.144:/opt/lvmdir/c2/brick [2016-03-10 10:17:19.966250] D [MSGID: 0] [glusterd-volgen.c:1268:server_check_marker_off] 0-glusterd: Returning 0 [2016-03-10 10:17:19.968595] D [MSGID: 0] [glusterd-volgen.c:5120:generate_brick_volfiles] 0-management: Returning 0 [2016-03-10 10:17:19.968703] D [MSGID: 0] [glusterd-utils.c:884:glusterd_brickinfo_new] 0-management: Returning 0 [2016-03-10 10:17:19.968779] D [MSGID: 0] [glusterd-utils.c:1041:glusterd_brickinfo_new_from_brick] 0-management: Returning 0 [2016-03-10 10:17:19.968850] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:19.968913] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:19.968989] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.1.144:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:19.969049] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:19.969113] D [MSGID: 0] [glusterd-utils.c:1359:glusterd_volume_brickinfo_get_by_brick] 0-glusterd: Returning 0 [2016-03-10 10:17:19.969175] D [MSGID: 0] [glusterd-utils.c:4539:glusterd_brick_start] 0-management: returning 0 [2016-03-10 10:17:19.969242] D [MSGID: 0] [glusterd-brick-ops.c:1436:glusterd_op_perform_add_bricks] 0-glusterd: Returning 0 [2016-03-10 10:17:19.969330] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: nfs already stopped [2016-03-10 10:17:19.970069] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:19.970168] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:19.970232] D [MSGID: 0] [glusterd-nfs-svc.c:135:glusterd_nfssvc_stop] 0-management: Returning 0 [2016-03-10 10:17:19.970730] D [MSGID: 0] [glusterd-volgen.c:4809:build_nfs_graph] 0-glusterd: Returning 0 [2016-03-10 10:17:19.971646] D [MSGID: 0] [glusterd-nfs-svc.c:106:glusterd_nfssvc_manager] 0-management: Returning 0 [2016-03-10 10:17:19.972564] D [MSGID: 0] [glusterd-volgen.c:881:_xl_link_children] 0-management: glustershd:c_glusterfs-replicate-0 [2016-03-10 10:17:19.975682] D [MSGID: 0] [glusterd-shd-svc.c:78:glusterd_shdsvc_create_volfile] 0-management: Returning 0 [2016-03-10 10:17:19.976093] D [MSGID: 0] [glusterd-proc-mgmt.c:87:glusterd_proc_stop] 0-management: Stopping glustershd daemon running in pid: 2790 [2016-03-10 10:17:19.997041] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:19.997144] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:19.997250] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=2 from gen=28 to slot->gen=29, fd=7, slot->fd=7 [2016-03-10 10:17:20.068384] D [socket.c:3021:socket_connect] 0-glustershd: connection attempt on /var/run/gluster/b5a955fbd30abfb75ed6d5965f41d006.socket failed, (Connection refused) [2016-03-10 10:17:20.976971] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: /var/run/gluster/b5a955fbd30abfb75ed6d5965f41d006.socket: ping timer event already removed [2016-03-10 10:17:20.977060] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:20.977152] D [MSGID: 0] [glusterd-svc-mgmt.c:195:glusterd_svc_start] 0-management: Starting glustershd service [2016-03-10 10:17:20.988436] D [MSGID: 0] [glusterd-svc-mgmt.c:208:glusterd_svc_start] 0-management: Returning 0 [2016-03-10 10:17:20.988638] D [MSGID: 0] [glusterd-shd-svc.c:177:glusterd_shdsvc_start] 0-management: Returning 0 [2016-03-10 10:17:20.988743] D [MSGID: 0] [glusterd-shd-svc.c:139:glusterd_shdsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:20.989010] D [MSGID: 0] [glusterd-quotad-svc.c:111:glusterd_quotadsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:20.989147] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: bitd already stopped [2016-03-10 10:17:20.989955] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:20.990080] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:20.990118] D [MSGID: 0] [glusterd-bitd-svc.c:109:glusterd_bitdsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:20.990288] I [MSGID: 106132] [glusterd-proc-mgmt.c:83:glusterd_proc_stop] 0-management: scrub already stopped [2016-03-10 10:17:20.990707] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_conn_disconnect-0x6210c)[0x3fff92066ab4] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_svc_stop-0x613f8)[0x3fff920678b8] ))))) 0-: : ping timer event already removed [2016-03-10 10:17:20.990787] D [MSGID: 0] [glusterd-svc-mgmt.c:227:glusterd_svc_stop] 0-management: Returning 0 [2016-03-10 10:17:20.990822] D [MSGID: 0] [glusterd-scrub-svc.c:104:glusterd_scrubsvc_manager] 0-management: Returning 0 [2016-03-10 10:17:20.990851] D [MSGID: 0] [glusterd-mgmt.c:294:gd_mgmt_v3_commit_fn] 0-management: OP = 8. Returning 0 [2016-03-10 10:17:20.990892] D [MSGID: 0] [glusterd-utils.c:7507:glusterd_aggr_brick_mount_dirs] 0-management: No brick_count present [2016-03-10 10:17:20.991588] D [MSGID: 0] [glusterd-svc-mgmt.c:315:glusterd_svc_common_rpc_notify] 0-management: glustershd has connected with glusterd. [2016-03-10 10:17:20.991672] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:20.991947] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: /var/run/gluster/b5a955fbd30abfb75ed6d5965f41d006.socket: ping timer event already removed [2016-03-10 10:17:20.991993] I [MSGID: 106006] [glusterd-svc-mgmt.c:323:glusterd_svc_common_rpc_notify] 0-management: glustershd has disconnected from glusterd. [2016-03-10 10:17:20.992039] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=2 from gen=31 to slot->gen=32, fd=7, slot->fd=7 [2016-03-10 10:17:21.025763] D [MSGID: 0] [glusterd-handshake.c:409:glusterd_get_args_from_dict] 0-management: No brick name present [2016-03-10 10:17:21.025811] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning -1 [2016-03-10 10:17:21.025963] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 127.0.0.1 [2016-03-10 10:17:21.037077] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:21.037107] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:21.037146] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=11 from gen=1 to slot->gen=2, fd=19, slot->fd=19 [2016-03-10 10:17:21.094138] D [MSGID: 0] [glusterd-utils.c:7507:glusterd_aggr_brick_mount_dirs] 0-management: No brick_count present [2016-03-10 10:17:21.094300] D [MSGID: 0] [glusterd-mgmt.c:1427:glusterd_mgmt_v3_commit] 0-management: Sent commit req for Add brick to 1 peers. Returning 0 [2016-03-10 10:17:21.094429] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:21.094484] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:21.094685] D [MSGID: 0] [glusterd-volgen.c:5109:generate_brick_volfiles] 0-management: Found a brick - 10.32.0.48:/opt/lvmdir/c2/brick [2016-03-10 10:17:21.095541] D [MSGID: 0] [glusterd-volgen.c:1268:server_check_marker_off] 0-glusterd: Returning 0 [2016-03-10 10:17:21.096565] D [MSGID: 0] [glusterd-volgen.c:5109:generate_brick_volfiles] 0-management: Found a brick - 10.32.1.144:/opt/lvmdir/c2/brick [2016-03-10 10:17:21.097350] D [MSGID: 0] [glusterd-volgen.c:1268:server_check_marker_off] 0-glusterd: Returning 0 [2016-03-10 10:17:21.098181] D [MSGID: 0] [glusterd-volgen.c:5120:generate_brick_volfiles] 0-management: Returning 0 [2016-03-10 10:17:21.098703] D [MSGID: 0] [glusterd-peer-utils.c:133:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: 10.32.0.48 [2016-03-10 10:17:21.098798] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:21.099422] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:21.099508] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:21.099541] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.0.48:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:21.099576] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:21.099609] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:21.099637] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:21.099664] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.1.144:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:21.099691] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:21.101400] D [MSGID: 0] [glusterd-peer-utils.c:133:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: 10.32.0.48 [2016-03-10 10:17:21.101504] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:21.101962] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:21.101993] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:21.102021] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.0.48:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:21.102047] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:21.102077] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:17:21.102105] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:17:21.102132] D [MSGID: 0] [glusterd-utils.c:1326:glusterd_volume_brickinfo_get] 0-management: Found brick 10.32.1.144:/opt/lvmdir/c2/brick in volume c_glusterfs [2016-03-10 10:17:21.102158] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning 0 [2016-03-10 10:17:21.104038] D [MSGID: 0] [glusterd-store.c:1058:glusterd_store_create_volume_dir] 0-management: Returning with 0 [2016-03-10 10:17:21.104205] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:21.105541] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 19 times between [2016-03-10 10:17:21.104205] and [2016-03-10 10:17:21.105537] [2016-03-10 10:17:21.105540] D [MSGID: 0] [glusterd-store.c:440:glusterd_store_snapd_write] 0-management: Returning 0 [2016-03-10 10:17:21.119989] D [MSGID: 0] [glusterd-store.c:503:glusterd_store_perform_snapd_store] 0-management: Returning 0 [2016-03-10 10:17:21.120027] D [MSGID: 0] [glusterd-store.c:568:glusterd_store_snapd_info] 0-management: Returning with 0 [2016-03-10 10:17:21.120093] D [MSGID: 0] [glusterd-store.c:753:_storeopts] 0-management: Storing in volinfo:key= nfs.disable, val=on [2016-03-10 10:17:21.120192] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:21.120229] D [MSGID: 0] [glusterd-store.c:753:_storeopts] 0-management: Storing in volinfo:key= network.ping-timeout, val=4 [2016-03-10 10:17:21.120313] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:21.120349] D [MSGID: 0] [glusterd-store.c:753:_storeopts] 0-management: Storing in volinfo:key= performance.readdir-ahead, val=on [2016-03-10 10:17:21.120431] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:21.120472] D [MSGID: 0] [glusterd-store.c:1104:glusterd_store_volinfo_write] 0-management: Returning 0 [2016-03-10 10:17:21.120563] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:21.121182] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 8 times between [2016-03-10 10:17:21.120563] and [2016-03-10 10:17:21.121178] [2016-03-10 10:17:21.121181] D [MSGID: 0] [glusterd-store.c:414:glusterd_store_brickinfo_write] 0-management: Returning 0 [2016-03-10 10:17:21.121267] D [MSGID: 0] [glusterd-store.c:464:glusterd_store_perform_brick_store] 0-management: Returning 0 [2016-03-10 10:17:21.121294] D [MSGID: 0] [glusterd-store.c:533:glusterd_store_brickinfo] 0-management: Returning with 0 [2016-03-10 10:17:21.121379] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:21.129062] D [MSGID: 0] [store.c:421:gf_store_handle_new] 0-: Returning 0 [2016-03-10 10:17:21.129254] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:21.129700] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 7 times between [2016-03-10 10:17:21.129254] and [2016-03-10 10:17:21.129696] [2016-03-10 10:17:21.129700] D [MSGID: 0] [glusterd-store.c:414:glusterd_store_brickinfo_write] 0-management: Returning 0 [2016-03-10 10:17:21.129775] D [MSGID: 0] [glusterd-store.c:464:glusterd_store_perform_brick_store] 0-management: Returning 0 [2016-03-10 10:17:21.129802] D [MSGID: 0] [glusterd-store.c:533:glusterd_store_brickinfo] 0-management: Returning with 0 [2016-03-10 10:17:21.129828] D [MSGID: 0] [glusterd-store.c:1325:glusterd_store_brickinfos] 0-management: Returning 0 [2016-03-10 10:17:21.129854] D [MSGID: 0] [glusterd-store.c:1439:glusterd_store_perform_volume_store] 0-management: Returning 0 [2016-03-10 10:17:21.181712] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:17:21.181941] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 3 times between [2016-03-10 10:17:21.181712] and [2016-03-10 10:17:21.181936] [2016-03-10 10:17:21.181940] D [MSGID: 0] [glusterd-store.c:1383:glusterd_store_node_state_write] 0-management: Returning 0 [2016-03-10 10:17:21.204216] D [MSGID: 0] [glusterd-store.c:1411:glusterd_store_perform_node_state_store] 0-management: Returning 0 [2016-03-10 10:17:21.204776] D [MSGID: 0] [glusterd-utils.c:2052:glusterd_volume_compute_cksum] 0-management: Returning with 0 [2016-03-10 10:17:21.204810] D [MSGID: 0] [glusterd-store.c:1645:glusterd_store_volinfo] 0-management: Returning 0 [2016-03-10 10:17:21.205043] D [MSGID: 0] [glusterd-handshake.c:414:glusterd_get_args_from_dict] 0-management: brick_name = /opt/lvmdir/c2/brick [2016-03-10 10:17:21.205104] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning -1 [2016-03-10 10:17:21.205261] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:21.205966] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:21.206020] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning -1 [2016-03-10 10:17:21.206052] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:21.206078] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:21.206173] D [MSGID: 0] [glusterd-handshake.c:841:__server_getspec] 0-management: Look for missing snap creates for /opt/lvmdir/c2/brick [2016-03-10 10:17:21.206426] D [MSGID: 0] [glusterd-handshake.c:409:glusterd_get_args_from_dict] 0-management: No brick name present [2016-03-10 10:17:21.206478] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:21.206523] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:21.206634] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 10.32.0.48 [2016-03-10 10:17:21.207229] D [MSGID: 0] [common-utils.c:3027:gf_interface_search] 0-management: 10.32.0.48 is local address at interface efd [2016-03-10 10:17:21.207305] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:21.207336] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:21.207601] D [MSGID: 0] [glusterd-handshake.c:409:glusterd_get_args_from_dict] 0-management: No brick name present [2016-03-10 10:17:21.207644] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning -1 [2016-03-10 10:17:21.207750] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 127.0.0.1 [2016-03-10 10:17:21.208312] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:21.208334] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:21.208372] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=11 from gen=4 to slot->gen=5, fd=19, slot->fd=19 [2016-03-10 10:17:21.220691] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:21.220737] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:21.220779] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=11 from gen=7 to slot->gen=8, fd=19, slot->fd=19 [2016-03-10 10:17:21.399669] D [MSGID: 0] [glusterd-mgmt.c:1647:glusterd_mgmt_v3_post_validate] 0-management: Sent post valaidation req for Add brick to 1 peers. Returning 0 [2016-03-10 10:17:21.404002] D [MSGID: 0] [glusterd-mgmt.c:1828:glusterd_mgmt_v3_release_peer_locks] 0-management: Sent unlock op req for Add brick to 1 peers. Returning 0 [2016-03-10 10:17:21.404076] D [MSGID: 0] [glusterd-locks.c:669:glusterd_mgmt_v3_unlock] 0-management: Trying to release lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:17:21.404161] D [MSGID: 0] [glusterd-locks.c:714:glusterd_mgmt_v3_unlock] 0-management: Lock for vol c_glusterfs successfully released [2016-03-10 10:17:21.404209] D [MSGID: 0] [glusterd-locks.c:451:glusterd_multiple_mgmt_v3_unlock] 0-management: Returning 0 [2016-03-10 10:17:21.404373] D [MSGID: 0] [glusterd-rpc-ops.c:205:glusterd_op_send_cli_response] 0-management: Returning 0 [2016-03-10 10:17:21.406505] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:21.406545] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:21.406587] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=43 to slot->gen=44, fd=17, slot->fd=17 [2016-03-10 10:17:21.466449] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:17:21.468826] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:21.468883] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:21.468930] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=46 to slot->gen=47, fd=17, slot->fd=17 [2016-03-10 10:17:21.493938] I [MSGID: 106488] [glusterd-handler.c:1472:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req [2016-03-10 10:17:21.494029] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:21.494057] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:21.496730] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:21.496791] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:21.496848] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=49 to slot->gen=50, fd=17, slot->fd=17 [2016-03-10 10:17:21.554620] D [MSGID: 0] [glusterd-handshake.c:409:glusterd_get_args_from_dict] 0-management: No brick name present [2016-03-10 10:17:21.554672] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:21.554699] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:21.554847] D [MSGID: 0] [common-utils.c:3133:gf_is_local_addr] 0-management: 127.0.0.1 [2016-03-10 10:17:21.554884] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:17:21.554913] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:17:21.572963] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:21.572992] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:21.573026] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=12 from gen=1 to slot->gen=2, fd=20, slot->fd=20 [2016-03-10 10:17:21.654246] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:21.654291] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:21.654335] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=12 from gen=4 to slot->gen=5, fd=20, slot->fd=20 [2016-03-10 10:17:24.069230] D [MSGID: 0] [glusterd-svc-mgmt.c:315:glusterd_svc_common_rpc_notify] 0-management: glustershd has connected with glusterd. [2016-03-10 10:17:24.418821] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:24.418878] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:24.418926] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=11 from gen=10 to slot->gen=11, fd=19, slot->fd=19 [2016-03-10 10:17:24.422667] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:24.422706] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:24.422750] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=8 from gen=52 to slot->gen=53, fd=17, slot->fd=17 [2016-03-10 10:17:46.071993] D [rpc-clnt-ping.c:300:rpc_clnt_start_ping] 0-management: returning as transport is already disconnected OR there are no frames (0 || 0) [2016-03-10 10:17:46.072533] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_disconnect-0x1a198)[0x3fff955f6430] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_unref-0x1a098)[0x3fff955f6548] (--> /usr/lib64/libgfrpc.so.0(+0x1a224)[0x3fff955fb224] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:17:46.072728] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:46.073105] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:17:46.073169] D [MSGID: 0] [glusterd-peer-utils.c:1005:glusterd_peerinfo_find_by_generation] 0-management: Friend with generation: 2, not found [2016-03-10 10:17:46.073234] D [MSGID: 106129] [glusterd-handler.c:5032:__glusterd_peer_rpc_notify] 0-management: Could not find peer 10.32.1.144(c6b64e36-76da-4e98-a616-48e0e52c7006) [No such file or directory] [2016-03-10 10:17:46.073926] I [MSGID: 101053] [mem-pool.c:616:mem_pool_destroy] 0-management: size=588 max=3 total=17 [2016-03-10 10:17:46.074003] I [MSGID: 101053] [mem-pool.c:616:mem_pool_destroy] 0-management: size=124 max=3 total=17 [2016-03-10 10:17:46.074144] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=4 to slot->gen=5, fd=15, slot->fd=15 [2016-03-10 10:17:46.107872] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:17:46.107936] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:17:46.108011] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=7 from gen=1 to slot->gen=2, fd=16, slot->fd=16 [2016-03-10 10:17:48.072896] D [rpc-clnt-ping.c:300:rpc_clnt_start_ping] 0-management: returning as transport is already disconnected OR there are no frames (0 || 0) [2016-03-10 10:19:13.835079] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:19:13.835243] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:21:13.845438] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:21:13.845496] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:22:03.409124] I [MSGID: 106488] [glusterd-handler.c:1472:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req [2016-03-10 10:22:03.412145] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:22:03.412207] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:22:03.414016] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:22:03.414062] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:22:03.414109] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=7 to slot->gen=8, fd=15, slot->fd=15 [2016-03-10 10:22:19.911677] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:22:19.911723] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:22:19.911775] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=10 to slot->gen=11, fd=15, slot->fd=15 [2016-03-10 10:22:46.651322] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:22:46.653442] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:22:46.653478] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:22:46.653524] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=13 to slot->gen=14, fd=15, slot->fd=15 [2016-03-10 10:23:13.855606] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present The message "I [MSGID: 106488] [glusterd-handler.c:1472:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req" repeated 3 times between [2016-03-10 10:22:03.409124] and [2016-03-10 10:22:19.909383] [2016-03-10 10:22:19.909416] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:22:19.909421] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:23:13.855774] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:25:01.580130] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:25:01.580222] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=10 from gen=1 to slot->gen=2, fd=21, slot->fd=21 [2016-03-10 10:25:01.884141] W [socket.c:588:__socket_rwv] 0-management: readv on 10.32.1.144:24007 failed (Connection timed out) [2016-03-10 10:25:01.884200] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:25:01.884625] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:25:01.884679] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:25:01.884720] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:25:01.884756] D [MSGID: 0] [glusterd-locks.c:669:glusterd_mgmt_v3_unlock] 0-management: Trying to release lock of vol c_glusterfs for c6b64e36-76da-4e98-a616-48e0e52c7006 as c_glusterfs_vol [2016-03-10 10:25:01.885075] W [glusterd-locks.c:681:glusterd_mgmt_v3_unlock] (-->/usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_big_locked_notify-0x14b5a0) [0x3fff91f764f8] -->/usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(__glusterd_peer_rpc_notify-0x141264) [0x3fff91f80f54] -->/usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_mgmt_v3_unlock-0x9dd2c) [0x3fff9202997c] ) 0-management: Lock for vol c_glusterfs not held [2016-03-10 10:25:01.885107] W [MSGID: 106118] [glusterd-handler.c:5087:__glusterd_peer_rpc_notify] 0-management: Lock not released for c_glusterfs [2016-03-10 10:25:01.885143] D [MSGID: 0] [glusterd-utils.c:173:glusterd_lock] 0-management: Cluster lock held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:25:01.885182] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=4 to slot->gen=5, fd=18, slot->fd=18 [2016-03-10 10:25:12.866390] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:25:12.866460] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:25:12.866510] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:25:12.866533] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:25:13.867439] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:25:13.867516] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:25:46.804281] E [socket.c:2278:socket_connect_finish] 0-management: connection to 10.32.1.144:24007 failed (No route to host) [2016-03-10 10:25:46.804336] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:25:46.804357] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:25:46.804793] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:25:46.804852] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:25:46.804894] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:25:46.804928] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=16 to slot->gen=17, fd=15, slot->fd=15 [2016-03-10 10:25:48.871282] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:25:48.871331] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:25:48.871382] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:25:48.871409] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:25:49.810230] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:25:49.810280] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:25:49.810697] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:25:49.810775] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=19 to slot->gen=20, fd=15, slot->fd=15 [2016-03-10 10:25:51.872477] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:25:51.872547] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:25:51.872570] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:25:54.878279] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:25:54.878332] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:25:54.878846] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:25:54.878941] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd." repeated 2 times between [2016-03-10 10:25:46.804894] and [2016-03-10 10:25:54.878924] [2016-03-10 10:25:54.878939] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=22 to slot->gen=23, fd=15, slot->fd=15 [2016-03-10 10:25:57.873834] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:25:57.873906] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:25:57.873929] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:25:57.884301] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:25:57.884346] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:25:57.884811] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:25:57.884889] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster" repeated 3 times between [2016-03-10 10:25:46.804852] and [2016-03-10 10:25:57.884871] [2016-03-10 10:25:57.884888] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:25:57.885001] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=25 to slot->gen=26, fd=15, slot->fd=15 [2016-03-10 10:26:00.875043] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:26:00.875128] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:26:00.875151] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:26:00.890330] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:26:00.890364] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:26:00.890781] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:26:00.890834] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007" repeated 3 times between [2016-03-10 10:25:48.871282] and [2016-03-10 10:26:00.875037] [2016-03-10 10:26:00.890832] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:26:00.890924] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:26:00.890967] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=28 to slot->gen=29, fd=15, slot->fd=15 [2016-03-10 10:26:03.876224] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:26:03.876278] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:26:03.876329] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:26:03.876355] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:26:03.896343] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:26:03.896386] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:26:03.896877] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:26:03.896931] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:26:03.896977] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:26:03.897014] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=31 to slot->gen=32, fd=15, slot->fd=15 [2016-03-10 10:26:06.877409] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:26:06.877469] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:26:06.877521] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:26:06.877548] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:26:06.902341] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:26:06.902381] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:26:06.902815] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:26:06.902898] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:26:06.902951] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:26:06.902990] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=34 to slot->gen=35, fd=15, slot->fd=15 [2016-03-10 10:26:09.878614] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:26:09.878679] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:26:09.878729] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:26:09.878752] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:26:09.908346] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:26:09.908391] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:26:09.908809] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:26:09.908857] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:26:09.908903] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:26:09.908940] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=37 to slot->gen=38, fd=15, slot->fd=15 [2016-03-10 10:26:12.879748] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:26:12.879802] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:26:12.879854] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:26:12.879877] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:26:12.914342] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:26:12.914387] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:26:12.914807] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:26:12.914857] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:26:12.914903] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:26:12.914940] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=40 to slot->gen=41, fd=15, slot->fd=15 [2016-03-10 10:26:15.880955] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:26:15.881006] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:26:15.881068] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:26:15.881100] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:26:15.920350] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:26:15.920396] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:26:15.920796] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:26:15.920845] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:26:15.920891] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:26:15.920927] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=43 to slot->gen=44, fd=15, slot->fd=15 [2016-03-10 10:26:18.882152] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:26:18.882211] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:26:18.882262] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:26:18.882285] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:26:18.926337] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:26:18.926377] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:26:18.926785] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:26:18.926835] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:26:18.926881] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:26:18.926918] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=46 to slot->gen=47, fd=15, slot->fd=15 [2016-03-10 10:26:21.883379] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:26:21.883441] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:26:21.883494] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:26:21.883517] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:26:21.932356] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:26:21.932411] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:26:21.932822] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:26:21.932873] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:26:21.932921] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:26:21.932957] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=49 to slot->gen=50, fd=15, slot->fd=15 [2016-03-10 10:26:24.884577] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:26:24.884632] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:26:24.884683] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:26:24.884705] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:26:27.888432] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:26:27.888481] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:26:27.888878] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:26:27.888929] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:26:27.888975] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:26:27.889012] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=52 to slot->gen=53, fd=15, slot->fd=15 [2016-03-10 10:26:30.886000] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:26:30.886074] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:26:30.886125] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:26:30.886148] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:26:30.886664] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:26:30.886688] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:26:30.887087] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:26:30.887144] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:26:30.887186] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:26:30.887222] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=55 to slot->gen=56, fd=15, slot->fd=15 [2016-03-10 10:26:33.887229] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:26:33.887290] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:26:33.887342] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:26:33.887365] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:26:33.887864] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:26:33.887889] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:26:33.888291] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:26:33.888341] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:26:33.888381] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:26:33.888417] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=58 to slot->gen=59, fd=15, slot->fd=15 [2016-03-10 10:26:36.888426] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:26:36.888481] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:26:36.888535] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:26:36.888558] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:27:13.891923] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:27:13.892000] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:27:40.016426] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:27:40.016480] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:27:40.016891] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:27:40.016946] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:27:40.016987] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:27:40.017022] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=61 to slot->gen=62, fd=15, slot->fd=15 [2016-03-10 10:27:42.895126] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:27:42.895177] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:27:42.895233] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:27:42.895256] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:27:42.895768] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:27:42.895793] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:27:42.896203] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:27:42.896278] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=64 to slot->gen=65, fd=15, slot->fd=15 [2016-03-10 10:27:45.896346] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:27:45.896414] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:27:45.896436] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:27:45.896948] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:27:45.896973] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:27:45.897378] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:27:45.897474] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd." repeated 2 times between [2016-03-10 10:27:40.016987] and [2016-03-10 10:27:45.897461] [2016-03-10 10:27:45.897472] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=67 to slot->gen=68, fd=15, slot->fd=15 [2016-03-10 10:27:48.897516] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:27:48.897587] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:27:48.897609] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:27:48.898088] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:27:48.898115] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:27:48.898504] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:27:48.898568] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster" repeated 3 times between [2016-03-10 10:27:40.016946] and [2016-03-10 10:27:48.898553] [2016-03-10 10:27:48.898567] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:27:48.898653] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=70 to slot->gen=71, fd=15, slot->fd=15 [2016-03-10 10:27:51.898717] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:27:51.898788] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:27:51.898810] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:27:51.899317] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:27:51.899348] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:27:51.899785] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:27:51.899836] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007" repeated 3 times between [2016-03-10 10:27:42.895126] and [2016-03-10 10:27:51.898713] [2016-03-10 10:27:51.899835] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:27:51.899926] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:27:51.899974] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=73 to slot->gen=74, fd=15, slot->fd=15 [2016-03-10 10:27:54.900233] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:27:54.900289] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:27:54.900348] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:27:54.900636] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:27:54.901142] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:27:54.901168] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:27:54.901572] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:27:54.901623] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:27:54.901665] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:27:54.901702] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=76 to slot->gen=77, fd=15, slot->fd=15 [2016-03-10 10:27:57.901678] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:27:57.901734] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:27:57.901783] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:27:57.901806] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:27:57.902305] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:27:57.902330] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:27:57.902727] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:27:57.902777] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:27:57.902819] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:27:57.902855] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=79 to slot->gen=80, fd=15, slot->fd=15 [2016-03-10 10:28:00.902842] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:28:00.902900] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:28:00.902951] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:28:00.902974] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:28:00.903534] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:28:00.903561] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:28:00.903968] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:28:00.904018] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:00.904069] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:28:00.904108] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=82 to slot->gen=83, fd=15, slot->fd=15 [2016-03-10 10:28:03.904085] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:28:03.904141] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:28:03.904192] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:28:03.904218] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:28:03.904713] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:28:03.904737] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:28:03.905137] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:28:03.905186] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:03.905228] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:28:03.905264] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=85 to slot->gen=86, fd=15, slot->fd=15 [2016-03-10 10:28:06.905289] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:28:06.905345] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:28:06.905403] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:28:06.905426] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:28:06.905913] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:28:06.905937] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:28:06.906337] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:28:06.906388] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:06.906429] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:28:06.906466] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=88 to slot->gen=89, fd=15, slot->fd=15 [2016-03-10 10:28:09.906544] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:28:09.906599] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:28:09.906649] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:28:09.906671] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:28:09.907171] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:28:09.907196] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:28:09.907585] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:28:09.907634] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:09.907675] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:28:09.907711] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=91 to slot->gen=92, fd=15, slot->fd=15 [2016-03-10 10:28:12.907745] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:28:12.907801] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:28:12.907851] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:28:12.907873] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:28:12.908407] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:28:12.908446] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:28:12.908878] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:28:12.908935] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:12.908984] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:28:12.909022] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=94 to slot->gen=95, fd=15, slot->fd=15 [2016-03-10 10:28:15.908948] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:28:15.908999] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:28:15.909069] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:28:15.909096] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:28:15.909593] D [socket.c:681:__socket_shutdown] 0-management: shutdown() returned -1. Transport endpoint is not connected [2016-03-10 10:28:15.909618] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:28:15.910005] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup-0x19b20)[0x3fff955f6af0] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify-0x18e68)[0x3fff955f7808] (--> /usr/lib64/libgfrpc.so.0(rpc_transport_notify-0x1d8bc)[0x3fff955f285c] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:28:15.910064] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:15.910106] I [MSGID: 106004] [glusterd-handler.c:5065:__glusterd_peer_rpc_notify] 0-management: Peer <10.32.1.144> (), in state , has disconnected from glusterd. [2016-03-10 10:28:15.910143] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=6 from gen=97 to slot->gen=98, fd=15, slot->fd=15 [2016-03-10 10:28:18.910197] D [MSGID: 0] [common-utils.c:333:gf_resolve_ip6] 0-resolver: returning ip-10.32.1.144 (port-24007) for hostname: 10.32.1.144 and port: 24007 [2016-03-10 10:28:18.910256] D [socket.c:2833:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection [2016-03-10 10:28:18.910306] W [socket.c:869:__socket_keepalive] 0-socket: failed to set TCP_USER_TIMEOUT -1000 on socket 15, Invalid argument [2016-03-10 10:28:18.910329] E [socket.c:2965:socket_connect] 0-management: Failed to set keep-alive: Invalid argument [2016-03-10 10:28:18.910808] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:18.910845] D [MSGID: 0] [glusterd-handler.c:5042:__glusterd_peer_rpc_notify] 0-management: got RPC_CLNT_CONNECT [2016-03-10 10:28:18.910878] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:18.911530] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(+0x1a188)[0x3fff955fb188] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit-0x1a4d8)[0x3fff955f60a8] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(glusterd_submit_request-0x129078)[0x3fff91f99de8] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:28:19.314976] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:28:19.314957] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.314974] D [MSGID: 0] [glusterd-handshake.c:2098:__glusterd_peer_dump_version_cbk] 0-management: Proceeding to op-version handshake with peer 10.32.1.144 [2016-03-10 10:28:19.315152] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.316904] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:28:19.316881] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.316903] D [MSGID: 0] [glusterd-handshake.c:1660:gd_validate_peer_op_version] 0-management: Peer 10.32.1.144 accepted [2016-03-10 10:28:19.317120] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: 267a92c3-fd28-4811-903c-c1d54854bda9, not found [2016-03-10 10:28:19.317157] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: 267a92c3-fd28-4811-903c-c1d54854bda9 [2016-03-10 10:28:19.317565] E [MSGID: 101076] [common-utils.c:2954:gf_get_hostname_from_ip] 0-common-utils: Could not lookup hostname of 10.32.1.144 : Temporary failure in name resolution [2016-03-10 10:28:19.317601] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:19.317723] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: 267a92c3-fd28-4811-903c-c1d54854bda9, not found [2016-03-10 10:28:19.317759] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: 267a92c3-fd28-4811-903c-c1d54854bda9 [2016-03-10 10:28:19.318064] E [MSGID: 101076] [common-utils.c:2954:gf_get_hostname_from_ip] 0-common-utils: Could not lookup hostname of 10.32.1.144 : Temporary failure in name resolution [2016-03-10 10:28:19.318101] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:19.333549] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.333619] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:28:19.333612] D [MSGID: 0] [glusterd-peer-utils.c:995:glusterd_peerinfo_find_by_generation] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.333618] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_CONNECTED' [2016-03-10 10:28:19.333711] D [MSGID: 0] [glusterd-handshake.c:1613:glusterd_event_connected_inject] 0-glusterd: returning 0 [2016-03-10 10:28:19.333751] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.333790] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_CONNECTED' [2016-03-10 10:28:19.333819] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.334237] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:28:19.333849] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.334236] D [MSGID: 0] [glusterd-utils.c:2504:glusterd_add_volume_to_dict] 0-management: Returning with 0 [2016-03-10 10:28:19.334664] D [MSGID: 0] [glusterd-rpc-ops.c:1579:glusterd_rpc_friend_add] 0-glusterd: Returning 0 [2016-03-10 10:28:19.334699] D [MSGID: 0] [glusterd-sm.c:334:glusterd_ac_friend_add] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.334727] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.334757] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Peer in Cluster' to 'Peer in Cluster' due to event 'GD_FRIEND_EVENT_CONNECTED' [2016-03-10 10:28:19.334784] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:28:19.334812] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.334853] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.335103] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:28:19.335251] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:28:19.335103] and [2016-03-10 10:28:19.335247] [2016-03-10 10:28:19.335250] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.353166] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:28:19.353229] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.353335] I [MSGID: 106163] [glusterd-handshake.c:1193:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 30706 [2016-03-10 10:28:19.353659] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:28:19.375921] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:28:19.353744] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:28:19.375919] I [MSGID: 106163] [glusterd-handshake.c:1193:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 30706 [2016-03-10 10:28:19.376258] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:28:19.503126] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:28:19.376344] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:28:19.503124] I [MSGID: 106493] [glusterd-rpc-ops.c:480:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 267a92c3-fd28-4811-903c-c1d54854bda9, host: 10.32.1.144, port: 0 [2016-03-10 10:28:19.503233] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: 267a92c3-fd28-4811-903c-c1d54854bda9, not found [2016-03-10 10:28:19.503279] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: 267a92c3-fd28-4811-903c-c1d54854bda9 [2016-03-10 10:28:19.503310] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:19.503344] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_RCVD_ACC' [2016-03-10 10:28:19.503374] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.503401] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_RCVD_ACC' [2016-03-10 10:28:19.503428] D [MSGID: 0] [glusterd-sm.c:203:glusterd_ac_none] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.503454] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.503483] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Peer in Cluster' to 'Peer in Cluster' due to event 'GD_FRIEND_EVENT_RCVD_ACC' [2016-03-10 10:28:19.503510] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:28:19.503537] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.503580] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.503808] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:28:19.503949] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:28:19.503808] and [2016-03-10 10:28:19.503944] [2016-03-10 10:28:19.503948] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.517966] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:28:19.518006] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.519805] D [MSGID: 0] [glusterd-utils.c:173:glusterd_lock] 0-management: Cluster lock held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:28:19.520673] D [MSGID: 0] [glusterd-snapshot-utils.c:3595:glusterd_is_snapd_enabled] 0-management: Key features.uss not present in the dict for volume c_glusterfs [2016-03-10 10:28:19.537655] I [MSGID: 106490] [glusterd-handler.c:2884:__glusterd_handle_probe_query] 0-glusterd: Received probe from uuid: 267a92c3-fd28-4811-903c-c1d54854bda9 [2016-03-10 10:28:19.538085] E [MSGID: 101076] [common-utils.c:2954:gf_get_hostname_from_ip] 0-common-utils: Could not lookup hostname of 10.32.1.144 : Temporary failure in name resolution [2016-03-10 10:28:19.538128] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: 267a92c3-fd28-4811-903c-c1d54854bda9, not found [2016-03-10 10:28:19.538159] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: 267a92c3-fd28-4811-903c-c1d54854bda9 [2016-03-10 10:28:19.538189] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:19.538283] I [MSGID: 106493] [glusterd-handler.c:2947:__glusterd_handle_probe_query] 0-glusterd: Responded to 10.32.1.144, op_ret: 0, op_errno: 0, ret: 0 [2016-03-10 10:28:19.570343] I [MSGID: 106490] [glusterd-handler.c:2884:__glusterd_handle_probe_query] 0-glusterd: Received probe from uuid: 267a92c3-fd28-4811-903c-c1d54854bda9 [2016-03-10 10:28:19.570767] E [MSGID: 101076] [common-utils.c:2954:gf_get_hostname_from_ip] 0-common-utils: Could not lookup hostname of 10.32.1.144 : Temporary failure in name resolution [2016-03-10 10:28:19.570812] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: 267a92c3-fd28-4811-903c-c1d54854bda9, not found [2016-03-10 10:28:19.570844] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: 267a92c3-fd28-4811-903c-c1d54854bda9 [2016-03-10 10:28:19.570874] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:19.570970] I [MSGID: 106493] [glusterd-handler.c:2947:__glusterd_handle_probe_query] 0-glusterd: Responded to 10.32.1.144, op_ret: 0, op_errno: 0, ret: 0 [2016-03-10 10:28:19.588349] I [MSGID: 106490] [glusterd-handler.c:2539:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: 267a92c3-fd28-4811-903c-c1d54854bda9 [2016-03-10 10:28:19.588701] E [MSGID: 101076] [common-utils.c:2954:gf_get_hostname_from_ip] 0-common-utils: Could not lookup hostname of 10.32.1.144 : Temporary failure in name resolution [2016-03-10 10:28:19.588743] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: 267a92c3-fd28-4811-903c-c1d54854bda9, not found [2016-03-10 10:28:19.588774] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: 267a92c3-fd28-4811-903c-c1d54854bda9 [2016-03-10 10:28:19.588803] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:19.589017] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_RCVD_FRIEND_REQ' [2016-03-10 10:28:19.589060] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.589092] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_RCVD_FRIEND_REQ' [2016-03-10 10:28:19.589122] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:19.589170] D [MSGID: 0] [glusterd-utils.c:2830:import_prdict_dict] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.589213] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:28:19.589241] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:28:19.589281] D [MSGID: 0] [glusterd-utils.c:2757:glusterd_compare_friend_volume] 0-management: quota checksum absent for volume c_glusterfs in peer 10.32.1.144's response [2016-03-10 10:28:19.589309] D [MSGID: 0] [glusterd-utils.c:2776:glusterd_compare_friend_volume] 0-management: Returning with ret: 0, status: 1 [2016-03-10 10:28:19.589337] D [MSGID: 0] [glusterd-utils.c:4078:glusterd_compare_friend_data] 0-management: Returning with ret: 0, status: 1 [2016-03-10 10:28:19.601718] D [MSGID: 0] [glusterd-sm.c:1163:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_LOCAL_ACC' [2016-03-10 10:28:19.601869] I [MSGID: 106493] [glusterd-handler.c:3780:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 10.32.1.144 (0), ret: 0 [2016-03-10 10:28:19.601900] D [MSGID: 0] [glusterd-sm.c:911:glusterd_ac_handle_friend_add_req] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.601936] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: c6b64e36-76da-4e98-a616-48e0e52c7006, not found [2016-03-10 10:28:19.601968] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:28:19.601999] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:19.602041] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Peer in Cluster' to 'Peer in Cluster' due to event 'GD_FRIEND_EVENT_RCVD_FRIEND_REQ' [2016-03-10 10:28:19.602082] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:28:19.602115] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: c6b64e36-76da-4e98-a616-48e0e52c7006, not found [2016-03-10 10:28:19.602146] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:28:19.602175] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:19.602226] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.602441] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:28:19.602584] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:28:19.602441] and [2016-03-10 10:28:19.602580] [2016-03-10 10:28:19.602584] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.618731] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:28:19.618794] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.618985] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: c6b64e36-76da-4e98-a616-48e0e52c7006, not found [2016-03-10 10:28:19.619018] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:28:19.619049] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:19.619091] D [MSGID: 0] [glusterd-sm.c:1255:glusterd_friend_sm] 0-glusterd: Dequeued event of type: 'GD_FRIEND_EVENT_LOCAL_ACC' [2016-03-10 10:28:19.619124] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: c6b64e36-76da-4e98-a616-48e0e52c7006, not found [2016-03-10 10:28:19.619155] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:28:19.619183] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:19.619240] D [MSGID: 0] [glusterd-peer-utils.c:615:gd_add_friend_to_dict] 0-management: Returning 0 [2016-03-10 10:28:19.619389] D [MSGID: 0] [glusterd-rpc-ops.c:1674:glusterd_rpc_friend_update] 0-glusterd: Returning 0 [2016-03-10 10:28:19.619418] D [MSGID: 0] [glusterd-sm.c:590:glusterd_ac_send_friend_update] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.619459] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: c6b64e36-76da-4e98-a616-48e0e52c7006, not found [2016-03-10 10:28:19.619489] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:28:19.619517] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:19.619547] D [MSGID: 0] [glusterd-utils.c:6023:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Peer in Cluster' to 'Peer in Cluster' due to event 'GD_FRIEND_EVENT_LOCAL_ACC' [2016-03-10 10:28:19.619574] D [MSGID: 0] [glusterd-utils.c:6025:glusterd_sm_tr_log_transition_add] 0-management: returning 0 [2016-03-10 10:28:19.619616] D [MSGID: 0] [glusterd-peer-utils.c:209:glusterd_peerinfo_find_by_uuid] 0-management: Friend with uuid: c6b64e36-76da-4e98-a616-48e0e52c7006, not found [2016-03-10 10:28:19.619647] D [MSGID: 0] [glusterd-peer-utils.c:235:glusterd_peerinfo_find] 0-management: Unable to find peer by uuid: c6b64e36-76da-4e98-a616-48e0e52c7006 [2016-03-10 10:28:19.619675] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:19.619718] D [MSGID: 0] [glusterd-store.c:3802:glusterd_store_create_peer_dir] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.619965] D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0 [2016-03-10 10:28:19.620128] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "D [MSGID: 0] [store.c:375:gf_store_save_value] 0-management: returning: 0" repeated 2 times between [2016-03-10 10:28:19.619965] and [2016-03-10 10:28:19.620124] [2016-03-10 10:28:19.620128] D [MSGID: 0] [glusterd-store.c:3931:glusterd_store_peer_write] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.634120] D [MSGID: 0] [glusterd-store.c:3957:glusterd_store_perform_peer_store] 0-glusterd: Returning 0 [2016-03-10 10:28:19.634178] D [MSGID: 0] [glusterd-store.c:3978:glusterd_store_peerinfo] 0-glusterd: Returning with 0 [2016-03-10 10:28:19.685253] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:28:19.685290] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:28:19.685328] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=7 to slot->gen=8, fd=18, slot->fd=18 [2016-03-10 10:28:19.693506] I [MSGID: 106493] [glusterd-rpc-ops.c:694:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 267a92c3-fd28-4811-903c-c1d54854bda9 [2016-03-10 10:28:19.892392] I [MSGID: 106488] [glusterd-handler.c:1472:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req [2016-03-10 10:28:19.892492] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:28:19.892519] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:28:19.894857] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:28:19.894901] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:28:19.894976] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=10 to slot->gen=11, fd=18, slot->fd=18 [2016-03-10 10:28:19.940480] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:28:19.942575] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:28:19.942613] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:28:19.942653] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=13 to slot->gen=14, fd=18, slot->fd=18 [2016-03-10 10:28:19.991846] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:28:19.994142] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:28:19.994176] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:28:19.994219] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=16 to slot->gen=17, fd=18, slot->fd=18 [2016-03-10 10:28:20.040400] D [MSGID: 0] [glusterd-op-sm.c:214:glusterd_generate_txn_id] 0-management: Transaction_id = f8aae686-ccad-4e94-9027-191a994703e0 [2016-03-10 10:28:20.040473] D [MSGID: 0] [glusterd-op-sm.c:311:glusterd_set_txn_opinfo] 0-management: Successfully set opinfo for transaction ID : f8aae686-ccad-4e94-9027-191a994703e0 [2016-03-10 10:28:20.040512] D [MSGID: 0] [glusterd-op-sm.c:318:glusterd_set_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:28:20.040544] D [MSGID: 0] [glusterd-syncop.c:1767:gd_sync_task_begin] 0-management: Transaction ID : f8aae686-ccad-4e94-9027-191a994703e0 [2016-03-10 10:28:20.040577] D [MSGID: 0] [glusterd-syncop.c:1807:gd_sync_task_begin] 0-glusterd: Failed to get volume name [2016-03-10 10:28:20.040624] D [MSGID: 0] [glusterd-op-sm.c:1695:glusterd_op_stage_status_volume] 0-management: Returning: 0 [2016-03-10 10:28:20.040652] D [MSGID: 0] [glusterd-op-sm.c:5515:glusterd_op_stage_validate] 0-management: OP = 18. Returning 0 [2016-03-10 10:28:20.040816] D [MSGID: 0] [glusterd-syncop.c:1312:gd_stage_op_phase] 0-management: Sent stage op req for 'Volume Status' to 1 peers [2016-03-10 10:28:20.042109] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:20.042193] D [MSGID: 0] [glusterd-op-sm.c:7010:glusterd_op_bricks_select] 0-management: Returning 0 [2016-03-10 10:28:20.042233] D [MSGID: 0] [glusterd-syncop.c:1709:gd_brick_op_phase] 0-management: Sent op req to 0 bricks [2016-03-10 10:28:20.042282] D [MSGID: 0] [glusterd-op-sm.c:3360:glusterd_op_status_volume] 0-management: Returning 0 [2016-03-10 10:28:20.042310] D [MSGID: 0] [glusterd-op-sm.c:5642:glusterd_op_commit_perform] 0-management: Returning 0 [2016-03-10 10:28:20.044833] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:20.044913] D [MSGID: 0] [glusterd-syncop.c:1449:gd_commit_op_phase] 0-management: Sent commit op req for 'Volume Status' to 1 peers [2016-03-10 10:28:20.044945] D [MSGID: 0] [glusterd-op-sm.c:4487:glusterd_op_modify_op_ctx] 0-management: op_ctx modification not required for status operation being performed [2016-03-10 10:28:20.044982] D [MSGID: 0] [glusterd-op-sm.c:255:glusterd_get_txn_opinfo] 0-management: Successfully got opinfo for transaction ID : f8aae686-ccad-4e94-9027-191a994703e0 [2016-03-10 10:28:20.045010] D [MSGID: 0] [glusterd-op-sm.c:259:glusterd_get_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:28:20.045045] D [MSGID: 0] [glusterd-op-sm.c:360:glusterd_clear_txn_opinfo] 0-management: Successfully cleared opinfo for transaction ID : f8aae686-ccad-4e94-9027-191a994703e0 [2016-03-10 10:28:20.045084] D [MSGID: 0] [glusterd-op-sm.c:364:glusterd_clear_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:28:20.045182] D [MSGID: 0] [glusterd-rpc-ops.c:205:glusterd_op_send_cli_response] 0-management: Returning 0 [2016-03-10 10:28:20.047365] I [MSGID: 106499] [glusterd-handler.c:4267:__glusterd_handle_status_volume] 0-management: Received status volume req for volume c_glusterfs [2016-03-10 10:28:20.047529] D [MSGID: 0] [glusterd-op-sm.c:214:glusterd_generate_txn_id] 0-management: Transaction_id = af726920-0fa0-404e-b397-9e28a632ca48 [2016-03-10 10:28:20.047573] D [MSGID: 0] [glusterd-op-sm.c:311:glusterd_set_txn_opinfo] 0-management: Successfully set opinfo for transaction ID : af726920-0fa0-404e-b397-9e28a632ca48 [2016-03-10 10:28:20.047601] D [MSGID: 0] [glusterd-op-sm.c:318:glusterd_set_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:28:20.047631] D [MSGID: 0] [glusterd-syncop.c:1767:gd_sync_task_begin] 0-management: Transaction ID : af726920-0fa0-404e-b397-9e28a632ca48 [2016-03-10 10:28:20.047674] D [MSGID: 0] [glusterd-locks.c:562:glusterd_mgmt_v3_lock] 0-management: Trying to acquire lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:28:20.048284] D [MSGID: 0] [glusterd-locks.c:618:glusterd_mgmt_v3_lock] 0-management: Lock for vol c_glusterfs successfully held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:28:20.048443] D [MSGID: 0] [glusterd-syncop.c:411:gd_syncop_mgmt_v3_lock] 0-glusterd: Returning 0 [2016-03-10 10:28:20.051529] D [MSGID: 0] [glusterd-syncop.c:1205:gd_lock_op_phase] 0-management: Sent lock op req for 'Volume Status' to 1 peers. Returning 0 [2016-03-10 10:28:20.051581] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:28:20.051608] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:28:20.051663] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:28:20.051690] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:28:20.051722] D [MSGID: 0] [glusterd-op-sm.c:1695:glusterd_op_stage_status_volume] 0-management: Returning: 0 [2016-03-10 10:28:20.051750] D [MSGID: 0] [glusterd-op-sm.c:5515:glusterd_op_stage_validate] 0-management: OP = 18. Returning 0 [2016-03-10 10:28:20.051841] D [MSGID: 0] [glusterd-syncop.c:1312:gd_stage_op_phase] 0-management: Sent stage op req for 'Volume Status' to 1 peers [2016-03-10 10:28:20.054548] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:20.054640] D [MSGID: 0] [glusterd-op-sm.c:7010:glusterd_op_bricks_select] 0-management: Returning 0 [2016-03-10 10:28:20.054674] D [MSGID: 0] [glusterd-syncop.c:1709:gd_brick_op_phase] 0-management: Sent op req to 0 bricks [2016-03-10 10:28:20.054725] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:28:20.054753] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:28:20.054910] D [MSGID: 0] [glusterd-snapshot-utils.c:3595:glusterd_is_snapd_enabled] 0-management: Key features.uss not present in the dict for volume c_glusterfs [2016-03-10 10:28:20.055087] D [MSGID: 0] [glusterd-utils.c:4342:glusterd_add_node_to_dict] 0-management: Returning 0 [2016-03-10 10:28:20.055402] D [MSGID: 0] [glusterd-op-sm.c:3360:glusterd_op_status_volume] 0-management: Returning 0 [2016-03-10 10:28:20.055431] D [MSGID: 0] [glusterd-op-sm.c:5642:glusterd_op_commit_perform] 0-management: Returning 0 [2016-03-10 10:28:20.059193] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:28:20.059445] D [MSGID: 0] [glusterd-syncop.c:1449:gd_commit_op_phase] 0-management: Sent commit op req for 'Volume Status' to 1 peers [2016-03-10 10:28:20.059487] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:28:20.059515] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:28:20.059557] D [MSGID: 0] [glusterd-op-sm.c:4244:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Got uuid /opt/lvmdir/c2/brick [2016-03-10 10:28:20.059592] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:28:20.059587] D [MSGID: 0] [glusterd-op-sm.c:4244:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Got uuid /opt/lvmdir/c2/brick [2016-03-10 10:28:20.059592] D [MSGID: 0] [glusterd-op-sm.c:4244:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Got uuid f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:28:20.059663] D [MSGID: 0] [glusterd-op-sm.c:4256:glusterd_op_volume_dict_uuid_to_hostname] 0-management: f4ebe3c5-b6a4-4795-98e0-732337f76faf -> localhost [2016-03-10 10:28:20.059695] D [MSGID: 0] [glusterd-op-sm.c:4244:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Got uuid 267a92c3-fd28-4811-903c-c1d54854bda9 [2016-03-10 10:28:20.059726] D [MSGID: 0] [glusterd-op-sm.c:4256:glusterd_op_volume_dict_uuid_to_hostname] 0-management: 267a92c3-fd28-4811-903c-c1d54854bda9 -> 10.32.1.144 [2016-03-10 10:28:20.059756] D [MSGID: 0] [glusterd-op-sm.c:4270:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Returning 0 [2016-03-10 10:28:20.059885] D [MSGID: 0] [glusterd-syncop.c:510:gd_syncop_mgmt_v3_unlock] 0-glusterd: Returning 0 [2016-03-10 10:28:20.062534] D [MSGID: 0] [glusterd-syncop.c:1558:gd_unlock_op_phase] 0-management: Sent unlock op req for 'Volume Status' to 1 peers. Returning 0 [2016-03-10 10:28:20.062576] D [MSGID: 0] [glusterd-locks.c:669:glusterd_mgmt_v3_unlock] 0-management: Trying to release lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:28:20.062617] D [MSGID: 0] [glusterd-locks.c:714:glusterd_mgmt_v3_unlock] 0-management: Lock for vol c_glusterfs successfully released [2016-03-10 10:28:20.062654] D [MSGID: 0] [glusterd-op-sm.c:255:glusterd_get_txn_opinfo] 0-management: Successfully got opinfo for transaction ID : af726920-0fa0-404e-b397-9e28a632ca48 [2016-03-10 10:28:20.062681] D [MSGID: 0] [glusterd-op-sm.c:259:glusterd_get_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:28:20.062722] D [MSGID: 0] [glusterd-op-sm.c:360:glusterd_clear_txn_opinfo] 0-management: Successfully cleared opinfo for transaction ID : af726920-0fa0-404e-b397-9e28a632ca48 [2016-03-10 10:28:20.062755] D [MSGID: 0] [glusterd-op-sm.c:364:glusterd_clear_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:28:20.062941] D [MSGID: 0] [glusterd-rpc-ops.c:205:glusterd_op_send_cli_response] 0-management: Returning 0 [2016-03-10 10:28:20.064989] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:28:20.065280] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:28:20.065321] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=19 to slot->gen=20, fd=18, slot->fd=18 [2016-03-10 10:28:20.111607] I [MSGID: 106484] [glusterd-brick-ops.c:836:__glusterd_handle_remove_brick] 0-management: Received rem brick req [2016-03-10 10:28:20.111704] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:28:20.111733] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:28:20.111763] I [MSGID: 106062] [glusterd-brick-ops.c:914:__glusterd_handle_remove_brick] 0-management: request to change replica-count to 1 [2016-03-10 10:28:20.111825] D [MSGID: 0] [glusterd-brick-ops.c:1038:__glusterd_handle_remove_brick] 0-management: Remove brick count 1 brick: 10.32.1.144:/opt/lvmdir/c2/brick [2016-03-10 10:28:20.111874] D [MSGID: 0] [glusterd-utils.c:884:glusterd_brickinfo_new] 0-management: Returning 0 [2016-03-10 10:28:20.111910] D [MSGID: 0] [glusterd-utils.c:1041:glusterd_brickinfo_new_from_brick] 0-management: Returning 0 [2016-03-10 10:28:20.111944] D [MSGID: 0] [glusterd-peer-utils.c:646:gd_peerinfo_find_from_hostname] 0-management: Friend 10.32.1.144 found.. state: 3 [2016-03-10 10:28:20.111972] D [MSGID: 0] [glusterd-peer-utils.c:168:glusterd_hostname_to_uuid] 0-management: returning 0 [2016-03-10 10:28:20.112001] D [MSGID: 0] [glusterd-utils.c:1335:glusterd_volume_brickinfo_get] 0-management: Returning -1 [2016-03-10 10:28:20.112028] D [MSGID: 0] [glusterd-utils.c:1359:glusterd_volume_brickinfo_get_by_brick] 0-glusterd: Returning -1 [2016-03-10 10:28:20.112068] E [MSGID: 106256] [glusterd-brick-ops.c:1047:__glusterd_handle_remove_brick] 0-management: Incorrect brick 10.32.1.144:/opt/lvmdir/c2/brick for volume c_glusterfs [Invalid argument] [2016-03-10 10:28:20.112108] E [MSGID: 106265] [glusterd-brick-ops.c:1088:__glusterd_handle_remove_brick] 0-management: Incorrect brick 10.32.1.144:/opt/lvmdir/c2/brick for volume c_glusterfs [2016-03-10 10:28:20.114208] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:28:20.114243] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:28:20.114284] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=22 to slot->gen=23, fd=18, slot->fd=18 [2016-03-10 10:28:49.913404] D [rpc-clnt-ping.c:300:rpc_clnt_start_ping] 0-management: returning as transport is already disconnected OR there are no frames (0 || 0) [2016-03-10 10:29:13.915513] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:29:13.915602] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:30:36.026399] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:30:36.028686] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:36.028720] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:36.028766] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=25 to slot->gen=26, fd=18, slot->fd=18 [2016-03-10 10:30:36.078939] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:36.078975] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:36.079015] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=28 to slot->gen=29, fd=18, slot->fd=18 [2016-03-10 10:30:41.773668] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:41.773706] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:41.773747] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=31 to slot->gen=32, fd=18, slot->fd=18 [2016-03-10 10:30:41.822348] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:41.822399] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:41.822442] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=34 to slot->gen=35, fd=18, slot->fd=18 [2016-03-10 10:30:44.537265] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:44.537323] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:44.537372] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req" repeated 4 times between [2016-03-10 10:30:36.026399] and [2016-03-10 10:30:44.534549] [2016-03-10 10:30:44.537367] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=37 to slot->gen=38, fd=18, slot->fd=18 [2016-03-10 10:30:44.583034] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:30:44.586028] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:44.586096] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:44.586139] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=40 to slot->gen=41, fd=18, slot->fd=18 [2016-03-10 10:30:47.225468] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:30:47.227642] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:47.227677] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:47.227718] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=43 to slot->gen=44, fd=18, slot->fd=18 [2016-03-10 10:30:47.273600] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:30:47.276430] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:47.276459] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:47.276499] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=46 to slot->gen=47, fd=18, slot->fd=18 [2016-03-10 10:30:49.894950] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:30:49.897845] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:49.897893] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:49.897947] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=49 to slot->gen=50, fd=18, slot->fd=18 [2016-03-10 10:30:49.944421] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:30:49.946343] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:49.946402] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:49.946445] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=52 to slot->gen=53, fd=18, slot->fd=18 [2016-03-10 10:30:52.614015] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:30:52.616366] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:52.616425] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:52.616477] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=55 to slot->gen=56, fd=18, slot->fd=18 [2016-03-10 10:30:52.662981] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:30:52.664955] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:52.664982] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:52.665023] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=58 to slot->gen=59, fd=18, slot->fd=18 [2016-03-10 10:30:55.089851] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:30:55.091814] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:55.091841] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:55.091881] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=61 to slot->gen=62, fd=18, slot->fd=18 [2016-03-10 10:30:55.140120] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:30:55.142245] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:30:55.142274] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:30:55.142313] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=64 to slot->gen=65, fd=18, slot->fd=18 [2016-03-10 10:31:13.925769] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:31:13.925843] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:31:28.236554] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:31:28.239765] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:28.239800] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:28.239842] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=67 to slot->gen=68, fd=18, slot->fd=18 [2016-03-10 10:31:28.287620] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:28.287663] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:28.287719] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=70 to slot->gen=71, fd=18, slot->fd=18 [2016-03-10 10:31:30.974692] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:30.974728] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:30.974768] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=73 to slot->gen=74, fd=18, slot->fd=18 [2016-03-10 10:31:31.024275] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:31.024327] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:31.024367] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=76 to slot->gen=77, fd=18, slot->fd=18 [2016-03-10 10:31:33.438727] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:33.438764] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:33.438807] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req" repeated 4 times between [2016-03-10 10:31:28.236554] and [2016-03-10 10:31:33.436711] [2016-03-10 10:31:33.438803] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=79 to slot->gen=80, fd=18, slot->fd=18 [2016-03-10 10:31:33.484857] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:31:33.486981] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:33.487014] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:33.487067] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=82 to slot->gen=83, fd=18, slot->fd=18 [2016-03-10 10:31:35.865127] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:31:35.868162] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:35.868221] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:35.868272] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=85 to slot->gen=86, fd=18, slot->fd=18 [2016-03-10 10:31:35.913556] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:31:35.916066] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:35.916098] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:35.916140] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=88 to slot->gen=89, fd=18, slot->fd=18 [2016-03-10 10:31:49.399386] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:31:49.402113] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:49.402143] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:49.402182] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=91 to slot->gen=92, fd=18, slot->fd=18 [2016-03-10 10:31:49.448175] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:31:49.450326] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:49.450362] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:49.450410] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=94 to slot->gen=95, fd=18, slot->fd=18 [2016-03-10 10:31:52.045012] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:31:52.047858] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:52.047893] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:52.047942] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=97 to slot->gen=98, fd=18, slot->fd=18 [2016-03-10 10:31:52.093282] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:31:52.095249] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:52.095281] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:52.095325] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=100 to slot->gen=101, fd=18, slot->fd=18 [2016-03-10 10:31:56.044930] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:31:56.047399] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:56.047436] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:56.047482] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=103 to slot->gen=104, fd=18, slot->fd=18 [2016-03-10 10:31:56.092766] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:31:56.094949] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:31:56.094980] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:31:56.095023] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=106 to slot->gen=107, fd=18, slot->fd=18 [2016-03-10 10:32:47.006905] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:32:47.008903] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:32:47.008937] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:32:47.008983] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=109 to slot->gen=110, fd=18, slot->fd=18 [2016-03-10 10:32:47.056819] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:32:47.059501] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:32:47.059540] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:32:47.059581] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=112 to slot->gen=113, fd=18, slot->fd=18 [2016-03-10 10:33:13.935862] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:33:13.935939] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:34:23.344538] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:34:23.347034] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:34:23.347079] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:34:23.347121] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=115 to slot->gen=116, fd=18, slot->fd=18 [2016-03-10 10:34:23.396193] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:34:23.396246] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:34:23.396295] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=118 to slot->gen=119, fd=18, slot->fd=18 [2016-03-10 10:34:43.550539] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:34:43.550579] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:34:43.550619] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=121 to slot->gen=122, fd=18, slot->fd=18 [2016-03-10 10:34:43.598431] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:34:43.598476] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:34:43.598530] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=124 to slot->gen=125, fd=18, slot->fd=18 [2016-03-10 10:34:47.546751] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:34:47.546792] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:34:47.546844] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req" repeated 4 times between [2016-03-10 10:34:23.344538] and [2016-03-10 10:34:47.544619] [2016-03-10 10:34:47.546839] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=127 to slot->gen=128, fd=18, slot->fd=18 [2016-03-10 10:34:47.593586] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:34:47.595978] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:34:47.596010] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:34:47.596060] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=130 to slot->gen=131, fd=18, slot->fd=18 [2016-03-10 10:34:50.203640] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:34:50.206284] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:34:50.206316] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:34:50.206358] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=133 to slot->gen=134, fd=18, slot->fd=18 [2016-03-10 10:34:50.252143] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:34:50.254754] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:34:50.254793] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:34:50.254839] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=136 to slot->gen=137, fd=18, slot->fd=18 [2016-03-10 10:35:13.945945] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:35:13.946033] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:35:30.718489] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:35:30.720373] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:35:30.720406] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:35:30.720448] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=139 to slot->gen=140, fd=18, slot->fd=18 [2016-03-10 10:35:30.769408] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:35:30.769444] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:35:30.769485] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=142 to slot->gen=143, fd=18, slot->fd=18 [2016-03-10 10:36:16.645958] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:36:16.646002] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:36:16.646067] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=145 to slot->gen=146, fd=18, slot->fd=18 [2016-03-10 10:36:16.693717] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:36:16.693769] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:36:16.693818] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=148 to slot->gen=149, fd=18, slot->fd=18 [2016-03-10 10:36:19.625789] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:36:19.625825] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:36:19.625869] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req" repeated 4 times between [2016-03-10 10:35:30.718489] and [2016-03-10 10:36:19.623136] [2016-03-10 10:36:19.625864] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=151 to slot->gen=152, fd=18, slot->fd=18 [2016-03-10 10:36:19.673996] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:36:19.677003] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:36:19.677037] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:36:19.677089] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=154 to slot->gen=155, fd=18, slot->fd=18 [2016-03-10 10:36:22.432000] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:36:22.434345] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:36:22.434379] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:36:22.434421] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=157 to slot->gen=158, fd=18, slot->fd=18 [2016-03-10 10:36:22.479872] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:36:22.482666] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:36:22.482701] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:36:22.482741] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=160 to slot->gen=161, fd=18, slot->fd=18 [2016-03-10 10:36:24.730452] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:36:24.732607] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:36:24.732645] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:36:24.732689] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=163 to slot->gen=164, fd=18, slot->fd=18 [2016-03-10 10:36:24.780739] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:36:24.783404] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:36:24.783437] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:36:24.783486] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=166 to slot->gen=167, fd=18, slot->fd=18 [2016-03-10 10:36:36.696767] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:36:36.700024] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:36:36.700081] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:36:36.700132] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=169 to slot->gen=170, fd=18, slot->fd=18 [2016-03-10 10:36:36.745854] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:36:36.747812] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:36:36.747841] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:36:36.747887] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=172 to slot->gen=173, fd=18, slot->fd=18 [2016-03-10 10:36:39.130170] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:36:39.132872] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:36:39.132912] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:36:39.132957] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=175 to slot->gen=176, fd=18, slot->fd=18 [2016-03-10 10:36:39.179425] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:36:39.181814] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:36:39.181844] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:36:39.181885] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=178 to slot->gen=179, fd=18, slot->fd=18 [2016-03-10 10:37:13.956839] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:37:13.956920] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:37:35.622719] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:37:35.625102] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:37:35.625138] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:37:35.625181] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=181 to slot->gen=182, fd=18, slot->fd=18 [2016-03-10 10:37:35.674703] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:37:35.674740] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:37:35.674780] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=184 to slot->gen=185, fd=18, slot->fd=18 [2016-03-10 10:37:38.314976] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:37:38.315013] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:37:38.315065] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=187 to slot->gen=188, fd=18, slot->fd=18 [2016-03-10 10:37:38.364020] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:37:38.364091] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:37:38.364165] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=190 to slot->gen=191, fd=18, slot->fd=18 [2016-03-10 10:37:41.956873] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:37:41.956911] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:37:41.956963] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req" repeated 4 times between [2016-03-10 10:37:35.622719] and [2016-03-10 10:37:41.954652] [2016-03-10 10:37:41.956958] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=193 to slot->gen=194, fd=18, slot->fd=18 [2016-03-10 10:37:42.002988] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:37:42.005719] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:37:42.005757] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:37:42.005803] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=196 to slot->gen=197, fd=18, slot->fd=18 [2016-03-10 10:37:44.341201] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:37:44.343726] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:37:44.343761] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:37:44.343804] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=199 to slot->gen=200, fd=18, slot->fd=18 [2016-03-10 10:37:44.390353] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:37:44.393034] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:37:44.393083] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:37:44.393124] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=202 to slot->gen=203, fd=18, slot->fd=18 [2016-03-10 10:37:47.081476] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:37:47.083683] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:37:47.083721] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:37:47.083767] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=205 to slot->gen=206, fd=18, slot->fd=18 [2016-03-10 10:37:47.131568] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:37:47.134320] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:37:47.134362] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:37:47.134409] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=208 to slot->gen=209, fd=18, slot->fd=18 [2016-03-10 10:39:00.848565] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:39:00.851335] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:00.851376] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:00.851426] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=211 to slot->gen=212, fd=18, slot->fd=18 [2016-03-10 10:39:00.899009] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:39:00.901270] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:00.901313] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:00.901363] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=214 to slot->gen=215, fd=18, slot->fd=18 [2016-03-10 10:39:13.966930] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:39:13.967009] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:39:27.135854] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:39:27.138021] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:27.138074] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:27.138125] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=217 to slot->gen=218, fd=18, slot->fd=18 [2016-03-10 10:39:27.189867] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:27.189903] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:27.189943] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=220 to slot->gen=221, fd=18, slot->fd=18 [2016-03-10 10:39:49.521661] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:49.521699] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:49.521740] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=223 to slot->gen=224, fd=18, slot->fd=18 [2016-03-10 10:39:49.569209] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:49.569261] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:49.569303] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=226 to slot->gen=227, fd=18, slot->fd=18 [2016-03-10 10:39:51.889585] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:51.889854] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:51.889900] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req" repeated 4 times between [2016-03-10 10:39:27.135854] and [2016-03-10 10:39:51.887511] [2016-03-10 10:39:51.889896] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=229 to slot->gen=230, fd=18, slot->fd=18 [2016-03-10 10:39:51.936293] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:39:51.938431] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:51.938468] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:51.938510] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=232 to slot->gen=233, fd=18, slot->fd=18 [2016-03-10 10:39:54.683699] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:39:54.685804] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:54.685835] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:54.685884] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=235 to slot->gen=236, fd=18, slot->fd=18 [2016-03-10 10:39:54.731985] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:39:54.734478] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:54.734512] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:54.734552] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=238 to slot->gen=239, fd=18, slot->fd=18 [2016-03-10 10:39:57.164171] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:39:57.166132] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:57.166170] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:57.166217] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=241 to slot->gen=242, fd=18, slot->fd=18 [2016-03-10 10:39:57.214662] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:39:57.217463] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:57.217502] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:57.217557] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=244 to slot->gen=245, fd=18, slot->fd=18 [2016-03-10 10:39:59.549244] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:39:59.552026] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:59.552074] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:59.552116] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=247 to slot->gen=248, fd=18, slot->fd=18 [2016-03-10 10:39:59.600735] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:39:59.602944] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:39:59.602986] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:39:59.603036] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=250 to slot->gen=251, fd=18, slot->fd=18 [2016-03-10 10:40:02.218664] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:40:02.220994] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:40:02.221037] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:40:02.221091] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=253 to slot->gen=254, fd=18, slot->fd=18 [2016-03-10 10:40:02.266951] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:40:02.269457] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:40:02.269510] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:40:02.269552] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=256 to slot->gen=257, fd=18, slot->fd=18 [2016-03-10 10:40:05.076042] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:40:05.078033] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:40:05.078082] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:40:05.078133] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=259 to slot->gen=260, fd=18, slot->fd=18 [2016-03-10 10:40:05.124065] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:40:05.126032] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:40:05.126073] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:40:05.126113] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=262 to slot->gen=263, fd=18, slot->fd=18 [2016-03-10 10:40:09.395321] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:40:09.398007] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:40:09.398047] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:40:09.398107] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=265 to slot->gen=266, fd=18, slot->fd=18 [2016-03-10 10:40:09.444870] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:40:09.447039] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:40:09.447106] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:40:09.447150] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=268 to slot->gen=269, fd=18, slot->fd=18 [2016-03-10 10:40:25.007990] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:40:25.010639] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:40:25.010669] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:40:25.010709] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=271 to slot->gen=272, fd=18, slot->fd=18 [2016-03-10 10:40:25.062747] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:40:25.064792] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:40:25.064825] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:40:25.064865] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=274 to slot->gen=275, fd=18, slot->fd=18 [2016-03-10 10:41:11.634231] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:41:11.636125] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:41:11.636157] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:41:11.636198] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=277 to slot->gen=278, fd=18, slot->fd=18 [2016-03-10 10:41:11.685004] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:41:11.687872] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:41:11.687917] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:41:11.687966] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=280 to slot->gen=281, fd=18, slot->fd=18 [2016-03-10 10:41:13.977016] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:41:13.977104] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:41:15.630208] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:41:15.632636] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:41:15.632671] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:41:15.632711] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=283 to slot->gen=284, fd=18, slot->fd=18 [2016-03-10 10:41:15.683848] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:41:15.683904] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:41:15.683947] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=286 to slot->gen=287, fd=18, slot->fd=18 [2016-03-10 10:41:22.253986] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:41:22.254024] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:41:22.254076] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=289 to slot->gen=290, fd=18, slot->fd=18 [2016-03-10 10:41:22.304042] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:41:22.304089] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:41:22.304131] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=292 to slot->gen=293, fd=18, slot->fd=18 [2016-03-10 10:42:50.934063] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:42:50.934123] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:42:50.934170] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req" repeated 4 times between [2016-03-10 10:41:15.630208] and [2016-03-10 10:42:50.931918] [2016-03-10 10:42:50.934165] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=295 to slot->gen=296, fd=18, slot->fd=18 [2016-03-10 10:42:50.980778] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:42:50.983259] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:42:50.983288] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:42:50.983328] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=298 to slot->gen=299, fd=18, slot->fd=18 [2016-03-10 10:42:53.381487] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:42:53.383890] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:42:53.383950] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:42:53.383993] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=301 to slot->gen=302, fd=18, slot->fd=18 [2016-03-10 10:42:53.431780] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:42:53.434512] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:42:53.434548] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:42:53.434598] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=304 to slot->gen=305, fd=18, slot->fd=18 [2016-03-10 10:42:55.767747] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:42:55.770403] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:42:55.770461] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:42:55.770504] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=307 to slot->gen=308, fd=18, slot->fd=18 [2016-03-10 10:42:55.817277] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:42:55.819674] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:42:55.819702] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:42:55.819742] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=310 to slot->gen=311, fd=18, slot->fd=18 [2016-03-10 10:43:02.835324] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:43:02.837863] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:43:02.837923] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:43:02.837965] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=313 to slot->gen=314, fd=18, slot->fd=18 [2016-03-10 10:43:02.887605] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:43:02.890580] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:43:02.890636] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:43:02.890679] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=316 to slot->gen=317, fd=18, slot->fd=18 [2016-03-10 10:43:10.910204] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:43:10.912501] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:43:10.912557] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:43:10.912598] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=319 to slot->gen=320, fd=18, slot->fd=18 [2016-03-10 10:43:10.958020] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:43:10.960016] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:43:10.960044] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:43:10.960102] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=322 to slot->gen=323, fd=18, slot->fd=18 [2016-03-10 10:43:13.987154] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:43:13.987234] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:44:27.813779] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:44:27.816332] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:44:27.816389] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:44:27.816430] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=325 to slot->gen=326, fd=18, slot->fd=18 [2016-03-10 10:44:27.864408] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:44:27.864468] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:44:27.864511] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=328 to slot->gen=329, fd=18, slot->fd=18 [2016-03-10 10:44:30.332839] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:44:30.332901] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:44:30.332944] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=331 to slot->gen=332, fd=18, slot->fd=18 [2016-03-10 10:44:30.380885] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:44:30.380944] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:44:30.380988] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=334 to slot->gen=335, fd=18, slot->fd=18 [2016-03-10 10:44:52.082782] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:44:52.082840] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:44:52.082886] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req" repeated 4 times between [2016-03-10 10:44:27.813779] and [2016-03-10 10:44:52.080609] [2016-03-10 10:44:52.082881] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=337 to slot->gen=338, fd=18, slot->fd=18 [2016-03-10 10:44:52.131973] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:44:52.134165] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:44:52.134230] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:44:52.134274] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=340 to slot->gen=341, fd=18, slot->fd=18 [2016-03-10 10:45:13.997242] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:45:13.997323] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:47:14.007421] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:47:14.007480] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:47:27.230135] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:47:27.232265] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:47:27.232325] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:47:27.232366] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=343 to slot->gen=344, fd=18, slot->fd=18 [2016-03-10 10:47:27.280808] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:47:27.280865] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:47:27.280909] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=346 to slot->gen=347, fd=18, slot->fd=18 [2016-03-10 10:47:30.405546] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:47:30.405605] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:47:30.405648] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=349 to slot->gen=350, fd=18, slot->fd=18 [2016-03-10 10:47:30.453433] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:47:30.453492] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:47:30.453546] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=352 to slot->gen=353, fd=18, slot->fd=18 [2016-03-10 10:47:32.915122] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:47:32.915176] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:47:32.915225] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk The message "I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req" repeated 4 times between [2016-03-10 10:47:27.230135] and [2016-03-10 10:47:32.912492] [2016-03-10 10:47:32.915221] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=355 to slot->gen=356, fd=18, slot->fd=18 [2016-03-10 10:47:32.961504] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:47:32.963927] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:47:32.963977] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:47:32.964020] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=358 to slot->gen=359, fd=18, slot->fd=18 [2016-03-10 10:49:14.017620] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:49:14.017701] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:50:22.774177] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:50:22.776268] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:50:22.776306] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:50:22.776348] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=361 to slot->gen=362, fd=18, slot->fd=18 [2016-03-10 10:50:22.824582] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:50:22.824635] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:50:22.824677] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=364 to slot->gen=365, fd=18, slot->fd=18 [2016-03-10 10:51:14.027741] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:50:22.821944] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:51:14.027836] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:51:40.492282] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:51:40.494417] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:51:40.494470] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:51:40.494512] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=367 to slot->gen=368, fd=18, slot->fd=18 [2016-03-10 10:51:40.545237] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:51:40.545287] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:51:40.545327] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=370 to slot->gen=371, fd=18, slot->fd=18 [2016-03-10 10:53:14.038229] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:51:40.542544] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:53:14.038345] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:55:14.049138] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:55:14.049199] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:56:55.752039] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:56:55.754019] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:56:55.754045] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:56:55.754098] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=373 to slot->gen=374, fd=18, slot->fd=18 [2016-03-10 10:57:02.646575] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:57:02.646621] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:57:02.646656] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=376 to slot->gen=377, fd=18, slot->fd=18 [2016-03-10 10:57:14.059332] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:57:14.059405] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 10:57:21.864125] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:57:21.864163] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:57:21.864203] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=379 to slot->gen=380, fd=18, slot->fd=18 [2016-03-10 10:57:34.298205] I [MSGID: 106499] [glusterd-handler.c:4267:__glusterd_handle_status_volume] 0-management: Received status volume req for volume c_glusterfs [2016-03-10 10:57:34.298361] D [MSGID: 0] [glusterd-op-sm.c:214:glusterd_generate_txn_id] 0-management: Transaction_id = 8a313c06-114a-4392-9fb9-8769d63ba7f0 [2016-03-10 10:57:34.298403] D [MSGID: 0] [glusterd-op-sm.c:311:glusterd_set_txn_opinfo] 0-management: Successfully set opinfo for transaction ID : 8a313c06-114a-4392-9fb9-8769d63ba7f0 [2016-03-10 10:57:34.298428] D [MSGID: 0] [glusterd-op-sm.c:318:glusterd_set_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:57:34.298456] D [MSGID: 0] [glusterd-syncop.c:1767:gd_sync_task_begin] 0-management: Transaction ID : 8a313c06-114a-4392-9fb9-8769d63ba7f0 [2016-03-10 10:57:34.298501] D [MSGID: 0] [glusterd-locks.c:562:glusterd_mgmt_v3_lock] 0-management: Trying to acquire lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:57:34.299099] D [MSGID: 0] [glusterd-locks.c:618:glusterd_mgmt_v3_lock] 0-management: Lock for vol c_glusterfs successfully held by f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:57:34.299624] D [rpc-clnt-ping.c:98:rpc_clnt_remove_ping_timer_locked] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn-0xb5c80)[0x3fff95651f58] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_remove_ping_timer_locked-0x15f98)[0x3fff955fa990] (--> /usr/lib64/libgfrpc.so.0(+0x1a188)[0x3fff955fb188] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_submit-0x1a4d8)[0x3fff955f60a8] (--> /usr/lib64/glusterfs/3.7.6/xlator/mgmt/glusterd.so(gd_syncop_submit_request-0xa5514)[0x3fff92021d44] ))))) 0-: 10.32.1.144:24007: ping timer event already removed [2016-03-10 10:57:34.299715] D [MSGID: 0] [glusterd-syncop.c:411:gd_syncop_mgmt_v3_lock] 0-glusterd: Returning 0 [2016-03-10 10:57:34.302497] D [MSGID: 0] [glusterd-syncop.c:1205:gd_lock_op_phase] 0-management: Sent lock op req for 'Volume Status' to 1 peers. Returning 0 [2016-03-10 10:57:34.302593] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:57:34.302623] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:57:34.302702] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:57:34.302732] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:57:34.302764] D [MSGID: 0] [glusterd-op-sm.c:1695:glusterd_op_stage_status_volume] 0-management: Returning: 0 [2016-03-10 10:57:34.302792] D [MSGID: 0] [glusterd-op-sm.c:5515:glusterd_op_stage_validate] 0-management: OP = 18. Returning 0 [2016-03-10 10:57:34.302906] D [MSGID: 0] [glusterd-syncop.c:1312:gd_stage_op_phase] 0-management: Sent stage op req for 'Volume Status' to 1 peers [2016-03-10 10:57:34.305566] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:57:34.305648] D [MSGID: 0] [glusterd-op-sm.c:7010:glusterd_op_bricks_select] 0-management: Returning 0 [2016-03-10 10:57:34.305679] D [MSGID: 0] [glusterd-syncop.c:1709:gd_brick_op_phase] 0-management: Sent op req to 0 bricks [2016-03-10 10:57:34.305720] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:57:34.305747] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:57:34.305891] D [MSGID: 0] [glusterd-snapshot-utils.c:3595:glusterd_is_snapd_enabled] 0-management: Key features.uss not present in the dict for volume c_glusterfs [2016-03-10 10:57:34.306014] D [MSGID: 0] [glusterd-utils.c:4342:glusterd_add_node_to_dict] 0-management: Returning 0 [2016-03-10 10:57:34.306338] D [MSGID: 0] [glusterd-op-sm.c:3360:glusterd_op_status_volume] 0-management: Returning 0 [2016-03-10 10:57:34.306368] D [MSGID: 0] [glusterd-op-sm.c:5642:glusterd_op_commit_perform] 0-management: Returning 0 [2016-03-10 10:57:34.310249] D [MSGID: 0] [glusterd-peer-utils.c:200:glusterd_peerinfo_find_by_uuid] 0-management: Friend found... state: Peer in Cluster [2016-03-10 10:57:34.310510] D [MSGID: 0] [glusterd-syncop.c:1449:gd_commit_op_phase] 0-management: Sent commit op req for 'Volume Status' to 1 peers [2016-03-10 10:57:34.310580] D [MSGID: 0] [glusterd-utils.c:1424:glusterd_volinfo_find] 0-management: Volume c_glusterfs found [2016-03-10 10:57:34.310609] D [MSGID: 0] [glusterd-utils.c:1431:glusterd_volinfo_find] 0-management: Returning 0 [2016-03-10 10:57:34.310652] D [MSGID: 0] [glusterd-op-sm.c:4244:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Got uuid /opt/lvmdir/c2/brick [2016-03-10 10:57:34.310687] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk [2016-03-10 10:57:34.310682] D [MSGID: 0] [glusterd-op-sm.c:4244:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Got uuid /opt/lvmdir/c2/brick [2016-03-10 10:57:34.310687] D [MSGID: 0] [glusterd-op-sm.c:4244:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Got uuid f4ebe3c5-b6a4-4795-98e0-732337f76faf [2016-03-10 10:57:34.310758] D [MSGID: 0] [glusterd-op-sm.c:4256:glusterd_op_volume_dict_uuid_to_hostname] 0-management: f4ebe3c5-b6a4-4795-98e0-732337f76faf -> localhost [2016-03-10 10:57:34.310791] D [MSGID: 0] [glusterd-op-sm.c:4244:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Got uuid 267a92c3-fd28-4811-903c-c1d54854bda9 [2016-03-10 10:57:34.310822] D [MSGID: 0] [glusterd-op-sm.c:4256:glusterd_op_volume_dict_uuid_to_hostname] 0-management: 267a92c3-fd28-4811-903c-c1d54854bda9 -> 10.32.1.144 [2016-03-10 10:57:34.310852] D [MSGID: 0] [glusterd-op-sm.c:4270:glusterd_op_volume_dict_uuid_to_hostname] 0-management: Returning 0 [2016-03-10 10:57:34.311010] D [MSGID: 0] [glusterd-syncop.c:510:gd_syncop_mgmt_v3_unlock] 0-glusterd: Returning 0 [2016-03-10 10:57:34.313356] D [MSGID: 0] [glusterd-syncop.c:1558:gd_unlock_op_phase] 0-management: Sent unlock op req for 'Volume Status' to 1 peers. Returning 0 [2016-03-10 10:57:34.313400] D [MSGID: 0] [glusterd-locks.c:669:glusterd_mgmt_v3_unlock] 0-management: Trying to release lock of vol c_glusterfs for f4ebe3c5-b6a4-4795-98e0-732337f76faf as c_glusterfs_vol [2016-03-10 10:57:34.313437] D [MSGID: 0] [glusterd-locks.c:714:glusterd_mgmt_v3_unlock] 0-management: Lock for vol c_glusterfs successfully released [2016-03-10 10:57:34.313473] D [MSGID: 0] [glusterd-op-sm.c:255:glusterd_get_txn_opinfo] 0-management: Successfully got opinfo for transaction ID : 8a313c06-114a-4392-9fb9-8769d63ba7f0 [2016-03-10 10:57:34.313500] D [MSGID: 0] [glusterd-op-sm.c:259:glusterd_get_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:57:34.313534] D [MSGID: 0] [glusterd-op-sm.c:360:glusterd_clear_txn_opinfo] 0-management: Successfully cleared opinfo for transaction ID : 8a313c06-114a-4392-9fb9-8769d63ba7f0 [2016-03-10 10:57:34.313560] D [MSGID: 0] [glusterd-op-sm.c:364:glusterd_clear_txn_opinfo] 0-management: Returning 0 [2016-03-10 10:57:34.313730] D [MSGID: 0] [glusterd-rpc-ops.c:205:glusterd_op_send_cli_response] 0-management: Returning 0 [2016-03-10 10:57:34.316202] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:57:34.316226] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:57:34.316262] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=382 to slot->gen=383, fd=18, slot->fd=18 [2016-03-10 10:58:05.063772] D [rpc-clnt-ping.c:300:rpc_clnt_start_ping] 0-management: returning as transport is already disconnected OR there are no frames (0 || 0) [2016-03-10 10:59:07.191388] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:59:07.193379] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:59:07.193432] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:59:07.193474] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=385 to slot->gen=386, fd=18, slot->fd=18 [2016-03-10 10:59:07.244086] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 10:59:07.247279] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 10:59:07.247332] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 10:59:07.247375] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=388 to slot->gen=389, fd=18, slot->fd=18 [2016-03-10 10:59:14.069611] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 10:59:14.069693] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 11:01:14.079760] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 11:01:14.079822] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 11:02:20.241266] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 11:02:20.243631] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 11:02:20.243668] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 11:02:20.243767] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=391 to slot->gen=392, fd=18, slot->fd=18 [2016-03-10 11:02:20.291901] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 11:02:20.291941] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 11:02:20.291993] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=394 to slot->gen=395, fd=18, slot->fd=18 [2016-03-10 11:03:14.089865] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 11:02:20.289709] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 11:03:14.089962] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 11:05:14.100012] D [logging.c:1828:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present [2016-03-10 11:05:14.100083] D [logging.c:1790:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5 [2016-03-10 11:06:46.145396] I [MSGID: 106487] [glusterd-handler.c:1411:__glusterd_handle_cli_list_friends] 0-glusterd: Received cli list req [2016-03-10 11:06:46.147590] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 11:06:46.147625] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 11:06:46.147665] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=397 to slot->gen=398, fd=18, slot->fd=18 [2016-03-10 11:06:46.199453] D [socket.c:558:__socket_rwv] 0-socket.management: EOF on socket [2016-03-10 11:06:46.199509] D [socket.c:2355:socket_event_handler] 0-transport: disconnecting now [2016-03-10 11:06:46.199559] D [MSGID: 0] [event-epoll.c:591:event_dispatch_epoll_handler] 0-epoll: generation bumped on idx=9 from gen=400 to slot->gen=401, fd=18, slot->fd=18