[Bugs] [Bug 1447523] Glusterd segmentation fault in ' _Unwind_Backtrace' while running peer probe

bugzilla at redhat.com bugzilla at redhat.com
Fri May 5 10:43:31 UTC 2017


https://bugzilla.redhat.com/show_bug.cgi?id=1447523



--- Comment #14 from Ben Werthmann <ben at apcera.com> ---
# 10.0.50.125 /var/logs/glusterfs/etc-glusterfs-glusterd.vol.log
[2017-05-05 09:43:56.035300] I [MSGID: 100030] [glusterfsd.c:2454:main]
0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.8.11 (args:
/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level=TRACE --log-buf-size=0)
[2017-05-05 09:43:56.035327] T [MSGID: 0] [glusterfsd.c:573:create_fuse_mount]
0-glusterfsd: mount point not found, not a client process
[2017-05-05 09:43:56.039856] D [MSGID: 0]
[glusterfsd.c:2072:glusterfs_pidfile_update] 0-glusterfsd: pidfile
/var/run/glusterd.pid updated with pid 13600
[2017-05-05 09:43:56.039889] D [logging.c:1791:__gf_log_inject_timer_event]
0-logging-infra: Starting timer now. Timeout = 120, current buf size = 0
[2017-05-05 09:43:56.039979] D [MSGID: 0] [glusterfsd.c:660:get_volfp]
0-glusterfsd: loading volume file /etc/glusterfs/glusterd.vol
[2017-05-05 09:43:56.040077] T [MSGID: 0] [graph.y:186:new_volume] 0-parser:
New node for 'management'
[2017-05-05 09:43:56.040092] T [MSGID: 0] [xlator.c:193:xlator_dynload]
0-xlator: attempt to load file
/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/mgmt/glusterd.so
[2017-05-05 09:43:56.045814] T [MSGID: 0] [xlator.c:244:xlator_dynload]
0-xlator: dlsym(reconfigure) on
/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/mgmt/glusterd.so: undefined
symbol: reconfigure -- neglecting
[2017-05-05 09:43:56.045850] T [MSGID: 0] [graph.y:217:volume_type] 0-parser:
Type:management:mgmt/glusterd
[2017-05-05 09:43:56.045867] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:working-directory:/var/lib/glusterd
[2017-05-05 09:43:56.045877] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:transport-type:socket,rdma
[2017-05-05 09:43:56.045883] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:transport.socket.keepalive-time:10
[2017-05-05 09:43:56.045888] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:transport.socket.keepalive-interval:2
[2017-05-05 09:43:56.045893] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:transport.socket.read-fail-log:off
[2017-05-05 09:43:56.045898] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:ping-timeout:0
[2017-05-05 09:43:56.045903] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:event-threads:1
[2017-05-05 09:43:56.045908] T [MSGID: 0] [graph.y:323:volume_end] 0-parser:
end:management
[2017-05-05 09:43:56.045975] I [MSGID: 106478] [glusterd.c:1381:init]
0-management: Maximum allowed open file descriptors set to 65536
[2017-05-05 09:43:56.045990] I [MSGID: 106479] [glusterd.c:1430:init]
0-management: Using /var/lib/glusterd as working directory
[2017-05-05 09:43:56.046152] D [MSGID: 0]
[glusterd.c:408:glusterd_rpcsvc_options_build] 0-glusterd: listen-backlog
value: 128
[2017-05-05 09:43:56.046167] T [rpcsvc.c:2326:rpcsvc_init] 0-rpc-service: rx
pool: 64
[2017-05-05 09:43:56.046229] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_GLUSTERFS
[2017-05-05 09:43:56.046234] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_GLUSTERFS-v2
[2017-05-05 09:43:56.046238] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_UNIX
[2017-05-05 09:43:56.046242] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_NULL
[2017-05-05 09:43:56.046245] D [rpcsvc.c:2345:rpcsvc_init] 0-rpc-service: RPC
service inited.
[2017-05-05 09:43:56.046252] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GF-DUMP, Num: 123451501, Ver: 1, Port: 0
[2017-05-05 09:43:56.046268] D [rpc-transport.c:283:rpc_transport_load]
0-rpc-transport: attempt to load file
/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/rpc-transport/socket.so
[2017-05-05 09:43:56.048206] T [MSGID: 0]
[options.c:86:xlator_option_validate_int] 0-management: no range check required
for 'option transport.socket.listen-backlog 128'
[2017-05-05 09:43:56.048229] T [MSGID: 0]
[options.c:86:xlator_option_validate_int] 0-management: no range check required
for 'option transport.socket.keepalive-interval 2'
[2017-05-05 09:43:56.048240] T [MSGID: 0]
[options.c:86:xlator_option_validate_int] 0-management: no range check required
for 'option transport.socket.keepalive-time 10'
[2017-05-05 09:43:56.048252] D [socket.c:3938:socket_init] 0-socket.management:
Configued transport.tcp-user-timeout=0
[2017-05-05 09:43:56.048260] D [socket.c:4021:socket_init] 0-socket.management:
SSL support on the I/O path is NOT enabled
[2017-05-05 09:43:56.048264] D [socket.c:4024:socket_init] 0-socket.management:
SSL support for glusterd is NOT enabled
[2017-05-05 09:43:56.048267] D [socket.c:4041:socket_init] 0-socket.management:
using system polling thread
[2017-05-05 09:43:56.048274] D [name.c:584:server_fill_address_family]
0-socket.management: option address-family not specified, defaulting to inet
[2017-05-05 09:43:56.048287] T [socket.c:831:__socket_nodelay] 0-management:
NODELAY enabled for socket 10
[2017-05-05 09:43:56.048352] D [rpc-transport.c:283:rpc_transport_load]
0-rpc-transport: attempt to load file
/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/rpc-transport/rdma.so
[2017-05-05 09:43:56.048625] D [rpc-transport.c:321:rpc_transport_load]
0-rpc-transport: dlsym (gf_rpc_transport_reconfigure) on
/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/rpc-transport/rdma.so: undefined
symbol: reconfigure
[2017-05-05 09:43:56.048660] T [MSGID: 0] [rdma.c:4560:gf_rdma_options_init]
0-rpc-transport/rdma: rdma.management: defaulting MTU to '2048'
[2017-05-05 09:43:56.054678] W [MSGID: 103071]
[rdma.c:4589:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel
creation failed [No such device]
[2017-05-05 09:43:56.054690] W [MSGID: 103055] [rdma.c:4896:init]
0-rdma.management: Failed to initialize IB Device
[2017-05-05 09:43:56.054695] W [rpc-transport.c:354:rpc_transport_load]
0-rpc-transport: 'rdma' initialization failed
[2017-05-05 09:43:56.054728] W [rpcsvc.c:1667:rpcsvc_create_listener]
0-rpc-service: cannot create listener, initing the transport failed
[2017-05-05 09:43:56.054737] E [MSGID: 106243] [glusterd.c:1654:init]
0-management: creation of 1 listeners failed, continuing with succeeded
transport
[2017-05-05 09:43:56.054742] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GlusterD svc peer, Num: 1238437, Ver: 2,
Port: 0
[2017-05-05 09:43:56.054746] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GlusterD svc cli read-only, Num:
1238463, Ver: 2, Port: 0
[2017-05-05 09:43:56.054750] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GlusterD svc mgmt, Num: 1238433, Ver: 2,
Port: 0
[2017-05-05 09:43:56.054754] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GlusterD svc mgmt v3, Num: 1238433, Ver:
3, Port: 0
[2017-05-05 09:43:56.054758] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: Gluster Portmap, Num: 34123456, Ver: 1,
Port: 0
[2017-05-05 09:43:56.054761] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: Gluster Handshake, Num: 14398633, Ver:
2, Port: 0
[2017-05-05 09:43:56.054765] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: Gluster MGMT Handshake, Num: 1239873,
Ver: 1, Port: 0
[2017-05-05 09:43:56.054774] T [rpcsvc.c:2326:rpcsvc_init] 0-rpc-service: rx
pool: 8
[2017-05-05 09:43:56.054788] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_GLUSTERFS
[2017-05-05 09:43:56.054792] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_GLUSTERFS-v2
[2017-05-05 09:43:56.054796] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_UNIX
[2017-05-05 09:43:56.054799] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_NULL
[2017-05-05 09:43:56.054802] D [rpcsvc.c:2345:rpcsvc_init] 0-rpc-service: RPC
service inited.
[2017-05-05 09:43:56.054806] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GF-DUMP, Num: 123451501, Ver: 1, Port: 0
[2017-05-05 09:43:56.054818] D [rpc-transport.c:283:rpc_transport_load]
0-rpc-transport: attempt to load file
/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/rpc-transport/socket.so
[2017-05-05 09:43:56.054839] D [socket.c:3887:socket_init] 0-socket.management:
disabling nodelay
[2017-05-05 09:43:56.054844] D [socket.c:3938:socket_init] 0-socket.management:
Configued transport.tcp-user-timeout=0
[2017-05-05 09:43:56.054849] D [socket.c:4021:socket_init] 0-socket.management:
SSL support on the I/O path is NOT enabled
[2017-05-05 09:43:56.054853] D [socket.c:4024:socket_init] 0-socket.management:
SSL support for glusterd is NOT enabled
[2017-05-05 09:43:56.054856] D [socket.c:4041:socket_init] 0-socket.management:
using system polling thread
[2017-05-05 09:43:56.054889] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GlusterD svc cli, Num: 1238463, Ver: 2,
Port: 0
[2017-05-05 09:43:56.054896] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: Gluster Handshake (CLI Getspec), Num:
14398633, Ver: 2, Port: 0
[2017-05-05 09:43:56.054915] D [MSGID: 0]
[glusterd-utils.c:6384:glusterd_sm_tr_log_init] 0-glusterd: returning 0
[2017-05-05 09:43:56.054922] D [MSGID: 0] [glusterd.c:1722:init] 0-management:
cannot get run-with-valgrind value
[2017-05-05 09:43:56.515522] D [MSGID: 0]
[glusterd.c:467:glusterd_check_gsync_present] 0-glusterd: Returning 0
[2017-05-05 09:43:56.515610] D [MSGID: 0]
[glusterd.c:603:glusterd_crt_georep_folders] 0-glusterd: Returning 0
[2017-05-05 09:43:59.414037] E [MSGID: 101032]
[store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to
/var/lib/glusterd/glusterd.info. [No such file or directory]
[2017-05-05 09:43:59.414060] D [MSGID: 0]
[store.c:438:gf_store_handle_retrieve] 0-: Returning -1
[2017-05-05 09:43:59.414067] D [MSGID: 0]
[glusterd-store.c:1985:glusterd_retrieve_op_version] 0-management: Unable to
get store handle!
[2017-05-05 09:43:59.414074] E [MSGID: 101032]
[store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to
/var/lib/glusterd/glusterd.info. [No such file or directory]
[2017-05-05 09:43:59.414079] D [MSGID: 0]
[store.c:438:gf_store_handle_retrieve] 0-: Returning -1
[2017-05-05 09:43:59.414083] D [MSGID: 0]
[glusterd-store.c:2154:glusterd_retrieve_uuid] 0-management: Unable to get
storehandle!
[2017-05-05 09:43:59.414087] D [MSGID: 0]
[glusterd-store.c:2173:glusterd_retrieve_uuid] 0-management: Returning -1
[2017-05-05 09:43:59.414092] I [MSGID: 106514]
[glusterd-store.c:2120:glusterd_restore_op_version] 0-management: Detected new
install. Setting op-version to maximum : 30800
[2017-05-05 09:43:59.414115] D [MSGID: 0]
[glusterd-store.c:3190:glusterd_store_retrieve_volumes] 0-management: Returning
with 0
[2017-05-05 09:43:59.414144] D [MSGID: 0]
[glusterd-store.c:4257:glusterd_store_retrieve_peers] 0-management: Returning
with 0
[2017-05-05 09:43:59.414163] I [MSGID: 106194]
[glusterd-store.c:3628:glusterd_store_retrieve_missed_snaps_list] 0-management:
No missed snaps list.
[2017-05-05 09:43:59.414169] T [MSGID: 0]
[glusterd-store.c:3687:glusterd_store_retrieve_missed_snaps_list] 0-management:
Returning with 0
[2017-05-05 09:43:59.414173] D [MSGID: 0]
[glusterd-store.c:3748:glusterd_store_retrieve_snaps] 0-management: Returning
with 0
[2017-05-05 09:43:59.414178] T [MSGID: 0]
[glusterd-store.c:4425:glusterd_resolve_all_bricks] 0-management: Returning
with 0
[2017-05-05 09:43:59.414184] T [MSGID: 0]
[glusterd-store.c:4379:glusterd_snap_cleanup] 0-management: Returning with 0
[2017-05-05 09:43:59.414189] T [MSGID: 0]
[glusterd-store.c:4311:glusterd_recreate_all_snap_brick_mounts] 0-management:
Returning with 0
[2017-05-05 09:43:59.414193] D [MSGID: 0]
[glusterd-store.c:4478:glusterd_restore] 0-management: Returning 0
[2017-05-05 09:43:59.414225] E [MSGID: 101032]
[store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to
/var/lib/glusterd/options. [No such file or directory]
[2017-05-05 09:43:59.414232] D [MSGID: 0]
[store.c:438:gf_store_handle_retrieve] 0-: Returning -1
[2017-05-05 09:43:59.414237] D [MSGID: 0] [store.c:459:gf_store_handle_destroy]
0-: Returning 0
[2017-05-05 09:43:59.414288] T [MSGID: 0] [syncop.c:1006:__synclock_unlock] 0-:
Unlock success 0x7f56de91f800, remaining locks=0
[2017-05-05 09:43:59.416193] D [MSGID: 0] [store.c:420:gf_store_handle_new] 0-:
Returning 0
[2017-05-05 09:43:59.416237] D [MSGID: 0] [store.c:374:gf_store_save_value]
0-management: returning: 0
[2017-05-05 09:43:59.419580] D [MSGID: 0] [store.c:459:gf_store_handle_destroy]
0-: Returning 0
[2017-05-05 09:43:59.419619] D [MSGID: 0]
[options.c:1214:xlator_option_init_int32] 0-management: option event-threads
using set value 1
Final graph:
+------------------------------------------------------------------------------+
  1: volume management
  2:     type mgmt/glusterd
  3:     option rpc-auth.auth-glusterfs on
  4:     option rpc-auth.auth-unix on
  5:     option rpc-auth.auth-null on
  6:     option rpc-auth-allow-insecure on
  7:     option transport.socket.listen-backlog 128
  8:     option event-threads 1
  9:     option ping-timeout 0
 10:     option transport.socket.read-fail-log off
 11:     option transport.socket.keepalive-interval 2
 12:     option transport.socket.keepalive-time 10
 13:     option transport-type rdma
 14:     option working-directory /var/lib/glusterd
 15: end-volume
 16:  
+------------------------------------------------------------------------------+
[2017-05-05 09:43:59.419713] I [MSGID: 101190]
[event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with
index 1
[2017-05-05 09:45:56.060586] D [logging.c:1829:gf_log_flush_timeout_cbk]
0-logging-infra: Log timer timed out. About to flush outstanding messages if
present
[2017-05-05 09:45:56.060657] D [logging.c:1791:__gf_log_inject_timer_event]
0-logging-infra: Starting timer now. Timeout = 120, current buf size = 0
[2017-05-05 09:47:56.079709] D [logging.c:1829:gf_log_flush_timeout_cbk]
0-logging-infra: Log timer timed out. About to flush outstanding messages if
present
[2017-05-05 09:47:56.079783] D [logging.c:1791:__gf_log_inject_timer_event]
0-logging-infra: Starting timer now. Timeout = 120, current buf size = 0
[2017-05-05 09:49:56.099246] D [logging.c:1829:gf_log_flush_timeout_cbk]
0-logging-infra: Log timer timed out. About to flush outstanding messages if
present
[2017-05-05 09:49:56.099304] D [logging.c:1791:__gf_log_inject_timer_event]
0-logging-infra: Starting timer now. Timeout = 120, current buf size = 0
[2017-05-05 09:51:56.118550] D [logging.c:1829:gf_log_flush_timeout_cbk]
0-logging-infra: Log timer timed out. About to flush outstanding messages if
present
[2017-05-05 09:51:56.118601] D [logging.c:1791:__gf_log_inject_timer_event]
0-logging-infra: Starting timer now. Timeout = 120, current buf size = 0
[2017-05-05 09:53:56.137978] D [logging.c:1829:gf_log_flush_timeout_cbk]
0-logging-infra: Log timer timed out. About to flush outstanding messages if
present
[2017-05-05 09:53:56.138043] D [logging.c:1791:__gf_log_inject_timer_event]
0-logging-infra: Starting timer now. Timeout = 120, current buf size = 0
[2017-05-05 09:55:56.157222] D [logging.c:1829:gf_log_flush_timeout_cbk]
0-logging-infra: Log timer timed out. About to flush outstanding messages if
present
[2017-05-05 09:55:56.157283] D [logging.c:1791:__gf_log_inject_timer_event]
0-logging-infra: Starting timer now. Timeout = 120, current buf size = 0
[2017-05-05 09:57:37.713968] W [glusterfsd.c:1327:cleanup_and_exit]
(-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x8184) [0x7f56dc321184]
-->/usr/sbin/glusterd(glusterfs_sigwaiter+0xd5) [0x7f56dd085c45]
-->/usr/sbin/glusterd(cleanup_and_exit+0x6b) [0x7f56dd085acb] ) 0-: received
signum (15), shutting down
[2017-05-05 09:57:37.714016] D
[glusterfsd-mgmt.c:2385:glusterfs_mgmt_pmap_signout] 0-fsd-mgmt: portmapper
signout arguments not given
[2017-05-05 09:57:37.714032] T [MSGID: 0]
[glusterfsd.c:2016:glusterfs_pidfile_cleanup] 0-glusterfsd: pidfile
/var/run/glusterd.pid cleanup
[2017-05-05 09:57:37.714936] D [rpcsvc.c:1578:rpcsvc_program_unregister]
0-rpc-service: Program unregistered: GlusterD svc cli, Num: 1238463, Ver: 2,
Port: 0
[2017-05-05 09:57:37.715081] D [rpcsvc.c:1578:rpcsvc_program_unregister]
0-rpc-service: Program unregistered: Gluster Handshake (CLI Getspec), Num:
14398633, Ver: 2, Port: 0
[2017-05-05 09:57:37.715107] D [MSGID: 0]
[glusterd.c:1160:glusterd_stop_listener] 0-management: glusterd_stop_listener
function called 
[2017-05-05 09:57:37.715224] D [rpcsvc.c:1578:rpcsvc_program_unregister]
0-rpc-service: Program unregistered: GlusterD svc peer, Num: 1238437, Ver: 2,
Port: 0
[2017-05-05 09:57:37.715341] D [rpcsvc.c:1578:rpcsvc_program_unregister]
0-rpc-service: Program unregistered: GlusterD svc cli read-only, Num: 1238463,
Ver: 2, Port: 0
[2017-05-05 09:57:37.715516] D [rpcsvc.c:1578:rpcsvc_program_unregister]
0-rpc-service: Program unregistered: GlusterD svc mgmt, Num: 1238433, Ver: 2,
Port: 0
[2017-05-05 09:57:37.715639] D [rpcsvc.c:1578:rpcsvc_program_unregister]
0-rpc-service: Program unregistered: GlusterD svc mgmt v3, Num: 1238433, Ver:
3, Port: 0
[2017-05-05 09:57:37.715754] D [rpcsvc.c:1578:rpcsvc_program_unregister]
0-rpc-service: Program unregistered: Gluster Portmap, Num: 34123456, Ver: 1,
Port: 0
[2017-05-05 09:57:37.715868] D [rpcsvc.c:1578:rpcsvc_program_unregister]
0-rpc-service: Program unregistered: Gluster Handshake, Num: 14398633, Ver: 2,
Port: 0
[2017-05-05 09:57:37.715986] D [rpcsvc.c:1578:rpcsvc_program_unregister]
0-rpc-service: Program unregistered: Gluster MGMT Handshake, Num: 1239873, Ver:
1, Port: 0
[2017-05-05 09:58:59.505677] I [MSGID: 100030] [glusterfsd.c:2454:main]
0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.8.11 (args:
/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level=TRACE --log-buf-size=0)
[2017-05-05 09:58:59.505706] T [MSGID: 0] [glusterfsd.c:573:create_fuse_mount]
0-glusterfsd: mount point not found, not a client process
[2017-05-05 09:58:59.511561] D [MSGID: 0]
[glusterfsd.c:2072:glusterfs_pidfile_update] 0-glusterfsd: pidfile
/var/run/glusterd.pid updated with pid 15170
[2017-05-05 09:58:59.511597] D [logging.c:1791:__gf_log_inject_timer_event]
0-logging-infra: Starting timer now. Timeout = 120, current buf size = 0
[2017-05-05 09:58:59.511718] D [MSGID: 0] [glusterfsd.c:660:get_volfp]
0-glusterfsd: loading volume file /etc/glusterfs/glusterd.vol
[2017-05-05 09:58:59.511850] T [MSGID: 0] [graph.y:186:new_volume] 0-parser:
New node for 'management'
[2017-05-05 09:58:59.511867] T [MSGID: 0] [xlator.c:193:xlator_dynload]
0-xlator: attempt to load file
/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/mgmt/glusterd.so
[2017-05-05 09:58:59.513326] T [MSGID: 0] [xlator.c:244:xlator_dynload]
0-xlator: dlsym(reconfigure) on
/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/mgmt/glusterd.so: undefined
symbol: reconfigure -- neglecting
[2017-05-05 09:58:59.513351] T [MSGID: 0] [graph.y:217:volume_type] 0-parser:
Type:management:mgmt/glusterd
[2017-05-05 09:58:59.513368] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:working-directory:/var/lib/glusterd
[2017-05-05 09:58:59.513379] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:transport-type:socket,rdma
[2017-05-05 09:58:59.513386] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:transport.socket.keepalive-time:10
[2017-05-05 09:58:59.513392] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:transport.socket.keepalive-interval:2
[2017-05-05 09:58:59.513398] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:transport.socket.read-fail-log:off
[2017-05-05 09:58:59.513403] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:ping-timeout:0
[2017-05-05 09:58:59.513409] T [MSGID: 0] [graph.y:252:volume_option] 0-parser:
Option:management:event-threads:1
[2017-05-05 09:58:59.513414] T [MSGID: 0] [graph.y:323:volume_end] 0-parser:
end:management
[2017-05-05 09:58:59.513491] I [MSGID: 106478] [glusterd.c:1381:init]
0-management: Maximum allowed open file descriptors set to 65536
[2017-05-05 09:58:59.513507] I [MSGID: 106479] [glusterd.c:1430:init]
0-management: Using /var/lib/glusterd as working directory
[2017-05-05 09:58:59.513737] D [MSGID: 0]
[glusterd.c:408:glusterd_rpcsvc_options_build] 0-glusterd: listen-backlog
value: 128
[2017-05-05 09:58:59.513762] T [rpcsvc.c:2326:rpcsvc_init] 0-rpc-service: rx
pool: 64
[2017-05-05 09:58:59.513838] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_GLUSTERFS
[2017-05-05 09:58:59.513843] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_GLUSTERFS-v2
[2017-05-05 09:58:59.513847] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_UNIX
[2017-05-05 09:58:59.513851] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_NULL
[2017-05-05 09:58:59.513854] D [rpcsvc.c:2345:rpcsvc_init] 0-rpc-service: RPC
service inited.
[2017-05-05 09:58:59.513862] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GF-DUMP, Num: 123451501, Ver: 1, Port: 0
[2017-05-05 09:58:59.513878] D [rpc-transport.c:283:rpc_transport_load]
0-rpc-transport: attempt to load file
/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/rpc-transport/socket.so
[2017-05-05 09:58:59.515904] T [MSGID: 0]
[options.c:86:xlator_option_validate_int] 0-management: no range check required
for 'option transport.socket.listen-backlog 128'
[2017-05-05 09:58:59.515929] T [MSGID: 0]
[options.c:86:xlator_option_validate_int] 0-management: no range check required
for 'option transport.socket.keepalive-interval 2'
[2017-05-05 09:58:59.515936] T [MSGID: 0]
[options.c:86:xlator_option_validate_int] 0-management: no range check required
for 'option transport.socket.keepalive-time 10'
[2017-05-05 09:58:59.515948] D [socket.c:3938:socket_init] 0-socket.management:
Configued transport.tcp-user-timeout=0
[2017-05-05 09:58:59.515956] D [socket.c:4021:socket_init] 0-socket.management:
SSL support on the I/O path is NOT enabled
[2017-05-05 09:58:59.515960] D [socket.c:4024:socket_init] 0-socket.management:
SSL support for glusterd is NOT enabled
[2017-05-05 09:58:59.515963] D [socket.c:4041:socket_init] 0-socket.management:
using system polling thread
[2017-05-05 09:58:59.515970] D [name.c:584:server_fill_address_family]
0-socket.management: option address-family not specified, defaulting to inet
[2017-05-05 09:58:59.515985] T [socket.c:831:__socket_nodelay] 0-management:
NODELAY enabled for socket 10
[2017-05-05 09:58:59.516083] D [rpc-transport.c:283:rpc_transport_load]
0-rpc-transport: attempt to load file
/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/rpc-transport/rdma.so
[2017-05-05 09:58:59.516357] D [rpc-transport.c:321:rpc_transport_load]
0-rpc-transport: dlsym (gf_rpc_transport_reconfigure) on
/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/rpc-transport/rdma.so: undefined
symbol: reconfigure
[2017-05-05 09:58:59.516398] T [MSGID: 0] [rdma.c:4560:gf_rdma_options_init]
0-rpc-transport/rdma: rdma.management: defaulting MTU to '2048'
[2017-05-05 09:58:59.516439] W [MSGID: 103071]
[rdma.c:4589:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel
creation failed [No such device]
[2017-05-05 09:58:59.516448] W [MSGID: 103055] [rdma.c:4896:init]
0-rdma.management: Failed to initialize IB Device
[2017-05-05 09:58:59.516452] W [rpc-transport.c:354:rpc_transport_load]
0-rpc-transport: 'rdma' initialization failed
[2017-05-05 09:58:59.516485] W [rpcsvc.c:1667:rpcsvc_create_listener]
0-rpc-service: cannot create listener, initing the transport failed
[2017-05-05 09:58:59.516493] E [MSGID: 106243] [glusterd.c:1654:init]
0-management: creation of 1 listeners failed, continuing with succeeded
transport
[2017-05-05 09:58:59.516499] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GlusterD svc peer, Num: 1238437, Ver: 2,
Port: 0
[2017-05-05 09:58:59.516503] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GlusterD svc cli read-only, Num:
1238463, Ver: 2, Port: 0
[2017-05-05 09:58:59.516507] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GlusterD svc mgmt, Num: 1238433, Ver: 2,
Port: 0
[2017-05-05 09:58:59.516510] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GlusterD svc mgmt v3, Num: 1238433, Ver:
3, Port: 0
[2017-05-05 09:58:59.516519] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: Gluster Portmap, Num: 34123456, Ver: 1,
Port: 0
[2017-05-05 09:58:59.516523] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: Gluster Handshake, Num: 14398633, Ver:
2, Port: 0
[2017-05-05 09:58:59.516527] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: Gluster MGMT Handshake, Num: 1239873,
Ver: 1, Port: 0
[2017-05-05 09:58:59.516536] T [rpcsvc.c:2326:rpcsvc_init] 0-rpc-service: rx
pool: 8
[2017-05-05 09:58:59.516551] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_GLUSTERFS
[2017-05-05 09:58:59.516556] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_GLUSTERFS-v2
[2017-05-05 09:58:59.516559] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_UNIX
[2017-05-05 09:58:59.516563] T [rpcsvc-auth.c:119:rpcsvc_auth_init_auth]
0-rpc-service: Authentication enabled: AUTH_NULL
[2017-05-05 09:58:59.516566] D [rpcsvc.c:2345:rpcsvc_init] 0-rpc-service: RPC
service inited.
[2017-05-05 09:58:59.516569] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GF-DUMP, Num: 123451501, Ver: 1, Port: 0
[2017-05-05 09:58:59.516578] D [rpc-transport.c:283:rpc_transport_load]
0-rpc-transport: attempt to load file
/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/rpc-transport/socket.so
[2017-05-05 09:58:59.516600] D [socket.c:3887:socket_init] 0-socket.management:
disabling nodelay
[2017-05-05 09:58:59.516606] D [socket.c:3938:socket_init] 0-socket.management:
Configued transport.tcp-user-timeout=0
[2017-05-05 09:58:59.516610] D [socket.c:4021:socket_init] 0-socket.management:
SSL support on the I/O path is NOT enabled
[2017-05-05 09:58:59.516614] D [socket.c:4024:socket_init] 0-socket.management:
SSL support for glusterd is NOT enabled
[2017-05-05 09:58:59.516618] D [socket.c:4041:socket_init] 0-socket.management:
using system polling thread
[2017-05-05 09:58:59.516651] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: GlusterD svc cli, Num: 1238463, Ver: 2,
Port: 0
[2017-05-05 09:58:59.516659] D [rpcsvc.c:1895:rpcsvc_program_register]
0-rpc-service: New program registered: Gluster Handshake (CLI Getspec), Num:
14398633, Ver: 2, Port: 0
[2017-05-05 09:58:59.516679] D [MSGID: 0]
[glusterd-utils.c:6384:glusterd_sm_tr_log_init] 0-glusterd: returning 0
[2017-05-05 09:58:59.516687] D [MSGID: 0] [glusterd.c:1722:init] 0-management:
cannot get run-with-valgrind value
[2017-05-05 09:58:59.573447] D [MSGID: 0]
[glusterd.c:467:glusterd_check_gsync_present] 0-glusterd: Returning 0
[2017-05-05 09:58:59.573499] D [MSGID: 0]
[glusterd.c:603:glusterd_crt_georep_folders] 0-glusterd: Returning 0
[2017-05-05 09:59:00.833263] E [MSGID: 101032]
[store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to
/var/lib/glusterd/glusterd.info. [No such file or directory]
[2017-05-05 09:59:00.833286] D [MSGID: 0]
[store.c:438:gf_store_handle_retrieve] 0-: Returning -1
[2017-05-05 09:59:00.833292] D [MSGID: 0]
[glusterd-store.c:1985:glusterd_retrieve_op_version] 0-management: Unable to
get store handle!
[2017-05-05 09:59:00.833299] E [MSGID: 101032]
[store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to
/var/lib/glusterd/glusterd.info. [No such file or directory]
[2017-05-05 09:59:00.833304] D [MSGID: 0]
[store.c:438:gf_store_handle_retrieve] 0-: Returning -1
[2017-05-05 09:59:00.833308] D [MSGID: 0]
[glusterd-store.c:2154:glusterd_retrieve_uuid] 0-management: Unable to get
storehandle!
[2017-05-05 09:59:00.833312] D [MSGID: 0]
[glusterd-store.c:2173:glusterd_retrieve_uuid] 0-management: Returning -1
[2017-05-05 09:59:00.833317] I [MSGID: 106514]
[glusterd-store.c:2120:glusterd_restore_op_version] 0-management: Detected new
install. Setting op-version to maximum : 30800
[2017-05-05 09:59:00.833339] D [MSGID: 0]
[glusterd-store.c:3190:glusterd_store_retrieve_volumes] 0-management: Returning
with 0
[2017-05-05 09:59:00.833372] D [MSGID: 0]
[glusterd-store.c:4257:glusterd_store_retrieve_peers] 0-management: Returning
with 0
[2017-05-05 09:59:00.833391] I [MSGID: 106194]
[glusterd-store.c:3628:glusterd_store_retrieve_missed_snaps_list] 0-management:
No missed snaps list.
[2017-05-05 09:59:00.833397] T [MSGID: 0]
[glusterd-store.c:3687:glusterd_store_retrieve_missed_snaps_list] 0-management:
Returning with 0
[2017-05-05 09:59:00.833401] D [MSGID: 0]
[glusterd-store.c:3748:glusterd_store_retrieve_snaps] 0-management: Returning
with 0
[2017-05-05 09:59:00.833405] T [MSGID: 0]
[glusterd-store.c:4425:glusterd_resolve_all_bricks] 0-management: Returning
with 0
[2017-05-05 09:59:00.833412] T [MSGID: 0]
[glusterd-store.c:4379:glusterd_snap_cleanup] 0-management: Returning with 0
[2017-05-05 09:59:00.833416] T [MSGID: 0]
[glusterd-store.c:4311:glusterd_recreate_all_snap_brick_mounts] 0-management:
Returning with 0
[2017-05-05 09:59:00.833420] D [MSGID: 0]
[glusterd-store.c:4478:glusterd_restore] 0-management: Returning 0
[2017-05-05 09:59:00.833450] E [MSGID: 101032]
[store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to
/var/lib/glusterd/options. [No such file or directory]
[2017-05-05 09:59:00.833457] D [MSGID: 0]
[store.c:438:gf_store_handle_retrieve] 0-: Returning -1
[2017-05-05 09:59:00.833462] D [MSGID: 0] [store.c:459:gf_store_handle_destroy]
0-: Returning 0
[2017-05-05 09:59:00.833528] T [MSGID: 0] [syncop.c:1006:__synclock_unlock] 0-:
Unlock success 0x7fcaaca59800, remaining locks=0
[2017-05-05 09:59:00.835579] D [MSGID: 0] [store.c:420:gf_store_handle_new] 0-:
Returning 0
[2017-05-05 09:59:00.835665] D [MSGID: 0] [store.c:374:gf_store_save_value]
0-management: returning: 0
[2017-05-05 09:59:00.839234] D [MSGID: 0] [store.c:459:gf_store_handle_destroy]
0-: Returning 0
[2017-05-05 09:59:00.839269] D [MSGID: 0]
[options.c:1214:xlator_option_init_int32] 0-management: option event-threads
using set value 1
Final graph:
+------------------------------------------------------------------------------+
  1: volume management
  2:     type mgmt/glusterd
  3:     option rpc-auth.auth-glusterfs on
  4:     option rpc-auth.auth-unix on
  5:     option rpc-auth.auth-null on
  6:     option rpc-auth-allow-insecure on
  7:     option transport.socket.listen-backlog 128
  8:     option event-threads 1
  9:     option ping-timeout 0
 10:     option transport.socket.read-fail-log off
 11:     option transport.socket.keepalive-interval 2
 12:     option transport.socket.keepalive-time 10
 13:     option transport-type rdma
 14:     option working-directory /var/lib/glusterd
 15: end-volume
 16:  
+------------------------------------------------------------------------------+
[2017-05-05 09:59:00.839739] I [MSGID: 101190]
[event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with
index 1
[2017-05-05 10:00:59.536641] D [logging.c:1829:gf_log_flush_timeout_cbk]
0-logging-infra: Log timer timed out. About to flush outstanding messages if
present
[2017-05-05 10:00:59.536672] D [logging.c:1791:__gf_log_inject_timer_event]
0-logging-infra: Starting timer now. Timeout = 120, current buf size = 0
[2017-05-05 10:02:59.555415] D [logging.c:1829:gf_log_flush_timeout_cbk]
0-logging-infra: Log timer timed out. About to flush outstanding messages if
present
[2017-05-05 10:02:59.555488] D [logging.c:1791:__gf_log_inject_timer_event]
0-logging-infra: Starting timer now. Timeout = 120, current buf size = 0

-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.


More information about the Bugs mailing list