[Gluster-users] Multiple versions on the same machine, errors on glusterd startup

Raphaël Yancey raphael at badfile.net
Tue Jan 1 16:45:53 UTC 2019 

Hi,

I'm trying to host several GlusterFS versions on the same machine 
(3.8.8, 4.1.6 and 5.2), not to be ran together of course.

I built them with the following procedure (examples with 3.8.8):

> git clone https://github.com/gluster/glusterfs .
> git checkout v3.8.8
> ./autogen
> ./configure --program-suffix="-3.8.8"
> make
> sudo make install
> sudo cp -a extras/systemd/glusterd.service 
> /etc/systemd/system/glusterd-3.8.8.service
> sudo systemctl load glusterd-3.8.8
I had to edit the service for it to execute the right version of glusterd:

> ExecStart=/usr/local/sbin/glusterd*-3.8.8* -p /var/run/glusterd.pid  
> --log-level $LOG_LEVEL $GLUSTERD_OPTIONS

And I had to create symlinks for glusterd:

> cd /usr/local/sbin
> ln -s glusterd-3.8.8 glusterfsd-3.8.8
I also ran ldconfig for good mesure...

> sudo ldconfig

When I run glusterd in the foreground (not even with systemd) I'm left 
with some errors and the process exits (errors emphasized):

> user at host0:~/glusterfs-3.8.8 on e5f3a990c [!☡]# sudo glusterd-3.8.8 
> --debug
> [2019-01-01 16:23:37.120684] I [MSGID: 100030] 
> [glusterfsd.c:2454:main] 0-glusterd-3.8.8: Started running 
> glusterd-3.8.8 version 3.8.8 (args: glusterd-3.8.8 --debug)
> [2019-01-01 16:23:37.120765] D 
> [logging.c:1791:__gf_log_inject_timer_event] 0-logging-infra: Starting 
> timer now. Timeout = 120, current buf size = 5
> [2019-01-01 16:23:37.121187] D [MSGID: 0] [glusterfsd.c:660:get_volfp] 
> 0-glusterfsd: loading volume file /usr/local/etc/glusterfs/glusterd.vol
> [2019-01-01 16:23:37.137003] I [MSGID: 106478] [glusterd.c:1379:init] 
> 0-management: Maximum allowed open file descriptors set to 65536
> [2019-01-01 16:23:37.137064] I [MSGID: 106479] [glusterd.c:1428:init] 
> 0-management: Using /var/lib/glusterd as working directory
> [2019-01-01 16:23:37.137262] D [MSGID: 0] 
> [glusterd.c:406:glusterd_rpcsvc_options_build] 0-glusterd: 
> listen-backlog value: 128
> [2019-01-01 16:23:37.137683] D [rpcsvc.c:2316:rpcsvc_init] 
> 0-rpc-service: RPC service inited.
> [2019-01-01 16:23:37.137723] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GF-DUMP, Num: 123451501, Ver: 
> 1, Port: 0
> [2019-01-01 16:23:37.137798] D 
> [rpc-transport.c:283:rpc_transport_load] 0-rpc-transport: attempt to 
> load file /usr/local/lib/glusterfs/3.8.8/rpc-transport/socket.so
> [2019-01-01 16:23:37.151778] D [socket.c:3938:socket_init] 
> 0-socket.management: Configued transport.tcp-user-timeout=0
> [2019-01-01 16:23:37.151823] D [socket.c:4021:socket_init] 
> 0-socket.management: SSL support on the I/O path is NOT enabled
> [2019-01-01 16:23:37.151862] D [socket.c:4024:socket_init] 
> 0-socket.management: SSL support for glusterd is NOT enabled
> [2019-01-01 16:23:37.151890] D [socket.c:4041:socket_init] 
> 0-socket.management: using system polling thread
> [2019-01-01 16:23:37.151927] D [name.c:584:server_fill_address_family] 
> 0-socket.management: option address-family not specified, defaulting 
> to inet
> [2019-01-01 16:23:37.152173] D 
> [rpc-transport.c:283:rpc_transport_load] 0-rpc-transport: attempt to 
> load file /usr/local/lib/glusterfs/3.8.8/rpc-transport/rdma.so
> [2019-01-01 16:23:37.155510] D 
> [rpc-transport.c:321:rpc_transport_load] 0-rpc-transport: dlsym 
> (gf_rpc_transport_reconfigure) on 
> /usr/local/lib/glusterfs/3.8.8/rpc-transport/rdma.so: undefined 
> symbol: reconfigure
> [2019-01-01 16:23:37.155830] W [MSGID: 103071] 
> [rdma.c:4589:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event 
> channel creation failed [No such device]
> [2019-01-01 16:23:37.155884] W [MSGID: 103055] [rdma.c:4896:init] 
> 0-rdma.management: Failed to initialize IB Device
> [2019-01-01 16:23:37.155920] W 
> [rpc-transport.c:354:rpc_transport_load] 0-rpc-transport: 'rdma' 
> initialization failed
> [2019-01-01 16:23:37.156224] W [rpcsvc.c:1638:rpcsvc_create_listener] 
> 0-rpc-service: cannot create listener, initing the transport failed
> *[2019-01-01 16:23:37.156258] E [MSGID: 106243] [glusterd.c:1652:init] 
> 0-management: creation of 1 listeners failed, continuing with 
> succeeded transport*
> [2019-01-01 16:23:37.156300] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GlusterD svc peer, Num: 
> 1238437, Ver: 2, Port: 0
> [2019-01-01 16:23:37.156332] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GlusterD svc cli read-only, 
> Num: 1238463, Ver: 2, Port: 0
> [2019-01-01 16:23:37.156356] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GlusterD svc mgmt, Num: 
> 1238433, Ver: 2, Port: 0
> [2019-01-01 16:23:37.156384] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GlusterD svc mgmt v3, Num: 
> 1238433, Ver: 3, Port: 0
> [2019-01-01 16:23:37.156414] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: Gluster Portmap, Num: 34123456, 
> Ver: 1, Port: 0
> [2019-01-01 16:23:37.156438] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: Gluster Handshake, Num: 
> 14398633, Ver: 2, Port: 0
> [2019-01-01 16:23:37.156468] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: Gluster MGMT Handshake, Num: 
> 1239873, Ver: 1, Port: 0
> [2019-01-01 16:23:37.156591] D [rpcsvc.c:2316:rpcsvc_init] 
> 0-rpc-service: RPC service inited.
> [2019-01-01 16:23:37.156619] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GF-DUMP, Num: 123451501, Ver: 
> 1, Port: 0
> [2019-01-01 16:23:37.156665] D 
> [rpc-transport.c:283:rpc_transport_load] 0-rpc-transport: attempt to 
> load file /usr/local/lib/glusterfs/3.8.8/rpc-transport/socket.so
> [2019-01-01 16:23:37.156854] D [socket.c:3887:socket_init] 
> 0-socket.management: disabling nodelay
> [2019-01-01 16:23:37.156882] D [socket.c:3938:socket_init] 
> 0-socket.management: Configued transport.tcp-user-timeout=0
> [2019-01-01 16:23:37.156912] D [socket.c:4021:socket_init] 
> 0-socket.management: SSL support on the I/O path is NOT enabled
> [2019-01-01 16:23:37.156933] D [socket.c:4024:socket_init] 
> 0-socket.management: SSL support for glusterd is NOT enabled
> [2019-01-01 16:23:37.156961] D [socket.c:4041:socket_init] 
> 0-socket.management: using system polling thread
> [2019-01-01 16:23:37.157095] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: GlusterD svc cli, Num: 1238463, 
> Ver: 2, Port: 0
> [2019-01-01 16:23:37.157125] D [rpcsvc.c:1866:rpcsvc_program_register] 
> 0-rpc-service: New program registered: Gluster Handshake (CLI 
> Getspec), Num: 14398633, Ver: 2, Port: 0
> [2019-01-01 16:23:37.157282] D [MSGID: 0] 
> [glusterd-utils.c:6379:glusterd_sm_tr_log_init] 0-glusterd: returning 0
> [2019-01-01 16:23:37.157318] D [MSGID: 0] [glusterd.c:1720:init] 
> 0-management: cannot get run-with-valgrind value
> *[2019-01-01 16:23:37.170633] E [MSGID: 106229] 
> [glusterd.c:455:glusterd_check_gsync_present] 0-glusterd: 
> geo-replication module not working as desired*
> [2019-01-01 16:23:37.171476] D [MSGID: 0] 
> [glusterd.c:465:glusterd_check_gsync_present] 0-glusterd: Returning -1
> *[2019-01-01 16:23:37.171572] E [MSGID: 101019] 
> [xlator.c:433:xlator_init] 0-management: Initialization of volume 
> 'management' failed, review your volfile again*
> *[2019-01-01 16:23:37.171613] E [MSGID: 101066] 
> [graph.c:324:glusterfs_graph_init] 0-management: initializing 
> translator failed*
> *[2019-01-01 16:23:37.171649] E [MSGID: 101176] 
> [graph.c:673:glusterfs_graph_activate] 0-graph: init failed*
> [2019-01-01 16:23:37.173130] D 
> [logging.c:1765:gf_log_flush_extra_msgs] 0-logging-infra: Log buffer 
> size reduced. About to flush 5 extra log messages
> [2019-01-01 16:23:37.173187] D 
> [logging.c:1768:gf_log_flush_extra_msgs] 0-logging-infra: Just flushed 
> 5 extra log messages
> [2019-01-01 16:23:37.173280] W [MSGID: 100032] 
> [glusterfsd.c:1327:cleanup_and_exit] 0-: received signum (1), shutting 
> down
> [2019-01-01 16:23:37.173335] D 
> [glusterfsd-mgmt.c:2385:glusterfs_mgmt_pmap_signout] 0-fsd-mgmt: 
> portmapper signout arguments not given

I can't pin what particular error caused the process to exit and I 
failed findind informations on the 'management' volume fail... any hints?

Thanks,
Raphael.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20190101/a19482d9/attachment.html>

More information about the Gluster-users mailing list