[Gluster-devel] glusterd.log file - few observations

[Atin Mukherjee]

As highlighted in the last maintainers meeting that I'm seeing some log
entries in the glusterd log file which are (a) informative logs in one way
but can cause excessive logging and potentially may run an user with out of
space issue (b) some logs might not be errors or be avoided.
Even though these logs are captured in glusterd.log file, but they don't
originate from glusterd APIs. So request all of devs to go through the
below. I will eventually convert this to a BZ to track this better, so this
is a heads up for now.

I believe as a practice working on code changes, we need to look at the
aspects of balancing out the log entries i.e. (a) don't log everything &
(b) log only meaningful things.

===============================================================
[2018-09-10 03:55:19.236387] I [dict.c:2838:dict_get_str_boolean]
(-->/usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0xc2) [0x7ff7a83d0452]
-->/usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0x65b0)
[0x7ff7a06cf5b0]
-->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf)
[0x7ff7a85fc58f] ) 0-dict: key transport.socket.ignore-enoent, integer type
asked, has string type [Invalid argument] <==* seen in volume start*

[2018-09-10 03:55:21.583508] I [run.c:241:runner_log]
(-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd166a)
[0x7ff7a34d766a]
-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd119c)
[0x7ff7a34d719c] -->/usr/local/lib/libglusterfs.so.0(runner_log+0x105)
[0x7ff7a8651805] ) 0-management: Ran script:
/var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=test-vol1
--first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd
<== *seen in volume start*

[2018-09-10 03:55:13.647675] E [MSGID: 101191]
[event-epoll.c:689:event_dispatch_epoll_worker] 0-epoll: Failed to dispatch
handler <== *seen in almost all the volume operations*


[2018-09-10 03:57:14.370861] E [MSGID: 106061]
[glusterd-utils.c:10584:glusterd_max_opversion_use_rsp_dict] 0-management:
Maximum supported op-version not set in destination dictionary
<=== *seen while running gluster v get all all*

[2018-09-10 03:58:24.307305] W [MSGID: 101095]
[xlator.c:181:xlator_volopt_dynload] 0-xlator:
/usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open
shared object file: No such file or directory
[2018-09-10 03:58:24.307322] E [MSGID: 106434]
[glusterd-utils.c:13301:glusterd_get_value_for_vme_entry] 0-management:
xlator_volopt_dynload error (-1)
[2018-09-10 03:58:24.307336] W [MSGID: 101095]
[xlator.c:181:xlator_volopt_dynload] 0-xlator:
/usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open
shared object file: No such file or directory
[2018-09-10 03:58:24.307340] E [MSGID: 106434]
[glusterd-utils.c:13301:glusterd_get_value_for_vme_entry] 0-management:
xlator_volopt_dynload error (-1)
[2018-09-10 03:58:24.307350] W [MSGID: 101095]
[xlator.c:181:xlator_volopt_dynload] 0-xlator:
/usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open
shared object file: No such file or directory
[2018-09-10 03:58:24.307355] E [MSGID: 106434]
[glusterd-utils.c:13301:glusterd_get_value_for_vme_entry] 0-management:
xlator_volopt_dynload error (-1)
[2018-09-10 03:58:24.307365] W [MSGID: 101095]
[xlator.c:181:xlator_volopt_dynload] 0-xlator:
/usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open
shared object file: No such file or directory
[2018-09-10 03:58:24.307369] E [MSGID: 106434]
[glusterd-utils.c:13301:glusterd_get_value_for_vme_entry] 0-management:
xlator_volopt_dynload error (-1)
[2018-09-10 03:58:24.307378] W [MSGID: 101095]
[xlator.c:181:xlator_volopt_dynload] 0-xlator:
/usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open
shared object file: No such file or directory

<===* seen while running gluster v get <volname> all, cloudsync xlator
seems to be the culprit here*.


[2018-09-10 05:00:16.082968] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/storage/posix.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.083388] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/trash.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.084201] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/changetimerecorder.so:
undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.084597] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/changelog.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.084917] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/bitrot-stub.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.085258] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/access-control.so:
undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.086153] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/locks.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.086546] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/worm.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.086947] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/read-only.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.087273] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/leases.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.088271] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/upcall.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.088800] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/performance/io-threads.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089004] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/selinux.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089245] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/marker.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089491] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/barrier.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089684] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/index.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089967] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/quota.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.090247] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.090433] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/performance/decompounder.so:
undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.093580] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/changelog.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.093729] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/bitrot-stub.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.093930] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/access-control.so:
undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.094184] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/locks.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.094451] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/worm.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.094650] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/read-only.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.094853] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/leases.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.095113] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/upcall.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.095613] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/performance/io-threads.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.095934] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/selinux.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096125] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/marker.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096273] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/barrier.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096433] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/index.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096606] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/quota.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096803] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol:
xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway]
0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/changetimerecorder.so:
undefined symbol: xlator_api. Fall back to old symbols" repeated 2 times
between [2018-09-10 05:00:16.084201] and [2018-09-10 05:00:16.100584]
[2018-09-10 05:00:16.100775] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/changelog.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.100978] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/bitrot-stub.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101105] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/access-control.so:
undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101257] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/locks.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101398] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/worm.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101525] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/read-only.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101688] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/leases.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101852] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/upcall.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102043] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/performance/io-threads.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102164] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/selinux.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102315] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/marker.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102467] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/barrier.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102633] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/index.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102800] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/features/quota.so: undefined symbol:
xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway]
0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/performance/decompounder.so:
undefined symbol: xlator_api. Fall back to old symbols" repeated 2 times
between [2018-09-10 05:00:16.090433] and [2018-09-10 05:00:16.103150]
[2018-09-10 05:00:16.105005] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined
symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway]
0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined
symbol: xlator_api. Fall back to old symbols" repeated 2 times between
[2018-09-10 05:00:16.105005] and [2018-09-10 05:00:16.105194]
[2018-09-10 05:00:16.105430] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/cluster/replicate.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.105664] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/cluster/distribute.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.105803] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/performance/write-behind.so:
undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.105904] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/performance/read-ahead.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.106041] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/performance/readdir-ahead.so:
undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.106160] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/performance/io-cache.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.106364] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/performance/open-behind.so:
undefined symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway]
0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol:
xlator_api. Fall back to old symbols" repeated 2 times between [2018-09-10
05:00:16.096803] and [2018-09-10 05:00:16.106602]
[2018-09-10 05:00:16.107303] W [MSGID: 101095]
[xlator.c:454:xlator_dynload] 0-xlator:
/usr/local/lib/glusterfs/4.2dev/xlator/nfs/server.so: cannot open shared
object file: No such file or directory
[2018-09-10 05:00:16.107435] I [dict.c:2838:dict_get_str_boolean]
(-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x93c6a)
[0x7ff7a3499c6a]
-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x9074c)
[0x7ff7a349674c]
-->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf)
[0x7ff7a85fc58f] ) 0-dict: key graph-check, integer type asked, has string
type [Invalid argument]
[2018-09-10 05:00:16.108476] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined
symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway]
0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined
symbol: xlator_api. Fall back to old symbols" repeated 2 times between
[2018-09-10 05:00:16.108476] and [2018-09-10 05:00:16.109080]
[2018-09-10 05:00:16.109376] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/cluster/replicate.so: undefined
symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.112484] I [MSGID: 101097]
[xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on
/usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol:
xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.145133] I [dict.c:2838:dict_get_str_boolean]
(-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xcebf4)
[0x7ff7a34d4bf4]
-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x392e0)
[0x7ff7a343f2e0]
-->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf)
[0x7ff7a85fc58f] ) 0-dict: key check-op-version, integer type asked, has
unsigned integer type [Invalid argument]
[2018-09-10 05:00:16.145841] W [MSGID: 101095]
[xlator.c:181:xlator_volopt_dynload] 0-xlator:
/usr/local/lib/glusterfs/4.2dev/xlator/nfs/server.so: cannot open shared
object file: No such file or directory
[2018-09-10 05:00:16.151513] I [dict.c:2838:dict_get_str_boolean]
(-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x86d69)
[0x7ff7a348cd69]
-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x8f747)
[0x7ff7a3495747]
-->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf)
[0x7ff7a85fc58f] ) 0-dict: key gfproxy-client, integer type asked, has
string type [Invalid argument]
[2018-09-10 05:00:16.151613] I [dict.c:2838:dict_get_str_boolean]
(-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x86d69)
[0x7ff7a348cd69]
-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x8fb6c)
[0x7ff7a3495b6c]
-->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf)
[0x7ff7a85fc58f] ) 0-dict: key gfproxy-client, integer type asked, has
string type [Invalid argument]
[2018-09-10 05:00:16.154023] I [dict.c:2838:dict_get_str_boolean]
(-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x86d69)
[0x7ff7a348cd69]
-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x8fb8d)
[0x7ff7a3495b8d]
-->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf)
[0x7ff7a85fc58f] ) 0-dict: key gfproxy-server, integer type asked, has
string type [Invalid argument]
[2018-09-10 05:00:16.238162] I [run.c:241:runner_log]
(-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd166a)
[0x7ff7a34d766a]
-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd119c)
[0x7ff7a34d719c] -->/usr/local/lib/libglusterfs.so.0(runner_log+0x105)
[0x7ff7a8651805] ) 0-management: Ran script:
/var/lib/glusterd/hooks/1/set/post/S30samba-set.sh --volname=test-vol1 -o
barrier=on --gd-workdir=/var/lib/glusterd
[2018-09-10 05:00:16.257676] I [run.c:241:runner_log]
(-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd166a)
[0x7ff7a34d766a]
-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd119c)
[0x7ff7a34d719c] -->/usr/local/lib/libglusterfs.so.0(runner_log+0x105)
[0x7ff7a8651805] ) 0-management: Ran script:
/var/lib/glusterd/hooks/1/set/post/S32gluster_enable_shared_storage.sh
--volname=test-vol1 -o barrier=on --gd-workdir=/var/lib/glusterd
[2018-09-10 05:00:16.335118] E [MSGID: 101191]
[event-epoll.c:689:event_dispatch_epoll_worker] 0-epoll: Failed to dispatch
handler

<== *all the above snippets for only one volume set operation*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-devel/attachments/20180910/b9cf5643/attachment-0001.html>