[Bugs] [Bug 1389947] Upgrading to 3.7.16-1 breaks fuse mounts

bugzilla at redhat.com bugzilla at redhat.com
Wed Nov 2 09:56:44 UTC 2016


https://bugzilla.redhat.com/show_bug.cgi?id=1389947



--- Comment #4 from Jules <jules at ispire.me> ---
[2016-10-28 12:52:14.528621] I [MSGID: 100030] [glusterfsd.c:2338:main]
0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.7.16
(args: /usr/sbin/glusterfs --acl --volfile-server=node2d
--volfile-server=node2c --volfile-id=/netshare /storage)
[2016-10-28 12:52:14.956640] I [MSGID: 101190]
[event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with
index 1
[2016-10-28 12:52:15.848575] I [graph.c:269:gf_add_cmdline_options]
0-netshare-md-cache: adding option 'cache-posix-acl' for volume
'netshare-md-cache' with value 'true'
Final graph:
+------------------------------------------------------------------------------+
  1: volume netshare-client-0
  2:     type protocol/client
  3:     option ping-timeout 5
  4:     option remote-host node2c
  5:     option remote-subvolume /storage/gfs/netshare
  6:     option transport-type socket
  7:     option send-gids true
  8: end-volume
  9:
 10: volume netshare-client-1
 11:     type protocol/client
 12:     option ping-timeout 5
 13:     option remote-host node2d
 14:     option remote-subvolume /storage/gfs/netshare
 15:     option transport-type socket
 16:     option send-gids true
 17: end-volume
 18:
 19: volume netshare-replicate-0
 20:     type cluster/replicate
 21:     option background-self-heal-count 20
 22:     option metadata-self-heal on
 23:     option data-self-heal on
 24:     option entry-self-heal on
 25:     option data-self-heal-window-size 2
 26:     option self-heal-readdir-size 2KB
 27:     subvolumes netshare-client-0 netshare-client-1
 28: end-volume
 29:
 30: volume netshare-dht
 31:     type cluster/distribute
 32:     option min-free-disk 5%
 33:     option readdir-optimize on
 34:     subvolumes netshare-replicate-0
 35: end-volume
 36:
 37: volume netshare-write-behind
 38:     type performance/write-behind
 39:     subvolumes netshare-dht
 40: end-volume
 41:
 42: volume netshare-read-ahead
 43:     type performance/read-ahead
 44:     subvolumes netshare-write-behind
 45: end-volume
 46:
 47: volume netshare-io-cache
 48:     type performance/io-cache
 49:     option cache-size 2GB
 50:     subvolumes netshare-read-ahead
 51: end-volume
 52:
 53: volume netshare-quick-read
 54:     type performance/quick-read
 55:     option cache-size 2GB
 56:     subvolumes netshare-io-cache
 57: end-volume
 58:
 59: volume netshare-open-behind
 60:     type performance/open-behind
 61:     subvolumes netshare-quick-read
 62: end-volume
 63:
 64: volume netshare-md-cache
 65:     type performance/md-cache
 66:     option cache-posix-acl true
 67:     subvolumes netshare-open-behind
 68: end-volume
 69:
 70: volume netshare
 71:     type debug/io-stats
 72:     option log-level WARNING
 73:     option latency-measurement off
 74:     option count-fop-hits off
 75:     subvolumes netshare-md-cache
 76: end-volume
 77:
 78: volume posix-acl-autoload
 79:     type system/posix-acl
 80:     subvolumes netshare
 81: end-volume
 82:
 83: volume meta-autoload
 84:     type meta
 85:     subvolumes posix-acl-autoload
 86: end-volume
 87:
+------------------------------------------------------------------------------+
[2016-10-28 12:53:03.346269] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1866: LOOKUP() /conf/mail/amavis/conf.d/01-debian => -1
(Permission denied)
[2016-10-28 12:53:03.346560] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1867: LOOKUP() /conf/mail/amavis/conf.d/01-debian => -1
(Permission denied)
[2016-10-28 12:53:03.346967] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1869: LOOKUP() /conf/mail/amavis/conf.d/05-domain_id => -1
(Permission denied)
[2016-10-28 12:53:03.347103] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1871: LOOKUP() /conf/mail/amavis/conf.d/05-domain_id => -1
(Permission denied)
[2016-10-28 12:53:03.347258] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1872: LOOKUP() /conf/mail/amavis/conf.d/05-node_id => -1
(Permission denied)
[2016-10-28 12:53:03.347377] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1873: LOOKUP() /conf/mail/amavis/conf.d/05-node_id => -1
(Permission denied)
[2016-10-28 12:53:03.347516] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1875: LOOKUP() /conf/mail/amavis/conf.d/15-av_scanners => -1
(Permission denied)
[2016-10-28 12:53:03.347609] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1876: LOOKUP() /conf/mail/amavis/conf.d/15-av_scanners => -1
(Permission denied)
[2016-10-28 12:53:03.347723] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1878: LOOKUP()
/conf/mail/amavis/conf.d/15-content_filter_mode => -1 (Permission denied)
[2016-10-28 12:53:03.347809] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1879: LOOKUP()
/conf/mail/amavis/conf.d/15-content_filter_mode => -1 (Permission denied)
[2016-10-28 12:53:03.347910] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1881: LOOKUP() /conf/mail/amavis/conf.d/20-debian_defaults =>
-1 (Permission denied)
[2016-10-28 12:53:03.348037] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1883: LOOKUP() /conf/mail/amavis/conf.d/20-debian_defaults =>
-1 (Permission denied)
[2016-10-28 12:53:03.348161] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1884: LOOKUP() /conf/mail/amavis/conf.d/25-amavis_helpers =>
-1 (Permission denied)
[2016-10-28 12:53:03.348287] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1886: LOOKUP() /conf/mail/amavis/conf.d/25-amavis_helpers =>
-1 (Permission denied)
[2016-10-28 12:53:03.348397] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1887: LOOKUP()
/conf/mail/amavis/conf.d/30-template_localization => -1 (Permission denied)
[2016-10-28 12:53:03.348500] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1889: LOOKUP()
/conf/mail/amavis/conf.d/30-template_localization => -1 (Permission denied)
[2016-10-28 12:53:03.348626] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1890: LOOKUP() /conf/mail/amavis/conf.d/50-user => -1
(Permission denied)
[2016-10-28 12:53:03.348743] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 1892: LOOKUP() /conf/mail/amavis/conf.d/50-user => -1
(Permission denied)
[2016-10-28 13:12:37.048137] C
[rpc-clnt-ping.c:165:rpc_clnt_ping_timer_expired] 0-netshare-client-0: server
10.1.20.1:49159 has not responded in the last 5 seconds, disconnecting.
[2016-10-28 13:12:37.048571] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(LOOKUP(27)) called at 2016-10-28 13:12:32.020037 (xid=0x2110)
[2016-10-28 13:12:37.048601] W [MSGID: 114031]
[client-rpc-fops.c:2981:client3_3_lookup_cbk] 0-netshare-client-0: remote
operation failed. Path: /conf (b28cb9a1-1cfd-4296-9595-874cc6cc8056) [Transport
endpoint is not connected]
[2016-10-28 13:12:37.049956] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GF-DUMP) op(NULL(2))
called at 2016-10-28 13:12:32.020050 (xid=0x2111)
[2016-10-28 13:12:37.049972] W [rpc-clnt-ping.c:208:rpc_clnt_ping_cbk]
0-netshare-client-0: socket disconnected
[2016-10-28 13:12:37.050417] W [rpc-clnt.c:1653:rpc_clnt_submit]
0-netshare-client-0: failed to submit rpc-request (XID: 0x2112 Program:
GlusterFS 3.3, ProgVers: 330, Proc: 27) to rpc-transport (netshare-client-0)
[2016-10-28 13:12:37.050447] W [MSGID: 114031]
[client-rpc-fops.c:2981:client3_3_lookup_cbk] 0-netshare-client-0: remote
operation failed. Path: (null) (00000000-0000-0000-0000-000000000000)
[Transport endpoint is not connected]
[2016-10-28 13:13:43.159065] E [socket.c:2292:socket_connect_finish]
0-netshare-client-0: connection to 10.1.20.1:24007 failed (No route to host)
[2016-10-28 13:12:37.051508] W [MSGID: 114031]
[client-rpc-fops.c:2981:client3_3_lookup_cbk] 0-netshare-client-0: remote
operation failed. Path: (null) (00000000-0000-0000-0000-000000000000)
[Transport endpoint is not connected]
[2016-10-28 13:15:18.079711] E [MSGID: 114058]
[client-handshake.c:1524:client_query_portmap_cbk] 0-netshare-client-0: failed
to get the port number for remote subvolume. Please run 'gluster volume status'
on server to see if brick process is running.
[2016-10-28 13:17:20.952559] W [MSGID: 108015]
[afr-self-heal-entry.c:69:afr_selfheal_entry_delete] 0-netshare-replicate-0:
expunging file c5972d7b-17de-48ab-9d5c-b4a4a27c6ae6/dovecot-uidlist
(485c47c7-1ebb-4721-b51f-35c28e375b18) on netshare-client-0
[2016-10-28 13:17:24.078183] W [MSGID: 108015]
[afr-self-heal-entry.c:69:afr_selfheal_entry_delete] 0-netshare-replicate-0:
expunging file a0e3d62a-6478-47e7-85f8-cc587d3a2b7a/dovecot-uidlist
(98155ec4-3cfe-4208-badc-83c566956946) on netshare-client-0
[2016-10-28 13:17:28.015808] W [MSGID: 114028]
[client-lk.c:369:delete_granted_locks_owner] 0-netshare-client-0: fdctx not
valid [Invalid argument]
[2016-10-28 13:18:27.379573] W [MSGID: 108015]
[afr-self-heal-entry.c:69:afr_selfheal_entry_delete] 0-netshare-replicate-0:
expunging file
b453d72c-077c-4d47-94d5-baa593fdcf71/1477660254.M841368P2673.mail-01,S=2006,W=2057:2,a
(d7d750cc-e354-42cf-866b-ada8aa0895be) on netshare-client-0
[2016-10-28 13:23:01.302461] W [fuse-resolve.c:66:fuse_resolve_entry_cbk]
0-fuse: 2e556bde-2555-455f-86f2-29616fb6ef0d/dovecot-uidlist: failed to resolve
(Stale file handle)
[2016-10-28 13:33:02.154725] W [fuse-resolve.c:66:fuse_resolve_entry_cbk]
0-fuse: 9d7096c6-31e4-4234-9412-858a7a0af57c/dovecot.index: failed to resolve
(Stale file handle)
[2016-10-28 13:33:02.311722] W [fuse-resolve.c:66:fuse_resolve_entry_cbk]
0-fuse: 9d7096c6-31e4-4234-9412-858a7a0af57c/dovecot-keywords: failed to
resolve (Stale file handle)
[2016-10-29 01:24:09.113425] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155047: LOOKUP() /conf/mail/amavis/conf.d/01-debian => -1
(Permission denied)
[2016-10-29 01:24:09.113604] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155048: LOOKUP() /conf/mail/amavis/conf.d/01-debian => -1
(Permission denied)
[2016-10-29 01:24:09.113775] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155050: LOOKUP() /conf/mail/amavis/conf.d/05-domain_id => -1
(Permission denied)
[2016-10-29 01:24:09.113853] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155051: LOOKUP() /conf/mail/amavis/conf.d/05-domain_id => -1
(Permission denied)
[2016-10-29 01:24:09.113936] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155053: LOOKUP() /conf/mail/amavis/conf.d/05-node_id => -1
(Permission denied)
[2016-10-29 01:24:09.114011] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155054: LOOKUP() /conf/mail/amavis/conf.d/05-node_id => -1
(Permission denied)
[2016-10-29 01:24:09.114101] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155056: LOOKUP() /conf/mail/amavis/conf.d/15-av_scanners =>
-1 (Permission denied)
[2016-10-29 01:24:09.114185] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155057: LOOKUP() /conf/mail/amavis/conf.d/15-av_scanners =>
-1 (Permission denied)
[2016-10-29 01:24:09.114265] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155059: LOOKUP()
/conf/mail/amavis/conf.d/15-content_filter_mode => -1 (Permission denied)
[2016-10-29 01:24:09.114337] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155060: LOOKUP()
/conf/mail/amavis/conf.d/15-content_filter_mode => -1 (Permission denied)
[2016-10-29 01:24:09.114410] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155062: LOOKUP() /conf/mail/amavis/conf.d/20-debian_defaults
=> -1 (Permission denied)
[2016-10-29 01:24:09.114508] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155063: LOOKUP() /conf/mail/amavis/conf.d/20-debian_defaults
=> -1 (Permission denied)
[2016-10-29 01:24:09.114593] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155065: LOOKUP() /conf/mail/amavis/conf.d/25-amavis_helpers
=> -1 (Permission denied)
[2016-10-29 01:24:09.114669] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155066: LOOKUP() /conf/mail/amavis/conf.d/25-amavis_helpers
=> -1 (Permission denied)
[2016-10-29 01:24:09.114743] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155068: LOOKUP()
/conf/mail/amavis/conf.d/30-template_localization => -1 (Permission denied)
[2016-10-29 01:24:09.114818] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155069: LOOKUP()
/conf/mail/amavis/conf.d/30-template_localization => -1 (Permission denied)
[2016-10-29 01:24:09.114917] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155071: LOOKUP() /conf/mail/amavis/conf.d/50-user => -1
(Permission denied)
[2016-10-29 01:24:09.115025] W [fuse-bridge.c:470:fuse_entry_cbk]
0-glusterfs-fuse: 155072: LOOKUP() /conf/mail/amavis/conf.d/50-user => -1
(Permission denied)
[2016-10-29 08:42:00.979281] C
[rpc-clnt-ping.c:165:rpc_clnt_ping_timer_expired] 0-netshare-client-0: server
10.1.20.1:49159 has not responded in the last 5 seconds, disconnecting.
[2016-10-29 08:42:00.979826] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(INODELK(29)) called at 2016-10-29 05:07:10.893092 (xid=0x21d80)
[2016-10-29 08:42:00.979857] E [MSGID: 114031]
[client-rpc-fops.c:1624:client3_3_inodelk_cbk] 0-netshare-client-0: remote
operation failed [Transport endpoint is not connected]
[2016-10-29 08:42:00.980057] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(INODELK(29)) called at 2016-10-29 05:07:20.941329 (xid=0x21da5)
[2016-10-29 08:42:00.980278] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(INODELK(29)) called at 2016-10-29 05:07:30.970826 (xid=0x21daa)
[2016-10-29 08:42:00.980471] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(INODELK(29)) called at 2016-10-29 05:07:41.008092 (xid=0x21daf)
[2016-10-29 08:42:00.980617] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(INODELK(29)) called at 2016-10-29 05:07:51.117968 (xid=0x21db4)
[2016-10-29 08:42:00.980752] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(INODELK(29)) called at 2016-10-29 05:08:01.218324 (xid=0x21db9)
[2016-10-29 08:42:00.980884] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(INODELK(29)) called at 2016-10-29 05:08:11.271745 (xid=0x21dbe)
[2016-10-29 08:42:00.981031] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(INODELK(29)) called at 2016-10-29 05:08:21.326249 (xid=0x21dc3)
[2016-10-29 08:42:00.981157] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(INODELK(29)) called at 2016-10-29 05:08:31.370418 (xid=0x21e08)
[2016-10-29 08:42:00.981299] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(INODELK(29)) called at 2016-10-29 05:08:41.433237 (xid=0x21e0d)
[2016-10-29 08:42:00.981422] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(INODELK(29)) called at 2016-10-29 05:08:51.446256 (xid=0x21e26)
[2016-10-29 08:42:00.981545] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GlusterFS 3.3)
op(INODELK(29)) called at 2016-10-29 05:08:54.476734 (xid=0x21e2a)
[2016-10-29 08:42:00.981666] E [rpc-clnt.c:370:saved_frames_unwind] (-->
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(_gf_log_callingfn+0x1a3)[0x7f5863707ab3]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_unwind+0x1cf)[0x7f58634d128f]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f58634d13ae]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x89)[0x7f58634d29e9]
(-->
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_notify+0x160)[0x7f58634d3330]
))))) 0-netshare-client-0: forced unwinding frame type(GF-DUMP) op(NULL(2))
called at 2016-10-29 08:41:55.978587 (xid=0x23bda)
[2016-10-29 08:42:00.981679] W [rpc-clnt-ping.c:208:rpc_clnt_ping_cbk]
0-netshare-client-0: socket disconnected
The message "E [MSGID: 114031] [client-rpc-fops.c:1624:client3_3_inodelk_cbk]
0-netshare-client-0: remote operation failed [Transport endpoint is not
connected]" repeated 11 times between [2016-10-29 08:42:00.979857] and
[2016-10-29 08:42:00.981558]
[2016-10-29 08:42:02.601745] W [glusterfsd.c:1251:cleanup_and_exit]
(-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x80a4) [0x7f58629890a4]
-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x564f0cace725]
-->/usr/sbin/glusterfs(cleanup_and_exit+0x57) [0x564f0cace5a7] ) 0-: received
signum (15), shutting down

-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.


More information about the Bugs mailing list