[Gluster-devel] geo-replication pair failed after create file(s) through samba protocol with gluster version 3.7.13

柯名峻 fmpnate at gmail.com
Wed Jul 20 09:28:15 UTC 2016


Hi all,

I create a geo-replication pair, both source and target volume are using
disperse (2+1)  as volume type.

geo-replication pair works well no matter I do create or other
operations *through
fuse mount,*


MASTER NODE    MASTER VOL    MASTER BRICK                      SLAVE USER
 SLAVE                                 SLAVE NODE    STATUS     CRAWL
STATUS       LAST_SYNCED

---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
VM69                    S1                     /export/Ilvol_06nWMZ45Dl/fs
    root                   ssh://110.110.110.72::T1    VM74
Active        Changelog Crawl        2016-07-20 04:54:04

VM70                    S1                     /export/lvol_GQgXr9xEih/fs
     root                   ssh://110.110.110.72::T1    VM72
  Passive      N/A                           N/A

VM71                    S1                     /export/lvol_G6XHjYcRwC/fs
   root                   ssh://110.110.110.72::T1    VM73
Passive      N/A                           N/A


But when I create file(s) from samba protocol (by samba-vfs-glusterfs
plug-in),

*gluster geo-replication status shows Faulty on all bricks.*

MASTER NODE    MASTER VOL    MASTER BRICK                      SLAVE USER
 SLAVE                               SLAVE NODE    STATUS    CRAWL STATUS
 LAST_SYNCED
-----------------------------------------------------------------------------------------------------------------------------------------------------------
VM69                    S1                       /export/lvol_06nWMZ45Dl/fs
   root                  ssh://110.110.110.72::T1    N/A
Faulty        N/A                        N/A
VM71                    S1                       /export/lvol_G6XHjYcRwC/fs
   root                  ssh://110.110.110.72::T1    N/A
Faulty        N/A                        N/A
VM70                    S1                       /export/lvol_GQgXr9xEih/fs
     root                  ssh://110.110.110.72::T1    N/A
  Faulty        N/A                        N/A


*Size of new file(s) added from samba shows zero.*

# stat /volume/T1/New\ Text\ Document.txt

File: ‘/volume/T1/New Text Document.txt’
Size: 0               Blocks: 0          IO Block: 131072 regular empty file

Device: 26h/38d Inode: 12478956496820509771  Links: 1
Access: (0744/-rwxr--r--)  Uid: (65535/ UNKNOWN)   Gid: (  100/   users)
Access: 2016-07-20 04:57:23.805832046 +0800
Modify: 2016-07-20 04:57:23.805832046 +0800
Change: 2016-07-20 04:57:23.805832046 +0800
Birth: -

geo-replication-slaves/a4f632fe-2946-4608-b679-3064585e0ef5:gluster%3A%2F%2F127.0.0.1%3AT1.gluster.log
 shows

[2016-07-19 21:02:38.018610] I [MSGID: 122061] [ec.c:313:ec_up]
0-T1-disperse-0: Going UP
[2016-07-19 21:02:38.018772] D [fuse-bridge.c:5195:notify] 0-fuse: got
event 5 on graph 0
[2016-07-19 21:02:38.024367] I [fuse-bridge.c:5172:fuse_graph_setup]
0-fuse: switched to graph 0
[2016-07-19 21:02:38.024521] I [MSGID: 114035]
[client-handshake.c:193:client_set_lk_version_cbk] 0-T1-client-2: Server lk
version = 1
[2016-07-19 21:02:38.024547] D [fuse-bridge.c:4798:fuse_get_mount_status]
0-fuse: mount status is 0
[2016-07-19 21:02:38.024655] D [MSGID: 0]
[dht-diskusage.c:97:dht_du_info_cbk] 0-T1-dht: subvolume 'T1-disperse-0':
avail_percent is: 98.00 and avail_space is: 5275992064 and avail_inodes is:
99.00
[2016-07-19 21:02:38.024690] D [fuse-bridge.c:4042:fuse_init]
0-glusterfs-fuse: Detected support for FUSE_AUTO_INVAL_DATA. Enabling
fopen_keep_cache automatically.
[2016-07-19 21:02:38.024734] I [fuse-bridge.c:4083:fuse_init]
0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.22 kernel
7.22
[2016-07-19 21:02:38.024885] D [MSGID: 0] [dht-common.c:2445:dht_lookup]
0-T1-dht: Calling fresh lookup for / on T1-disperse-0
[2016-07-19 21:02:38.029359] D [MSGID: 0]
[dht-common.c:2032:dht_lookup_cbk] 0-T1-dht: fresh_lookup returned for /
with op_ret 0 [Invalid argument]
[2016-07-19 21:02:38.038381] D [MSGID: 0]
[dht-common.c:791:dht_revalidate_cbk] 0-T1-dht: revalidate lookup of /
returned with op_ret 0 [Invalid argument]
[2016-07-19 21:02:42.177173] D [MSGID: 0]
[dht-common.c:278:dht_discover_complete] 0-T1-dht: key =
trusted.glusterfs.quota.read-only not present in dict
[2016-07-19 21:02:42.188603] *E [MSGID: 122065]
[ec-common.c:961:ec_prepare_update_cbk] 0-T1-disperse-0: Unable to get
config xattr [No data available]*
[2016-07-19 21:02:42.188693] D [MSGID: 0]
[defaults.c:1248:default_setattr_cbk] 0-stack-trace: stack-address:
0x7fa27751306c, T1-disperse-0 returned -1 error: No data available [No data
available]
[2016-07-19 21:02:42.188725] D [MSGID: 0]
[dht-inode-write.c:940:dht_file_setattr_cbk] 0-T1-dht: subvolume
T1-disperse-0 returned -1 [No data available]
[2016-07-19 21:02:42.188749] D [MSGID: 0]
[dht-inode-write.c:973:dht_file_setattr_cbk] 0-stack-trace: stack-address:
0x7fa27751306c, T1-dht returned -1 error: No data available [No data
available]
[2016-07-19 21:02:42.188777] D [MSGID: 0] [md-cache.c:1621:mdc_setattr_cbk]
0-stack-trace: stack-address: 0x7fa27751306c, T1-md-cache returned -1
error: No data available [No data available]
[2016-07-19 21:02:42.188807] D [MSGID: 0]
[io-stats.c:1462:io_stats_setattr_cbk] 0-stack-trace: stack-address:
0x7fa27751306c, T1 returned -1 error: No data available [No data available]
[2016-07-19 21:02:42.188837] D [MSGID: 0]
[posix-acl.c:1833:posix_acl_setattr_cbk] 0-stack-trace: stack-address:
0x7fa27751306c, posix-acl-autoload returned -1 error: No data available [No
data available]
[2016-07-19 21:02:42.188863] D [MSGID: 0]
[defaults.c:1248:default_setattr_cbk] 0-stack-trace: stack-address:
0x7fa27751306c, gfid-access-autoload returned -1 error: No data available
[No data available]
[2016-07-19 21:02:42.188892] W [fuse-bridge.c:1066:fuse_setattr_cbk]
0-glusterfs-fuse: 5: SETATTR() /.gfid/aac75b9d-e044-496c-957c-4a4ed6c6b835
=> -1 (No data available)
[2016-07-19 21:02:42.203417] *D [fuse-bridge.c:4909:fuse_thread_proc]
0-glusterfs-fuse: terminating upon getting ENODEV when reading /dev/fuse*
[2016-07-19 21:02:42.203478] *I [fuse-bridge.c:5013:fuse_thread_proc]
0-fuse: unmounting /tmp/gsyncd-aux-mount-aswk0l*
[2016-07-19 21:02:42.203543] D [logging.c:1766:gf_log_flush_extra_msgs]
0-logging-infra: Log buffer size reduced. About to flush 5 extra log
messages
[2016-07-19 21:02:42.203593] D [logging.c:1769:gf_log_flush_extra_msgs]
0-logging-infra: Just flushed 5 extra log messages
[2016-07-19 21:02:42.203679] W [glusterfsd.c:1251:cleanup_and_exit]
(-->/lib64/libpthread.so.0(+0x7dc5) [0x7fa278a1ddc5]
-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7fa27a097915]
-->/usr/sbin/glusterfs(cleanup_and_exit+0x
6b) [0x7fa27a09778b] ) 0-: received signum (15), shutting down
[2016-07-19 21:02:42.203700] D
[glusterfsd-mgmt.c:2361:glusterfs_mgmt_pmap_signout] 0-fsd-mgmt: portmapper
signout arguments not given
[2016-07-19 21:02:42.203712] I [fuse-bridge.c:5720:fini] 0-fuse: Unmounting
'/tmp/gsyncd-aux-mount-aswk0l'.

After I delete the file(s) created throgh samba, geo-replication pair
status return to normal state(Active and Passive).

Can someone help this issue?

Thanks.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-devel/attachments/20160720/446f7a75/attachment-0001.html>


More information about the Gluster-devel mailing list