[Gluster-users] Gluster trying to heal /

Pablo Schandin pablo.schandin at avature.net
Thu Nov 22 14:36:46 UTC 2018


Hello!

I'm seeing something strange. When executed a v heal info on my volume I 
saw this:

root at gluster-gu3:~# gluster volume heal gv3 info
Brick gluster-gu3.xcade.net:/mnt/gv_gu3/brick
/
Status: Connected
Number of entries: 1

Brick gluster-gu1.xcade.net:/mnt/gv_gu3/brick
Status: Connected
Number of entries: 0

After running the heal command it still appears and the logs show:

[2018-11-22 14:15:57.008133] I [MSGID: 108026] 
[afr-self-heal-entry.c:887:afr_selfheal_entry_do] 0-gv3-replicate-0: 
performing entry selfheal on 00000000-0000-0000-0000-000000000001
[2018-11-22 14:25:45.852709] I [MSGID: 108026] 
[afr-self-heal-entry.c:887:afr_selfheal_entry_do] 0-gv3-replicate-0: 
performing entry selfheal on 00000000-0000-0000-0000-000000000001

And after running a full heal this appeared:

[2018-11-22 14:10:17.114267] I [MSGID: 108026] 
[afr-self-heald.c:821:afr_shd_full_healer] 0-gv3-replicate-0: starting 
full sweep on subvol gv3-client-0
[2018-11-22 14:10:17.117031] E 
[client-common.c:2739:client_pre_getxattr_v2] 
(-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf) 
[0x7f8102254fcf] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a) 
[0x7f81022a735a] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942) 
[0x7f8102294942] ) 0-: Assertion failed: 0
[2018-11-22 14:10:17.117358] E 
[client-common.c:2739:client_pre_getxattr_v2] 
(-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf) 
[0x7f8102254fcf] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a) 
[0x7f81022a735a] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942) 
[0x7f8102294942] ) 0-: Assertion failed: 0
[2018-11-22 14:10:17.119759] W [MSGID: 114031] 
[client-rpc-fops_v2.c:2540:client4_0_lookup_cbk] 0-gv3-client-0: remote 
operation failed. Path: /test.xml (3762ade0-e844-46e8-a77b-c81655170e3e) 
[No such file or directory]
[2018-11-22 14:10:17.121515] E 
[client-common.c:2739:client_pre_getxattr_v2] 
(-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf) 
[0x7f8102254fcf] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a) 
[0x7f81022a735a] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942) 
[0x7f8102294942] ) 0-: Assertion failed: 0
[2018-11-22 14:10:17.121842] E 
[client-common.c:2739:client_pre_getxattr_v2] 
(-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf) 
[0x7f8102254fcf] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a) 
[0x7f81022a735a] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942) 
[0x7f8102294942] ) 0-: Assertion failed: 0
[2018-11-22 14:10:17.122149] E 
[client-common.c:2739:client_pre_getxattr_v2] 
(-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf) 
[0x7f8102254fcf] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a) 
[0x7f81022a735a] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942) 
[0x7f8102294942] ) 0-: Assertion failed: 0
[2018-11-22 14:10:17.122473] E 
[client-common.c:2739:client_pre_getxattr_v2] 
(-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf) 
[0x7f8102254fcf] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a) 
[0x7f81022a735a] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942) 
[0x7f8102294942] ) 0-: Assertion failed: 0
[2018-11-22 14:10:17.124086] E 
[client-common.c:2739:client_pre_getxattr_v2] 
(-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf) 
[0x7f8102254fcf] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a) 
[0x7f81022a735a] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942) 
[0x7f8102294942] ) 0-: Assertion failed: 0
[2018-11-22 14:10:17.124476] E 
[client-common.c:2739:client_pre_getxattr_v2] 
(-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf) 
[0x7f8102254fcf] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a) 
[0x7f81022a735a] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942) 
[0x7f8102294942] ) 0-: Assertion failed: 0
[2018-11-22 14:10:17.124762] E 
[client-common.c:2739:client_pre_getxattr_v2] 
(-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf) 
[0x7f8102254fcf] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a) 
[0x7f81022a735a] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942) 
[0x7f8102294942] ) 0-: Assertion failed: 0
[2018-11-22 14:10:17.125035] E 
[client-common.c:2739:client_pre_getxattr_v2] 
(-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf) 
[0x7f8102254fcf] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a) 
[0x7f81022a735a] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942) 
[0x7f8102294942] ) 0-: Assertion failed: 0
[2018-11-22 14:10:17.130656] W [MSGID: 114031] 
[client-rpc-fops_v2.c:2540:client4_0_lookup_cbk] 0-gv3-client-0: remote 
operation failed. Path: /keys-tc1.img 
(dd75a145-845d-4755-aea2-c23a23b8a026) [No such file or directory]
[2018-11-22 14:10:17.143055] W [MSGID: 114031] 
[client-rpc-fops_v2.c:2540:client4_0_lookup_cbk] 0-gv3-client-0: remote 
operation failed. Path: /testbionic-gu1.xml 
(3f55dab2-f7e2-461e-a7ae-e64d6a690628) [No such file or directory]
[2018-11-22 14:10:17.144894] E 
[client-common.c:2739:client_pre_getxattr_v2] 
(-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf) 
[0x7f8102254fcf] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a) 
[0x7f81022a735a] 
-->/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942) 
[0x7f8102294942] ) 0-: Assertion failed: 0
[2018-11-22 14:10:17.154748] I [MSGID: 108026] 
[afr-self-heald.c:831:afr_shd_full_healer] 0-gv3-replicate-0: finished 
full sweep on subvol gv3-client-0

I'm running gluster 4.1.4 in Ubuntu Xenial. It is a replica 2 volume 
with one brick in gluster-gu1 and one brick in gluster-gu3.
I was checking the .glusterfs directory and corroborated that for some 
reason, in gluster-gu3 host it exists this file and not in gluster-gu1:

root at gluster-gu3:~# stat 
/mnt/gv_gu3/brick/.glusterfs/indices/xattrop/00000000-0000-0000-0000-000000000001 

   File: 
'/mnt/gv_gu3/brick/.glusterfs/indices/xattrop/00000000-0000-0000-0000-000000000001'
   Size: 0             Blocks: 0          IO Block: 4096 regular empty file
Device: fc00h/64512d    Inode: 361         Links: 2
Access: (0000/----------)  Uid: (    0/    root)   Gid: ( 0/    root)
Access: 2018-10-27 20:20:45.916617570 +0000
Modify: 2018-10-27 20:20:45.916617570 +0000
Change: 2018-11-22 14:31:08.748261742 +0000
  Birth: -

That indicates that the / needs to be healed in gluster-gu3 but is the 
brick itself so I do not know how to proceed.

This is the volume info:

root at gluster-gu3:~# gluster volume info gv3

Volume Name: gv3
Type: Replicate
Volume ID: c5529e9f-2ded-4f56-9eff-f46f5b184d97
Status: Started
Snapshot Count: 0
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: gluster-gu3.xcade.net:/mnt/gv_gu3/brick
Brick2: gluster-gu1.xcade.net:/mnt/gv_gu3/brick
Options Reconfigured:
transport.address-family: inet
nfs.disable: on
performance.client-io-threads: off

Any help will be appreciated. Thanks!

-- 
Pablo

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20181122/c1592286/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4008 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20181122/c1592286/attachment.p7s>


More information about the Gluster-users mailing list