<html>
  <head>

    <meta http-equiv="content-type" content="text/html; charset=UTF-8">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <p>Hello!</p>
    <p>I'm seeing something strange. When executed a v heal info on my
      volume I saw this:</p>
    <p><font size="-1">root@gluster-gu3:~# gluster volume heal gv3 info<br>
        Brick gluster-gu3.xcade.net:/mnt/gv_gu3/brick<br>
        / <br>
        Status: Connected<br>
        Number of entries: 1<br>
        <br>
        Brick gluster-gu1.xcade.net:/mnt/gv_gu3/brick<br>
        Status: Connected<br>
        Number of entries: 0</font><br>
      <br>
    </p>
    <p>After running the heal command it still appears and the logs
      show:</p>
    <p><font size="-1">[2018-11-22 14:15:57.008133] I [MSGID: 108026]
        [afr-self-heal-entry.c:887:afr_selfheal_entry_do]
        0-gv3-replicate-0: performing entry selfheal on
        00000000-0000-0000-0000-000000000001<br>
        [2018-11-22 14:25:45.852709] I [MSGID: 108026]
        [afr-self-heal-entry.c:887:afr_selfheal_entry_do]
        0-gv3-replicate-0: performing entry selfheal on
        00000000-0000-0000-0000-000000000001</font><br>
      <br>
    </p>
    <p>And after running a full heal this appeared:</p>
    <p><font size="-1">[2018-11-22 14:10:17.114267] I [MSGID: 108026]
        [afr-self-heald.c:821:afr_shd_full_healer] 0-gv3-replicate-0:
        starting full sweep on subvol gv3-client-0<br>
        [2018-11-22 14:10:17.117031] E
        [client-common.c:2739:client_pre_getxattr_v2]
(--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf)
        [0x7f8102254fcf]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a)
        [0x7f81022a735a]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942)
        [0x7f8102294942] ) 0-: Assertion failed: 0<br>
        [2018-11-22 14:10:17.117358] E
        [client-common.c:2739:client_pre_getxattr_v2]
(--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf)
        [0x7f8102254fcf]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a)
        [0x7f81022a735a]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942)
        [0x7f8102294942] ) 0-: Assertion failed: 0<br>
        [2018-11-22 14:10:17.119759] W [MSGID: 114031]
        [client-rpc-fops_v2.c:2540:client4_0_lookup_cbk] 0-gv3-client-0:
        remote operation failed. Path: /test.xml
        (3762ade0-e844-46e8-a77b-c81655170e3e) [No such file or
        directory]<br>
        [2018-11-22 14:10:17.121515] E
        [client-common.c:2739:client_pre_getxattr_v2]
(--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf)
        [0x7f8102254fcf]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a)
        [0x7f81022a735a]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942)
        [0x7f8102294942] ) 0-: Assertion failed: 0<br>
        [2018-11-22 14:10:17.121842] E
        [client-common.c:2739:client_pre_getxattr_v2]
(--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf)
        [0x7f8102254fcf]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a)
        [0x7f81022a735a]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942)
        [0x7f8102294942] ) 0-: Assertion failed: 0<br>
        [2018-11-22 14:10:17.122149] E
        [client-common.c:2739:client_pre_getxattr_v2]
(--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf)
        [0x7f8102254fcf]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a)
        [0x7f81022a735a]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942)
        [0x7f8102294942] ) 0-: Assertion failed: 0<br>
        [2018-11-22 14:10:17.122473] E
        [client-common.c:2739:client_pre_getxattr_v2]
(--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf)
        [0x7f8102254fcf]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a)
        [0x7f81022a735a]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942)
        [0x7f8102294942] ) 0-: Assertion failed: 0<br>
        [2018-11-22 14:10:17.124086] E
        [client-common.c:2739:client_pre_getxattr_v2]
(--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf)
        [0x7f8102254fcf]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a)
        [0x7f81022a735a]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942)
        [0x7f8102294942] ) 0-: Assertion failed: 0<br>
        [2018-11-22 14:10:17.124476] E
        [client-common.c:2739:client_pre_getxattr_v2]
(--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf)
        [0x7f8102254fcf]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a)
        [0x7f81022a735a]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942)
        [0x7f8102294942] ) 0-: Assertion failed: 0<br>
        [2018-11-22 14:10:17.124762] E
        [client-common.c:2739:client_pre_getxattr_v2]
(--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf)
        [0x7f8102254fcf]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a)
        [0x7f81022a735a]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942)
        [0x7f8102294942] ) 0-: Assertion failed: 0<br>
        [2018-11-22 14:10:17.125035] E
        [client-common.c:2739:client_pre_getxattr_v2]
(--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf)
        [0x7f8102254fcf]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a)
        [0x7f81022a735a]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942)
        [0x7f8102294942] ) 0-: Assertion failed: 0<br>
        [2018-11-22 14:10:17.130656] W [MSGID: 114031]
        [client-rpc-fops_v2.c:2540:client4_0_lookup_cbk] 0-gv3-client-0:
        remote operation failed. Path: /keys-tc1.img
        (dd75a145-845d-4755-aea2-c23a23b8a026) [No such file or
        directory]<br>
        [2018-11-22 14:10:17.143055] W [MSGID: 114031]
        [client-rpc-fops_v2.c:2540:client4_0_lookup_cbk] 0-gv3-client-0:
        remote operation failed. Path: /testbionic-gu1.xml
        (3f55dab2-f7e2-461e-a7ae-e64d6a690628) [No such file or
        directory]<br>
        [2018-11-22 14:10:17.144894] E
        [client-common.c:2739:client_pre_getxattr_v2]
(--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0xdfcf)
        [0x7f8102254fcf]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x6035a)
        [0x7f81022a735a]
--&gt;/usr/lib/x86_64-linux-gnu/glusterfs/4.1.4/xlator/protocol/client.so(+0x4d942)
        [0x7f8102294942] ) 0-: Assertion failed: 0<br>
        [2018-11-22 14:10:17.154748] I [MSGID: 108026]
        [afr-self-heald.c:831:afr_shd_full_healer] 0-gv3-replicate-0:
        finished full sweep on subvol gv3-client-0</font><br>
    </p>
    <p>I'm running gluster 4.1.4 in Ubuntu Xenial. It is a replica 2
      volume with one brick in gluster-gu1 and one brick in gluster-gu3.
      <br>
      I was checking the .glusterfs directory and corroborated that for
      some reason, in gluster-gu3 host it exists this file and not in
      gluster-gu1:</p>
    <p><font size="-1">root@gluster-gu3:~# stat
/mnt/gv_gu3/brick/.glusterfs/indices/xattrop/00000000-0000-0000-0000-000000000001
        <br>
          File:
'/mnt/gv_gu3/brick/.glusterfs/indices/xattrop/00000000-0000-0000-0000-000000000001'<br>
          Size: 0             Blocks: 0          IO Block: 4096  
        regular empty file<br>
        Device: fc00h/64512d    Inode: 361         Links: 2<br>
        Access: (0000/----------)  Uid: (    0/    root)   Gid: (   
        0/    root)<br>
        Access: 2018-10-27 20:20:45.916617570 +0000<br>
        Modify: 2018-10-27 20:20:45.916617570 +0000<br>
        Change: 2018-11-22 14:31:08.748261742 +0000<br>
         Birth: -</font><br>
    </p>
    <p>That indicates that the / needs to be healed in gluster-gu3 but
      is the brick itself so I do not know how to proceed.</p>
    <p>This is the volume info:</p>
    <p><font size="-1">root@gluster-gu3:~# gluster volume info gv3<br>
         </font><br>
      <font size="-1">Volume Name: gv3<br>
        Type: Replicate<br>
        Volume ID: c5529e9f-2ded-4f56-9eff-f46f5b184d97<br>
        Status: Started<br>
        Snapshot Count: 0<br>
        Number of Bricks: 1 x 2 = 2<br>
        Transport-type: tcp<br>
        Bricks:<br>
        Brick1: gluster-gu3.xcade.net:/mnt/gv_gu3/brick<br>
        Brick2: gluster-gu1.xcade.net:/mnt/gv_gu3/brick<br>
        Options Reconfigured:<br>
        transport.address-family: inet<br>
        nfs.disable: on<br>
        performance.client-io-threads: off</font><br>
    </p>
    <p>Any help will be appreciated. Thanks! <br>
    </p>
    <div class="moz-signature">-- <br>
      Pablo<br>
      <br>
    </div>
  </body>
</html>