<div dir="ltr">Hey,<div><br></div><div>Please provide the glustershd log from all the nodes and client logs on the node from where you did the lookup on the file to resolve this issue.</div><div><br></div><div>Regards,</div><div>Karthik</div></div><br><div class="gmail_quote"><div dir="ltr">On Fri, Sep 28, 2018 at 5:27 PM Ravishankar N <<a href="mailto:ravishankar@redhat.com">ravishankar@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<p>+ gluster-users.</p>
<p>Adding Karthik to see if he has some cycles to look into this.</p>
<p>-Ravi<br>
</p>
<br>
<div class="m_-3806270261102207834moz-cite-prefix">On 09/28/2018 12:07 PM, Zhou, Cynthia
(NSB - CN/Hangzhou) wrote:<br>
</div>
<blockquote type="cite">
<div class="m_-3806270261102207834WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hi, glusterfs expert<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">When I test with
glusterfs version 3.12.3 I find it quite often that
sometimes, there are entry remains in gluster volume heal
<vol-name>info output for long time,
<b>it does not disappear until you visit it from the mount
point, is this normal</b>?<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[root@sn-0:/root]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"># gluster v heal
services info<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Brick
sn-0.local:/mnt/bricks/services/brick<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Status: Connected<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Number of entries: 0<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Brick
sn-1.local:/mnt/bricks/services/brick<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Status: Connected<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Number of entries: 0<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Brick
sn-2.local:/mnt/bricks/services/brick<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:red" lang="EN-US">/fstest_88402c989256d6e39e50208c90c1e85d
//this entry remains in the output until you touch
/mnt/services/ fstest_88402c989256d6e39e50208c90c1e85d<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Status: Connected<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Number of entries: 1<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[root@sn-0:/root]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"># ssh sn-2.local<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Warning: Permanently
added 'sn-2.local' (RSA) to the list of known hosts.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">USAGE OF THE ROOT
ACCOUNT AND THE FULL BASH IS RECOMMENDED ONLY FOR LIMITED
USE. PLEASE USE A NON-ROOT ACCOUNT AND THE SCLI SHELL
(fsclish) AND/OR LIMITED BASH SHELL.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Read
/opt/nokia/share/security/readme_root.txt for more details.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[root@sn-2:/root]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"># cd
/mnt/bricks/services/brick/.glusterfs/indices/xattrop/<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[<a class="m_-3806270261102207834moz-txt-link-abbreviated" href="mailto:root@sn-2:/mnt/bricks/services/brick/.glusterfs/indices/xattrop" target="_blank">root@sn-2:/mnt/bricks/services/brick/.glusterfs/indices/xattrop</a>]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"># ls<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">9138e315-efd6-46e0-8a3a-db535078c781
xattrop-dfcd7e67-8c2d-4ef1-93e2-c180073c8d87<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[<a class="m_-3806270261102207834moz-txt-link-abbreviated" href="mailto:root@sn-2:/mnt/bricks/services/brick/.glusterfs/indices/xattrop" target="_blank">root@sn-2:/mnt/bricks/services/brick/.glusterfs/indices/xattrop</a>]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"># getfattr -m . -d -e
hex
/mnt/bricks/services/brick/fstest_88402c989256d6e39e50208c90c1e85d/<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">getfattr: Removing
leading '/' from absolute path names<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"># file:
mnt/bricks/services/brick/fstest_88402c989256d6e39e50208c90c1e85d/<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">trusted.afr.services-client-1=<span style="color:red">0x000000000000000100000001</span><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">trusted.gfid=0x9138e315efd646e08a3adb535078c781<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">trusted.glusterfs.dht=0x000000010000000000000000ffffffff<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[<a class="m_-3806270261102207834moz-txt-link-abbreviated" href="mailto:root@sn-2:/mnt/bricks/services/brick/.glusterfs/indices/xattrop" target="_blank">root@sn-2:/mnt/bricks/services/brick/.glusterfs/indices/xattrop</a>]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"># getfattr -m . -d -e
hex
/mnt/bricks/services/brick/fstest_88402c989256d6e39e50208c90c1e85d/fstest_4cf1be62e0b12d3d65fac8eacb523ef3/<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">getfattr: Removing
leading '/' from absolute path names<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"># file:
mnt/bricks/services/brick/fstest_88402c989256d6e39e50208c90c1e85d/fstest_4cf1be62e0b12d3d65fac8eacb523ef3/<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">trusted.gfid=0x0ccb5c1f96064e699f62fdc72cf036f5<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">“<span style="color:red">fstest_88402c989256d6e39e50208c90c1e85d”
is only seen from sn-2 mount point and sn-2 service brick,
there is no such entry if you ls /mnt/services on sn-0 or
sn-1.</span><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[<a class="m_-3806270261102207834moz-txt-link-abbreviated" href="mailto:root@sn-2:/mnt/bricks/services/brick/.glusterfs/indices/xattrop" target="_blank">root@sn-2:/mnt/bricks/services/brick/.glusterfs/indices/xattrop</a>]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"># cd /mnt/services/<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[root@sn-2:/mnt/services]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"># ls<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">backup
db <span style="color:red">
fstest_88402c989256d6e39e50208c90c1e85d</span> LCM
NE3SAgent _nokrcpautoremoteuser PM9 RCP_Backup
SS_AlLightProcessor SymptomDataUpl<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">commoncollector
EventCorrelationEngine hypertracer
Log netserv ODS ptp
rcpha SWM<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[root@sn-2:/mnt/services]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</div>
</blockquote>
<br>
</div>
</blockquote></div>