<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Roboto;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
p.yiv5897603885msonormal, li.yiv5897603885msonormal, div.yiv5897603885msonormal
{mso-style-name:yiv5897603885msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle27
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Thank you for the suggestion!<o:p></o:p></span></font></p>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">I mounted the volume on a new mount point, retrieved the gfid of another file, and was able to obtain the file information through Method2.<o:p></o:p></span></font></p>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">However, when I used the gfids listed in heal, I get a “transport endpoint is not connected” error, despite them showing as “connected” in heal info (and volume status).<o:p></o:p></span></font></p>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Thanks,<o:p></o:p></span></font></p>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Collin<o:p></o:p></span></font></p>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><font size="2" face="Calibri"><span style="font-size:11.0pt;font-weight:bold">From:</span></font></b> Strahil Nikolov <hunter86_bg@yahoo.com>
<br>
<b><span style="font-weight:bold">Sent:</span></b> Friday, March 25, 2022 1:47 PM<br>
<b><span style="font-weight:bold">To:</span></b> Collin Strassburger <cstrassburger@bihrle.com>; gluster-users@gluster.org<br>
<b><span style="font-weight:bold">Subject:</span></b> Re: [Gluster-users] gfid entries failing to heal<o:p></o:p></p>
</div>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p>
<div style="border:solid black 1.5pt;padding:0in 0in 0in 0in">
<p style="margin:2.25pt;background:#FFFFCC"><b><font size="1" color="red" face="Calibri"><span style="font-size:9.0pt;color:red;font-weight:bold">CAUTION - EXTERNAL EMAIL:</span></font></b><font size="1" color="black"><span style="font-size:9.0pt;color:black">
Do not click any links or open any attachments unless you trust the sender and know the content is safe.
</span></font><font size="1"><span style="font-size:9.0pt"><o:p></o:p></span></font></p>
</div>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">To find gfid path, you can use <a href="https://docs.gluster.org/en/main/Troubleshooting/gfid-to-path/" id="linkextractor__1648230314675">https://docs.gluster.org/en/main/Troubleshooting/gfid-to-path/</a><o:p></o:p></span></font></p>
<div>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p>
</div>
<div>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Usually, I prefer to mount and then use Method2 to retrieve the path.<o:p></o:p></span></font></p>
</div>
<div>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p>
</div>
<div>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Then, you can getfattr the file/dir to get a clue.<o:p></o:p></span></font></p>
</div>
<div>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><o:p> </o:p></span></font></p>
</div>
<div>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Best Regards,<o:p></o:p></span></font></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><font size="2" face="Calibri"><span style="font-size:11.0pt">Strahil Nikolov<o:p></o:p></span></font></p>
<blockquote style="margin-left:0in;margin-right:0in;margin-bottom:15.0pt">
<div>
<div>
<p class="MsoNormal"><font size="2" color="#6d00f6" face="Roboto"><span style="font-size:11.0pt;font-family:Roboto;color:#6D00F6">On Fri, Mar 25, 2022 at 18:51, Collin Strassburger<o:p></o:p></span></font></p>
</div>
<div>
<p class="MsoNormal"><font size="2" color="#6d00f6" face="Roboto"><span style="font-size:11.0pt;font-family:Roboto;color:#6D00F6"><<a href="mailto:cstrassburger@bihrle.com">cstrassburger@bihrle.com</a>> wrote:<o:p></o:p></span></font></p>
</div>
</div>
<div style="border:none;border-left:solid #6D00F6 1.0pt;padding:0in 0in 0in 15.0pt;margin-top:7.5pt">
<div id="yiv5897603885">
<div>
<div>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Hello,<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"> <o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">I am having a problem with a replica 3 volume.<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"> <o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">When I run: gluster volume heal hydra_pbs_vol info<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">It returns:<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Brick hydra1:/data/glusterfs/PBS/NonMountDir<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><gfid:78ce1382-4ac8-4c2e-94af-45b5abd055c5><o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Status: Connected<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Number of entries: 1<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"> <o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Brick hydra2:/data/glusterfs/PBS/NonMountDir<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><gfid:c3e7dc8e-111c-4ab2-9c10-ea5c1fd11223><o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><gfid:96a72cf8-025d-4127-a216-4429dd1f59c6><o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><gfid:8abbef15-929b-450f-9528-cb37dfc40bde><o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"><gfid:825bffa1-c727-4c2e-8c21-4da563851d7b><o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Status: Connected<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Number of entries: 4<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"> <o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Brick viz1:/data/glusterfs/PBS/NonMountDir<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Status: Connected<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Number of entries: 0<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"> <o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">The items have been present for some time and do not appear to be healing.<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">As shown above, the items are not labeled as split-brain and they do not have path information to do a manual delete-and-heal.<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"> <o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Content of /var/log/glusterfs/glfsheal-hydra_pbs_vol.log is attached<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Info:<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">gluster volume info hydra_pbs_vol<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Volume Name: hydra_pbs_vol<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Type: Replicate<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Volume ID: efb30804-1c08-4ef6-a579-a2f77d5049e0<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Status: Started<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Snapshot Count: 0<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Number of Bricks: 1 x 3 = 3<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Transport-type: tcp<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Bricks:<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Brick1: hydra1:/data/glusterfs/PBS/NonMountDir<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Brick2: hydra2:/data/glusterfs/PBS/NonMountDir<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Brick3: viz1:/data/glusterfs/PBS/NonMountDir<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Options Reconfigured:<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">performance.client-io-threads: off<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">nfs.disable: on<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">transport.address-family: inet<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">storage.fips-mode-rchecksum: on<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">cluster.granular-entry-heal: on<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">features.bitrot: on<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">features.scrub: Active<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"> <o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Status:<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Status of volume: hydra_pbs_vol<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Gluster process TCP Port RDMA Port Online Pid<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">------------------------------------------------------------------------------<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Brick hydra1:/data/glusterfs/PBS/NonMountDi<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">r 49152 0 Y 1518<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Brick hydra2:/data/glusterfs/PBS/NonMountDi<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">r 49152 0 Y 1438<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Brick viz1:/data/glusterfs/PBS/NonMountDir 49152 0 Y 2991<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Self-heal Daemon on localhost N/A N/A Y 1942<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Bitrot Daemon on localhost N/A N/A Y 1563<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Scrubber Daemon on localhost N/A N/A Y 1738<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Self-heal Daemon on viz1 N/A N/A Y 3491<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Bitrot Daemon on viz1 N/A N/A Y 3203<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Scrubber Daemon on viz1 N/A N/A Y 3261<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Self-heal Daemon on hydra2 N/A N/A Y 1843<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Bitrot Daemon on hydra2 N/A N/A Y 1475<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Scrubber Daemon on hydra2 N/A N/A Y 1651<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"> <o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Task Status of Volume hydra_pbs_vol<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">------------------------------------------------------------------------------<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">There are no active volume tasks<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"> <o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"> <o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">How can I resolve these entries/issues?<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"> <o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt"> <o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Thanks,<o:p></o:p></span></font></p>
<p class="yiv5897603885msonormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">Collin Strassburger (he/him)<o:p></o:p></span></font></p>
</div>
</div>
</div>
<p class="MsoNormal"><font size="2" face="Calibri"><span style="font-size:11.0pt">________<br>
<br>
<br>
<br>
Community Meeting Calendar:<br>
<br>
Schedule -<br>
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC<br>
Bridge: <a href="https://meet.google.com/cpu-eiue-hvk" target="_blank">https://meet.google.com/cpu-eiue-hvk</a><br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><o:p></o:p></span></font></p>
</div>
</blockquote>
</div>
</div>
</body>
</html>