<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Sep 28, 2017 at 12:11 PM, Zhou, Cynthia (NSB - CN/Hangzhou) <span dir="ltr">&lt;<a href="mailto:cynthia.zhou@nokia-sbell.com" target="_blank">cynthia.zhou@nokia-sbell.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">





<div link="blue" vlink="purple" lang="ZH-CN">
<div class="m_5742686906645710940WordSection1">
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">The version I am using is glusterfs 3.6.9</span></p></div></div></blockquote><div>This is a very old version which is EOL. If you can upgrade to any of the supported version (3.10 or 3.12) would be great.<br></div><div>They have many new features, bug fixes &amp; performance improvements. If you can try to reproduce the issue on that would be<br></div><div>very helpful.<br></div><div><br></div><div>Regards,<br></div><div>Karthik<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div link="blue" vlink="purple" lang="ZH-CN"><div class="m_5742686906645710940WordSection1"><p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"><u></u><u></u></span></p><span class="">
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph"><span style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US">Best regards,<br>
<b>Cynthia </b></span><b><span style="font-size:10.5pt">(周琳)</span></b><b><span style="font-size:11.0pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US"><u></u><u></u></span></b></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph"><span style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US">MBB SM HETRAN SW3 MATRIX 
<u></u><u></u></span></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph"><span style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US">Storage        
<b><br>
</b>Mobile: +86 (0)18657188311</span><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"><u></u> <u></u></span></p>
</span><p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> Karthik Subrahmanya [mailto:<a href="mailto:ksubrahm@redhat.com" target="_blank">ksubrahm@redhat.com</a>]
<br>
<b>Sent:</b> Thursday, September 28, 2017 2:37 PM</span></p><div><div class="h5"><br>
<b>To:</b> Zhou, Cynthia (NSB - CN/Hangzhou) &lt;<a href="mailto:cynthia.zhou@nokia-sbell.com" target="_blank">cynthia.zhou@nokia-sbell.com</a>&gt;<br>
<b>Cc:</b> <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>; <a href="mailto:gluster-devel@gluster.org" target="_blank">gluster-devel@gluster.org</a><br>
<b>Subject:</b> Re: [Gluster-users] after hard reboot, split-brain happened, but nothing showed in gluster voluem heal info command !<u></u><u></u></div></div><p></p><div><div class="h5">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US">On Thu, Sep 28, 2017 at 11:41 AM, Zhou, Cynthia (NSB - CN/Hangzhou) &lt;<a href="mailto:cynthia.zhou@nokia-sbell.com" target="_blank">cynthia.zhou@nokia-sbell.com</a>&gt; wrote:<u></u><u></u></span></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Hi,</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Thanks for reply!</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">I’ve checked [1]. But the problem is that there is nothing shown in command “gluster volume heal &lt;volume-name&gt;
 info”. So these split-entry files could only be detected when app try to visit them.</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">I can find gfid mismatch for those in-split-brain entries from mount log, however, nothing show in shd
 log, the shd log does not know those split-brain entries. Because there is nothing in indices/xattrop directory.</span><span lang="EN-US"><u></u><u></u></span></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><span lang="EN-US">I guess it was there before, and then it got cleared by one of the heal process either client side or server side. I wanted to check that by examining the logs.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Which version of gluster you are running by the way?<u></u><u></u></span></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">The log is not available right now, when it reproduced, I will provide it to your, Thanks!</span><span lang="EN-US"><u></u><u></u></span></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><span lang="EN-US">Ok. <u></u><u></u></span></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US">Best regards,<br>
<b>Cynthia </b></span><b><span style="font-size:10.5pt">(周琳)</span></b><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US">MBB SM HETRAN SW3 MATRIX 
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US">Storage        
<b><br>
</b>Mobile: +86 (0)18657188311</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> Karthik
 Subrahmanya [mailto:</span><span lang="EN-US"><a href="mailto:ksubrahm@redhat.com" target="_blank"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif">ksubrahm@redhat.com</span></a></span><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">]
<br>
<b>Sent:</b> Thursday, September 28, 2017 2:02 PM<br>
<b>To:</b> Zhou, Cynthia (NSB - CN/Hangzhou) &lt;</span><span lang="EN-US"><a href="mailto:cynthia.zhou@nokia-sbell.com" target="_blank"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif">cynthia.zhou@nokia-sbell.com</span></a></span><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">&gt;<br>
<b>Cc:</b> </span><span lang="EN-US"><a href="mailto:Gluster-users@gluster.org" target="_blank"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif">Gluster-users@gluster.org</span></a></span><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">;
</span><span lang="EN-US"><a href="mailto:gluster-devel@gluster.org" target="_blank"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif">gluster-devel@gluster.org</span></a></span><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"><br>
<b>Subject:</b> Re: [Gluster-users] after hard reboot, split-brain happened, but nothing showed in gluster voluem heal info command !</span><span lang="EN-US"><u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt;margin-left:11.55pt">
<span lang="EN-US">Hi,<u></u><u></u></span></p>
</div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US">To resolve the gfid split-brain you can follow the steps at [1].<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US">Since we don&#39;t have the pending markers set on the files, it is not showing in the heal info.<br>
To debug this issue, need some more data from you. Could you provide these things?<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US">1. volume info<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US">2. mount log<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US">3. brick logs<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US">4. shd log<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US"> <u></u><u></u></span></p>
</div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US">May I also know which version of gluster you are running. From the info you have provided it looks like an old version.<u></u><u></u></span></p>
</div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US">If it is, then it would be great if you can upgarde to one of the latest supported release.<u></u><u></u></span></p>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US"><br>
[1] <a href="http://docs.gluster.org/en/latest/Troubleshooting/split-brain/#fixing-directory-entry-split-brain" target="_blank">
http://docs.gluster.org/en/<wbr>latest/Troubleshooting/split-<wbr>brain/#fixing-directory-entry-<wbr>split-brain</a><u></u><u></u></span></p>
<div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US">Thanks &amp; Regards,<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt;margin-left:11.55pt">
<span lang="EN-US">Karthik<u></u><u></u></span></p>
</div>
<div>
<div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US">On Wed, Sep 27, 2017 at 9:42 AM, Zhou, Cynthia (NSB - CN/Hangzhou) &lt;<a href="mailto:cynthia.zhou@nokia-sbell.com" target="_blank">cynthia.zhou@nokia-sbell.com</a>&gt; wrote:<u></u><u></u></span></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Times New Roman&quot;,serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">HI gluster experts,</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">I meet a tough problem about “split-brain” issue. Sometimes, after hard reboot, we will find some files in split-brain, however its parent directory or anything could be shown in command
 “gluster volume heal &lt;volume-name&gt; info”, also, no entry in .glusterfs/indices/xattrop directory, can you help to shed some lights on this issue? Thanks!</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Following is some info from our env,</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<b><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Checking from sn-0 cliet, nothing is shown in-split-brain!</span></b><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Times New Roman&quot;,serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-0:/mnt/bricks/<wbr>services/brick/netserv/ethip]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># gluster v heal services info</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Brick sn-0:/mnt/bricks/services/<wbr>brick/</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Number of entries: 0</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Brick sn-1:/mnt/bricks/services/<wbr>brick/</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Number of entries: 0</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-0:/mnt/bricks/<wbr>services/brick/netserv/ethip]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-0:/mnt/bricks/<wbr>services/brick/netserv/ethip]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># gluster v heal services info split-brain</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Gathering list of split brain entries on volume services has been successful
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Brick sn-0.local:/mnt/bricks/<wbr>services/brick</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Number of entries: 0</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Brick sn-1.local:/mnt/bricks/<wbr>services/brick</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Number of entries: 0</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-0:/mnt/bricks/<wbr>services/brick/netserv/ethip]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># ls -l /mnt/services/netserv/ethip/</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif;color:red" lang="EN-US">ls: cannot access &#39;/mnt/services/netserv/ethip/<wbr>sn-2&#39;: Input/output error</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif;color:red" lang="EN-US">ls: cannot access &#39;/mnt/services/netserv/ethip/<wbr>mn-1&#39;: Input/output error</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">total 3</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">-rw-r--r-- 1 root root 144 Sep 26 20:35 as-0</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">-rw-r--r-- 1 root root 144 Sep 26 20:35 as-1</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">-rw-r--r-- 1 root root 145 Sep 26 20:35 as-2</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">-rw-r--r-- 1 root root 237 Sep 26 20:36 mn-0</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">-????????? ? ?    ?      ?            ? mn-1</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">-rw-r--r-- 1 root root  73 Sep 26 20:35 sn-0</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">-rw-r--r-- 1 root root  73 Sep 26 20:35 sn-1</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">-????????? ? ?    ?      ?            ? sn-2</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-0:/mnt/bricks/<wbr>services/brick/netserv/ethip]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<b><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Checking from glusterfs server side, the gfid of mn-1 on sn-0 and sn-1 is different</span></b><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<b><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[SN-0]</span></b><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-0:/mnt/bricks/<wbr>services/brick/.glusterfs/53/<wbr>a3]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># getfattr -m . -d -e hex /mnt/bricks/services/brick/<wbr>netserv/ethip</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">getfattr: Removing leading &#39;/&#39; from absolute path names</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># file: mnt/bricks/services/brick/<wbr>netserv/ethip</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">trusted.gfid=<wbr>0xee71d19ac0f84f60b11eb42a0836<wbr>44e4</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">trusted.glusterfs.dht=<wbr>0x000000010000000000000000ffff<wbr>ffff</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Times New Roman&quot;,serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-0:/mnt/bricks/<wbr>services/brick/netserv/ethip]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># getfattr -m . -d -e hex mn-1</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># file: mn-1</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">trusted.afr.dirty=<wbr>0x000000000000000000000000</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">trusted.afr.services-client-0=<wbr>0x000000000000000000000000</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">trusted.afr.services-client-1=<wbr>0x000000000000000000000000</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">trusted.gfid=<span style="color:red">0x53a33f437464475<wbr>486f31c4e44d83afd</span></span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-0:/mnt/bricks/<wbr>services/brick/netserv/ethip]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># stat mn-1</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">  File: mn-1</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">  Size: 237              Blocks: 16         IO Block: 4096   regular file</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Device: fd51h/64849d    Inode: 2536        Links: 2</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Access: 2017-09-26 20:30:25.679000000 +0300</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Modify: 2017-09-26 20:30:24.604000000 +0300</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Change: 2017-09-26 20:30:24.610000000 +0300</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Birth: -</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-0:/mnt/bricks/<wbr>services/brick/.glusterfs/<wbr>indices/xattrop]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># ls</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">xattrop-63f8bbcb-7fa6-4fc8-<wbr>b721-675a05de0ab3</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-0:/mnt/bricks/<wbr>services/brick/.glusterfs/<wbr>indices/xattrop]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-0:/mnt/bricks/<wbr>services/brick/.glusterfs/53/<wbr>a3]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># ls</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">53a33f43-7464-4754-86f3-<wbr>1c4e44d83afd</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-0:/mnt/bricks/<wbr>services/brick/.glusterfs/53/<wbr>a3]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># stat 53a33f43-7464-4754-86f3-<wbr>1c4e44d83afd
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">  File: 53a33f43-7464-4754-86f3-<wbr>1c4e44d83afd</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">  Size: 237              Blocks: 16         IO Block: 4096   regular file</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Device: fd51h/64849d    Inode: 2536        Links: 2</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Access: 2017-09-26 20:30:25.679000000 +0300</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Modify: 2017-09-26 20:30:24.604000000 +0300</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Change: 2017-09-26 20:30:24.610000000 +0300</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Birth: -</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">#</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<b><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[SN-1]</span></b><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Times New Roman&quot;,serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-1:/mnt/bricks/<wbr>services/brick/.glusterfs/f7/<wbr>f1]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">#  getfattr -m . -d -e hex /mnt/bricks/services/brick/<wbr>netserv/ethip</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">getfattr: Removing leading &#39;/&#39; from absolute path names</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># file: mnt/bricks/services/brick/<wbr>netserv/ethip</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">trusted.gfid=<wbr>0xee71d19ac0f84f60b11eb42a0836<wbr>44e4</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">trusted.glusterfs.dht=<wbr>0x000000010000000000000000ffff<wbr>ffff</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-1:/mnt/bricks/<wbr>services/brick/.glusterfs/f7/<wbr>f1]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<b><span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">#</span></b><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-1:/mnt/bricks/<wbr>services/brick/netserv/ethip]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># getfattr -m . -d -e hex mn-1</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># file: mn-1</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">trusted.afr.dirty=<wbr>0x000000000000000000000000</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">trusted.afr.services-client-0=<wbr>0x000000000000000000000000</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">trusted.afr.services-client-1=<wbr>0x000000000000000000000000</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">trusted.gfid=<span style="color:red">0xf7f10f980acc404<wbr>1a015e48018571d4a</span></span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Times New Roman&quot;,serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-1:/mnt/bricks/<wbr>services/brick/netserv/ethip]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># stat mn-1</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">  File: mn-1</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">  Size: 237              Blocks: 16         IO Block: 4096   regular file</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Device: fd41h/64833d    Inode: 2608        Links: 2</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Access: 2017-09-26 20:31:48.231000000 +0300</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Modify: 2017-09-26 20:31:46.872000000 +0300</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Change: 2017-09-26 20:31:46.875000000 +0300</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Birth: -</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-1:/mnt/bricks/<wbr>services/brick/.glusterfs/<wbr>indices/xattrop]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># ls</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">xattrop-240713ea-eda3-4914-<wbr>a55d-7dd4aed724ed</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-1:/mnt/bricks/<wbr>services/brick/.glusterfs/<wbr>indices/xattrop]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">[root@sn-1:/mnt/bricks/<wbr>services/brick/.glusterfs/f7/<wbr>f1]</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"># stat f7f10f98-0acc-4041-a015-<wbr>e48018571d4a
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">  File: f7f10f98-0acc-4041-a015-<wbr>e48018571d4a</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">  Size: 237              Blocks: 16         IO Block: 4096   regular file</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Device: fd41h/64833d    Inode: 2608        Links: 2</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Access: 2017-09-26 20:31:48.231000000 +0300</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Modify: 2017-09-26 20:31:46.872000000 +0300</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Change: 2017-09-26 20:31:46.875000000 +0300</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US">Birth: -</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Calibri&quot;,sans-serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US">Best regards,<br>
<b>Cynthia </b></span><b><span style="font-size:10.5pt">(周琳)</span></b><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US">MBB SM HETRAN SW3 MATRIX 
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US">Storage        
<br>
Mobile: +86 (0)18657188311</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Times New Roman&quot;,serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Times New Roman&quot;,serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Times New Roman&quot;,serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US">Best regards,<br>
<b>Cynthia </b></span><b><span style="font-size:10.5pt">(周琳)</span></b><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US">MBB SM HETRAN SW3 MATRIX 
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif" lang="EN-US">Storage        
<br>
Mobile: +86 (0)18657188311</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Times New Roman&quot;,serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Times New Roman&quot;,serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:23.1pt;text-align:justify;text-justify:inter-ideograph">
<span style="font-size:10.5pt;font-family:&quot;Times New Roman&quot;,serif" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
</div>
<p class="MsoNormal" style="margin-left:23.1pt">
<span lang="EN-US"><br>
______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a><u></u><u></u></span></p>
</blockquote>
</div>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US"> <u></u><u></u></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</div>
</div>
</div></div></div>
</div>

</blockquote></div><br></div></div>