<div dir="ltr"><div><div><div>hi,<br></div> In the same commit you mentioned earlier, there was this code earlier:<br>-/* Returns 1 if the stat seems to be filled with zeroes. */<br>-int<br>-nfs_zero_filled_stat (struct iatt *buf)<br>-{<br>- if (!buf)<br>- return 1;<br>-<br>- /* Do not use st_dev because it is transformed to store the xlator id<br>- * in place of the device number. Do not use st_ino because by this time<br>- * we've already mapped the root ino to 1 so it is not guaranteed to be<br>- * 0.<br>- */<br>- if ((buf->ia_nlink == 0) && (buf->ia_ctime == 0))<br>- return 1;<br>-<br>- return 0;<br>-}<br>-<br>-<br><br></div>I moved this to a common library function that can be used in afr as well. Why was it there in NFS? +Niels for answering that question.<br><br></div>If I give you a patch which will assert the error condition, would it be possible for you to figure out the first xlator which is unwinding the iatt with nlink count as zero but ctime as non-zero?<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Jan 24, 2018 at 1:03 PM, Lian, George (NSB - CN/Hangzhou) <span dir="ltr"><<a href="mailto:george.lian@nokia-sbell.com" target="_blank">george.lian@nokia-sbell.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div link="blue" vlink="purple" lang="ZH-CN">
<div class="m_836724691695841165WordSection1">
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Hi, Pranith Kumar,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Can you tell me while need set buf->ia_nlink to “0”in function gf_zero_fill_stat(), which API or Application will care it?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">If I remove this line and also update corresponding in function gf_is_zero_filled_stat,
<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">The issue seems gone, but I can’t confirm will lead to other issues.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">So could you please double check it and give your comments?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">My change is as the below:<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">gf_boolean_t<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">gf_is_zero_filled_stat (struct iatt *buf)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">{<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> if (!buf)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> return 1;<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> /* Do not use st_dev because it is transformed to store the xlator id<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> * in place of the device number. Do not use st_ino because by this time<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> * we've already mapped the root ino to 1 so it is not guaranteed to be<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> * 0.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> */<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">// if ((buf->ia_nlink == 0) && (buf->ia_ctime == 0))<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> if (buf->ia_ctime == )<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> return 1;<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> return 0;<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">}<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">void<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">gf_zero_fill_stat (struct iatt *buf)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">{<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">// buf->ia_nlink = 0;<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> buf->ia_ctime = 0;<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">}<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Thanks & Best Regards<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">George<u></u><u></u></span></p>
<div>
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US"> Lian, George (NSB - CN/Hangzhou)
<br>
<b>Sent:</b> Friday, January 19, 2018 10:03 AM<br>
<b>To:</b> Pranith Kumar Karampuri <<a href="mailto:pkarampu@redhat.com" target="_blank">pkarampu@redhat.com</a>>; Zhou, Cynthia (NSB - CN/Hangzhou) <<a href="mailto:cynthia.zhou@nokia-sbell.com" target="_blank">cynthia.zhou@nokia-sbell.com</a>><br>
<b>Cc:</b> Li, Deqian (NSB - CN/Hangzhou) <<a href="mailto:deqian.li@nokia-sbell.com" target="_blank">deqian.li@nokia-sbell.com</a>>; <a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>; Sun, Ping (NSB - CN/Hangzhou) <<a href="mailto:ping.sun@nokia-sbell.com" target="_blank">ping.sun@nokia-sbell.com</a>></span></p><div><div class="h5"><br>
<b>Subject:</b> RE: [Gluster-devel] a link issue maybe introduced in a bug fix " Don't let NFS cache stat after writes"<u></u><u></u></div></div><p></p>
</div>
</div><div><div class="h5">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Hi,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">>>></span><span lang="EN-US"> Cool, this works for me too. Send me a mail off-list once you are available and we can figure out a way to get into a call and work on this.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Have you reproduced the issue per the step I listed in
<a href="https://bugzilla.redhat.com/show_bug.cgi?id=1531457" target="_blank">https://bugzilla.redhat.com/<wbr>show_bug.cgi?id=1531457</a> and last mail?<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">If not, I would like you could try it yourself , which the difference between yours and mine is just create only 2 bricks instead of 6 bricks.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">And Cynthia could have a session with you if you needed when I am not available in next Monday and Tuesday.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Thanks & Best Regards,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">George</span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">
<a href="mailto:gluster-devel-bounces@gluster.org" target="_blank">gluster-devel-bounces@gluster.<wbr>org</a> [<a href="mailto:gluster-devel-bounces@gluster.org" target="_blank">mailto:gluster-devel-bounces@<wbr>gluster.org</a>]
<b>On Behalf Of </b>Pranith Kumar Karampuri<br>
<b>Sent:</b> Thursday, January 18, 2018 6:03 PM<br>
<b>To:</b> Lian, George (NSB - CN/Hangzhou) <<a href="mailto:george.lian@nokia-sbell.com" target="_blank">george.lian@nokia-sbell.com</a>><br>
<b>Cc:</b> Zhou, Cynthia (NSB - CN/Hangzhou) <<a href="mailto:cynthia.zhou@nokia-sbell.com" target="_blank">cynthia.zhou@nokia-sbell.com</a>><wbr>; Li, Deqian (NSB - CN/Hangzhou) <<a href="mailto:deqian.li@nokia-sbell.com" target="_blank">deqian.li@nokia-sbell.com</a>>;
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>; Sun, Ping (NSB - CN/Hangzhou) <<a href="mailto:ping.sun@nokia-sbell.com" target="_blank">ping.sun@nokia-sbell.com</a>><br>
<b>Subject:</b> Re: [Gluster-devel] a link issue maybe introduced in a bug fix " Don't let NFS cache stat after writes"<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US">On Thu, Jan 18, 2018 at 12:17 PM, Lian, George (NSB - CN/Hangzhou) <<a href="mailto:george.lian@nokia-sbell.com" target="_blank">george.lian@nokia-sbell.com</a>> wrote:<u></u><u></u></span></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Hi,</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">>>>I actually tried it with replica-2 and replica-3 and then distributed replica-2 before replying to the earlier mail. We can have a debugging session if you
are okay with it.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">It is fine if you can</span><span style="font-size:10.5pt;font-family:DengXian">’<span lang="EN-US">t reproduce
the issue in your ENV.</span></span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">And I has attached the detail reproduce log in the Bugzilla FYI</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">But I am sorry I maybe OOO at Monday and Tuesday next week, so debug session will be fine to me at next Wednesday.</span><span lang="EN-US"><u></u><u></u></span></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Cool, this works for me too. Send me a mail off-list once you are available and we can figure out a way to get into a call and work on this.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Paste the detail reproduce log FYI here:</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:~# gluster peer probe ubuntu</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">peer probe: success. Probe on localhost not needed</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:~# gluster v create test replica 2 ubuntu:/home/gfs/b1 ubuntu:/home/gfs/b2 force</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">volume create: test: success: please start the volume to access data</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:~# gluster v start test</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">volume start: test: success</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:~# gluster v info test</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US"> </span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Volume Name: test</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Type: Replicate</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Volume ID: fef5fca3-81d9-46d3-8847-<wbr>74cde6f701a5</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Status: Started</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Snapshot Count: 0</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Number of Bricks: 1 x 2 = 2</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Transport-type: tcp</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Bricks:</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Brick1: ubuntu:/home/gfs/b1</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Brick2: ubuntu:/home/gfs/b2</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Options Reconfigured:</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">transport.address-family: inet</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">nfs.disable: on</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">performance.client-io-threads: off</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:~# gluster v status</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Status of volume: test</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Gluster process TCP Port RDMA Port Online Pid</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">------------------------------<wbr>------------------------------<wbr>------------------</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Brick ubuntu:/home/gfs/b1 <wbr> 49152 0 Y 7798</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Brick ubuntu:/home/gfs/b2 <wbr> 49153 0 Y 7818</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Self-heal Daemon on localhost N/A N/A Y 7839</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US"> </span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">Task Status of Volume test</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">------------------------------<wbr>------------------------------<wbr>------------------</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">There are no active volume tasks</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US"> </span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US"> </span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:~# gluster v set test cluster.consistent-metadata on</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">volume set: success</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US"> </span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:~# ls /mnt/test</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">ls: cannot access '/mnt/test': No such file or directory</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:~# mkdir -p /mnt/test</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:~# mount -t glusterfs ubuntu:/test /mnt/test</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US"> </span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:~# cd /mnt/test</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:/mnt/test# echo "abc">aaa</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:/mnt/test# cp aaa bbb;link bbb ccc</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US"> </span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:/mnt/test# kill -9 7818</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">root@ubuntu:/mnt/test# cp aaa ddd;link ddd eee</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><i><span style="font-family:"Courier New";color:black" lang="EN-US">link: cannot create link 'eee' to 'ddd': No such file or directory</span></i><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Best Regards,</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">George</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">
<a href="mailto:gluster-devel-bounces@gluster.org" target="_blank">gluster-devel-bounces@gluster.<wbr>org</a> [mailto:<a href="mailto:gluster-devel-bounces@gluster.org" target="_blank">gluster-devel-bounces@<wbr>gluster.org</a>]
<b>On Behalf Of </b>Pranith Kumar Karampuri<br>
<b>Sent:</b> Thursday, January 18, 2018 2:40 PM</span><span lang="EN-US"><u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<b>To:</b> Lian, George (NSB - CN/Hangzhou) <<a href="mailto:george.lian@nokia-sbell.com" target="_blank">george.lian@nokia-sbell.com</a>><br>
<b>Cc:</b> Zhou, Cynthia (NSB - CN/Hangzhou) <<a href="mailto:cynthia.zhou@nokia-sbell.com" target="_blank">cynthia.zhou@nokia-sbell.com</a>><wbr>;
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>; Li, Deqian (NSB - CN/Hangzhou) <<a href="mailto:deqian.li@nokia-sbell.com" target="_blank">deqian.li@nokia-sbell.com</a>>; Sun, Ping (NSB - CN/Hangzhou) <<a href="mailto:ping.sun@nokia-sbell.com" target="_blank">ping.sun@nokia-sbell.com</a>><br>
<b>Subject:</b> Re: [Gluster-devel] a link issue maybe introduced in a bug fix " Don't let NFS cache stat after writes"<u></u><u></u></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US">On Thu, Jan 18, 2018 at 6:33 AM, Lian, George (NSB - CN/Hangzhou) <<a href="mailto:george.lian@nokia-sbell.com" target="_blank">george.lian@nokia-sbell.com</a>>
wrote:<u></u><u></u></span></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Hi,</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">I suppose the brick numbers in your testing is six, and you just shut down the 3 process.</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">When I reproduce the issue, I only create a replicate volume with 2 bricks, only let ONE brick working and set cluster.consistent-metadata
on, </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">With this 2 test condition, the issue could 100% reproducible.</span><span lang="EN-US"><u></u><u></u></span></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Hi,<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> I actually tried it with replica-2 and replica-3 and then distributed replica-2 before replying to the earlier mail. We can have a debugging session if
you are okay with it.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">I am in the middle of a customer issue myself(That is the reason for this delay :-( ) and thinking of wrapping it up early next week. Would that be fine with
you?<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">16:44:28 :)
</span><span style="font-size:10.5pt;font-family:"Segoe UI Emoji",serif" lang="EN-US">⚡</span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> gluster v status</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Status of volume: r2</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Gluster process</span><span style="font-size:10.5pt" lang="EN-US"> <wbr> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
TCP Port</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> RDMA Port</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
Online</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> Pid</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">------------------------------<wbr>------------------------------<wbr>------------------</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Brick localhost.localdomain:/home/<wbr>gfs/r2_0</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
49152</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> 0</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
Y</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> 5309
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Brick localhost.localdomain:/home/<wbr>gfs/r2_1</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
49154</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> 0</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
Y</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> 5330
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Brick localhost.localdomain:/home/<wbr>gfs/r2_2</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
49156</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> 0</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
Y</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> 5351
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Brick localhost.localdomain:/home/<wbr>gfs/r2_3</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
49158</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> 0</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
Y</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> 5372
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Brick localhost.localdomain:/home/<wbr>gfs/r2_4</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
49159</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> 0</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
Y</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> 5393
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Brick localhost.localdomain:/home/<wbr>gfs/r2_5</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
49160</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> 0</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
Y</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> 5414
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Self-heal Daemon on localhost</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">N/A</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
N/A</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> Y</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
5436 </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Task Status of Volume r2</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">------------------------------<wbr>------------------------------<wbr>------------------</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">There are no active volume tasks</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">root@dhcp35-190 - ~
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">16:44:38 :)
</span><span style="font-size:10.5pt;font-family:"Segoe UI Emoji",serif" lang="EN-US">⚡</span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US"> kill -9 5309 5351 5393</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Best Regards,</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">George</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">
<a href="mailto:gluster-devel-bounces@gluster.org" target="_blank">gluster-devel-bounces@gluster.<wbr>org</a> [mailto:<a href="mailto:gluster-devel-bounces@gluster.org" target="_blank">gluster-devel-bounces@<wbr>gluster.org</a>]
<b>On Behalf Of </b>Pranith Kumar Karampuri<br>
<b>Sent:</b> Wednesday, January 17, 2018 7:27 PM<br>
<b>To:</b> Lian, George (NSB - CN/Hangzhou) <<a href="mailto:george.lian@nokia-sbell.com" target="_blank">george.lian@nokia-sbell.com</a>><br>
<b>Cc:</b> Li, Deqian (NSB - CN/Hangzhou) <<a href="mailto:deqian.li@nokia-sbell.com" target="_blank">deqian.li@nokia-sbell.com</a>>;
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>; Zhou, Cynthia (NSB - CN/Hangzhou) <<a href="mailto:cynthia.zhou@nokia-sbell.com" target="_blank">cynthia.zhou@nokia-sbell.com</a>><wbr>; Sun, Ping (NSB - CN/Hangzhou) <<a href="mailto:ping.sun@nokia-sbell.com" target="_blank">ping.sun@nokia-sbell.com</a>></span><span lang="EN-US"><u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<b>Subject:</b> Re: [Gluster-devel] a link issue maybe introduced in a bug fix " Don't let NFS cache stat after writes"<u></u><u></u></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US">On Mon, Jan 15, 2018 at 1:55 PM, Pranith Kumar Karampuri <<a href="mailto:pkarampu@redhat.com" target="_blank">pkarampu@redhat.com</a>> wrote:<u></u><u></u></span></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span class="m_836724691695841165m2919162071098184476m-131719470587259559gmail-"><span lang="EN-US">On Mon, Jan 15, 2018 at 8:46 AM, Lian, George (NSB - CN/Hangzhou) <<a href="mailto:george.lian@nokia-sbell.com" target="_blank">george.lian@nokia-sbell.com</a>>
wrote:</span></span><span lang="EN-US"><u></u><u></u></span></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Hi,</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Have you reproduced this issue? If yes, could you please confirm whether it is an issue or not?</span><span lang="EN-US"><u></u><u></u></span></p>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Hi,<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> I tried recreating this on my laptop and on both master and 3.12 and I am not able to recreate the issue :-(.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Here is the execution log:
<a href="https://paste.fedoraproject.org/paste/-csXUKrwsbrZAVW1KzggQQ" target="_blank">
https://paste.fedoraproject.<wbr>org/paste/-<wbr>csXUKrwsbrZAVW1KzggQQ</a><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Since I was doing this on my laptop, I changed shutting down of the replica to killing the brick process to simulate this test.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Let me know if I missed something.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Sorry, I am held up with some issue at work, so I think I will get some time day after tomorrow to look at this. In the mean time I am adding more people who
know about afr to see if they get a chance to work on this before me.<u></u><u></u></span></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">And if it is an issue,</span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
do you have any solution for this issue?</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Thanks & Best Regards,</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">George</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<div>
<div style="border:none;border-top:solid windowtext 1.0pt;padding:3.0pt 0cm 0cm 0cm;border-color:currentcolor currentcolor">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US"> Lian,
George (NSB - CN/Hangzhou) <br>
<b>Sent:</b> Thursday, January 11, 2018 2:01 PM<br>
<b>To:</b> Pranith Kumar Karampuri <<a href="mailto:pkarampu@redhat.com" target="_blank">pkarampu@redhat.com</a>><br>
<b>Cc:</b> Zhou, Cynthia (NSB - CN/Hangzhou) <<a href="mailto:cynthia.zhou@nokia-sbell.com" target="_blank">cynthia.zhou@nokia-sbell.com</a>><wbr>;
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>; Li, Deqian (NSB - CN/Hangzhou) <<a href="mailto:deqian.li@nokia-sbell.com" target="_blank">deqian.li@nokia-sbell.com</a>>; Sun, Ping (NSB - CN/Hangzhou) <<a href="mailto:ping.sun@nokia-sbell.com" target="_blank">ping.sun@nokia-sbell.com</a>><br>
<b>Subject:</b> RE: [Gluster-devel] a link issue maybe introduced in a bug fix " Don't let NFS cache stat after writes"</span><span lang="EN-US"><u></u><u></u></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Hi,</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Please see detail test step on
<a href="https://bugzilla.redhat.com/show_bug.cgi?id=1531457" target="_blank">https://bugzilla.redhat.com/<wbr>show_bug.cgi?id=1531457</a></span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US">How reproducible:</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US">Steps to Reproduce:</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US">1.create a volume name "test" with replicated
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US">2.set volume option cluster.consistent-metadata with on:
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US"> gluster v set test cluster.consistent-metadata on</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US">3. mount volume test on client on /mnt/test</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US">4. create a file aaa size more than 1 byte</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US"> echo "1234567890" >/mnt/test/aaa</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US">5. shutdown a replicat node, let's say sn-1, only let sn-0 worked</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US">6. cp /mnt/test/aaa /mnt/test/bbb; link /mnt/test/bbb /mnt/test/ccc</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">BRs</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">George</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">
<a href="mailto:gluster-devel-bounces@gluster.org" target="_blank">gluster-devel-bounces@gluster.<wbr>org</a> [<a href="mailto:gluster-devel-bounces@gluster.org" target="_blank">mailto:gluster-devel-bounces@<wbr>gluster.org</a>]
<b>On Behalf Of </b>Pranith Kumar Karampuri<br>
<b>Sent:</b> Thursday, January 11, 2018 12:39 PM<br>
<b>To:</b> Lian, George (NSB - CN/Hangzhou) <<a href="mailto:george.lian@nokia-sbell.com" target="_blank">george.lian@nokia-sbell.com</a>><br>
<b>Cc:</b> Zhou, Cynthia (NSB - CN/Hangzhou) <<a href="mailto:cynthia.zhou@nokia-sbell.com" target="_blank">cynthia.zhou@nokia-sbell.com</a>><wbr>;
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>; Li, Deqian (NSB - CN/Hangzhou) <<a href="mailto:deqian.li@nokia-sbell.com" target="_blank">deqian.li@nokia-sbell.com</a>>; Sun, Ping (NSB - CN/Hangzhou) <<a href="mailto:ping.sun@nokia-sbell.com" target="_blank">ping.sun@nokia-sbell.com</a>><br>
<b>Subject:</b> Re: [Gluster-devel] a link issue maybe introduced in a bug fix " Don't let NFS cache stat after writes"</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US">On Thu, Jan 11, 2018 at 6:35 AM, Lian, George (NSB - CN/Hangzhou) <<a href="mailto:george.lian@nokia-sbell.com" target="_blank">george.lian@nokia-sbell.com</a>>
wrote:<u></u><u></u></span></p>
<blockquote style="border:none;border-left:solid windowtext 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)">
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Hi,</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">>>></span><span lang="EN-US"> In which protocol are you seeing this issue? Fuse/NFS/SMB?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">It is fuse, within mountpoint by
</span><span style="font-size:10.5pt;font-family:DengXian">“<span lang="EN-US">mount -t glusterfs</span></span><span style="font-size:10.5pt" lang="EN-US"> </span><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">
</span><span style="font-size:10.5pt;font-family:DengXian">…“<span lang="EN-US"> command.</span></span><span lang="EN-US"><u></u><u></u></span></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Could you let me know the test you did so that I can try to re-create and see what exactly is going on?<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Configuration of the volume and the steps to re-create the issue you are seeing would be helpful in debugging the issue further.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<blockquote style="border:none;border-left:solid windowtext 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)">
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">Thanks & Best Regards,</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:DengXian" lang="EN-US">George</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">
<a href="mailto:gluster-devel-bounces@gluster.org" target="_blank">gluster-devel-bounces@gluster.<wbr>org</a> [mailto:<a href="mailto:gluster-devel-bounces@gluster.org" target="_blank">gluster-devel-bounces@<wbr>gluster.org</a>]
<b>On Behalf Of </b>Pranith Kumar Karampuri<br>
<b>Sent:</b> Wednesday, January 10, 2018 8:08 PM<br>
<b>To:</b> Lian, George (NSB - CN/Hangzhou) <<a href="mailto:george.lian@nokia-sbell.com" target="_blank">george.lian@nokia-sbell.com</a>><br>
<b>Cc:</b> Zhou, Cynthia (NSB - CN/Hangzhou) <<a href="mailto:cynthia.zhou@nokia-sbell.com" target="_blank">cynthia.zhou@nokia-sbell.com</a>><wbr>; Zhong, Hua (NSB - CN/Hangzhou) <<a href="mailto:hua.zhong@nokia-sbell.com" target="_blank">hua.zhong@nokia-sbell.com</a>>;
Li, Deqian (NSB - CN/Hangzhou) <<a href="mailto:deqian.li@nokia-sbell.com" target="_blank">deqian.li@nokia-sbell.com</a>>;
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a>; Sun, Ping (NSB - CN/Hangzhou) <<a href="mailto:ping.sun@nokia-sbell.com" target="_blank">ping.sun@nokia-sbell.com</a>><br>
<b>Subject:</b> Re: [Gluster-devel] a link issue maybe introduced in a bug fix " Don't let NFS cache stat after writes"</span><span lang="EN-US"><u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US">On Wed, Jan 10, 2018 at 11:09 AM, Lian, George (NSB - CN/Hangzhou) <<a href="mailto:george.lian@nokia-sbell.com" target="_blank">george.lian@nokia-sbell.com</a>>
wrote:<u></u><u></u></span></p>
<blockquote style="border:none;border-left:solid windowtext 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)">
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Hi, Pranith Kumar,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">I has create a bug on Bugzilla
<a href="https://bugzilla.redhat.com/show_bug.cgi?id=1531457" target="_blank">https://bugzilla.redhat.com/<wbr>show_bug.cgi?id=1531457</a><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">After my investigation for this link issue, I suppose your changes on afr-dir-write.c with issue " Don't let NFS cache stat after writes" , your fix is like:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">------------------------------<wbr>--------<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> if (afr_txn_nothing_failed (frame, this)) {<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> /*if it did pre-op, it will do post-op changing ctime*/<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> if (priv->consistent_metadata &&<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> afr_needs_changelog_update (local))<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> afr_<wbr>zero_fill_stat (local);<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> local->transaction.unwind (frame, this);<u></u><u></u></span></p>
<div style="border:none;border-bottom:solid windowtext 1.0pt;padding:0cm 0cm 1.0pt 0cm;border-color:currentcolor currentcolor windowtext">
<p class="MsoNormal"><span lang="EN-US"> }<u></u><u></u></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US">In the above fix, it set the ia_nlink to
</span>‘<span lang="EN-US">0</span>’<span lang="EN-US"> if option consistent-metadata is set to
</span>“<span lang="EN-US">on</span>”<span lang="EN-US">.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">And hard link a file with which just created will lead to an error, and the error is caused in kernel function
</span>“<span lang="EN-US">vfs_link</span>”<span lang="EN-US">:<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US">if (inode->i_nlink == 0 && !(inode->i_state & I_LINKABLE))</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black" lang="EN-US"> error = -ENOENT;</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">could you please have a check and give some comments here?<u></u><u></u></span></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">When stat is "zero filled", understanding is that the higher layer protocol doesn't send stat value to the kernel and a separate lookup is sent by the kernel
to get the latest stat value. In which protocol are you seeing this issue? Fuse/NFS/SMB?<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<blockquote style="border:none;border-left:solid windowtext 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)">
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Thanks & Best Regards,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">George<u></u><u></u></span></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br clear="all">
<br>
-- <u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Pranith<u></u><u></u></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br clear="all">
<br>
-- <u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Pranith<u></u><u></u></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
<p class="MsoNormal"><span style="color:#888888" lang="EN-US"><br>
<br clear="all">
<br>
<span class="m_836724691695841165m2919162071098184476m-131719470587259559gmail-hoenzb">-- </span></span><span lang="EN-US"><u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span style="color:#888888" lang="EN-US">Pranith</span><span lang="EN-US"><u></u><u></u></span></p>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br clear="all">
<br>
-- <u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Pranith<u></u><u></u></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br clear="all">
<br>
-- <u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Pranith<u></u><u></u></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br clear="all">
<br>
-- <u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Pranith<u></u><u></u></span></p>
</div>
</div>
</div>
</div>
</div></div></div>
</div>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Pranith<br></div></div>
</div>