<div dir="ltr">I've retried it more than a couple of times and the failures are consistent.<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Jul 5, 2017 at 6:26 PM, Amar Tumballi <span dir="ltr"><<a href="mailto:atumball@redhat.com" target="_blank">atumball@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span class="">On Wed, Jul 5, 2017 at 6:16 PM, Ashish Pandey <span dir="ltr"><<a href="mailto:aspandey@redhat.com" target="_blank">aspandey@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div style="font-family:times new roman,new york,times,serif;font-size:12pt;color:#000000">Hi Nigel,<br><br>As Pranith has already mentioned, we are getting different gfid's in loc and loc->inode.<br>It looks like issue with DHT. If a re validate fails for gfid, a fresh look up should be done.<br><br>I don't know if it is related or not but a similar bug was fixed by Pranith <br><a href="https://review.gluster.org/#/c/16986/" target="_blank">https://review.gluster.org/#/c<wbr>/16986/</a><br><br>Ashish<br><br></div></div></blockquote><div><br></div></span><div>Thanks for this info Ashish & Pranith. Also thanks for looking into this Anoop.<br><br></div><div>Nigel, lets retry these things, and see if its still the case! if not great, but if it is, then I will help you sort this out!<br><br></div><div>Regards,<br></div><div>Amar<br> <br></div><div><div class="h5"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div style="font-family:times new roman,new york,times,serif;font-size:12pt;color:#000000"><br><br><hr id="m_-4165040743924446900m_7437177195268021883zwchr"><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt"><b>From: </b>"Pranith Kumar Karampuri" <<a href="mailto:pkarampu@redhat.com" target="_blank">pkarampu@redhat.com</a>><br><b>To: </b>"Anoop C S" <<a href="mailto:anoopcs@autistici.org" target="_blank">anoopcs@autistici.org</a>><br><b>Cc: </b>"gluster-devel" <<a href="mailto:gluster-devel@gluster.org" target="_blank">gluster-devel@gluster.org</a>><br><b>Sent: </b>Thursday, June 29, 2017 7:36:45 PM<br><b>Subject: </b>Re: [Gluster-devel] Glusto failures with dispersed volumes + Samba<div><div class="m_-4165040743924446900h5"><br><br><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jun 29, 2017 at 6:49 PM, Anoop C S <span dir="ltr"><<a href="mailto:anoopcs@autistici.org" target="_blank">anoopcs@autistici.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span>On Thu, 2017-06-29 at 16:35 +0530, Nigel Babu wrote:<br>
> Hi Pranith and Xavi,<br>
><br>
> We seem to be running into a problem with glusto tests when we try to run them against dispersed<br>
> volumes over a CIFS mount[1].<br>
<br>
</span>Is this a new test case? If not was it running successfully before?<br>
<span><br>
> You can find the logs attached to the job [2].<br>
<br>
</span>VFS stat call failures are seen in Samba logs:<br>
<br>
[2017/06/29 11:01:55.959374, 0] ../source3/modules/vfs_gluster<wbr>fs.c:870(vfs_gluster_stat)<br>
glfs_stat(.) failed: Invalid argument<br>
<br>
I could also see the following errors(repeatedly..) in glusterfs client logs:<br>
<br>
[2017-06-29 10:33:43.031198] W [MSGID: 122019] [ec-helpers.c:412:ec_loc_gfid_<wbr>check] 0-<br>
testvol_distributed-dispersed-<wbr>disperse-0: Mismatching GFID's in loc<br>
[2017-06-29 10:33:43.031303] I [MSGID: 109094] [dht-common.c:1016:dht_revalid<wbr>ate_cbk] 0-<br>
testvol_distributed-dispersed-<wbr>dht: Revalidate: subvolume testvol_distributed-dispersed-<wbr>disperse-0<br>
for /user11 (gfid = 665c515b-3940-480f-af7c-6aaf37<wbr>731eaa) returned -1 [Invalid argument]<br></blockquote><div><br></div><div>This log basically says that EC received loc which has different gfids in loc->inode->gfid and loc->gfid.<br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<span><br>
> I've triggered a fresh job[3] to confirm that it only fails in these particular conditions and<br>
> certainly seems to be the case. The job is currently ongoing, so you may want to take a look when<br>
> you get some time how this job went.<br>
><br>
> Let me know if you have any questions or need more debugging information. <br>
><br>
> [1]: <a href="https://ci.centos.org/job/gluster_glusto/325/testReport/" rel="noreferrer" target="_blank">https://ci.centos.org/job/glus<wbr>ter_glusto/325/testReport/</a><br>
> [2]: <a href="https://ci.centos.org/job/gluster_glusto/325/artifact/" rel="noreferrer" target="_blank">https://ci.centos.org/job/glus<wbr>ter_glusto/325/artifact/</a><br>
> [3]: <a href="https://ci.centos.org/job/gluster_glusto/326/console" rel="noreferrer" target="_blank">https://ci.centos.org/job/glus<wbr>ter_glusto/326/console</a><br>
><br>
><br>
</span>> ______________________________<wbr>_________________<br>
> Gluster-devel mailing list<br>
> <a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
> <a href="http://lists.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-devel</a><br>
</blockquote></div><br><br clear="all"><br>-- <br><div class="m_-4165040743924446900m_7437177195268021883gmail_signature"><div dir="ltr">Pranith<br></div></div>
</div></div>
<br>______________________________<wbr>_________________<br>Gluster-devel mailing list<br><a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br><a href="http://lists.gluster.org/mailman/listinfo/gluster-devel" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-devel</a></div></div></div><br></div></div><br>______________________________<wbr>_________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-devel</a><br></blockquote></div></div></div><span class="HOEnZb"><font color="#888888"><br><br clear="all"><br>-- <br><div class="m_-4165040743924446900gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div>Amar Tumballi (amarts)<br></div></div></div></div></div>
</font></span></div></div>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">nigelb<br></div></div>
</div>