<html><body><div style="font-family: times new roman, new york, times, serif; font-size: 12pt; color: #000000"><div><br></div><div>I remember we have fixed 2 issues where such kind of error messages were coming and also we were seeing issues on mount.<br></div><div>In one of the case the problem was in dht. Unfortunately, I don't remember the BZ's for those issues. <br></div><div>As glusterfs 3.10.1 is an old version, I would request you to please upgrade it to latest one. I am sure this<br></div><div>would have fix .<br></div><div><br></div><div>----<br></div><div>Ashish<br></div><div><br></div><div><br></div><div><br></div><div><br></div><hr id="zwchr"><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-mce-style="color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><b>From: </b>"Nithya Balachandran" <nbalacha@redhat.com><br><b>To: </b>"Amudhan P" <amudhan83@gmail.com>, "Ashish Pandey" <aspandey@redhat.com><br><b>Cc: </b>"Amudhan Pandian" <amudh_an@hotmail.com>, gluster-users@gluster.org<br><b>Sent: </b>Monday, November 13, 2017 7:14:30 PM<br><b>Subject: </b>Re: [Gluster-users] Error logged in fuse-mount log file<br><div><br></div><div dir="ltr">Adding Ashish .<div><br></div><div>Hi Amudhan,</div><div><br></div><div>Can you check the gfids for every dir in that heirarchy? Maybe one of the parent dirs has a gfid mismatch.</div><div><br></div><div>Regards,</div><div>Nithya</div></div><div class="gmail_extra"><br><div class="gmail_quote">On 13 November 2017 at 17:39, Amudhan P <span dir="ltr"><<a href="mailto:amudhan83@gmail.com" target="_blank" data-mce-href="mailto:amudhan83@gmail.com">amudhan83@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex" data-mce-style="margin: 0 0 0 .8ex; border-left: 1px #ccc solid; padding-left: 1ex;"><div dir="ltr">Hi Nithya,<div><br></div><div>I have checked gfid in all the bricks in disperse set for the folder. it all same there is no difference.</div><div><br></div><div>regards</div><div>Amudhan P</div><div><div class="h5"><div><br></div><div><br></div><div><br><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Nov 10, 2017 at 9:02 AM, Nithya Balachandran <span dir="ltr"><<a href="mailto:nbalacha@redhat.com" target="_blank" data-mce-href="mailto:nbalacha@redhat.com">nbalacha@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex" data-mce-style="margin: 0 0 0 .8ex; border-left: 1px #ccc solid; padding-left: 1ex;"><div dir="ltr">Hi,<div><br></div><div>Comments inline.</div><div><br></div><div>Regards,</div><div>Nithya<br><div class="gmail_extra"><br><div class="gmail_quote"><span><span>On 9 November 2017 at 15:05, Amudhan Pandian <span dir="ltr"><<a href="mailto:amudh_an@hotmail.com" target="_blank" data-mce-href="mailto:amudh_an@hotmail.com">amudh_an@hotmail.com</a>></span> wrote:<br></span></span><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex" data-mce-style="margin: 0 0 0 .8ex; border-left: 1px #ccc solid; padding-left: 1ex;"><div dir="ltr"><div id="m_-5334527960056458822m_1420759986740830093m_-7283411623809065954divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif" dir="ltr" data-mce-style="font-size: 12pt; color: #000000; font-family: Calibri,Helvetica,sans-serif;"><p>resending mail from another id, doubt on whether mail reaches mailing list.</p><p><br></p><div style="color:rgb(0,0,0)" data-mce-style="color: #000000;"><div><div dir="ltr"><div class="m_-5334527960056458822m_1420759986740830093m_-7283411623809065954x_gmail_quote">---------- Forwarded message ----------<br> From: <b class="m_-5334527960056458822m_1420759986740830093m_-7283411623809065954x_gmail_sendername">Amudhan P</b> <span dir="ltr"><<a href="mailto:amudhan83@gmail.com" target="_blank" data-mce-href="mailto:amudhan83@gmail.com">amudhan83@gmail.com</a>></span><br> Date: Tue, Nov 7, 2017 at 6:43 PM<br> Subject: error logged in fuse-mount log file<br> To: Gluster Users <<a href="mailto:gluster-users@gluster.org" target="_blank" data-mce-href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a>><br> <br> <br><div dir="ltr"><div>Hi,</div><div><br></div><div>I am using glusterfs 3.10.1 and i am seeing below msg in fuse-mount log file.</div><div><br></div><div>what does this error mean? should i worry about this and how do i resolve this?</div><div><br></div><div>[2017-11-07 11:59:17.218973] W [MSGID: 109005] [dht-selfheal.c:2113:dht_selfheal_directory] 0-glustervol-dht: Directory selfheal fail</div><div>ed : 1 subvolumes have unrecoverable errors. path = /fol1/fol2/fol3/fol4/fol5, gfid =3f856ab3-f538-43ee-b408-53dd3da617fb</div><div>[2017-11-07 11:59:17.218935] I [MSGID: 109063] [dht-layout.c:713:dht_layout_normalize] 0-glustervol-dht: Found anomalies in /fol1/fol2/fol3/fol4/fol5 (gfid = 3f856ab3-f538-43ee-b408-53dd3da617fb). Holes=1 overlaps=0</div></div></div></div></div></div></div></div></blockquote><div><br></div><div><br></div><div>DHT found a problem in the layout of this directory so it tries to recreate and set the layout again.</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex" data-mce-style="margin: 0 0 0 .8ex; border-left: 1px #ccc solid; padding-left: 1ex;"><div dir="ltr"><div id="m_-5334527960056458822m_1420759986740830093m_-7283411623809065954divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif" dir="ltr" data-mce-style="font-size: 12pt; color: #000000; font-family: Calibri,Helvetica,sans-serif;"><div style="color:rgb(0,0,0)" data-mce-style="color: #000000;"><div><div dir="ltr"><div class="m_-5334527960056458822m_1420759986740830093m_-7283411623809065954x_gmail_quote"><div dir="ltr"><div>[2017-11-07 11:59:17.199917] W [MSGID: 122019] [ec-helpers.c:413:ec_loc_gfid_check] 0-glustervol-disperse-5: Mismatching GFID's in loc</div><div><br></div></div></div></div></div></div></div></div></blockquote><div><br></div><div>There appears to be a GFID mismatch for this directory on one of the bricks of this disperse set. Can you check the gfid xattr for this directory on all the bricks of this set?</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" data-mce-style="margin: 0px 0px 0px 0.8ex; border-left: 1px solid #cccccc; padding-left: 1ex;"><div dir="ltr"><div id="m_-5334527960056458822m_1420759986740830093m_-7283411623809065954divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif" dir="ltr" data-mce-style="font-size: 12pt; color: #000000; font-family: Calibri,Helvetica,sans-serif;"><div style="color:rgb(0,0,0)" data-mce-style="color: #000000;"><div><div dir="ltr"><div class="m_-5334527960056458822m_1420759986740830093m_-7283411623809065954x_gmail_quote"><div dir="ltr"><div><br></div><div>[2017-11-07 11:03:08.999769] W [MSGID: 109005] [dht-selfheal.c:2113:dht_selfheal_directory] 0-glustervol-dht: Directory selfheal fail</div><div>ed : 1 subvolumes have unrecoverable errors. path = /sec_fol1/sec_fol2/sec_fol3/sec_fol4/sec_fol5, gfid = 59b9762e-f419-4d56-9fa2-eea9ebc055b2</div><div>[2017-11-07 11:03:08.999749] I [MSGID: 109063] [dht-layout.c:713:dht_layout_normalize] 0-glustervol-dht: Found anomalies in /sec_fol1/sec_fol2/sec_fol3/sec_fol4/sec_fol5 (gfid = 59b9762e-f419-4d56-9fa2-eea9ebc055b2). Holes=1 overlaps=0</div><div>[2017-11-07 11:03:08.980275] W [MSGID: 122019] [ec-helpers.c:413:ec_loc_gfid_check] 0-glustervol-disperse-7: Mismatching GFID's in loc</div><div><br></div><div><br></div><div><div>[2017-11-07 12:58:43.569801] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-glustervol-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /thi_fol1/thi_fol2/thi_fol3/thi_fol4/thi_fol5/thi_fol6/thi_file1</div><div>[2017-11-07 12:58:43.528844] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-glustervol-dht: attempting deletion of stale linkfile /thi_fol1/thi_fol2/thi_fol3/thi_fol4/thi_fol5/thi_fol6/thi_file1 on glustervol-disperse-77 (hashed subvol is glustervol-disperse-106)</div></div><div><br></div></div></div></div></div></div></div></div></blockquote><div><br></div><div> <span style="color:rgb(0,0,0);font-family:Calibri,Helvetica,sans-serif;font-size:12pt" data-mce-style="color: #000000; font-family: Calibri,Helvetica,sans-serif; font-size: 12pt;">These can be ignored.</span></div><div><span style="color:rgb(0,0,0);font-family:Calibri,Helvetica,sans-serif;font-size:12pt" data-mce-style="color: #000000; font-family: Calibri,Helvetica,sans-serif; font-size: 12pt;"><br></span></div><div><span style="color:rgb(0,0,0);font-family:Calibri,Helvetica,sans-serif;font-size:12pt" data-mce-style="color: #000000; font-family: Calibri,Helvetica,sans-serif; font-size: 12pt;"><br></span></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" data-mce-style="margin: 0px 0px 0px 0.8ex; border-left: 1px solid #cccccc; padding-left: 1ex;"><div dir="ltr"><div id="m_-5334527960056458822m_1420759986740830093m_-7283411623809065954divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif" dir="ltr" data-mce-style="font-size: 12pt; color: #000000; font-family: Calibri,Helvetica,sans-serif;"><div style="color:rgb(0,0,0)" data-mce-style="color: #000000;"><div><div dir="ltr"><div class="m_-5334527960056458822m_1420759986740830093m_-7283411623809065954x_gmail_quote"><div dir="ltr"><div>regards</div><div>Amudhan P</div></div></div><br></div></div></div></div></div><br>_______________________________________________<br> Gluster-users mailing list<br> <a href="mailto:Gluster-users@gluster.org" target="_blank" data-mce-href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br> <a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank" data-mce-href="http://lists.gluster.org/mailman/listinfo/gluster-users">http://lists.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div><br></div></div></div><br>_______________________________________________<br> Gluster-users mailing list<br> <a href="mailto:Gluster-users@gluster.org" target="_blank" data-mce-href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br> <a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank" data-mce-href="http://lists.gluster.org/mailman/listinfo/gluster-users">http://lists.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div><br></div></div></div></div></div></blockquote></div><br></div><br>_______________________________________________<br>Gluster-users mailing list<br>Gluster-users@gluster.org<br>http://lists.gluster.org/mailman/listinfo/gluster-users</div><div><br></div></div></body></html>