<div dir="ltr"><div><div><div><div>Hi Kotresh,<br><br></div>As we know this problem occurs when BitRot start versioning of file of big size. <br><br></div>Is there any possibility to disable this feature totally means remove the BitRot feature so that it will not do this even when it is disabled.<br><br></div>Regards,<br></div>Abhishek<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Apr 25, 2017 at 12:47 PM, ABHISHEK PALIWAL <span dir="ltr"><<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div>Thanks Kotresh. <br><br></div>Let me discuss in my team and will let you know.<br><br></div>Regards,<br></div>Abhishek<br></div><div class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">On Tue, Apr 25, 2017 at 12:41 PM, Kotresh Hiremath Ravishankar <span dir="ltr"><<a href="mailto:khiremat@redhat.com" target="_blank">khiremat@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Abhishek,<br>
<br>
As this is an enhancement it won't be back ported to 3.7/3.8/3.10<br>
It would be only available from upcoming 3.11 release.<br>
<br>
But I did try applying it to 3.7.6. It has lot of conflicts.<br>
If it's important for you, you can upgrade to latest version.<br>
available and back port it. If it's impossible to upgrade to<br>
latest version, atleast 3.7.20 would do. It has minimal<br>
conflicts. I can help you out with that.<br>
<span><br>
Thanks and Regards,<br>
Kotresh H R<br>
<br>
----- Original Message -----<br>
> From: "ABHISHEK PALIWAL" <<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>><br>
</span><span>> To: "Kotresh Hiremath Ravishankar" <<a href="mailto:khiremat@redhat.com" target="_blank">khiremat@redhat.com</a>><br>
> Cc: "Pranith Kumar Karampuri" <<a href="mailto:pkarampu@redhat.com" target="_blank">pkarampu@redhat.com</a>>, "Gluster Devel" <<a href="mailto:gluster-devel@gluster.org" target="_blank">gluster-devel@gluster.org</a>>, "gluster-users"<br>
> <<a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a>><br>
</span><div><div class="m_-5595754579736679395h5">> Sent: Tuesday, April 25, 2017 10:58:41 AM<br>
> Subject: Re: [Gluster-users] High load on glusterfsd process<br>
><br>
> Hi Kotresh,<br>
><br>
> Could you please update whether it is possible to get the patch or bakport<br>
> this patch on Gluster 3.7.6 version.<br>
><br>
> Regards,<br>
> Abhishek<br>
><br>
> On Mon, Apr 24, 2017 at 6:14 PM, ABHISHEK PALIWAL <<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>><br>
> wrote:<br>
><br>
> > What is the way to take this patch on Gluster 3.7.6 or only way to upgrade<br>
> > the version?<br>
> ><br>
> > On Mon, Apr 24, 2017 at 3:22 PM, ABHISHEK PALIWAL <<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a><br>
> > > wrote:<br>
> ><br>
> >> Hi Kotresh,<br>
> >><br>
> >> I have seen the patch available on the link which you shared. It seems we<br>
> >> don't have some files in gluser 3.7.6 which you modified in the patch.<br>
> >><br>
> >> Is there any possibility to provide the patch for Gluster 3.7.6?<br>
> >><br>
> >> Regards,<br>
> >> Abhishek<br>
> >><br>
> >> On Mon, Apr 24, 2017 at 3:07 PM, Kotresh Hiremath Ravishankar <<br>
> >> <a href="mailto:khiremat@redhat.com" target="_blank">khiremat@redhat.com</a>> wrote:<br>
> >><br>
> >>> Hi Abhishek,<br>
> >>><br>
> >>> Bitrot requires versioning of files to be down on writes.<br>
> >>> This was being done irrespective of whether bitrot is<br>
> >>> enabled or not. This takes considerable CPU. With the<br>
> >>> fix <a href="https://review.gluster.org/#/c/14442/" rel="noreferrer" target="_blank">https://review.gluster.org/#/c<wbr>/14442/</a>, it is made<br>
> >>> optional and is enabled only with bitrot. If bitrot<br>
> >>> is not enabled, then you won't see any setxattr/getxattrs<br>
> >>> related to bitrot.<br>
> >>><br>
> >>> The fix would be available in 3.11.<br>
> >>><br>
> >>><br>
> >>> Thanks and Regards,<br>
> >>> Kotresh H R<br>
> >>><br>
> >>> ----- Original Message -----<br>
> >>> > From: "ABHISHEK PALIWAL" <<a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>><br>
> >>> > To: "Pranith Kumar Karampuri" <<a href="mailto:pkarampu@redhat.com" target="_blank">pkarampu@redhat.com</a>><br>
> >>> > Cc: "Gluster Devel" <<a href="mailto:gluster-devel@gluster.org" target="_blank">gluster-devel@gluster.org</a>>, "gluster-users" <<br>
> >>> <a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a>>, "Kotresh Hiremath<br>
> >>> > Ravishankar" <<a href="mailto:khiremat@redhat.com" target="_blank">khiremat@redhat.com</a>><br>
> >>> > Sent: Monday, April 24, 2017 11:30:57 AM<br>
> >>> > Subject: Re: [Gluster-users] High load on glusterfsd process<br>
> >>> ><br>
> >>> > Hi Kotresh,<br>
> >>> ><br>
> >>> > Could you please update me on this?<br>
> >>> ><br>
> >>> > Regards,<br>
> >>> > Abhishek<br>
> >>> ><br>
> >>> > On Sat, Apr 22, 2017 at 12:31 PM, Pranith Kumar Karampuri <<br>
> >>> > <a href="mailto:pkarampu@redhat.com" target="_blank">pkarampu@redhat.com</a>> wrote:<br>
> >>> ><br>
> >>> > > +Kotresh who seems to have worked on the bug you mentioned.<br>
> >>> > ><br>
> >>> > > On Fri, Apr 21, 2017 at 12:21 PM, ABHISHEK PALIWAL <<br>
> >>> > > <a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>> wrote:<br>
> >>> > ><br>
> >>> > >><br>
> >>> > >> If the patch provided in that case will resolve my bug as well then<br>
> >>> > >> please provide the patch so that I will backport it on 3.7.6<br>
> >>> > >><br>
> >>> > >> On Fri, Apr 21, 2017 at 11:30 AM, ABHISHEK PALIWAL <<br>
> >>> > >> <a href="mailto:abhishpaliwal@gmail.com" target="_blank">abhishpaliwal@gmail.com</a>> wrote:<br>
> >>> > >><br>
> >>> > >>> Hi Team,<br>
> >>> > >>><br>
> >>> > >>> I have noticed that there are so many glusterfsd threads are<br>
> >>> running in<br>
> >>> > >>> my system and we observed some of those thread consuming more cpu.<br>
> >>> I<br>
> >>> > >>> did “strace” on two such threads (before the problem disappeared by<br>
> >>> > >>> itself)<br>
> >>> > >>> and found that there is a continuous activity like below:<br>
> >>> > >>><br>
> >>> > >>> lstat("/opt/lvmdir/c2/brick/.g<wbr>lusterfs/e7/7d/e77d12b3-92f8-4<br>
> >>> > >>> dfe-9a7f-246e901cbdf1/002700/f<wbr>irewall_-J208482-4000025_20170<br>
> >>> 126T113552+0000.log.gz",<br>
> >>> > >>> {st_mode=S_IFREG|0670, st_size=1995, ...}) = 0<br>
> >>> > >>> lgetxattr("/opt/lvmdir/c2/bric<wbr>k/.glusterfs/e7/7d/e77d12b3-92<br>
> >>> > >>> f8-4dfe-9a7f-246e901cbdf1/0027<wbr>00/firewall_-J208482-4000025_2<br>
> >>> 0170126T113552+0000.log.gz",<br>
> >>> > >>> "trusted.bit-rot.bad-file", 0x3fff81f58550, 255) = -1 ENODATA (No<br>
> >>> data<br>
> >>> > >>> available)<br>
> >>> > >>> lgetxattr("/opt/lvmdir/c2/bric<wbr>k/.glusterfs/e7/7d/e77d12b3-92<br>
> >>> > >>> f8-4dfe-9a7f-246e901cbdf1/0027<wbr>00/firewall_-J208482-4000025_2<br>
> >>> 0170126T113552+0000.log.gz",<br>
> >>> > >>> "trusted.bit-rot.signature", 0x3fff81f58550, 255) = -1 ENODATA (No<br>
> >>> data<br>
> >>> > >>> available)<br>
> >>> > >>> lstat("/opt/lvmdir/c2/brick/.g<wbr>lusterfs/e7/7d/e77d12b3-92f8-4<br>
> >>> > >>> dfe-9a7f-246e901cbdf1/002700/t<wbr>cli_-J208482-4000025_20170123T<br>
> >>> 180550+0000.log.gz",<br>
> >>> > >>> {st_mode=S_IFREG|0670, st_size=169, ...}) = 0<br>
> >>> > >>> lgetxattr("/opt/lvmdir/c2/bric<wbr>k/.glusterfs/e7/7d/e77d12b3-92<br>
> >>> > >>> f8-4dfe-9a7f-246e901cbdf1/0027<wbr>00/tcli_-J208482-4000025_20170<br>
</div></div>> >>> 123T180550+0000.log.gz",<br>
<span>> >>> > >>> "trusted.bit-rot.bad-file", 0x3fff81f58550, 255) = -1 ENODATA (No<br>
> >>> data<br>
> >>> > >>> available)<br>
> >>> > >>> lgetxattr("/opt/lvmdir/c2/bric<wbr>k/.glusterfs/e7/7d/e77d12b3-92<br>
</span>> >>> > >>> f8-4dfe-9a7f-246e901cbdf1/0027<wbr>00/tcli_-J208482-4000025_20170<br>
<div class="m_-5595754579736679395HOEnZb"><div class="m_-5595754579736679395h5">> >>> 123T180550+0000.log.gz",<br>
> >>> > >>> "trusted.bit-rot.signature", 0x3fff81f58550, 255) = -1 ENODATA (No<br>
> >>> data<br>
> >>> > >>> available)<br>
> >>> > >>><br>
> >>> > >>> I have found the below existing issue which is very similar to my<br>
> >>> > >>> scenario.<br>
> >>> > >>><br>
> >>> > >>> <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1298258" rel="noreferrer" target="_blank">https://bugzilla.redhat.com/sh<wbr>ow_bug.cgi?id=1298258</a><br>
> >>> > >>><br>
> >>> > >>> We are using the gluster-3.7.6 and it seems that the issue is<br>
> >>> fixed in<br>
> >>> > >>> 3.8.4 version.<br>
> >>> > >>><br>
> >>> > >>> Could you please let me know why it showing the number of above<br>
> >>> logs and<br>
> >>> > >>> reason behind it as it is not explained in the above bug.<br>
> >>> > >>><br>
> >>> > >>> Regards,<br>
> >>> > >>> Abhishek<br>
> >>> > >>><br>
> >>> > >>> --<br>
> >>> > >>><br>
> >>> > >>><br>
> >>> > >>><br>
> >>> > >>><br>
> >>> > >>> Regards<br>
> >>> > >>> Abhishek Paliwal<br>
> >>> > >>><br>
> >>> > >><br>
> >>> > >><br>
> >>> > >><br>
> >>> > >> --<br>
> >>> > >><br>
> >>> > >><br>
> >>> > >><br>
> >>> > >><br>
> >>> > >> Regards<br>
> >>> > >> Abhishek Paliwal<br>
> >>> > >><br>
> >>> > >> ______________________________<wbr>_________________<br>
> >>> > >> Gluster-users mailing list<br>
> >>> > >> <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
> >>> > >> <a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-users</a><br>
> >>> > >><br>
> >>> > ><br>
> >>> > ><br>
> >>> > ><br>
> >>> > > --<br>
> >>> > > Pranith<br>
> >>> > ><br>
> >>> ><br>
> >>> ><br>
> >>> ><br>
> >>> > --<br>
> >>> ><br>
> >>> ><br>
> >>> ><br>
> >>> ><br>
> >>> > Regards<br>
> >>> > Abhishek Paliwal<br>
> >>> ><br>
> >>><br>
> >><br>
> >><br>
> >><br>
> >> --<br>
> >><br>
> >><br>
> >><br>
> >><br>
> >> Regards<br>
> >> Abhishek Paliwal<br>
> >><br>
> ><br>
> ><br>
> ><br>
> > --<br>
> ><br>
> ><br>
> ><br>
> ><br>
> > Regards<br>
> > Abhishek Paliwal<br>
> ><br>
><br>
><br>
><br>
> --<br>
><br>
><br>
><br>
><br>
> Regards<br>
> Abhishek Paliwal<br>
><br>
</div></div></blockquote></div><br><br clear="all"><br></div></div><span class="HOEnZb"><font color="#888888">-- <br><div class="m_-5595754579736679395gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><br><br><br><br>Regards<br>
Abhishek Paliwal<br>
</div></div>
</font></span></div>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><br><br><br><br>Regards<br>
Abhishek Paliwal<br>
</div></div>
</div>