<div dir="ltr">Wait, wait we are discussing this issue only. Expect a reply in some time :-)<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, May 8, 2017 at 2:19 PM, Abhijit Paul <span dir="ltr"><<a href="mailto:er.abhijitpaul@gmail.com" target="_blank">er.abhijitpaul@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">poking for previous mail reply<div><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Sun, May 7, 2017 at 1:06 AM, Abhijit Paul <span dir="ltr"><<a href="mailto:er.abhijitpaul@gmail.com" target="_blank">er.abhijitpaul@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><span style="font-size:12.8px"> </span><a href="https://pkalever.wordpress.com/2017/03/14/elasticsearch-with-gluster-block/" style="font-size:12.8px" target="_blank">https://pkalever.wordpress.co<wbr>m/2017/03/14/<span class="m_-1301792222940230058m_-4166879534598684678gmail-il">elasticsearch</span>-wit<wbr>h-gluster-block/</a><br></div><div>here used tested environment is Fedora , </div><div>but i am using RHEL based Oracle linux so does gluster-block compatible with RHEL as well? What i needs to change & make it work?</div></div><div class="m_-1301792222940230058HOEnZb"><div class="m_-1301792222940230058h5"><div class="gmail_extra"><br><div class="gmail_quote">On Fri, May 5, 2017 at 5:42 PM, Pranith Kumar Karampuri <span dir="ltr"><<a href="mailto:pkarampu@redhat.com" target="_blank">pkarampu@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span>On Fri, May 5, 2017 at 5:40 PM, Pranith Kumar Karampuri <span dir="ltr"><<a href="mailto:pkarampu@redhat.com" target="_blank">pkarampu@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span>On Fri, May 5, 2017 at 5:36 PM, Abhijit Paul <span dir="ltr"><<a href="mailto:er.abhijitpaul@gmail.com" target="_blank">er.abhijitpaul@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">So should i start using <span style="font-size:12.8px">gluster-block with elasticsearch in </span><span style="font-size:12.8px">kubernetes environment?</span><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px">My expectation from gluster-block is, it should not CorruptIndex of elasticsearch...and issue facing in previous mails.</span></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px">Please let me know whether should i processed with above mentioned combination.</span></div></div></blockquote><div><br></div></span><div>We are still in the process of fixing the failure scenarios of tcmu-runner dying and failingover in the multipath scenarios.<br></div></div></div></div></blockquote><div><br></div></span><div>Prasanna did test that elasticsearch itself worked fine in gluster-block environment when all the machines are up etc i.e. success path. We are doing failure path testing and fixing things at the moment.<br></div><div><div class="m_-1301792222940230058m_-4166879534598684678h5"><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div></div><div><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618h5"><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635HOEnZb"><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635h5"><div class="gmail_extra"><br><div class="gmail_quote">On Fri, May 5, 2017 at 5:06 PM, Pranith Kumar Karampuri <span dir="ltr"><<a href="mailto:pkarampu@redhat.com" target="_blank">pkarampu@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Abhijit we just started making the efforts to get all of this stable.<br></div><div class="gmail_extra"><div><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670h5"><br><div class="gmail_quote">On Fri, May 5, 2017 at 4:45 PM, Abhijit Paul <span dir="ltr"><<a href="mailto:er.abhijitpaul@gmail.com" target="_blank">er.abhijitpaul@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I yet to try gluster-block with elasticsearch...but carious to know does this combination plays well in kubernetes environment?</div><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705HOEnZb"><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705h5"><div class="gmail_extra"><br><div class="gmail_quote">On Fri, May 5, 2017 at 12:14 PM, Abhijit Paul <span dir="ltr"><<a href="mailto:er.abhijitpaul@gmail.com" target="_blank">er.abhijitpaul@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">thanks <span style="font-size:12.8px;font-weight:bold;white-space:nowrap">Krutika </span><span style="font-size:12.8px;white-space:nowrap">for the alternative.</span><div><span style="font-size:12.8px;white-space:nowrap"><br></span></div><div><span style="font-size:12.8px;white-space:nowrap">@</span><b style="color:rgb(119,119,119);font-size:12.8px;white-space:nowrap"><span dir="ltr" name="Prasanna" class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971gmail-g2 m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971gmail-ac2">Prasanna @</span></b><b style="color:rgb(119,119,119);font-size:12.8px;white-space:nowrap"><span dir="ltr" name="Pranith" class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971gmail-g2 m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971gmail-ac2">Pranith</span></b></div><div><span style="font-size:12.8px;white-space:nowrap">I</span><span style="font-size:12.8px;white-space:nowrap"> was going thorough the mentioned blog post and saw that used tested environment was Fedora</span><span style="font-size:12.8px;white-space:nowrap"> , </span><div><div><span style="font-size:12.8px;white-space:nowrap">but i am using RHEL based Oracle linux so does gluster-block compatible with RHEL as well?</span></div></div></div></div><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240HOEnZb"><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240h5"><div class="gmail_extra"><br><div class="gmail_quote">On Fri, May 5, 2017 at 12:03 PM, Krutika Dhananjay <span dir="ltr"><<a href="mailto:kdhananj@redhat.com" target="_blank">kdhananj@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div><div><div>Yeah, there are a couple of cache consistency issues with performance translators that are causing these exceptions.<br></div>Some of them were fixed by 3.10.1. Some still remain.<br><br></div>Alternatively you can give gluster-block + elasticsearch a try, which doesn't require solving all these caching issues.<br></div>Here's a blog post on the same - <a href="https://pkalever.wordpress.com/2017/03/14/elasticsearch-with-gluster-block/" target="_blank">https://pkalever.wordpress.com<wbr>/2017/03/14/elasticsearch-with<wbr>-gluster-block/</a><br><br></div>Adding Prasanna and Pranith who worked on this, in case you need more info on this.<span class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971HOEnZb"><font color="#888888"><br><br></font></span></div><span class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971HOEnZb"><font color="#888888">-Krutika<br></font></span></div><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971HOEnZb"><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971h5"><div class="gmail_extra"><br><div class="gmail_quote">On Fri, May 5, 2017 at 12:15 AM, Abhijit Paul <span dir="ltr"><<a href="mailto:er.abhijitpaul@gmail.com" target="_blank">er.abhijitpaul@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks for the reply, i will try it out but i am also facing one more issue "<span style="color:rgb(51,51,51);font-family:arial,sans-serif;font-size:14px;background-color:rgb(245,245,245)">i.e. replicated volumes returning different timestamps"</span><div><div><font color="#333333"><span style="font-size:14px">so is this because of </span></font><a href="https://bugzilla.redhat.com/show_bug.cgi?id=1426548" class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962external-link" rel="nofollow" style="color:rgb(59,115,175);text-decoration-line:none;font-size:14px" target="_blank">Bug 1426548 - Openshift Logging ElasticSearch FSLocks when using GlusterFS storage backend</a> ?</div><div><br></div><div><b>FYI i am using glusterfs 3.10.1 tar.gz</b></div><div><b><br></b></div><div>Regards,</div><div>Abhijit</div><div><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471h5"><div><br></div><div><br></div><div><br><div class="gmail_extra"><div class="gmail_quote">On Thu, May 4, 2017 at 10:58 PM, Amar Tumballi <span dir="ltr"><<a href="mailto:atumball@redhat.com" target="_blank">atumball@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-">On Thu, May 4, 2017 at 10:41 PM, Abhijit Paul <span dir="ltr"><<a href="mailto:er.abhijitpaul@gmail.com" target="_blank">er.abhijitpaul@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-m_3193954634081209320gmail-HOEnZb"><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-m_3193954634081209320gmail-h5"><div dir="ltr"><div dir="ltr">Since i am new to gluster, can please provide how to <span style="font-size:12.8px">turn off/</span>disable "<span style="font-size:12.8px">perf xlator options</span>"?</div><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-m_3193954634081209320gmail-m_-1768203812173932049gmail-HOEnZb"><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-m_3193954634081209320gmail-m_-1768203812173932049gmail-h5"></div></div><div class="gmail_extra"><div class="gmail_quote"><br></div></div></div></div></div></blockquote></span><div><br><div><div><span style="font-family:monospace,monospace">$ gluster volume set <volname> performance.stat-prefetch off<br>$ gluster volume set <volname> performance.read-ahead off<br>$ gluster volume set <volname> performance.write-behind off<br></span></div><span style="font-family:monospace,monospace">$ gluster volume set <volname> performance.io-cache off<br></span></div><span style="font-family:monospace,monospace">$ gluster volume set <volname> performance.quick-read off<br><br></span><br></div><div>Regards,<br></div><div>Amar <br></div><span class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-m_3193954634081209320gmail-HOEnZb"><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-m_3193954634081209320gmail-h5"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-m_3193954634081209320gmail-m_-1768203812173932049gmail-HOEnZb"><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-m_3193954634081209320gmail-m_-1768203812173932049gmail-h5"><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 3, 2017 at 8:51 PM, Atin Mukherjee <span dir="ltr"><<a href="mailto:amukherj@redhat.com" target="_blank">amukherj@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">I think there is still some pending stuffs in some of the gluster perf xlators to make that work complete. Cced the relevant folks for more information. Can you please turn off all the perf xlator options as a work around to move forward?<br></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-m_3193954634081209320gmail-m_-1768203812173932049gmail-m_-2232857996436092658h5">On Wed, May 3, 2017 at 8:04 PM, Abhijit Paul <span dir="ltr"><<a href="mailto:er.abhijitpaul@gmail.com" target="_blank">er.abhijitpaul@gmail.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-m_3193954634081209320gmail-m_-1768203812173932049gmail-m_-2232857996436092658h5"><div dir="ltr">Dear folks,<div><br></div><div>I setup Glusterfs(3.10.1) NFS type as persistence volume for Elasticsearch(5.1.2) but currently facing issue with <b>"CorruptIndexException" </b>with Elasticseach logs and due to that index health trued RED in Elasticsearch. </div><div><br></div><div>Later found that there was an issue with gluster < 3.10 (<a href="https://bugzilla.redhat.com/show_bug.cgi?id=1390050" target="_blank">https://bugzilla.redhat.com/s<wbr>how_bug.cgi?id=1390050</a>) but even after <b>upgrading to 3.10.1 issue is still there.</b></div><div><b><br></b></div><div><b>So curios to know what would be the root cause to fix this issue.</b></div><div><br></div><div>Regards,</div><div>Abhijit</div></div>
<br></div></div>______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-users</a><br></blockquote></div><br></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div></div>
</div></div><br>______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-users</a><br></blockquote></span></div><span class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-HOEnZb"><font color="#888888"><br><br clear="all"><br>-- <br><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705m_-5098074516094412240m_4316857186370861971m_-1063756327267601471m_6428151027507301962gmail-m_3193954634081209320gmail_signature"><div dir="ltr"><div><div dir="ltr"><div>Amar Tumballi (amarts)<br></div></div></div></div></div>
</font></span></div></div>
</blockquote></div><br></div></div></div></div></div></div>
<br>______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-users</a><br></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br><br clear="all"><br></div></div><span class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670HOEnZb"><font color="#888888">-- <br><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635m_-4193287844608098670m_1639904391754634705gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Pranith<br></div></div>
</font></span></div>
</blockquote></div><br></div>
</div></div></blockquote></div></div></div><span class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618HOEnZb"><font color="#888888"><br><br clear="all"><br>-- <br><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618m_-407383549438828635gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Pranith<br></div></div>
</font></span></div></div>
</blockquote></div></div></div><span class="m_-1301792222940230058m_-4166879534598684678HOEnZb"><font color="#888888"><br><br clear="all"><br>-- <br><div class="m_-1301792222940230058m_-4166879534598684678m_-8130433373451634618gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Pranith<br></div></div>
</font></span></div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div></div></div></div>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Pranith<br></div></div>
</div>