<div dir="ltr"><b>@Prasanna & @Pranith & @Keithley </b>Thank you very much for this update, let me try out this with build frm src and then use with Elasticsearch in kubernetes environment, i will let you know the update. <div><br></div><div>My hole intention to use this gluster-block solution is to <b>avoid Elasticsearch index health turn RED issue due to CorruptIndex</b> issue by using GlusterFS & FUSE, <b>on this regard if any further pointer or forwards are there will relay appreciate.</b><div><br></div><div>Regards,</div><div>Abhijit <br><div class="gmail_extra"><br><div class="gmail_quote">On Mon, May 8, 2017 at 5:26 PM, Prasanna Kalever <span dir="ltr"><<a href="mailto:pkalever@redhat.com" target="_blank">pkalever@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">On Mon, May 8, 2017 at 3:02 PM, Pranith Kumar Karampuri<br>
<<a href="mailto:pkarampu@redhat.com">pkarampu@redhat.com</a>> wrote:<br>
> Abhijit,<br>
> We released gluster-block v0.2 just this Friday for which RHEL<br>
> packages are yet to be built.<br>
><br>
> +Kaleb,<br>
> Could you help with this please?<br>
><br>
> Prasanna,<br>
> Could you let Abhijit know the rpm versions for tcmu-runner and other<br>
> packages so that this feature can be used?<br>
<br>
</span>Hi Abhijit,<br>
<br>
We will soon try to help you with the centos packages, but for time<br>
being you can try compile from sources, dependencies include<br>
<br>
gluster-block [1]: use v0.2, INSTALL guide [2]<br>
tcmu-runner [3] : >= 1.0.4 ( you can use current head for time being )<br>
targetcli [4]: >= 2.1.fb43 (try yum install, you should get this in<br>
RHEL, this pulls the required deps)<br>
<br>
[1] <a href="https://github.com/gluster/gluster-block" rel="noreferrer" target="_blank">https://github.com/gluster/<wbr>gluster-block</a><br>
[2] <a href="https://github.com/gluster/gluster-block/blob/master/INSTALL" rel="noreferrer" target="_blank">https://github.com/gluster/<wbr>gluster-block/blob/master/<wbr>INSTALL</a><br>
[3] <a href="https://github.com/open-iscsi/tcmu-runner" rel="noreferrer" target="_blank">https://github.com/open-iscsi/<wbr>tcmu-runner</a><br>
[4] <a href="https://github.com/open-iscsi/targetcli-fb" rel="noreferrer" target="_blank">https://github.com/open-iscsi/<wbr>targetcli-fb</a><br>
<br>
<br>
Note: gluster-block(server side) will be supported soon on RHEL 7.3 and + only.<br>
<br>
Cheers!<br>
--<br>
prasanna<br>
<div class="HOEnZb"><div class="h5"><br>
<br>
<br>
<br>
><br>
><br>
> On Mon, May 8, 2017 at 2:49 PM, Pranith Kumar Karampuri<br>
> <<a href="mailto:pkarampu@redhat.com">pkarampu@redhat.com</a>> wrote:<br>
>><br>
>> Wait, wait we are discussing this issue only. Expect a reply in some time<br>
>> :-)<br>
>><br>
>> On Mon, May 8, 2017 at 2:19 PM, Abhijit Paul <<a href="mailto:er.abhijitpaul@gmail.com">er.abhijitpaul@gmail.com</a>><br>
>> wrote:<br>
>>><br>
>>> poking for previous mail reply<br>
>>><br>
>>> On Sun, May 7, 2017 at 1:06 AM, Abhijit Paul <<a href="mailto:er.abhijitpaul@gmail.com">er.abhijitpaul@gmail.com</a>><br>
>>> wrote:<br>
>>>><br>
>>>><br>
>>>> <a href="https://pkalever.wordpress.com/2017/03/14/elasticsearch-with-gluster-block/" rel="noreferrer" target="_blank">https://pkalever.wordpress.<wbr>com/2017/03/14/elasticsearch-<wbr>with-gluster-block/</a><br>
>>>> here used tested environment is Fedora ,<br>
>>>> but i am using RHEL based Oracle linux so does gluster-block compatible<br>
>>>> with RHEL as well? What i needs to change & make it work?<br>
>>>><br>
>>>> On Fri, May 5, 2017 at 5:42 PM, Pranith Kumar Karampuri<br>
>>>> <<a href="mailto:pkarampu@redhat.com">pkarampu@redhat.com</a>> wrote:<br>
>>>>><br>
>>>>><br>
>>>>><br>
>>>>> On Fri, May 5, 2017 at 5:40 PM, Pranith Kumar Karampuri<br>
>>>>> <<a href="mailto:pkarampu@redhat.com">pkarampu@redhat.com</a>> wrote:<br>
>>>>>><br>
>>>>>><br>
>>>>>><br>
>>>>>> On Fri, May 5, 2017 at 5:36 PM, Abhijit Paul<br>
>>>>>> <<a href="mailto:er.abhijitpaul@gmail.com">er.abhijitpaul@gmail.com</a>> wrote:<br>
>>>>>>><br>
>>>>>>> So should i start using gluster-block with elasticsearch in<br>
>>>>>>> kubernetes environment?<br>
>>>>>>><br>
>>>>>>> My expectation from gluster-block is, it should not CorruptIndex of<br>
>>>>>>> elasticsearch...and issue facing in previous mails.<br>
>>>>>>><br>
>>>>>>> Please let me know whether should i processed with above mentioned<br>
>>>>>>> combination.<br>
>>>>>><br>
>>>>>><br>
>>>>>> We are still in the process of fixing the failure scenarios of<br>
>>>>>> tcmu-runner dying and failingover in the multipath scenarios.<br>
>>>>><br>
>>>>><br>
>>>>> Prasanna did test that elasticsearch itself worked fine in<br>
>>>>> gluster-block environment when all the machines are up etc i.e. success<br>
>>>>> path. We are doing failure path testing and fixing things at the moment.<br>
>>>>><br>
>>>>>><br>
>>>>>><br>
>>>>>>><br>
>>>>>>><br>
>>>>>>> On Fri, May 5, 2017 at 5:06 PM, Pranith Kumar Karampuri<br>
>>>>>>> <<a href="mailto:pkarampu@redhat.com">pkarampu@redhat.com</a>> wrote:<br>
>>>>>>>><br>
>>>>>>>> Abhijit we just started making the efforts to get all of this<br>
>>>>>>>> stable.<br>
>>>>>>>><br>
>>>>>>>> On Fri, May 5, 2017 at 4:45 PM, Abhijit Paul<br>
>>>>>>>> <<a href="mailto:er.abhijitpaul@gmail.com">er.abhijitpaul@gmail.com</a>> wrote:<br>
>>>>>>>>><br>
>>>>>>>>> I yet to try gluster-block with elasticsearch...but carious to know<br>
>>>>>>>>> does this combination plays well in kubernetes environment?<br>
>>>>>>>>><br>
>>>>>>>>> On Fri, May 5, 2017 at 12:14 PM, Abhijit Paul<br>
>>>>>>>>> <<a href="mailto:er.abhijitpaul@gmail.com">er.abhijitpaul@gmail.com</a>> wrote:<br>
>>>>>>>>>><br>
>>>>>>>>>> thanks Krutika for the alternative.<br>
>>>>>>>>>><br>
>>>>>>>>>> @Prasanna @Pranith<br>
>>>>>>>>>> I was going thorough the mentioned blog post and saw that used<br>
>>>>>>>>>> tested environment was Fedora ,<br>
>>>>>>>>>> but i am using RHEL based Oracle linux so does gluster-block<br>
>>>>>>>>>> compatible with RHEL as well?<br>
>>>>>>>>>><br>
>>>>>>>>>> On Fri, May 5, 2017 at 12:03 PM, Krutika Dhananjay<br>
>>>>>>>>>> <<a href="mailto:kdhananj@redhat.com">kdhananj@redhat.com</a>> wrote:<br>
>>>>>>>>>>><br>
>>>>>>>>>>> Yeah, there are a couple of cache consistency issues with<br>
>>>>>>>>>>> performance translators that are causing these exceptions.<br>
>>>>>>>>>>> Some of them were fixed by 3.10.1. Some still remain.<br>
>>>>>>>>>>><br>
>>>>>>>>>>> Alternatively you can give gluster-block + elasticsearch a try,<br>
>>>>>>>>>>> which doesn't require solving all these caching issues.<br>
>>>>>>>>>>> Here's a blog post on the same -<br>
>>>>>>>>>>> <a href="https://pkalever.wordpress.com/2017/03/14/elasticsearch-with-gluster-block/" rel="noreferrer" target="_blank">https://pkalever.wordpress.<wbr>com/2017/03/14/elasticsearch-<wbr>with-gluster-block/</a><br>
>>>>>>>>>>><br>
>>>>>>>>>>> Adding Prasanna and Pranith who worked on this, in case you need<br>
>>>>>>>>>>> more info on this.<br>
>>>>>>>>>>><br>
>>>>>>>>>>> -Krutika<br>
>>>>>>>>>>><br>
>>>>>>>>>>> On Fri, May 5, 2017 at 12:15 AM, Abhijit Paul<br>
>>>>>>>>>>> <<a href="mailto:er.abhijitpaul@gmail.com">er.abhijitpaul@gmail.com</a>> wrote:<br>
>>>>>>>>>>>><br>
>>>>>>>>>>>> Thanks for the reply, i will try it out but i am also facing one<br>
>>>>>>>>>>>> more issue "i.e. replicated volumes returning different timestamps"<br>
>>>>>>>>>>>> so is this because of Bug 1426548 - Openshift Logging<br>
>>>>>>>>>>>> ElasticSearch FSLocks when using GlusterFS storage backend ?<br>
>>>>>>>>>>>><br>
>>>>>>>>>>>> FYI i am using glusterfs 3.10.1 tar.gz<br>
>>>>>>>>>>>><br>
>>>>>>>>>>>> Regards,<br>
>>>>>>>>>>>> Abhijit<br>
>>>>>>>>>>>><br>
>>>>>>>>>>>><br>
>>>>>>>>>>>><br>
>>>>>>>>>>>> On Thu, May 4, 2017 at 10:58 PM, Amar Tumballi<br>
>>>>>>>>>>>> <<a href="mailto:atumball@redhat.com">atumball@redhat.com</a>> wrote:<br>
>>>>>>>>>>>>><br>
>>>>>>>>>>>>><br>
>>>>>>>>>>>>><br>
>>>>>>>>>>>>> On Thu, May 4, 2017 at 10:41 PM, Abhijit Paul<br>
>>>>>>>>>>>>> <<a href="mailto:er.abhijitpaul@gmail.com">er.abhijitpaul@gmail.com</a>> wrote:<br>
>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>> Since i am new to gluster, can please provide how to turn<br>
>>>>>>>>>>>>>> off/disable "perf xlator options"?<br>
>>>>>>>>>>>>>><br>
>>>>>>>>>>>>><br>
>>>>>>>>>>>>> $ gluster volume set <volname> performance.stat-prefetch off<br>
>>>>>>>>>>>>> $ gluster volume set <volname> performance.read-ahead off<br>
>>>>>>>>>>>>> $ gluster volume set <volname> performance.write-behind off<br>
>>>>>>>>>>>>> $ gluster volume set <volname> performance.io-cache off<br>
>>>>>>>>>>>>> $ gluster volume set <volname> performance.quick-read off<br>
>>>>>>>>>>>>><br>
>>>>>>>>>>>>><br>
>>>>>>>>>>>>> Regards,<br>
>>>>>>>>>>>>> Amar<br>
>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>>> On Wed, May 3, 2017 at 8:51 PM, Atin Mukherjee<br>
>>>>>>>>>>>>>>> <<a href="mailto:amukherj@redhat.com">amukherj@redhat.com</a>> wrote:<br>
>>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>>>> I think there is still some pending stuffs in some of the<br>
>>>>>>>>>>>>>>>> gluster perf xlators to make that work complete. Cced the relevant folks for<br>
>>>>>>>>>>>>>>>> more information. Can you please turn off all the perf xlator options as a<br>
>>>>>>>>>>>>>>>> work around to move forward?<br>
>>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>>>> On Wed, May 3, 2017 at 8:04 PM, Abhijit Paul<br>
>>>>>>>>>>>>>>>> <<a href="mailto:er.abhijitpaul@gmail.com">er.abhijitpaul@gmail.com</a>> wrote:<br>
>>>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>>>>> Dear folks,<br>
>>>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>>>>> I setup Glusterfs(3.10.1) NFS type as persistence volume<br>
>>>>>>>>>>>>>>>>> for Elasticsearch(5.1.2) but currently facing issue with<br>
>>>>>>>>>>>>>>>>> "CorruptIndexException" with Elasticseach logs and due to that index health<br>
>>>>>>>>>>>>>>>>> trued RED in Elasticsearch.<br>
>>>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>>>>> Later found that there was an issue with gluster < 3.10<br>
>>>>>>>>>>>>>>>>> (<a href="https://bugzilla.redhat.com/show_bug.cgi?id=1390050" rel="noreferrer" target="_blank">https://bugzilla.redhat.com/<wbr>show_bug.cgi?id=1390050</a>) but even after<br>
>>>>>>>>>>>>>>>>> upgrading to 3.10.1 issue is still there.<br>
>>>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>>>>> So curios to know what would be the root cause to fix this<br>
>>>>>>>>>>>>>>>>> issue.<br>
>>>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>>>>> Regards,<br>
>>>>>>>>>>>>>>>>> Abhijit<br>
>>>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>>>>> ______________________________<wbr>_________________<br>
>>>>>>>>>>>>>>>>> Gluster-users mailing list<br>
>>>>>>>>>>>>>>>>> <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
>>>>>>>>>>>>>>>>> <a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br>
>>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>><br>
>>>>>>>>>>>>>> ______________________________<wbr>_________________<br>
>>>>>>>>>>>>>> Gluster-users mailing list<br>
>>>>>>>>>>>>>> <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
>>>>>>>>>>>>>> <a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br>
>>>>>>>>>>>>><br>
>>>>>>>>>>>>><br>
>>>>>>>>>>>>><br>
>>>>>>>>>>>>><br>
>>>>>>>>>>>>> --<br>
>>>>>>>>>>>>> Amar Tumballi (amarts)<br>
>>>>>>>>>>>><br>
>>>>>>>>>>>><br>
>>>>>>>>>>>><br>
>>>>>>>>>>>> ______________________________<wbr>_________________<br>
>>>>>>>>>>>> Gluster-users mailing list<br>
>>>>>>>>>>>> <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
>>>>>>>>>>>> <a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br>
>>>>>>>>>>><br>
>>>>>>>>>>><br>
>>>>>>>>>><br>
>>>>>>>>><br>
>>>>>>>><br>
>>>>>>>><br>
>>>>>>>><br>
>>>>>>>> --<br>
>>>>>>>> Pranith<br>
>>>>>>><br>
>>>>>>><br>
>>>>>><br>
>>>>>><br>
>>>>>><br>
>>>>>> --<br>
>>>>>> Pranith<br>
>>>>><br>
>>>>><br>
>>>>><br>
>>>>><br>
>>>>> --<br>
>>>>> Pranith<br>
>>>><br>
>>>><br>
>>><br>
>><br>
>><br>
>><br>
>> --<br>
>> Pranith<br>
><br>
><br>
><br>
><br>
> --<br>
> Pranith<br>
</div></div></blockquote></div><br></div></div></div></div>