<div dir="ltr"><div>Hi Christopher,<br><br></div>We are experimenting few other options to get rid of this issue. We will provide an update as soon as we have it.<br><div class="gmail_extra"><br><div class="gmail_quote">On Thu, May 25, 2017 at 7:18 PM, Christopher Schmidt <span dir="ltr"><<a href="mailto:fakod666@gmail.com" target="_blank">fakod666@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Humble, </div><div dir="ltr"><br>
thanks for that, it is really appreciated.<br>
</div><div dir="ltr"><br></div><div dir="ltr">In the meanwhile, using K8s 1.5, what can I do to disable the performance translator that doesn't work with Kafka? Maybe something while generating the Glusterfs container for Kubernetes?</div><div dir="ltr"><br></div><div dir="ltr">Best Christopher</div><div class="HOEnZb"><div class="h5"><span>
</span><br><div class="gmail_quote"><div dir="ltr">Humble Chirammal <<a href="mailto:hchiramm@redhat.com" target="_blank">hchiramm@redhat.com</a>> schrieb am Do., 25. Mai 2017, 09:36:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Thu, May 25, 2017 at 12:57 PM, Raghavendra Talur <span dir="ltr"><<a href="mailto:rtalur@redhat.com" target="_blank">rtalur@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On Thu, May 25, 2017 at 11:21 AM, Christopher Schmidt<br>
<<a href="mailto:fakod666@gmail.com" target="_blank">fakod666@gmail.com</a>> wrote:<br>
> So this change of the Gluster Volume Plugin will make it into K8s 1.7 or<br>
> 1.8. Unfortunately too late for me.<br>
><br>
> Does anyone know how to disable performance translators by default?<br>
<br>
Humble,<br>
<br>
Do you know of any way Christopher can proceed here?<br></blockquote><div><br></div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div>I am trying to get it in 1.7 branch, will provide an update here as soon as its available. <br></div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
><br>
><br>
> Raghavendra Talur <<a href="mailto:rtalur@redhat.com" target="_blank">rtalur@redhat.com</a>> schrieb am Mi., 24. Mai 2017, 19:30:<br>
>><br>
>> On Wed, May 24, 2017 at 4:08 PM, Christopher Schmidt <<a href="mailto:fakod666@gmail.com" target="_blank">fakod666@gmail.com</a>><br>
>> wrote:<br>
>> ><br>
>> ><br>
>> > Vijay Bellur <<a href="mailto:vbellur@redhat.com" target="_blank">vbellur@redhat.com</a>> schrieb am Mi., 24. Mai 2017 um 05:53<br>
>> > Uhr:<br>
>> >><br>
>> >> On Tue, May 23, 2017 at 1:39 AM, Christopher Schmidt<br>
>> >> <<a href="mailto:fakod666@gmail.com" target="_blank">fakod666@gmail.com</a>><br>
>> >> wrote:<br>
>> >>><br>
>> >>> OK, seems that this works now.<br>
>> >>><br>
>> >>> A couple of questions:<br>
>> >>> - What do you think, are all these options necessary for Kafka?<br>
>> >><br>
>> >><br>
>> >> I am not entirely certain what subset of options will make it work as I<br>
>> >> do<br>
>> >> not understand the nature of failure with Kafka and the default<br>
>> >> gluster<br>
>> >> configuration. It certainly needs further analysis to identify the list<br>
>> >> of<br>
>> >> options necessary. Would it be possible for you to enable one option<br>
>> >> after<br>
>> >> the other and determine the configuration that ?<br>
>> >><br>
>> >><br>
>> >>><br>
>> >>> - You wrote that there have to be kind of application profiles. So to<br>
>> >>> find out, which set of options work is currently a matter of testing<br>
>> >>> (and<br>
>> >>> hope)? Or are there any experiences for MongoDB / ProstgreSQL /<br>
>> >>> Zookeeper<br>
>> >>> etc.?<br>
>> >><br>
>> >><br>
>> >> Application profiles are work in progress. We have a few that are<br>
>> >> focused<br>
>> >> on use cases like VM storage, block storage etc. at the moment.<br>
>> >><br>
>> >>><br>
>> >>> - I am using Heketi and Dynamik Storage Provisioning together with<br>
>> >>> Kubernetes. Can I set this volume options somehow by default or by<br>
>> >>> volume<br>
>> >>> plugin?<br>
>> >><br>
>> >><br>
>> >><br>
>> >> Adding Raghavendra and Michael to help address this query.<br>
>> ><br>
>> ><br>
>> > For me it would be sufficient to disable some (or all) translators, for<br>
>> > all<br>
>> > volumes that'll be created, somewhere here:<br>
>> > <a href="https://github.com/gluster/gluster-containers/tree/master/CentOS" rel="noreferrer" target="_blank">https://github.com/gluster/<wbr>gluster-containers/tree/<wbr>master/CentOS</a><br>
>> > This is the container used by the GlusterFS DaemonSet for Kubernetes.<br>
>><br>
>> Work is in progress to give such option at volume plugin level. We<br>
>> currently have a patch[1] in review for Heketi that allows users to<br>
>> set Gluster options using heketi-cli instead of going into a Gluster<br>
>> pod. Once this is in, we can add options in storage-class of<br>
>> Kubernetes that pass down Gluster options for every volume created in<br>
>> that storage-class.<br>
>><br>
>> [1] <a href="https://github.com/heketi/heketi/pull/751" rel="noreferrer" target="_blank">https://github.com/heketi/<wbr>heketi/pull/751</a><br>
>><br>
>> Thanks,<br>
>> Raghavendra Talur<br>
>><br>
>> ><br>
>> >><br>
>> >><br>
>> >> -Vijay<br>
>> >><br>
>> >><br>
>> >><br>
>> >>><br>
>> >>><br>
>> >>> Thanks for you help... really appreciated.. Christopher<br>
>> >>><br>
>> >>> Vijay Bellur <<a href="mailto:vbellur@redhat.com" target="_blank">vbellur@redhat.com</a>> schrieb am Mo., 22. Mai 2017 um<br>
>> >>> 16:41<br>
>> >>> Uhr:<br>
>> >>>><br>
>> >>>> Looks like a problem with caching. Can you please try by disabling<br>
>> >>>> all<br>
>> >>>> performance translators? The following configuration commands would<br>
>> >>>> disable<br>
>> >>>> performance translators in the gluster client stack:<br>
>> >>>><br>
>> >>>> gluster volume set <volname> performance.quick-read off<br>
>> >>>> gluster volume set <volname> performance.io-cache off<br>
>> >>>> gluster volume set <volname> performance.write-behind off<br>
>> >>>> gluster volume set <volname> performance.stat-prefetch off<br>
>> >>>> gluster volume set <volname> performance.read-ahead off<br>
>> >>>> gluster volume set <volname> performance.readdir-ahead off<br>
>> >>>> gluster volume set <volname> performance.open-behind off<br>
>> >>>> gluster volume set <volname> performance.client-io-threads off<br>
>> >>>><br>
>> >>>> Thanks,<br>
>> >>>> Vijay<br>
>> >>>><br>
>> >>>><br>
>> >>>><br>
>> >>>> On Mon, May 22, 2017 at 9:46 AM, Christopher Schmidt<br>
>> >>>> <<a href="mailto:fakod666@gmail.com" target="_blank">fakod666@gmail.com</a>> wrote:<br>
>> >>>>><br>
>> >>>>> Hi all,<br>
>> >>>>><br>
>> >>>>> has anyone ever successfully deployed a Kafka (Cluster) on GlusterFS<br>
>> >>>>> volumes?<br>
>> >>>>><br>
>> >>>>> I my case it's a Kafka Kubernetes-StatefulSet and a Heketi<br>
>> >>>>> GlusterFS.<br>
>> >>>>> Needless to say that I am getting a lot of filesystem related<br>
>> >>>>> exceptions like this one:<br>
>> >>>>><br>
>> >>>>> Failed to read `log header` from file channel<br>
>> >>>>> `sun.nio.ch.FileChannelImpl@<wbr>67afa54a`. Expected to read 12 bytes,<br>
>> >>>>> but<br>
>> >>>>> reached end of file after reading 0 bytes. Started read from<br>
>> >>>>> position<br>
>> >>>>> 123065680.<br>
>> >>>>><br>
>> >>>>> I limited the amount of exceptions with the<br>
>> >>>>> log.flush.interval.messages=1 option, but not all...<br>
>> >>>>><br>
>> >>>>> best Christopher<br>
>> >>>>><br>
>> >>>>><br>
>> >>>>> ______________________________<wbr>_________________<br>
>> >>>>> Gluster-users mailing list<br>
>> >>>>> <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
>> >>>>> <a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br>
>> >>>><br>
>> >>>><br>
>> ><br>
</blockquote></div></div></div><div dir="ltr"><div class="gmail_extra"><br><br clear="all"><br>-- <br><div class="m_-6631938511774116203m_4151924312025105237gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div>Cheers,<br>Humble<br><br></div>Sr.Software Engineer - Red Hat Storage Engineering<br></div>website: <a href="http://humblec.com" target="_blank">http://humblec.com</a><br></div></div></div></div>
</div></div></blockquote></div>
</div></div></blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div>Cheers,<br>Humble<br><br></div>Sr.Software Engineer - Red Hat Storage Engineering<br></div>website: <a href="http://humblec.com" target="_blank">http://humblec.com</a><br></div></div></div></div>
</div></div>