<div dir="ltr"><span style="color:rgb(33,33,33);font-size:13px">Hi,</span><div style="color:rgb(33,33,33);font-size:13px"><br></div><div style="color:rgb(33,33,33);font-size:13px">sorry for the confusion.</div><div style="color:rgb(33,33,33);font-size:13px">I opened this thread, to find an overall working configuration.</div><div style="color:rgb(33,33,33);font-size:13px"><br></div><div style="color:rgb(33,33,33);font-size:13px">My setup is as follows:</div><div style="color:rgb(33,33,33);font-size:13px">- Container Linux (CoreOS)</div><div style="color:rgb(33,33,33);font-size:13px">- No local installation (except Kubelet, everything (!) else runs in Containers)</div><div style="color:rgb(33,33,33);font-size:13px">- I am using this deploy scripts for GlusterFS <a href="https://github.com/gluster/gluster-kubernetes/tree/master/deploy/kube-templates" target="_blank">https://github.com/gluster/gluster-kubernetes/tree/master/deploy/kube-templates</a></div><div style="color:rgb(33,33,33);font-size:13px">- I've created my own containers with <a href="https://github.com/gluster/gluster-containers/tree/master/CentOS" target="_blank">https://github.com/gluster/gluster-containers/tree/master/CentOS</a> (so its Gluster 1.10.5)</div><div style="color:rgb(33,33,33);font-size:13px">- I am using the original container from docker hub heketi/heketi:5 (with a secret as DB backup, not the gk-deploy script)</div><div style="color:rgb(33,33,33);font-size:13px">- Kubernetes v1.6.8_coreos.0 with 3 masters and 6 minions, gluster pods on all minions (3 x 50GB partitions for Gluster on each node, rbac enabled)</div><div style="color:rgb(33,33,33);font-size:13px">- for network policies I use Canal (deployed as pods as well)</div><div style="color:rgb(33,33,33);font-size:13px"><br></div><div style="color:rgb(33,33,33);font-size:13px">Issues:</div><div style="color:rgb(33,33,33);font-size:13px">- I've learned that Kubernetes 1.7.x and GlusterFS is broken, since 1.7 requires GlusterFS > 1.10, right?</div><div style="color:rgb(33,33,33);font-size:13px">- I was testing K8s 1.5.x with Heketi/GlusterFS and it was fine for me (but really only small manual tests a couple of months ago)</div><div style="color:rgb(33,33,33);font-size:13px">- With my configuration (see above) no version of Gluster or Heketi works with K8s 1.6.x with dynamic provisioning.</div><div style="color:rgb(33,33,33);font-size:13px"><br></div><div style="color:rgb(33,33,33);font-size:13px">However, this is not the usual GlusterFS setup you are testing. So I am sure I do something wrong. What is noticeable is that creating a volume takes a couple of minutes (depending on the volume type) and Heketi has some issues with that.</div><div style="color:rgb(33,33,33);font-size:13px">So what can I do? Where to start testing/changing my configuration?</div><div style="color:rgb(33,33,33);font-size:13px"><br></div><div style="color:rgb(33,33,33);font-size:13px">regards Christopher</div><br class="inbox-inbox-Apple-interchange-newline"><br><div class="gmail_quote"><div dir="ltr">Humble Chirammal <<a href="mailto:hchiramm@redhat.com">hchiramm@redhat.com</a>> schrieb am Di., 22. Aug. 2017 um 09:51 Uhr:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Tue, Aug 22, 2017 at 1:14 PM, Michael Adam <span dir="ltr"><<a href="mailto:obnox@samba.org" target="_blank">obnox@samba.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span class="m_-5126049002861548145gmail-">On 2017-08-22 at 07:00 +0000, Christopher Schmidt wrote:<br>
> Hi guys,<br>
><br>
> I know it's difficult to support various installations and combinations of<br>
> tools.<br>
> But I'll give some Kubernetes training and talks in September/October.<br>
> So what should I recommend? So far I didn't find a working GlusterFS<br>
> Heketi, neither with Kubernetes 1.6.x nor 1.7.x<br>
<br>
</span>Hi Christopher,<br>
<br>
This statement seems surprising to me.<br>
The vagrant environment and the complex tests<br>
in the gluster-kubernetes repo<br>
(<a href="http://github.com/gluster/gluster-kubernetes" rel="noreferrer" target="_blank">github.com/gluster/gluster-kubernetes</a>)<br>
prove that heketi and gluster work in kube 1.6.<br>
<br>
Can you give some more details on what's going wrong?<br></blockquote><div><br></div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div>There is another thread opened by Christopher <br><a href="http://lists.gluster.org/pipermail/heketi-devel/2017-August/000166.html" target="_blank">http://lists.gluster.org/pipermail/heketi-devel/2017-August/000166.html</a><br> <br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> </blockquote></div></div></div><div dir="ltr"><div class="gmail_extra"><br><br clear="all"><br>-- <br><div class="m_-5126049002861548145gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div>Cheers,<br>Humble<br><br></div><br></div></div></div></div></div></div></div>
</div></div></blockquote></div></div>