<div dir="ltr">That is strange. I wonder if the volume creation was successful. Can show attach the logs for Heketi?<div><br></div><div>- Luis</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Aug 17, 2017 at 8:31 AM, Christopher Schmidt <span dir="ltr"><<a href="mailto:fakod666@gmail.com" target="_blank">fakod666@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><div>Hi all,</div><div><br></div><div>I've just tried Prometheus on Kubernetes, using</div><div>- CoreOS Prometheus Operator (0.10.2)</div><div>- K8s 1.6.8</div><div>- GlusterFS 3.10.4 (disabled all performance translators)</div><div>- Heketi 5</div><div><br></div><div>The Operator created a StatefulSet with a VolumeClaimTemplate <wbr>prometheus-prometheus-db-<wbr>prometheus-prometheus-0</div><div>As you can see below, the claim has issues creating volumes. </div><div>But actually, the volumes are created. LoggedIn in my GlusterFS Container I can see f.e. vol_<wbr>9903142828b2954544430d0f9dd385<wbr>bf but not in Heketi</div><div><br></div><div>Any idea how this can happen?</div><div><br></div><div>best Christopher</div><div><br></div><div> </div><div><br></div><div><br></div><div><div><font face="monospace">> kubectl -n metrics describe pvc prometheus-prometheus-db-<wbr>prometheus-prometheus-0</font></div><div><font face="monospace">Name:<span style="white-space:pre-wrap"> </span>prometheus-prometheus-db-<wbr>prometheus-prometheus-0</font></div><div><font face="monospace">Namespace:<span style="white-space:pre-wrap"> </span>metrics</font></div><div><font face="monospace">StorageClass:<span style="white-space:pre-wrap"> </span>distributed</font></div><div><font face="monospace">Status:<span style="white-space:pre-wrap"> </span>Pending</font></div><div><font face="monospace">Volume:</font></div><div><font face="monospace">Labels:<span style="white-space:pre-wrap"> </span>app=prometheus</font></div><div><font face="monospace"><span style="white-space:pre-wrap"> </span>prometheus=prometheus</font></div><div><font face="monospace">Annotations:<span style="white-space:pre-wrap"> </span><a href="http://volume.beta.kubernetes.io/storage-class=distributed" target="_blank">volume.beta.kubernetes.io/<wbr>storage-class=distributed</a></font></div><div><font face="monospace"><span style="white-space:pre-wrap"> </span><a href="http://volume.beta.kubernetes.io/storage-provisioner=kubernetes.io/glusterfs" target="_blank">volume.beta.kubernetes.io/<wbr>storage-provisioner=<wbr>kubernetes.io/glusterfs</a></font></div><div><font face="monospace">Capacity:</font></div><div><font face="monospace">Access Modes:</font></div><div><font face="monospace">Events:</font></div><div><font face="monospace"> FirstSeen<span style="white-space:pre-wrap"> </span>LastSeen<span style="white-space:pre-wrap"> </span>Count<span style="white-space:pre-wrap"> </span>From<span style="white-space:pre-wrap"> </span>SubObjectPath<span style="white-space:pre-wrap"> </span>Type<span style="white-space:pre-wrap"> </span>Reason<span style="white-space:pre-wrap"> </span>Message</font></div><div><font face="monospace"> ---------<span style="white-space:pre-wrap"> </span>--------<span style="white-space:pre-wrap"> </span>-----<span style="white-space:pre-wrap"> </span>----<span style="white-space:pre-wrap"> </span>-------------<span style="white-space:pre-wrap"> </span>--------<span style="white-space:pre-wrap"> </span>------<span style="white-space:pre-wrap"> </span>-------</font></div><div><font face="monospace"> 39s<span style="white-space:pre-wrap"> </span>39s<span style="white-space:pre-wrap"> </span>1<span style="white-space:pre-wrap"> </span>persistentvolume-controller<span style="white-space:pre-wrap"> </span>Warning<span style="white-space:pre-wrap"> </span>ProvisioningFailed<span style="white-space:pre-wrap"> </span>Failed to provision volume with StorageClass "distributed": glusterfs: create volume err: error creating volume Unable to execute command on glusterfs-vl1tl: volume start: vol_<wbr>9903142828b2954544430d0f9dd385<wbr>bf: failed: Another transaction is in progress Please try again after sometime..</font></div><div><font face="monospace"> 28s<span style="white-space:pre-wrap"> </span>28s<span style="white-space:pre-wrap"> </span>1<span style="white-space:pre-wrap"> </span>persistentvolume-controller<span style="white-space:pre-wrap"> </span>Warning<span style="white-space:pre-wrap"> </span>ProvisioningFailed<span style="white-space:pre-wrap"> </span>Failed to provision volume with StorageClass "distributed": glusterfs: create volume err: failed to create endpoint/service <nil>.</font></div><div><font face="monospace"> 15s<span style="white-space:pre-wrap"> </span>15s<span style="white-space:pre-wrap"> </span>1<span style="white-space:pre-wrap"> </span>persistentvolume-controller<span style="white-space:pre-wrap"> </span>Warning<span style="white-space:pre-wrap"> </span>ProvisioningFailed<span style="white-space:pre-wrap"> </span>Failed to provision volume with StorageClass "distributed": glusterfs: create volume err: error creating volume Unable to execute command on glusterfs-vl1tl: volume start: vol_<wbr>f4e20daae202e6190085fd4bbbe837<wbr>bb: failed: Another transaction is in progress Please try again after sometime..</font></div><div><font face="monospace"> 0s<span style="white-space:pre-wrap"> </span>0s<span style="white-space:pre-wrap"> </span>1<span style="white-space:pre-wrap"> </span>persistentvolume-controller<span style="white-space:pre-wrap"> </span>Warning<span style="white-space:pre-wrap"> </span>ProvisioningFailed<span style="white-space:pre-wrap"> </span>Failed to provision volume with StorageClass "distributed": glusterfs: create volume err: error creating volume Unable to execute command on glusterfs-4sl4b: volume start: vol_<wbr>8c913f988caa2328f57cc37e164d7d<wbr>80: failed: Another transaction is in progress Please try again after sometime..</font></div></div></div>
<br>______________________________<wbr>_________________<br>
heketi-devel mailing list<br>
<a href="mailto:heketi-devel@gluster.org">heketi-devel@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/heketi-devel" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/heketi-devel</a><br>
<br></blockquote></div><br></div>