<div dir="ltr">true, storage should be IP address. However afaict, it failed in "Peer in cluster" , because gluster cluster is formed with different IP/hostname and its stored in metadata. If you can delete the cluster and recreate it with "storage" in IP, it should work I believe. <br></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Feb 7, 2018 at 2:16 PM, Ercan Aydoğan <span dir="ltr"><<a href="mailto:ercan.aydogan@gmail.com" target="_blank">ercan.aydogan@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word;line-break:after-white-space"><font face="Monaco">Hello,</font><div><font face="Monaco"><br></font></div><div><font face="Monaco">i have dedicated 3.11.3 version glusterfs 3 nodes. i can create volumes with both gluster own command line utility and heketi-cli it’s ok. </font></div><div><font face="Monaco"><br></font></div><div><font face="Monaco">If i use storage hostname FQDN i can create cluster with </font></div><div><font face="Monaco"><br></font></div><div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">/heketi-cli topology load --json=topology.json</font></span></div></div><div><font face="Monaco"><br></font></div><div><font face="Monaco">after storageclass , secret and pvc creation i got this error.</font></div><div><font face="Monaco"><br></font></div><div><font face="Monaco">kubectl get pvc claim1 returns </font></div><div><font face="Monaco"><br></font></div><div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><font face="Monaco"><span style="font-variant-ligatures:no-common-ligatures;color:#c33720">root</span><span style="font-variant-ligatures:no-common-ligatures;color:#afad24">@</span><span style="font-variant-ligatures:no-common-ligatures;color:#34bbc8">kubemaster </span><span style="font-variant-ligatures:no-common-ligatures;color:#afad24">~ </span><span style="font-variant-ligatures:no-common-ligatures;color:#d53bd3"># </span><span style="font-variant-ligatures:no-common-ligatures">kubectl describe pvc claim1</span></font></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">Name: claim1</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">Namespace: default</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">StorageClass: fast</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">Status: Pending</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">Volume: </font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">Labels: <none></font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">Annotations: <a href="http://volume.beta.kubernetes.io/storage-provisioner=kubernetes.io/glusterfs" target="_blank">volume.beta.kubernetes.io/<wbr>storage-provisioner=<wbr>kubernetes.io/glusterfs</a></font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">Finalizers: []</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">Capacity: </font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">Access Modes: </font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">Events:</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> Type Reason Age From Message</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> ---- ------ ---- ---- -------</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> Warning ProvisioningFailed 21s persistentvolume-controller Failed to provision volume with StorageClass "fast": create volume error: failed to create endpoint/service error creating endpoint: Endpoints "glusterfs-dynamic-claim1" is invalid: [subsets[0].addresses[0].ip: Invalid value: "pri.ostechnix.lan": must be a valid IP address, (e.g. 10.9.8.7), subsets[0].addresses[1].ip: Invalid value: "third.ostechnix.lan": must be a valid IP address, (e.g. 10.9.8.7), subsets[0].addresses[2].ip: Invalid value: "sec.ostechnix.lan": must be a valid IP address, (e.g. 10.9.8.7)]</font></span></div></div><div><font face="Monaco"><br></font></div><div><font face="Monaco"><br></font></div><div><font face="Monaco">my topology.json content is</font></div><div><font face="Monaco"><br></font></div><div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">{</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "clusters": [</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> {</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "nodes": [</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> {</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "node": {</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "hostnames": {</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "manage": [</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "51.15.77.14"</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> ],</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "storage": [</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "pri.ostechnix.lan"</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> ]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> },</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "zone": 1</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> },</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "devices": [</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "/dev/nbd1",</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "/dev/nbd2",</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"><span class="m_-5859897150034671188Apple-tab-span" style="white-space:pre-wrap"> </span> "/dev/nbd3"</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> ]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> },</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> {</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "node": {</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "hostnames": {</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "manage": [</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "51.15.90.60"</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> ],</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "storage": [</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "sec.ostechnix.lan"</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> ]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> },</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "zone": 1</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> },</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "devices": [</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "/dev/nbd1",</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "/dev/nbd2",</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "/dev/nbd3"</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> ]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> },</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> {</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "node": {</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "hostnames": {</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "manage": [</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "163.172.151.120"</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> ],</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "storage": [</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "third.ostechnix.lan"</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> ]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> },</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "zone": 1</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> },</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "devices": [</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "/dev/nbd1",</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "/dev/nbd2",</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> "/dev/nbd3"</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> ]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> }</font></span></div><p style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098);min-height:14px"><font face="Monaco"><span style="font-variant-ligatures:no-common-ligatures"> </span><br class="m_-5859897150034671188webkit-block-placeholder"></font></p><p style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098);min-height:14px"><font face="Monaco"><span style="font-variant-ligatures:no-common-ligatures"> </span><br class="m_-5859897150034671188webkit-block-placeholder"></font></p><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> ]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> }</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"> ]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">}</font></span></div></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"><br></font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"><br></font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">Yes, it says storage must be ip for endpoint creation. But if i change </font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"><br></font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">manage : hostname </font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">storage: ip address</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"><br></font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures">{</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "clusters": [</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> {</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "nodes": [</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> {</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "node": {</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "hostnames": {</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "manage": [</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "pri.ostechnix.lan"</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> ],</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "storage": [</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "51.15.77.14"</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> ]</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> },</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "zone": 1</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> },</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "devices": [</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "/dev/nbd1",</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "/dev/nbd2",</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><span class="m_-5859897150034671188Apple-tab-span" style="white-space:pre-wrap"> </span> "/dev/nbd3"</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> ]</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> },</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> {</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "node": {</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "hostnames": {</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "manage": [</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "sec.ostechnix.lan"</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> ],</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "storage": [</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "51.15.90.60"</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> ]</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> },</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "zone": 1</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> },</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "devices": [</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "/dev/nbd1",</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "/dev/nbd2",</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "/dev/nbd3"</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> ]</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> },</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> {</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "node": {</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "hostnames": {</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "manage": [</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "third.ostechnix.lan"</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> ],</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "storage": [</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "163.172.151.120"</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> ]</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> },</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "zone": 1</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> },</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "devices": [</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "/dev/nbd1",</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "/dev/nbd2",</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> "/dev/nbd3"</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> ]</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> }</span></div><p style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098);min-height:14px"><span style="font-variant-ligatures:no-common-ligatures"> </span><br class="m_-5859897150034671188webkit-block-placeholder"></p><p style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098);min-height:14px"><span style="font-variant-ligatures:no-common-ligatures"> </span><br class="m_-5859897150034671188webkit-block-placeholder"></p><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> ]</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> }</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"> ]</span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures">}</span></div></font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"><br></font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">i can not create volume with heketi-cli.</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"><br></font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco">it says </font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"><br></font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font face="Monaco"><div style="color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098);margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures;color:#c33720">root</span><span style="font-variant-ligatures:no-common-ligatures;color:#afad24">@</span><span style="font-variant-ligatures:no-common-ligatures;color:#34bbc8">kubemaster </span><span style="font-variant-ligatures:no-common-ligatures;color:#afad24">~/heketi </span><span style="font-variant-ligatures:no-common-ligatures;color:#d53bd3"># </span><span style="font-variant-ligatures:no-common-ligatures">./heketi-cli volume create --size=3 --replica=3</span></div><div style="color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098);margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures">Error: volume create: vol_<wbr>207bbf81f28b959c51448b919be3bb<wbr>59: failed: Host 51.15.90.60 is not in 'Peer in Cluster’ state</span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font color="#232323"><br></font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><span style="font-variant-ligatures:no-common-ligatures"><font color="#232323">i need advice how can fix this issue.</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal"><br></div></font></span></div></div><br>______________________________<wbr>_________________<br>
heketi-devel mailing list<br>
<a href="mailto:heketi-devel@gluster.org">heketi-devel@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/heketi-devel" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/heketi-devel</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div>Cheers,<br>Humble<br><br></div>Red Hat Storage Engineering<br></div><div>Mastering KVM Virtualization: <span><a href="http://amzn.to/2vFTXaW" target="_blank">http://amzn.to/2vFTXaW</a></span></div>Website: <a href="http://humblec.com" target="_blank">http://humblec.com</a><br></div></div></div></div></div></div>
</div>