<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><font face="Monaco" class="">Hello,</font><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class="">i have dedicated 3.11.3 version glusterfs 3 nodes. i can create volumes with both gluster own command line utility and heketi-cli it’s ok. </font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class="">If i use storage hostname FQDN i can create cluster with </font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">/heketi-cli topology load --json=topology.json</font></span></div></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class="">after storageclass , secret and pvc creation i got this error.</font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class="">kubectl get pvc claim1 returns </font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><font face="Monaco" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #c33720" class="">root</span><span style="font-variant-ligatures: no-common-ligatures; color: #afad24" class="">@</span><span style="font-variant-ligatures: no-common-ligatures; color: #34bbc8" class="">kubemaster </span><span style="font-variant-ligatures: no-common-ligatures; color: #afad24" class="">~ </span><span style="font-variant-ligatures: no-common-ligatures; color: #d53bd3" class=""># </span><span style="font-variant-ligatures: no-common-ligatures" class="">kubectl describe pvc claim1</span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Name: claim1</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Namespace: default</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">StorageClass: fast</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Status: Pending</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Volume: </font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Labels: <none></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Annotations: <a href="http://volume.beta.kubernetes.io/storage-provisioner=kubernetes.io/glusterfs" class="">volume.beta.kubernetes.io/storage-provisioner=kubernetes.io/glusterfs</a></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Finalizers: []</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Capacity: </font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Access Modes: </font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Events:</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> Type Reason Age From Message</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> ---- ------ ---- ---- -------</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> Warning ProvisioningFailed 21s persistentvolume-controller Failed to provision volume with StorageClass "fast": create volume error: failed to create endpoint/service error creating endpoint: Endpoints "glusterfs-dynamic-claim1" is invalid: [subsets[0].addresses[0].ip: Invalid value: "pri.ostechnix.lan": must be a valid IP address, (e.g. 10.9.8.7), subsets[0].addresses[1].ip: Invalid value: "third.ostechnix.lan": must be a valid IP address, (e.g. 10.9.8.7), subsets[0].addresses[2].ip: Invalid value: "sec.ostechnix.lan": must be a valid IP address, (e.g. 10.9.8.7)]</font></span></div></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class="">my topology.json content is</font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">{</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "clusters": [</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> {</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "nodes": [</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> {</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "node": {</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "hostnames": {</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "manage": [</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "51.15.77.14"</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> ],</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "storage": [</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "pri.ostechnix.lan"</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> ]</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> },</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "zone": 1</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> },</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "devices": [</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "/dev/nbd1",</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "/dev/nbd2",</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""><span class="Apple-tab-span" style="white-space:pre"> </span> "/dev/nbd3"</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> ]</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> },</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> {</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "node": {</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "hostnames": {</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "manage": [</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "51.15.90.60"</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> ],</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "storage": [</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "sec.ostechnix.lan"</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> ]</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> },</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "zone": 1</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> },</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "devices": [</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "/dev/nbd1",</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "/dev/nbd2",</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "/dev/nbd3"</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> ]</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> },</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> {</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "node": {</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "hostnames": {</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "manage": [</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "163.172.151.120"</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> ],</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "storage": [</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "third.ostechnix.lan"</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> ]</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> },</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "zone": 1</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> },</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "devices": [</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "/dev/nbd1",</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "/dev/nbd2",</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> "/dev/nbd3"</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> ]</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> }</font></span></div><p style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098); min-height: 14px;" class=""><font face="Monaco" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> </span><br class="webkit-block-placeholder"></font></p><p style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098); min-height: 14px;" class=""><font face="Monaco" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> </span><br class="webkit-block-placeholder"></font></p><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> ]</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> }</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""> ]</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class="">}</font></span></div></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class=""><br class=""></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class=""><br class=""></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class="">Yes, it says storage must be ip for endpoint creation. But if i change </font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class=""><br class=""></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class="">manage : hostname </font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class="">storage: ip address</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class=""><br class=""></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">{</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "clusters": [</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> {</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "nodes": [</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> {</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "node": {</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "hostnames": {</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "manage": [</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "pri.ostechnix.lan"</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> ],</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "storage": [</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "51.15.77.14"</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> ]</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> },</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "zone": 1</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> },</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "devices": [</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "/dev/nbd1",</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "/dev/nbd2",</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><span class="Apple-tab-span" style="white-space:pre"> </span> "/dev/nbd3"</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> ]</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> },</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> {</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "node": {</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "hostnames": {</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "manage": [</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "sec.ostechnix.lan"</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> ],</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "storage": [</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "51.15.90.60"</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> ]</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> },</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "zone": 1</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> },</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "devices": [</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "/dev/nbd1",</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "/dev/nbd2",</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "/dev/nbd3"</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> ]</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> },</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> {</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "node": {</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "hostnames": {</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "manage": [</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "third.ostechnix.lan"</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> ],</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "storage": [</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "163.172.151.120"</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> ]</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> },</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "zone": 1</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> },</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "devices": [</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "/dev/nbd1",</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "/dev/nbd2",</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> "/dev/nbd3"</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> ]</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> }</span></div><p style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098); min-height: 14px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> </span><br class="webkit-block-placeholder"></p><p style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098); min-height: 14px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> </span><br class="webkit-block-placeholder"></p><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> ]</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> }</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""> ]</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">}</span></div></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class=""><br class=""></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class="">i can not create volume with heketi-cli.</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class=""><br class=""></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class="">it says </font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class=""><br class=""></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class=""><div style="color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098); margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #c33720" class="">root</span><span style="font-variant-ligatures: no-common-ligatures; color: #afad24" class="">@</span><span style="font-variant-ligatures: no-common-ligatures; color: #34bbc8" class="">kubemaster </span><span style="font-variant-ligatures: no-common-ligatures; color: #afad24" class="">~/heketi </span><span style="font-variant-ligatures: no-common-ligatures; color: #d53bd3" class=""># </span><span style="font-variant-ligatures: no-common-ligatures" class="">./heketi-cli volume create --size=3 --replica=3</span></div><div style="color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098); margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class="">Error: volume create: vol_207bbf81f28b959c51448b919be3bb59: failed: Host 51.15.90.60 is not in 'Peer in Cluster’ state</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font color="#232323" class=""><br class=""></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font color="#232323" class="">i need advice how can fix this issue.</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><br class=""></div></font></span></div></body></html>