<div dir="ltr">Hi Dmitry,<div><br></div><div>How many nodes does the cluster have ?</div><div><br></div><div>If the quorum is lost (majority of nodes are down), additional recovery steps are necessary to bring it back up:</div><div><a href="https://github.com/gluster/glusterd2/wiki/Recovery">https://github.com/gluster/glusterd2/wiki/Recovery</a><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Apr 4, 2018 at 11:08 AM, Dmitry Melekhov <span dir="ltr">&lt;<a href="mailto:dm@belkam.com" target="_blank">dm@belkam.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hello!<br>
<br>
Installed packages from SIG on centos7 ,<br>
<br>
at first start it works, but after restart- not:<br>
<br>
<br>
 glusterd2 --config /etc/glusterd2/glusterd2.toml<br>
DEBU[2018-04-04 09:28:16.945267] Starting GlusterD                      <wbr>       pid=221581 source=&quot;[main.go:55:main.main]<wbr>&quot; version=v4.0.0-0<br>
INFO[2018-04-04 09:28:16.945824] loaded configuration from file                file=/etc/glusterd2/glusterd2.<wbr>toml source=&quot;[config.go:163:<a href="http://main.in">main.in</a><wbr>itConfig]&quot;<br>
DEBU[2018-04-04 09:28:16.946343] running with configuration                 <wbr>   cert-file= clientaddress=&quot;<a href="http://192.168.222.24:24007" rel="noreferrer" target="_blank">192.168.222.24:<wbr>24007</a>&quot; config=/etc/glusterd2/glusterd<wbr>2.toml defaultpeerport=24008 etcdcurls=&quot;<a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">http://192.168.222.<wbr>24:2379</a>&quot; etcdendpoints=&quot;[]&quot; etcdpurls=&quot;<a href="http://192.168.222.24:2380" rel="noreferrer" target="_blank">http://192.168.222.<wbr>24:2380</a>&quot; key-file= localstatedir=/var/lib/gluster<wbr>d2 logdir=/var/log/glusterd2 logfile=glusterd2.log loglevel=debug noembed=false peeraddress=&quot;<a href="http://192.168.222.24:24008" rel="noreferrer" target="_blank">192.168.222.24:24<wbr>008</a>&quot; rundir=/usr/var/run/glusterd2 source=&quot;[config.go:129:main.du<wbr>mpConfigToLog]&quot; statedump=true version=false workdir=/etc/glusterd2<br>
DEBU[2018-04-04 09:28:17.067244] loading templates source=&quot;[template.go:64:volgen<wbr>.LoadTemplates]&quot; templatesdir=<br>
DEBU[2018-04-04 09:28:17.068207] generated default templates source=&quot;[template.go:82:volgen<wbr>.LoadTemplates]&quot; templates=&quot;[brick.graph distreplicate.graph fuse.graph distribute.graph replicate.graph disperse.graph]&quot;<br>
DEBU[2018-04-04 09:28:17.068361] loaded template source=&quot;[template.go:102:volge<wbr>n.LoadTemplate]&quot; template=brick.graph<br>
DEBU[2018-04-04 09:28:17.068450] loaded template source=&quot;[template.go:102:volge<wbr>n.LoadTemplate]&quot; template=distreplicate.graph<br>
DEBU[2018-04-04 09:28:17.068539] loaded template source=&quot;[template.go:102:volge<wbr>n.LoadTemplate]&quot; template=fuse.graph<br>
DEBU[2018-04-04 09:28:17.068621] loaded template source=&quot;[template.go:102:volge<wbr>n.LoadTemplate]&quot; template=distribute.graph<br>
DEBU[2018-04-04 09:28:17.068798] loaded template source=&quot;[template.go:102:volge<wbr>n.LoadTemplate]&quot; template=replicate.graph<br>
DEBU[2018-04-04 09:28:17.068878] loaded template source=&quot;[template.go:102:volge<wbr>n.LoadTemplate]&quot; template=disperse.graph<br>
DEBU[2018-04-04 09:28:17.069316] saving updated store config                   source=&quot;[config.go:166:store.G<wbr>etConfig]&quot;<br>
DEBU[2018-04-04 09:28:17.069745] starting embedded store                       cafile= certfile= curls=&quot;<a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">http://192.168.222.24:2<wbr>379</a>&quot; datadir=/var/lib/glusterd2/sto<wbr>re endpoints=&quot;<a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">http://192.168.222.<wbr>24:2379</a>&quot; keyfile= logdir=/var/log/glusterd2/stor<wbr>e name=10641b8a-7135-4694-9b90-9<wbr>55827c8eba9 purls=&quot;<a href="http://192.168.222.24:2380" rel="noreferrer" target="_blank">http://192.168.222.24:2<wbr>380</a>&quot; source=&quot;[embed.go:32:store.new<wbr>EmbedStore]&quot; trustedcafile=<br>
2018-04-04 09:28:17.071331 I | etcdserver/api/v3rpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = &quot;transport: dial tcp <a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">192.168.222.24:2379</a>: getsockopt: connection refused&quot;; Reconnecting to {<a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">192.168.222.24:2379</a> &lt;nil&gt;}<br>
2018-04-04 09:28:18.071206 I | etcdserver/api/v3rpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = &quot;transport: dial tcp <a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">192.168.222.24:2379</a>: getsockopt: connection refused&quot;; Reconnecting to {<a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">192.168.222.24:2379</a> &lt;nil&gt;}<br>
2018-04-04 09:28:19.681081 I | etcdserver/api/v3rpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = &quot;transport: dial tcp <a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">192.168.222.24:2379</a>: getsockopt: connection refused&quot;; Reconnecting to {<a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">192.168.222.24:2379</a> &lt;nil&gt;}<br>
2018-04-04 09:28:22.070811 I | etcdserver/api/v3rpc: Failed to dial <a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">192.168.222.24:2379</a>: context canceled; please retry.<br>
ERRO[2018-04-04 09:28:22.070891] failed to start embedded store                error=&quot;dial tcp <a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">192.168.222.24:2379</a>: getsockopt: connection refused&quot; source=&quot;[embed.go:36:store.new<wbr>EmbedStore]&quot;<br>
FATA[2018-04-04 09:28:22.071038] Failed to initialize store (etcd client)      error=&quot;dial tcp <a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">192.168.222.24:2379</a>: getsockopt: connection refused&quot; source=&quot;[main.go:89:main.main]<wbr>&quot;<br>
<br>
<br>
cat glusterd2.toml<br>
localstatedir = &quot;/var/lib/glusterd2&quot;<br>
logdir = &quot;/var/log/glusterd2&quot;<br>
logfile = &quot;glusterd2.log&quot;<br>
rundir = &quot;/usr/var/run/glusterd2&quot;<br>
peeraddress = &quot;<a href="http://192.168.222.24:24008" rel="noreferrer" target="_blank">192.168.222.24:24008</a>&quot;<br>
clientaddress = &quot;<a href="http://192.168.222.24:24007" rel="noreferrer" target="_blank">192.168.222.24:24007</a>&quot;<br>
etcdcurls = &quot;<a href="http://192.168.222.24:2379" rel="noreferrer" target="_blank">http://192.168.222.24:2379</a>&quot;<br>
etcdpurls = &quot;<a href="http://192.168.222.24:2380" rel="noreferrer" target="_blank">http://192.168.222.24:2380</a>&quot;<br>
<br>
<br>
Any ideas?<br>
<br>
<br>
Thank you!<br>
<br>
<br>
<br>
<br>
______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-users</a></blockquote></div><br></div>