<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><font face="Monaco" class="">With hostname it's ok. But if i peer probe with public ip address error message come back again.&nbsp;</font><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class="">I removed previous&nbsp;installation then after fresh installation</font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class="">on node 1</font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@pri:/var/log/glusterfs# gluster peer probe 51.15.90.60</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">peer probe: success.&nbsp;</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@pri:/var/log/glusterfs# gluster peer probe 163.172.151.120</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">peer probe: success.</font></span></div></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class="">on node 2</font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@sec:~# gluster peer probe 51.15.77.14</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">peer probe: success. Host 51.15.77.14 port 24007 already in peer list</font></span></div></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><font face="Monaco" class=""><br class=""></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font face="Monaco" class=""><br class=""></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font face="Monaco" class="">on node 1</font></div><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244);" class=""><font face="Monaco" class=""><br class=""></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""><br class=""></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@pri:/var/log/glusterfs# gluster volume create myvol1 replica 3 transport tcp 51.15.77.14:/gluster/brick1/mpoint1 51.15.90.60:/gluster/brick1/mpoint1&nbsp; 163.172.151.120:/gluster/brick1/mpoint1 force</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">volume create: myvol1: failed: Host 51.15.77.14 is not in 'Peer in Cluster' state</font></span></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""><br class=""></font></span></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">i think /etc/hosts and hostname issue but i’m not sure how can i fix this issue.</font></span></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class="">i commented previous etc host entries for ip resolve.</font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">127.0.0.1 &nbsp; &nbsp; &nbsp; localhost</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(82, 48, 225); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">#127.0.0.1 &nbsp; &nbsp; &nbsp; pri.ostechnix.lan &nbsp; &nbsp; pri</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">::1 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; localhost ip6-localhost ip6-loopback</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">ff02::1 &nbsp; &nbsp; &nbsp; &nbsp; ip6-allnodes</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">ff02::2 &nbsp; &nbsp; &nbsp; &nbsp; ip6-allrouters</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><font face="Monaco" class=""><br class=""></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(82, 48, 225); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">#51.15.90.10&nbsp; &nbsp; &nbsp; sec.ostechnix.lan &nbsp; &nbsp; sec</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(82, 48, 225); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">#163.172.151.170&nbsp; third.ostechnix.lan &nbsp; third</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(94, 52, 255); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;</font></span></div></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""><br class=""></font></span></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">on node 1&nbsp;</font></span></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class=""><br class=""></font></span></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">root@pri:/var/log/glusterfs# gluster peer status</span></div><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Number of Peers: 2</span></div><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098); min-height: 14px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Hostname: 51.15.90.60</span></div><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Uuid: 4d0958b1-0897-4d90-9817-f035c8ac5c27</span></div><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">State: Peer in Cluster (Connected)</span></div><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098); min-height: 14px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Hostname: 163.172.151.120</span></div><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Uuid: fda09db2-d549-4431-91c7-58336ba8b27d</span></div><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures;" class="">State: Peer in Cluster (Connected)</span></div><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><br class=""></span></div><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><br class=""></span></div><div style="font-family: Monaco; margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><br class=""></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">root@pri:/var/log/glusterfs# cat glusterd.log&nbsp;</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class=""><br class=""></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:20.744742] I [MSGID: 100030] [glusterfsd.c:2476:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.11.3 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO)</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:20.753570] I [MSGID: 106478] [glusterd.c:1422:init] 0-management: Maximum allowed open file descriptors set to 65536</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:20.753615] I [MSGID: 106479] [glusterd.c:1469:init] 0-management: Using /var/lib/glusterd as working directory</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:20.760257] W [MSGID: 103071] [rdma.c:4591:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed [No such device]</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:20.760307] W [MSGID: 103055] [rdma.c:4898:init] 0-rdma.management: Failed to initialize IB Device</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:20.760331] W [rpc-transport.c:350:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:20.760407] W [rpcsvc.c:1660:rpcsvc_create_listener] 0-rpc-service: cannot create listener, initing the transport failed</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:20.760430] E [MSGID: 106243] [glusterd.c:1693:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:23.983517] E [MSGID: 101032] [store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to /var/lib/glusterd/<a href="http://glusterd.info" class="">glusterd.info</a>. [No such file or directory]</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:23.983595] E [MSGID: 101032] [store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to /var/lib/glusterd/<a href="http://glusterd.info" class="">glusterd.info</a>. [No such file or directory]</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:23.983599] I [MSGID: 106514] [glusterd-store.c:2215:glusterd_restore_op_version] 0-management: Detected new install. Setting op-version to maximum : 31100</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:23.983654] E [MSGID: 101032] [store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to /var/lib/glusterd/options. [No such file or directory]</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:23.987234] I [MSGID: 106194] [glusterd-store.c:3772:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list.</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">Final graph:</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">+------------------------------------------------------------------------------+</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;&nbsp;1: volume management</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;&nbsp;2:&nbsp;&nbsp; &nbsp;&nbsp;type mgmt/glusterd</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;&nbsp;3:&nbsp;&nbsp; &nbsp;&nbsp;option rpc-auth.auth-glusterfs on</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;&nbsp;4:&nbsp;&nbsp; &nbsp;&nbsp;option rpc-auth.auth-unix on</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;&nbsp;5:&nbsp;&nbsp; &nbsp;&nbsp;option rpc-auth.auth-null on</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;&nbsp;6:&nbsp;&nbsp; &nbsp;&nbsp;option rpc-auth-allow-insecure on</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;&nbsp;7:&nbsp;&nbsp; &nbsp;&nbsp;option transport.socket.listen-backlog 128</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;&nbsp;8:&nbsp;&nbsp; &nbsp;&nbsp;option event-threads 1</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;&nbsp;9:&nbsp;&nbsp; &nbsp;&nbsp;option ping-timeout 0</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;10:&nbsp;&nbsp; &nbsp;&nbsp;option transport.socket.read-fail-log off</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;11:&nbsp;&nbsp; &nbsp;&nbsp;option transport.socket.keepalive-interval 2</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;12:&nbsp;&nbsp; &nbsp;&nbsp;option transport.socket.keepalive-time 10</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;13:&nbsp;&nbsp; &nbsp;&nbsp;option transport-type rdma</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;14:&nbsp;&nbsp; &nbsp;&nbsp;option working-directory /var/lib/glusterd</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;15: end-volume</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">&nbsp;16:&nbsp;&nbsp;</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">+------------------------------------------------------------------------------+</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:03:23.987671] I [MSGID: 101190] [event-epoll.c:602:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.506078] I [MSGID: 106487] [glusterd-handler.c:1242:__glusterd_handle_cli_probe] 0-glusterd: Received CLI probe req 51.15.90.60 24007</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.506808] I [MSGID: 106129] [glusterd-handler.c:3623:glusterd_probe_begin] 0-glusterd: Unable to find peerinfo for host: 51.15.90.60 (24007)</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.510993] W [MSGID: 106062] [glusterd-handler.c:3399:glusterd_transport_inet_options_build] 0-glusterd: Failed to get tcp-user-timeout</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.511039] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.511210] W [MSGID: 101002] [options.c:954:xl_opt_validate] 0-management: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.511930] I [MSGID: 106498] [glusterd-handler.c:3549:glusterd_friend_add] 0-management: connect returned 0</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.524806] E [MSGID: 101032] [store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to /var/lib/glusterd/<a href="http://glusterd.info" class="">glusterd.info</a>. [No such file or directory]</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.524931] I [MSGID: 106477] [glusterd.c:190:glusterd_uuid_generate_save] 0-management: generated UUID: 9a482152-68f6-4909-94ef-73ef6f2aaeeb</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.607450] I [MSGID: 106511] [glusterd-rpc-ops.c:261:__glusterd_probe_cbk] 0-management: Received probe resp from uuid: d66dc41b-794f-4cc6-a733-f8aecc47c7cc, host: 51.15.90.60</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.607504] I [MSGID: 106511] [glusterd-rpc-ops.c:421:__glusterd_probe_cbk] 0-glusterd: Received resp to probe req</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.659954] I [MSGID: 106493] [glusterd-rpc-ops.c:485:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: d66dc41b-794f-4cc6-a733-f8aecc47c7cc, host: 51.15.90.60, port: 0</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.672115] I [MSGID: 106163] [glusterd-handshake.c:1309:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 31100</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.683412] I [MSGID: 106490] [glusterd-handler.c:2890:__glusterd_handle_probe_query] 0-glusterd: Received probe from uuid: d66dc41b-794f-4cc6-a733-f8aecc47c7cc</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.718307] I [MSGID: 106493] [glusterd-handler.c:2953:__glusterd_handle_probe_query] 0-glusterd: Responded to 51.15.90.60, op_ret: 0, op_errno: 0, ret: 0</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.722659] I [MSGID: 106490] [glusterd-handler.c:2539:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: d66dc41b-794f-4cc6-a733-f8aecc47c7cc</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.726852] I [MSGID: 106493] [glusterd-handler.c:3799:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 51.15.90.60 (0), ret: 0, op_ret: 0</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.734638] I [MSGID: 106492] [glusterd-handler.c:2717:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: d66dc41b-794f-4cc6-a733-f8aecc47c7cc</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.734713] I [MSGID: 106502] [glusterd-handler.c:2762:__glusterd_handle_friend_update] 0-management: Received my uuid as Friend</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:25.734812] I [MSGID: 106493] [glusterd-rpc-ops.c:700:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: d66dc41b-794f-4cc6-a733-f8aecc47c7cc</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.243191] I [MSGID: 106487] [glusterd-handler.c:1242:__glusterd_handle_cli_probe] 0-glusterd: Received CLI probe req 163.172.151.120 24007</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.244017] I [MSGID: 106129] [glusterd-handler.c:3623:glusterd_probe_begin] 0-glusterd: Unable to find peerinfo for host: 163.172.151.120 (24007)</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.248000] W [MSGID: 106062] [glusterd-handler.c:3399:glusterd_transport_inet_options_build] 0-glusterd: Failed to get tcp-user-timeout</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.248043] I [rpc-clnt.c:1059:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.248208] W [MSGID: 101002] [options.c:954:xl_opt_validate] 0-management: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.248625] I [MSGID: 106498] [glusterd-handler.c:3549:glusterd_friend_add] 0-management: connect returned 0</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.614068] I [MSGID: 106511] [glusterd-rpc-ops.c:261:__glusterd_probe_cbk] 0-management: Received probe resp from uuid: a934d4ad-b785-423d-a818-1a73b1340fc1, host: 163.172.151.120</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.614119] I [MSGID: 106511] [glusterd-rpc-ops.c:421:__glusterd_probe_cbk] 0-glusterd: Received resp to probe req</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.669768] I [MSGID: 106493] [glusterd-rpc-ops.c:485:__glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: a934d4ad-b785-423d-a818-1a73b1340fc1, host: 163.172.151.120, port: 0</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.708761] I [MSGID: 106163] [glusterd-handshake.c:1309:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 31100</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.738003] I [MSGID: 106490] [glusterd-handler.c:2890:__glusterd_handle_probe_query] 0-glusterd: Received probe from uuid: a934d4ad-b785-423d-a818-1a73b1340fc1</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.780644] I [MSGID: 106493] [glusterd-handler.c:2953:__glusterd_handle_probe_query] 0-glusterd: Responded to 163.172.151.120, op_ret: 0, op_errno: 0, ret: 0</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.801411] I [MSGID: 106490] [glusterd-handler.c:2539:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: a934d4ad-b785-423d-a818-1a73b1340fc1</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.804636] I [MSGID: 106493] [glusterd-handler.c:3799:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 163.172.151.120 (0), ret: 0, op_ret: 0</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.816462] I [MSGID: 106493] [glusterd-rpc-ops.c:700:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: d66dc41b-794f-4cc6-a733-f8aecc47c7cc</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.820849] I [MSGID: 106492] [glusterd-handler.c:2717:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: a934d4ad-b785-423d-a818-1a73b1340fc1</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.820891] I [MSGID: 106502] [glusterd-handler.c:2762:__glusterd_handle_friend_update] 0-management: Received my uuid as Friend</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:04:43.829278] I [MSGID: 106493] [glusterd-rpc-ops.c:700:__glusterd_friend_update_cbk] 0-management: Received ACC from uuid: a934d4ad-b785-423d-a818-1a73b1340fc1</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:05:45.857042] E [MSGID: 106429] [glusterd-utils.c:1156:glusterd_brickinfo_new_from_brick] 0-management: Failed to convert hostname 51.15.77.14 to uuid</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font color="#ffffff" face="Monaco" class="">[2018-02-06 21:05:45.857095] E [MSGID: 106301] [glusterd-syncop.c:1322:gd_stage_op_phase] 0-management: Staging of operation 'Volume Create' failed on localhost : Host 51.15.77.14 is not in 'Peer in Cluster' state</font></div></div><div style="font-family: Helvetica; color: rgb(0, 0, 0);" class=""><br class=""></div></span></div></span></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><br class=""></span></div><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: &quot;Helvetica Neue&quot;;" class=""><br class=""></div></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: &quot;Helvetica Neue&quot;;" class=""><br class=""></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: &quot;Helvetica Neue&quot;;" class=""><br class=""></div><div><br class=""><blockquote type="cite" class=""><div class="">On 6 Feb 2018, at 19:01, Atin Mukherjee &lt;<a href="mailto:amukherj@redhat.com" class="">amukherj@redhat.com</a>&gt; wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class=""><div class="">I'm guessing there's something wrong w.r.t address resolution on node 1. From the logs it's quite clear to me that node 1 is unable to resolve the address configured in /etc/hosts where as the other nodes do. Could you paste the gluster peer status output from all the nodes?<br class=""><br class=""></div><div class="">Also can you please check if you're able to ping "pri.ostechnix.lan" from node1 only? Does volume create go through if you use the IP instead of the hostname?<br class=""><br class=""></div><div class=""><div class=""><div class="gmail_extra"><br class=""><div class="gmail_quote">On Tue, Feb 6, 2018 at 7:31 PM, Ercan Aydoğan <span dir="ltr" class="">&lt;<a href="mailto:ercan.aydogan@gmail.com" target="_blank" class="">ercan.aydogan@gmail.com</a>&gt;</span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word;line-break:after-white-space" class=""><font style="font-size:11px" face="Monaco" class="">Hello,</font><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class=""><span style="font-size:11px" class="">i installed glusterfs 3.11.3 &nbsp;version 3 nodes ubuntu 16.04 machine. All machines have same /etc/hosts.</span></font></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font style="font-size:11px" face="Monaco" class="">node1 hostname</font></div><div class=""><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">pri.ostechnix.lan</font></span></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font style="font-size:11px" face="Monaco" class="">node2 hostname</font></div><div class=""><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">sec.ostechnix.lan</font></span></div></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font style="font-size:11px" face="Monaco" class="">node2 hostname</font></div><div class=""><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">third.ostechnix.lan&nbsp;</font></span></div></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">51.15.77.14 &nbsp; &nbsp;&nbsp;pri.ostechnix.lan &nbsp; &nbsp; pri</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">51.15.90.60&nbsp; &nbsp; &nbsp; sec.ostechnix.lan &nbsp; &nbsp; sec</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;background-color:rgba(0,0,0,0.85098)" class=""><span style="font-size:11px" class=""><span style="color:rgb(244,244,244);font-variant-ligatures:no-common-ligatures" class=""><font face="Monaco" class="">163.172.151.120&nbsp; third.ostechnix.lan &nbsp;&nbsp;</font></span><font color="#f4f4f4" face="Monaco" class="">third</font></span></div></div></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><font style="font-size:11px" face="Monaco" class="">volume create command is&nbsp;</font></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">root@pri:/var/log/glusterfs# gluster volume create myvol1 replica 2 transport tcp pri.ostechnix.lan:/gluster/<wbr class="">brick1/mpoint1 sec.ostechnix.lan:/gluster/<wbr class="">brick1/mpoint1 force</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">Replica 2 volumes are prone to split-brain. Use Arbiter or Replica 3 to avoid this. See:&nbsp; <a href="https://gluster.readthedocs.io/en/latest/Administrator%20Guide/Split%20brain%20and%20ways%20to%20deal%20with%20it/" target="_blank" class="">https://gluster.readthedocs.<wbr class="">io/en/latest/Administrator%<wbr class="">20Guide/Split%20brain%20and%<wbr class="">20ways%20to%20deal%20with%<wbr class="">20it/</a>.</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">Do you still want to continue?</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp;(y/n) y</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">volume create: myvol1: failed: Host pri.ostechnix.lan is not in 'Peer in Cluster' state</font></span></div></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><font style="font-size:11px" face="Monaco" class="">node 1 glusterd.log is here</font></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">root@pri:/var/log/glusterfs# cat glusterd.log&nbsp;</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:28:37.638373] W [glusterfsd.c:1331:cleanup_<wbr class="">and_exit] (--&gt;/lib/x86_64-linux-gnu/<wbr class="">libpthread.so.0(+0x76ba) [0x7f0232faa6ba] --&gt;/usr/sbin/glusterd(<wbr class="">glusterfs_sigwaiter+0xe5) [0x55e17938a8c5] --&gt;/usr/sbin/glusterd(cleanup_<wbr class="">and_exit+0x54) [0x55e17938a6e4] ) 0-: received signum (15), shutting down</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.260479] I [MSGID: 100030] [glusterfsd.c:2476:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.11.3 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO)</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.284367] I [MSGID: 106478] [glusterd.c:1422:init] 0-management: Maximum allowed open file descriptors set to 65536</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.284462] I [MSGID: 106479] [glusterd.c:1469:init] 0-management: Using /var/lib/glusterd as working directory</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.300804] W [MSGID: 103071] [rdma.c:4591:__gf_rdma_ctx_<wbr class="">create] 0-rpc-transport/rdma: rdma_cm event channel creation failed [No such device]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.300969] W [MSGID: 103055] [rdma.c:4898:init] 0-rdma.management: Failed to initialize IB Device</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.301098] W [rpc-transport.c:350:rpc_<wbr class="">transport_load] 0-rpc-transport: 'rdma' initialization failed</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.301190] W [rpcsvc.c:1660:rpcsvc_create_<wbr class="">listener] 0-rpc-service: cannot create listener, initing the transport failed</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.301214] E [MSGID: 106243] [glusterd.c:1693:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:44.621889] E [MSGID: 101032] [store.c:433:gf_store_handle_<wbr class="">retrieve] 0-: Path corresponding to /var/lib/glusterd/<a href="http://glusterd.info/" target="_blank" class="">glusterd.<wbr class="">info</a>. [No such file or directory]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:44.621967] E [MSGID: 101032] [store.c:433:gf_store_handle_<wbr class="">retrieve] 0-: Path corresponding to /var/lib/glusterd/<a href="http://glusterd.info/" target="_blank" class="">glusterd.<wbr class="">info</a>. [No such file or directory]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:44.621971] I [MSGID: 106514] [glusterd-store.c:2215:<wbr class="">glusterd_restore_op_version] 0-management: Detected new install. Setting op-version to maximum : 31100</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:44.625749] I [MSGID: 106194] [glusterd-store.c:3772:<wbr class="">glusterd_store_retrieve_<wbr class="">missed_snaps_list] 0-management: No missed snaps list.</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">Final graph:</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">+-----------------------------<wbr class="">------------------------------<wbr class="">-------------------+</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp; 1: volume management</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp; 2: &nbsp; &nbsp; type mgmt/glusterd</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp; 3: &nbsp; &nbsp; option rpc-auth.auth-glusterfs on</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp; 4: &nbsp; &nbsp; option rpc-auth.auth-unix on</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp; 5: &nbsp; &nbsp; option rpc-auth.auth-null on</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp; 6: &nbsp; &nbsp; option rpc-auth-allow-insecure on</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp; 7: &nbsp; &nbsp; option transport.socket.listen-<wbr class="">backlog 128</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp; 8: &nbsp; &nbsp; option event-threads 1</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp; 9: &nbsp; &nbsp; option ping-timeout 0</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp;10: &nbsp; &nbsp; option transport.socket.read-fail-log off</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp;11: &nbsp; &nbsp; option transport.socket.keepalive-<wbr class="">interval 2</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp;12: &nbsp; &nbsp; option transport.socket.keepalive-<wbr class="">time 10</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp;13: &nbsp; &nbsp; option transport-type rdma</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp;14: &nbsp; &nbsp; option working-directory /var/lib/glusterd</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp;15: end-volume</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">&nbsp;16: &nbsp;</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">+-----------------------------<wbr class="">------------------------------<wbr class="">-------------------+</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:44.628451] I [MSGID: 101190] [event-epoll.c:602:event_<wbr class="">dispatch_epoll_worker] 0-epoll: Started thread with index 1</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:46:38.530154] I [MSGID: 106487] [glusterd-handler.c:1484:__<wbr class="">glusterd_handle_cli_list_<wbr class="">friends] 0-glusterd: Received cli list req</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.745357] I [MSGID: 106487] [glusterd-handler.c:1242:__<wbr class="">glusterd_handle_cli_probe] 0-glusterd: Received CLI probe req sec.ostechnix.lan 24007</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.746465] I [MSGID: 106129] [glusterd-handler.c:3623:<wbr class="">glusterd_probe_begin] 0-glusterd: Unable to find peerinfo for host: sec.ostechnix.lan (24007)</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.751131] W [MSGID: 106062] [glusterd-handler.c:3399:<wbr class="">glusterd_transport_inet_<wbr class="">options_build] 0-glusterd: Failed to get tcp-user-timeout</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.751179] I [rpc-clnt.c:1059:rpc_clnt_<wbr class="">connection_init] 0-management: setting frame-timeout to 600</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.751345] W [MSGID: 101002] [options.c:954:xl_opt_<wbr class="">validate] 0-management: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.751902] I [MSGID: 106498] [glusterd-handler.c:3549:<wbr class="">glusterd_friend_add] 0-management: connect returned 0</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.769054] E [MSGID: 101032] [store.c:433:gf_store_handle_<wbr class="">retrieve] 0-: Path corresponding to /var/lib/glusterd/<a href="http://glusterd.info/" target="_blank" class="">glusterd.<wbr class="">info</a>. [No such file or directory]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.769160] I [MSGID: 106477] [glusterd.c:190:glusterd_uuid_<wbr class="">generate_save] 0-management: generated UUID: 476b754c-24cd-4816-a630-<wbr class="">99c1b696a9e6</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.806715] I [MSGID: 106511] [glusterd-rpc-ops.c:261:__<wbr class="">glusterd_probe_cbk] 0-management: Received probe resp from uuid: 1c041dbb-bad3-4158-97b7-<wbr class="">fe47cddadada, host: sec.ostechnix.lan</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.806764] I [MSGID: 106511] [glusterd-rpc-ops.c:421:__<wbr class="">glusterd_probe_cbk] 0-glusterd: Received resp to probe req</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.816670] I [MSGID: 106493] [glusterd-rpc-ops.c:485:__<wbr class="">glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 1c041dbb-bad3-4158-97b7-<wbr class="">fe47cddadada, host: sec.ostechnix.lan, port: 0</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.831231] I [MSGID: 106163] [glusterd-handshake.c:1309:__<wbr class="">glusterd_mgmt_hndsk_versions_<wbr class="">ack] 0-management: using the op-version 31100</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.845025] I [MSGID: 106490] [glusterd-handler.c:2890:__<wbr class="">glusterd_handle_probe_query] 0-glusterd: Received probe from uuid: 1c041dbb-bad3-4158-97b7-<wbr class="">fe47cddadada</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.845156] I [MSGID: 106493] [glusterd-handler.c:2953:__<wbr class="">glusterd_handle_probe_query] 0-glusterd: Responded to sec.ostechnix.lan, op_ret: 0, op_errno: 0, ret: 0</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.852449] I [MSGID: 106490] [glusterd-handler.c:2539:__<wbr class="">glusterd_handle_incoming_<wbr class="">friend_req] 0-glusterd: Received probe from uuid: 1c041dbb-bad3-4158-97b7-<wbr class="">fe47cddadada</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.855861] I [MSGID: 106493] [glusterd-handler.c:3799:<wbr class="">glusterd_xfer_friend_add_resp] 0-glusterd: Responded to sec.ostechnix.lan (0), ret: 0, op_ret: 0</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.863598] I [MSGID: 106492] [glusterd-handler.c:2717:__<wbr class="">glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 1c041dbb-bad3-4158-97b7-<wbr class="">fe47cddadada</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.863674] I [MSGID: 106502] [glusterd-handler.c:2762:__<wbr class="">glusterd_handle_friend_update] 0-management: Received my uuid as Friend</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.866932] I [MSGID: 106493] [glusterd-rpc-ops.c:700:__<wbr class="">glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 1c041dbb-bad3-4158-97b7-<wbr class="">fe47cddadada</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:48:28.152542] I [MSGID: 106487] [glusterd-handler.c:1484:__<wbr class="">glusterd_handle_cli_list_<wbr class="">friends] 0-glusterd: Received cli list req</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:48:57.283814] E [MSGID: 106429] [glusterd-utils.c:1156:<wbr class="">glusterd_brickinfo_new_from_<wbr class="">brick] 0-management: Failed to convert hostname pri.ostechnix.lan to uuid</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:48:57.283871] E [MSGID: 106301] [glusterd-syncop.c:1322:gd_<wbr class="">stage_op_phase] 0-management: Staging of operation 'Volume Create' failed on localhost : Host pri.ostechnix.lan is not in 'Peer in Cluster' state</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:49:33.997818] E [MSGID: 106429] [glusterd-utils.c:1156:<wbr class="">glusterd_brickinfo_new_from_<wbr class="">brick] 0-management: Failed to convert hostname pri.ostechnix.lan to uuid</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:49:33.997826] E [MSGID: 106301] [glusterd-syncop.c:1322:gd_<wbr class="">stage_op_phase] 0-management: Staging of operation 'Volume Create' failed on localhost : Host pri.ostechnix.lan is not in 'Peer in Cluster' state</font></span></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font style="font-size:11px" face="Monaco" class="">i need advice how can fix this&nbsp;issue.</font></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font style="font-size:11px" face="Monaco" class="">Thanks.</font></div><div class=""><font size="1" face="Monaco" class=""><br class=""></font></div></div></div><br class="">______________________________<wbr class="">_________________<br class="">
Gluster-users mailing list<br class="">
<a href="mailto:Gluster-users@gluster.org" class="">Gluster-users@gluster.org</a><br class="">
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank" class="">http://lists.gluster.org/<wbr class="">mailman/listinfo/gluster-users</a><br class=""></blockquote></div><br class=""></div></div></div></div>
</div></blockquote></div><br class=""></div></div></body></html>