<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><font face="Monaco" class="">Yes,</font><div class=""><font face="Monaco" class="">on node2 </font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@sec:~# gluster peer probe pri.ostechnix.lan</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">peer probe: success. Host pri.ostechnix.lan port 24007 already in peer list</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@sec:~# gluster peer status</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Number of Peers: 1</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098); min-height: 14px;" class=""><font face="Monaco" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Hostname: pri.ostechnix.lan</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">Uuid: 476b754c-24cd-4816-a630-99c1b696a9e6</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">State: Peer in Cluster (Connected)</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class="">root@sec:~# </font></span></div></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><br class=""></span></div><div class=""><br class=""></div><div class=""> <br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On 6 Feb 2018, at 17:05, Serkan Çoban <<a href="mailto:cobanserkan@gmail.com" class="">cobanserkan@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class="">Did you do gluster peer probe? Check out the documentation:<br class=""><a href="http://docs.gluster.org/en/latest/Administrator%20Guide/Storage%20Pools/" class="">http://docs.gluster.org/en/latest/Administrator%20Guide/Storage%20Pools/</a><br class=""><br class="">On Tue, Feb 6, 2018 at 5:01 PM, Ercan Aydoğan <ercan.aydogan@gmail.com> wrote:<br class=""><blockquote type="cite" class="">Hello,<br class=""><br class="">i installed glusterfs 3.11.3 version 3 nodes ubuntu 16.04 machine. All<br class="">machines have same /etc/hosts.<br class=""><br class="">node1 hostname<br class="">pri.ostechnix.lan<br class=""><br class="">node2 hostname<br class="">sec.ostechnix.lan<br class=""><br class="">node2 hostname<br class="">third.ostechnix.lan<br class=""><br class=""><br class="">51.15.77.14 pri.ostechnix.lan pri<br class="">51.15.90.60 sec.ostechnix.lan sec<br class="">163.172.151.120 third.ostechnix.lan third<br class=""><br class="">volume create command is<br class=""><br class="">root@pri:/var/log/glusterfs# gluster volume create myvol1 replica 2<br class="">transport tcp pri.ostechnix.lan:/gluster/brick1/mpoint1<br class="">sec.ostechnix.lan:/gluster/brick1/mpoint1 force<br class="">Replica 2 volumes are prone to split-brain. Use Arbiter or Replica 3 to<br class="">avoid this. See:<br class="">https://gluster.readthedocs.io/en/latest/Administrator%20Guide/Split%20brain%20and%20ways%20to%20deal%20with%20it/.<br class="">Do you still want to continue?<br class=""> (y/n) y<br class="">volume create: myvol1: failed: Host pri.ostechnix.lan is not in 'Peer in<br class="">Cluster' state<br class=""><br class="">node 1 glusterd.log is here<br class=""><br class="">root@pri:/var/log/glusterfs# cat glusterd.log<br class="">[2018-02-06 13:28:37.638373] W [glusterfsd.c:1331:cleanup_and_exit]<br class="">(-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f0232faa6ba]<br class="">-->/usr/sbin/glusterd(glusterfs_sigwaiter+0xe5) [0x55e17938a8c5]<br class="">-->/usr/sbin/glusterd(cleanup_and_exit+0x54) [0x55e17938a6e4] ) 0-: received<br class="">signum (15), shutting down<br class="">[2018-02-06 13:29:41.260479] I [MSGID: 100030] [glusterfsd.c:2476:main]<br class="">0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.11.3<br class="">(args: /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO)<br class="">[2018-02-06 13:29:41.284367] I [MSGID: 106478] [glusterd.c:1422:init]<br class="">0-management: Maximum allowed open file descriptors set to 65536<br class="">[2018-02-06 13:29:41.284462] I [MSGID: 106479] [glusterd.c:1469:init]<br class="">0-management: Using /var/lib/glusterd as working directory<br class="">[2018-02-06 13:29:41.300804] W [MSGID: 103071]<br class="">[rdma.c:4591:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event<br class="">channel creation failed [No such device]<br class="">[2018-02-06 13:29:41.300969] W [MSGID: 103055] [rdma.c:4898:init]<br class="">0-rdma.management: Failed to initialize IB Device<br class="">[2018-02-06 13:29:41.301098] W [rpc-transport.c:350:rpc_transport_load]<br class="">0-rpc-transport: 'rdma' initialization failed<br class="">[2018-02-06 13:29:41.301190] W [rpcsvc.c:1660:rpcsvc_create_listener]<br class="">0-rpc-service: cannot create listener, initing the transport failed<br class="">[2018-02-06 13:29:41.301214] E [MSGID: 106243] [glusterd.c:1693:init]<br class="">0-management: creation of 1 listeners failed, continuing with succeeded<br class="">transport<br class="">[2018-02-06 13:29:44.621889] E [MSGID: 101032]<br class="">[store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to<br class="">/var/lib/glusterd/glusterd.info. [No such file or directory]<br class="">[2018-02-06 13:29:44.621967] E [MSGID: 101032]<br class="">[store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to<br class="">/var/lib/glusterd/glusterd.info. [No such file or directory]<br class="">[2018-02-06 13:29:44.621971] I [MSGID: 106514]<br class="">[glusterd-store.c:2215:glusterd_restore_op_version] 0-management: Detected<br class="">new install. Setting op-version to maximum : 31100<br class="">[2018-02-06 13:29:44.625749] I [MSGID: 106194]<br class="">[glusterd-store.c:3772:glusterd_store_retrieve_missed_snaps_list]<br class="">0-management: No missed snaps list.<br class="">Final graph:<br class="">+------------------------------------------------------------------------------+<br class=""> 1: volume management<br class=""> 2: type mgmt/glusterd<br class=""> 3: option rpc-auth.auth-glusterfs on<br class=""> 4: option rpc-auth.auth-unix on<br class=""> 5: option rpc-auth.auth-null on<br class=""> 6: option rpc-auth-allow-insecure on<br class=""> 7: option transport.socket.listen-backlog 128<br class=""> 8: option event-threads 1<br class=""> 9: option ping-timeout 0<br class=""> 10: option transport.socket.read-fail-log off<br class=""> 11: option transport.socket.keepalive-interval 2<br class=""> 12: option transport.socket.keepalive-time 10<br class=""> 13: option transport-type rdma<br class=""> 14: option working-directory /var/lib/glusterd<br class=""> 15: end-volume<br class=""> 16:<br class="">+------------------------------------------------------------------------------+<br class="">[2018-02-06 13:29:44.628451] I [MSGID: 101190]<br class="">[event-epoll.c:602:event_dispatch_epoll_worker] 0-epoll: Started thread with<br class="">index 1<br class="">[2018-02-06 13:46:38.530154] I [MSGID: 106487]<br class="">[glusterd-handler.c:1484:__glusterd_handle_cli_list_friends] 0-glusterd:<br class="">Received cli list req<br class="">[2018-02-06 13:47:05.745357] I [MSGID: 106487]<br class="">[glusterd-handler.c:1242:__glusterd_handle_cli_probe] 0-glusterd: Received<br class="">CLI probe req sec.ostechnix.lan 24007<br class="">[2018-02-06 13:47:05.746465] I [MSGID: 106129]<br class="">[glusterd-handler.c:3623:glusterd_probe_begin] 0-glusterd: Unable to find<br class="">peerinfo for host: sec.ostechnix.lan (24007)<br class="">[2018-02-06 13:47:05.751131] W [MSGID: 106062]<br class="">[glusterd-handler.c:3399:glusterd_transport_inet_options_build] 0-glusterd:<br class="">Failed to get tcp-user-timeout<br class="">[2018-02-06 13:47:05.751179] I [rpc-clnt.c:1059:rpc_clnt_connection_init]<br class="">0-management: setting frame-timeout to 600<br class="">[2018-02-06 13:47:05.751345] W [MSGID: 101002]<br class="">[options.c:954:xl_opt_validate] 0-management: option 'address-family' is<br class="">deprecated, preferred is 'transport.address-family', continuing with<br class="">correction<br class="">[2018-02-06 13:47:05.751902] I [MSGID: 106498]<br class="">[glusterd-handler.c:3549:glusterd_friend_add] 0-management: connect returned<br class="">0<br class="">[2018-02-06 13:47:05.769054] E [MSGID: 101032]<br class="">[store.c:433:gf_store_handle_retrieve] 0-: Path corresponding to<br class="">/var/lib/glusterd/glusterd.info. [No such file or directory]<br class="">[2018-02-06 13:47:05.769160] I [MSGID: 106477]<br class="">[glusterd.c:190:glusterd_uuid_generate_save] 0-management: generated UUID:<br class="">476b754c-24cd-4816-a630-99c1b696a9e6<br class="">[2018-02-06 13:47:05.806715] I [MSGID: 106511]<br class="">[glusterd-rpc-ops.c:261:__glusterd_probe_cbk] 0-management: Received probe<br class="">resp from uuid: 1c041dbb-bad3-4158-97b7-fe47cddadada, host:<br class="">sec.ostechnix.lan<br class="">[2018-02-06 13:47:05.806764] I [MSGID: 106511]<br class="">[glusterd-rpc-ops.c:421:__glusterd_probe_cbk] 0-glusterd: Received resp to<br class="">probe req<br class="">[2018-02-06 13:47:05.816670] I [MSGID: 106493]<br class="">[glusterd-rpc-ops.c:485:__glusterd_friend_add_cbk] 0-glusterd: Received ACC<br class="">from uuid: 1c041dbb-bad3-4158-97b7-fe47cddadada, host: sec.ostechnix.lan,<br class="">port: 0<br class="">[2018-02-06 13:47:05.831231] I [MSGID: 106163]<br class="">[glusterd-handshake.c:1309:__glusterd_mgmt_hndsk_versions_ack] 0-management:<br class="">using the op-version 31100<br class="">[2018-02-06 13:47:05.845025] I [MSGID: 106490]<br class="">[glusterd-handler.c:2890:__glusterd_handle_probe_query] 0-glusterd: Received<br class="">probe from uuid: 1c041dbb-bad3-4158-97b7-fe47cddadada<br class="">[2018-02-06 13:47:05.845156] I [MSGID: 106493]<br class="">[glusterd-handler.c:2953:__glusterd_handle_probe_query] 0-glusterd:<br class="">Responded to sec.ostechnix.lan, op_ret: 0, op_errno: 0, ret: 0<br class="">[2018-02-06 13:47:05.852449] I [MSGID: 106490]<br class="">[glusterd-handler.c:2539:__glusterd_handle_incoming_friend_req] 0-glusterd:<br class="">Received probe from uuid: 1c041dbb-bad3-4158-97b7-fe47cddadada<br class="">[2018-02-06 13:47:05.855861] I [MSGID: 106493]<br class="">[glusterd-handler.c:3799:glusterd_xfer_friend_add_resp] 0-glusterd:<br class="">Responded to sec.ostechnix.lan (0), ret: 0, op_ret: 0<br class="">[2018-02-06 13:47:05.863598] I [MSGID: 106492]<br class="">[glusterd-handler.c:2717:__glusterd_handle_friend_update] 0-glusterd:<br class="">Received friend update from uuid: 1c041dbb-bad3-4158-97b7-fe47cddadada<br class="">[2018-02-06 13:47:05.863674] I [MSGID: 106502]<br class="">[glusterd-handler.c:2762:__glusterd_handle_friend_update] 0-management:<br class="">Received my uuid as Friend<br class="">[2018-02-06 13:47:05.866932] I [MSGID: 106493]<br class="">[glusterd-rpc-ops.c:700:__glusterd_friend_update_cbk] 0-management: Received<br class="">ACC from uuid: 1c041dbb-bad3-4158-97b7-fe47cddadada<br class="">[2018-02-06 13:48:28.152542] I [MSGID: 106487]<br class="">[glusterd-handler.c:1484:__glusterd_handle_cli_list_friends] 0-glusterd:<br class="">Received cli list req<br class="">[2018-02-06 13:48:57.283814] E [MSGID: 106429]<br class="">[glusterd-utils.c:1156:glusterd_brickinfo_new_from_brick] 0-management:<br class="">Failed to convert hostname pri.ostechnix.lan to uuid<br class="">[2018-02-06 13:48:57.283871] E [MSGID: 106301]<br class="">[glusterd-syncop.c:1322:gd_stage_op_phase] 0-management: Staging of<br class="">operation 'Volume Create' failed on localhost : Host pri.ostechnix.lan is<br class="">not in 'Peer in Cluster' state<br class="">[2018-02-06 13:49:33.997818] E [MSGID: 106429]<br class="">[glusterd-utils.c:1156:glusterd_brickinfo_new_from_brick] 0-management:<br class="">Failed to convert hostname pri.ostechnix.lan to uuid<br class="">[2018-02-06 13:49:33.997826] E [MSGID: 106301]<br class="">[glusterd-syncop.c:1322:gd_stage_op_phase] 0-management: Staging of<br class="">operation 'Volume Create' failed on localhost : Host pri.ostechnix.lan is<br class="">not in 'Peer in Cluster' state<br class=""><br class="">i need advice how can fix this issue.<br class=""><br class="">Thanks.<br class=""><br class=""><br class="">_______________________________________________<br class="">Gluster-users mailing list<br class="">Gluster-users@gluster.org<br class="">http://lists.gluster.org/mailman/listinfo/gluster-users<br class=""></blockquote></div></div></blockquote></div><br class=""></div></body></html>