<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><font face="Monaco" class="">I forgot to say i called after </font><div class=""><br class=""></div><div class=""><div class=""><blockquote type="cite" class=""><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div class=""><div class=""><div class=""><div class="" style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);"><div class="" style="margin: 0px; font-stretch: normal; line-height: normal;"><span class="" style="font-variant-ligatures: no-common-ligatures;"><font face="Monaco" class="">root@pri:~# gluster peer probe third.ostechnix.lan</font></span></div></div></div></div></div></div></blockquote></div></div><div class=""><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div class=""><div class=""><div class=""><div class="" style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);"><div class="" style="margin: 0px; font-stretch: normal; line-height: normal;"><span class="" style="font-variant-ligatures: no-common-ligatures;"><font face="Monaco" class=""><br class=""></font></span></div></div></div></div></div></div></div><div class=""><br class=""><div class=""><div class=""><span style="font-family: Monaco;" class=""> node 2 terminal</span></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><blockquote type="cite" class=""><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div class=""><div class=""><div class=""><div class="" style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);"><div class="" style="margin: 0px; font-stretch: normal; line-height: normal;"><span class="" style="font-variant-ligatures: no-common-ligatures;"><font face="Monaco" class="">root@sec:~# gluster peer probe pri.ostechnix.lan</font></span></div></div></div></div></div></div></blockquote></div><div class=""><font face="Monaco" class=""><br class=""></font></div><font face="Monaco" class="">and i checked firewall rules still is valid after reboot.</font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class="">i used </font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">apt-get install iptables-persistent</font></span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class="">etfilter-persistent save</font></span></div><div><br class=""></div><div><br class=""><blockquote type="cite" class=""><div class="">On 6 Feb 2018, at 19:37, Ercan Aydoğan <<a href="mailto:ercan.aydogan@gmail.com" class="">ercan.aydogan@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html; charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><font face="Monaco" class="">I changed /etc/hosts</font><div class=""><font face="Monaco" class=""><br class=""></font><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">127.0.0.1 pri.ostechnix.lan pri</font></span></div></div><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">51.15.90.60 sec.ostechnix.lan sec</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">163.172.151.120 third.ostechnix.lan third</font></span></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class="">on every node matching hostname to 127.0.0.1</font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class="">then </font></div><div class=""><font face="Monaco" class=""><br class=""></font></div><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@pri:~# apt-get purge glusterfs-server</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@pri:~# rm -rf /var/lib/glusterd/</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@pri:~# rm -rf /var/log/glusterfs/</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@pri:~# apt-get install glusterfs-server</font></span></div></div><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@pri:~# apt-mark hold glusterfs*</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><font face="Monaco" class="">root@pri:~# reboot now</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@pri:~# gluster peer probe sec.ostechnix.lan</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">peer probe: success.</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@pri:~# gluster peer probe third.ostechnix.lan</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">peer probe: success.</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@pri:/var/log/glusterfs# gluster volume create myvol1 replica 3 transport tcp pri.ostechnix.lan:/gluster/brick1/mpoint1 sec.ostechnix.lan:/gluster/brick1/mpoint1 third.ostechnix.lan:/gluster/brick1/mpoint1 force</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">volume create: myvol1: success: please start the volume to access data </font></span></div></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244);" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font face="Monaco" class=""><br class=""></font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font face="Monaco" class=""><br class=""></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font face="Monaco" class="">and volume created</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">root@pri:~# gluster volume list</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; color: rgb(244, 244, 244); background-color: rgba(0, 0, 0, 0.85098);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><font face="Monaco" class="">myvol1</font></span></div></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font face="Monaco" class=""><br class=""></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font face="Monaco" class="">Thank you @Serkan and @Atin</font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font face="Monaco" class=""><br class=""></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><br class=""></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font face="Monaco" class=""><br class=""></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font face="Monaco" class=""><br class=""></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><font face="Monaco" class=""><br class=""></font></div><blockquote type="cite" class=""><div class="">On 6 Feb 2018, at 19:01, Atin Mukherjee <<a href="mailto:amukherj@redhat.com" class="">amukherj@redhat.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class=""><div class="">I'm guessing there's something wrong w.r.t address resolution on node 1. From the logs it's quite clear to me that node 1 is unable to resolve the address configured in /etc/hosts where as the other nodes do. Could you paste the gluster peer status output from all the nodes?<br class=""><br class=""></div><div class="">Also can you please check if you're able to ping "pri.ostechnix.lan" from node1 only? Does volume create go through if you use the IP instead of the hostname?<br class=""><br class=""></div><div class=""><div class=""><div class="gmail_extra"><br class=""><div class="gmail_quote">On Tue, Feb 6, 2018 at 7:31 PM, Ercan Aydoğan <span dir="ltr" class=""><<a href="mailto:ercan.aydogan@gmail.com" target="_blank" class="">ercan.aydogan@gmail.com</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word;line-break:after-white-space" class=""><font style="font-size:11px" face="Monaco" class="">Hello,</font><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font face="Monaco" class=""><span style="font-size:11px" class="">i installed glusterfs 3.11.3 version 3 nodes ubuntu 16.04 machine. All machines have same /etc/hosts.</span></font></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font style="font-size:11px" face="Monaco" class="">node1 hostname</font></div><div class=""><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">pri.ostechnix.lan</font></span></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font style="font-size:11px" face="Monaco" class="">node2 hostname</font></div><div class=""><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">sec.ostechnix.lan</font></span></div></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font style="font-size:11px" face="Monaco" class="">node2 hostname</font></div><div class=""><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">third.ostechnix.lan </font></span></div></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">51.15.77.14 pri.ostechnix.lan pri</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">51.15.90.60 sec.ostechnix.lan sec</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;background-color:rgba(0,0,0,0.85098)" class=""><span style="font-size:11px" class=""><span style="color:rgb(244,244,244);font-variant-ligatures:no-common-ligatures" class=""><font face="Monaco" class="">163.172.151.120 third.ostechnix.lan </font></span><font color="#f4f4f4" face="Monaco" class="">third</font></span></div></div></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><font style="font-size:11px" face="Monaco" class="">volume create command is </font></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">root@pri:/var/log/glusterfs# gluster volume create myvol1 replica 2 transport tcp pri.ostechnix.lan:/gluster/<wbr class="">brick1/mpoint1 sec.ostechnix.lan:/gluster/<wbr class="">brick1/mpoint1 force</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">Replica 2 volumes are prone to split-brain. Use Arbiter or Replica 3 to avoid this. See: <a href="https://gluster.readthedocs.io/en/latest/Administrator%20Guide/Split%20brain%20and%20ways%20to%20deal%20with%20it/" target="_blank" class="">https://gluster.readthedocs.<wbr class="">io/en/latest/Administrator%<wbr class="">20Guide/Split%20brain%20and%<wbr class="">20ways%20to%20deal%20with%<wbr class="">20it/</a>.</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">Do you still want to continue?</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> (y/n) y</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">volume create: myvol1: failed: Host pri.ostechnix.lan is not in 'Peer in Cluster' state</font></span></div></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><font style="font-size:11px" face="Monaco" class="">node 1 glusterd.log is here</font></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div style="margin:0px;font-stretch:normal;line-height:normal" class=""><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">root@pri:/var/log/glusterfs# cat glusterd.log </font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:28:37.638373] W [glusterfsd.c:1331:cleanup_<wbr class="">and_exit] (-->/lib/x86_64-linux-gnu/<wbr class="">libpthread.so.0(+0x76ba) [0x7f0232faa6ba] -->/usr/sbin/glusterd(<wbr class="">glusterfs_sigwaiter+0xe5) [0x55e17938a8c5] -->/usr/sbin/glusterd(cleanup_<wbr class="">and_exit+0x54) [0x55e17938a6e4] ) 0-: received signum (15), shutting down</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.260479] I [MSGID: 100030] [glusterfsd.c:2476:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.11.3 (args: /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO)</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.284367] I [MSGID: 106478] [glusterd.c:1422:init] 0-management: Maximum allowed open file descriptors set to 65536</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.284462] I [MSGID: 106479] [glusterd.c:1469:init] 0-management: Using /var/lib/glusterd as working directory</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.300804] W [MSGID: 103071] [rdma.c:4591:__gf_rdma_ctx_<wbr class="">create] 0-rpc-transport/rdma: rdma_cm event channel creation failed [No such device]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.300969] W [MSGID: 103055] [rdma.c:4898:init] 0-rdma.management: Failed to initialize IB Device</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.301098] W [rpc-transport.c:350:rpc_<wbr class="">transport_load] 0-rpc-transport: 'rdma' initialization failed</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.301190] W [rpcsvc.c:1660:rpcsvc_create_<wbr class="">listener] 0-rpc-service: cannot create listener, initing the transport failed</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:41.301214] E [MSGID: 106243] [glusterd.c:1693:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:44.621889] E [MSGID: 101032] [store.c:433:gf_store_handle_<wbr class="">retrieve] 0-: Path corresponding to /var/lib/glusterd/<a href="http://glusterd.info/" target="_blank" class="">glusterd.<wbr class="">info</a>. [No such file or directory]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:44.621967] E [MSGID: 101032] [store.c:433:gf_store_handle_<wbr class="">retrieve] 0-: Path corresponding to /var/lib/glusterd/<a href="http://glusterd.info/" target="_blank" class="">glusterd.<wbr class="">info</a>. [No such file or directory]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:44.621971] I [MSGID: 106514] [glusterd-store.c:2215:<wbr class="">glusterd_restore_op_version] 0-management: Detected new install. Setting op-version to maximum : 31100</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:44.625749] I [MSGID: 106194] [glusterd-store.c:3772:<wbr class="">glusterd_store_retrieve_<wbr class="">missed_snaps_list] 0-management: No missed snaps list.</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">Final graph:</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">+-----------------------------<wbr class="">------------------------------<wbr class="">-------------------+</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 1: volume management</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 2: type mgmt/glusterd</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 3: option rpc-auth.auth-glusterfs on</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 4: option rpc-auth.auth-unix on</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 5: option rpc-auth.auth-null on</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 6: option rpc-auth-allow-insecure on</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 7: option transport.socket.listen-<wbr class="">backlog 128</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 8: option event-threads 1</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 9: option ping-timeout 0</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 10: option transport.socket.read-fail-log off</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 11: option transport.socket.keepalive-<wbr class="">interval 2</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 12: option transport.socket.keepalive-<wbr class="">time 10</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 13: option transport-type rdma</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 14: option working-directory /var/lib/glusterd</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 15: end-volume</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class=""> 16: </font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">+-----------------------------<wbr class="">------------------------------<wbr class="">-------------------+</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:29:44.628451] I [MSGID: 101190] [event-epoll.c:602:event_<wbr class="">dispatch_epoll_worker] 0-epoll: Started thread with index 1</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:46:38.530154] I [MSGID: 106487] [glusterd-handler.c:1484:__<wbr class="">glusterd_handle_cli_list_<wbr class="">friends] 0-glusterd: Received cli list req</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.745357] I [MSGID: 106487] [glusterd-handler.c:1242:__<wbr class="">glusterd_handle_cli_probe] 0-glusterd: Received CLI probe req sec.ostechnix.lan 24007</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.746465] I [MSGID: 106129] [glusterd-handler.c:3623:<wbr class="">glusterd_probe_begin] 0-glusterd: Unable to find peerinfo for host: sec.ostechnix.lan (24007)</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.751131] W [MSGID: 106062] [glusterd-handler.c:3399:<wbr class="">glusterd_transport_inet_<wbr class="">options_build] 0-glusterd: Failed to get tcp-user-timeout</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.751179] I [rpc-clnt.c:1059:rpc_clnt_<wbr class="">connection_init] 0-management: setting frame-timeout to 600</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.751345] W [MSGID: 101002] [options.c:954:xl_opt_<wbr class="">validate] 0-management: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.751902] I [MSGID: 106498] [glusterd-handler.c:3549:<wbr class="">glusterd_friend_add] 0-management: connect returned 0</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.769054] E [MSGID: 101032] [store.c:433:gf_store_handle_<wbr class="">retrieve] 0-: Path corresponding to /var/lib/glusterd/<a href="http://glusterd.info/" target="_blank" class="">glusterd.<wbr class="">info</a>. [No such file or directory]</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.769160] I [MSGID: 106477] [glusterd.c:190:glusterd_uuid_<wbr class="">generate_save] 0-management: generated UUID: 476b754c-24cd-4816-a630-<wbr class="">99c1b696a9e6</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.806715] I [MSGID: 106511] [glusterd-rpc-ops.c:261:__<wbr class="">glusterd_probe_cbk] 0-management: Received probe resp from uuid: 1c041dbb-bad3-4158-97b7-<wbr class="">fe47cddadada, host: sec.ostechnix.lan</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.806764] I [MSGID: 106511] [glusterd-rpc-ops.c:421:__<wbr class="">glusterd_probe_cbk] 0-glusterd: Received resp to probe req</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.816670] I [MSGID: 106493] [glusterd-rpc-ops.c:485:__<wbr class="">glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 1c041dbb-bad3-4158-97b7-<wbr class="">fe47cddadada, host: sec.ostechnix.lan, port: 0</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.831231] I [MSGID: 106163] [glusterd-handshake.c:1309:__<wbr class="">glusterd_mgmt_hndsk_versions_<wbr class="">ack] 0-management: using the op-version 31100</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.845025] I [MSGID: 106490] [glusterd-handler.c:2890:__<wbr class="">glusterd_handle_probe_query] 0-glusterd: Received probe from uuid: 1c041dbb-bad3-4158-97b7-<wbr class="">fe47cddadada</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.845156] I [MSGID: 106493] [glusterd-handler.c:2953:__<wbr class="">glusterd_handle_probe_query] 0-glusterd: Responded to sec.ostechnix.lan, op_ret: 0, op_errno: 0, ret: 0</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.852449] I [MSGID: 106490] [glusterd-handler.c:2539:__<wbr class="">glusterd_handle_incoming_<wbr class="">friend_req] 0-glusterd: Received probe from uuid: 1c041dbb-bad3-4158-97b7-<wbr class="">fe47cddadada</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.855861] I [MSGID: 106493] [glusterd-handler.c:3799:<wbr class="">glusterd_xfer_friend_add_resp] 0-glusterd: Responded to sec.ostechnix.lan (0), ret: 0, op_ret: 0</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.863598] I [MSGID: 106492] [glusterd-handler.c:2717:__<wbr class="">glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 1c041dbb-bad3-4158-97b7-<wbr class="">fe47cddadada</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.863674] I [MSGID: 106502] [glusterd-handler.c:2762:__<wbr class="">glusterd_handle_friend_update] 0-management: Received my uuid as Friend</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:47:05.866932] I [MSGID: 106493] [glusterd-rpc-ops.c:700:__<wbr class="">glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 1c041dbb-bad3-4158-97b7-<wbr class="">fe47cddadada</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:48:28.152542] I [MSGID: 106487] [glusterd-handler.c:1484:__<wbr class="">glusterd_handle_cli_list_<wbr class="">friends] 0-glusterd: Received cli list req</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:48:57.283814] E [MSGID: 106429] [glusterd-utils.c:1156:<wbr class="">glusterd_brickinfo_new_from_<wbr class="">brick] 0-management: Failed to convert hostname pri.ostechnix.lan to uuid</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:48:57.283871] E [MSGID: 106301] [glusterd-syncop.c:1322:gd_<wbr class="">stage_op_phase] 0-management: Staging of operation 'Volume Create' failed on localhost : Host pri.ostechnix.lan is not in 'Peer in Cluster' state</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:49:33.997818] E [MSGID: 106429] [glusterd-utils.c:1156:<wbr class="">glusterd_brickinfo_new_from_<wbr class="">brick] 0-management: Failed to convert hostname pri.ostechnix.lan to uuid</font></span></div><div style="margin:0px;font-stretch:normal;line-height:normal;color:rgb(244,244,244);background-color:rgba(0,0,0,0.85098)" class=""><span style="font-variant-ligatures:no-common-ligatures;font-size:11px" class=""><font face="Monaco" class="">[2018-02-06 13:49:33.997826] E [MSGID: 106301] [glusterd-syncop.c:1322:gd_<wbr class="">stage_op_phase] 0-management: Staging of operation 'Volume Create' failed on localhost : Host pri.ostechnix.lan is not in 'Peer in Cluster' state</font></span></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font style="font-size:11px" face="Monaco" class="">i need advice how can fix this issue.</font></div><div class=""><font style="font-size:11px" face="Monaco" class=""><br class=""></font></div><div class=""><font style="font-size:11px" face="Monaco" class="">Thanks.</font></div><div class=""><font size="1" face="Monaco" class=""><br class=""></font></div></div></div><br class="">______________________________<wbr class="">_________________<br class="">
Gluster-users mailing list<br class="">
<a href="mailto:Gluster-users@gluster.org" class="">Gluster-users@gluster.org</a><br class="">
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank" class="">http://lists.gluster.org/<wbr class="">mailman/listinfo/gluster-users</a><br class=""></blockquote></div><br class=""></div></div></div></div>
</div></blockquote></div><br class=""></div></div></div></div></blockquote></div><br class=""></div></div></body></html>