<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:"Yu Gothic";
panose-1:2 11 4 0 0 0 0 0 0 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"\@Yu Gothic";
panose-1:2 11 4 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.hoenzb
{mso-style-name:hoenzb;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Hi Kotresh,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">[root@gluster-poc-noida repvol]# tailf /var/log/glusterfs/glusterd.log<o:p></o:p></p>
<p class="MsoNormal">[2018-09-06 07:57:03.443256] W [MSGID: 106028] [glusterd-geo-rep.c:2568:glusterd_get_statefile_name] 0-management: Config file (/var/lib/glusterd/geo-replication/glusterdist_gluster-poc-sj_gluster/gsyncd.conf) missing. Looking for template
config file (/var/lib/glusterd/geo-replication/gsyncd_template.conf) [No such file or directory]<o:p></o:p></p>
<p class="MsoNormal">[2018-09-06 07:57:03.443339] I [MSGID: 106294] [glusterd-geo-rep.c:2577:glusterd_get_statefile_name] 0-management: Using default config template(/var/lib/glusterd/geo-replication/gsyncd_template.conf).<o:p></o:p></p>
<p class="MsoNormal">[2018-09-06 07:57:03.512014] E [MSGID: 106028] [glusterd-geo-rep.c:3577:glusterd_op_stage_gsync_set] 0-management: Geo-replication session between glusterdist and gluster-poc-sj::gluster does not exist.. statefile = /var/lib/glusterd/geo-replication/glusterdist_gluster-poc-sj_gluster/monitor.status
[No such file or directory]<o:p></o:p></p>
<p class="MsoNormal">[2018-09-06 07:57:03.512049] E [MSGID: 106322] [glusterd-geo-rep.c:3778:glusterd_op_stage_gsync_set] 0-management: Geo-replication session between glusterdist and gluster-poc-sj::gluster does not exist.<o:p></o:p></p>
<p class="MsoNormal">[2018-09-06 07:57:03.512063] E [MSGID: 106301] [glusterd-syncop.c:1352:gd_stage_op_phase] 0-management: Staging of operation 'Volume Geo-replication' failed on localhost : Geo-replication session between glusterdist and gluster-poc-sj::gluster
does not exist.<o:p></o:p></p>
<p class="MsoNormal">[2018-09-06 07:57:24.869113] E [MSGID: 106316] [glusterd-geo-rep.c:2761:glusterd_verify_slave] 0-management: Not a valid slave<o:p></o:p></p>
<p class="MsoNormal">[2018-09-06 07:57:24.869289] E [MSGID: 106316] [glusterd-geo-rep.c:3152:glusterd_op_stage_gsync_create] 0-management: gluster-poc-sj::gluster is not a valid slave volume. Error: Unable to mount and fetch slave volume details. Please check
the log: /var/log/glusterfs/geo-replication/gverify-slavemnt.log<o:p></o:p></p>
<p class="MsoNormal">[2018-09-06 07:57:24.869313] E [MSGID: 106301] [glusterd-syncop.c:1352:gd_stage_op_phase] 0-management: Staging of operation 'Volume Geo-replication Create' failed on localhost : Unable to mount and fetch slave volume details. Please check
the log: /var/log/glusterfs/geo-replication/gverify-slavemnt.log<o:p></o:p></p>
<p class="MsoNormal">[2018-09-06 07:56:38.421045] I [MSGID: 106308] [glusterd-geo-rep.c:4881:glusterd_get_gsync_status_mst_slv] 0-management: geo-replication status glusterdist gluster-poc-sj::gluster : session is not active<o:p></o:p></p>
<p class="MsoNormal">[2018-09-06 07:56:38.486229] I [MSGID: 106028] [glusterd-geo-rep.c:4903:glusterd_get_gsync_status_mst_slv] 0-management: /var/lib/glusterd/geo-replication/glusterdist_gluster-poc-sj_gluster/monitor.status statefile not present. [No such
file or directory]<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">/Krishna<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><b>From:</b> Kotresh Hiremath Ravishankar <khiremat@redhat.com>
<br>
<b>Sent:</b> Thursday, September 6, 2018 1:20 PM<br>
<b>To:</b> Krishna Verma <kverma@cadence.com><br>
<b>Cc:</b> Gluster Users <gluster-users@gluster.org><br>
<b>Subject:</b> Re: [Gluster-users] Geo-Replication issue<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="color:red">EXTERNAL MAIL</span><o:p></o:p></p>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Hi Krishna,<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">glusterd log file would help here<o:p></o:p></p>
</div>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
</div>
<p class="MsoNormal">Kotresh HR<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Thu, Sep 6, 2018 at 1:02 PM, Krishna Verma <<a href="mailto:kverma@cadence.com" target="_blank">kverma@cadence.com</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hi All,<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I am getting issue in geo-replication distributed gluster volume. In a session status it shows only peer node instead of 2. And I am also not able to delete/start/stop or anything
on this session. <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:red">geo-replication distributed gluster volume “glusterdist” status</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]# gluster volume status glusterdist<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Status of volume: glusterdist<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Gluster process TCP Port RDMA Port Online Pid<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">------------------------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Brick gluster-poc-noida:/data/gluster-dist/<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">distvol 49154 0 Y 23138<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Brick noi-poc-gluster:/data/gluster-dist/di<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">stvol 49154 0 Y 14637<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Task Status of Volume glusterdist<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">------------------------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">There are no active volume tasks<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:red">Geo-replication session status
</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]# gluster volume geo-replication glusterdist gluster-poc-sj::glusterdist status<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">MASTER NODE MASTER VOL MASTER BRICK SLAVE USER SLAVE SLAVE NODE STATUS CRAWL STATUS LAST_SYNCED<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">----------------------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">noi-poc-gluster glusterdist /data/gluster-dist/distvol root gluster-poc-sj::glusterdist N/A Stopped N/A N/A<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:red">Can’t stop/start/delete the session</span>:<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]#
<span style="background:yellow">gluster volume geo-replication glusterdist gluster-poc-sj::glusterdist stop</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Staging failed on localhost. Please check the log file for more details.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">geo-replication command failed<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]#
<span style="background:yellow">gluster volume geo-replication glusterdist gluster-poc-sj::glusterdist stop force</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">pid-file entry mising in config file and template config file.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">geo-replication command failed<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]#
<span style="background:yellow">gluster volume geo-replication glusterdist gluster-poc-sj::glusterdist delete</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Staging failed on localhost. Please check the log file for more details.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">geo-replication command failed<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]#
<span style="background:yellow">gluster volume geo-replication glusterdist gluster-poc-sj::glusterdist start</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Staging failed on localhost. Please check the log file for more details.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">geo-replication command failed<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:red">gsyncd.log errors
</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[2018-09-06 06:17:21.757195] I [monitor(monitor):269:monitor] Monitor:
<span style="background:yellow">worker died before establishing connection brick=/data/gluster-dist/distvol</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[2018-09-06 06:17:32.312093] I [monitor(monitor):158:monitor] Monitor: starting gsyncd worker brick=/data/gluster-dist/distvol slave_node=gluster-poc-sj<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[2018-09-06 06:17:32.441817] I [monitor(monitor):261:monitor] Monitor:
<span style="background:yellow">Changelog Agent died, Aborting Worker brick=/data/gluster-dist/distvol</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[2018-09-06 06:17:32.442193] I [monitor(monitor):279:monitor] Monitor: worker died in startup phase brick=/data/gluster-dist/distvol<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[2018-09-06 06:17:43.1177] I [monitor(monitor):158:monitor] Monitor: starting gsyncd worker brick=/data/gluster-dist/distvol slave_node=gluster-poc-sj<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[2018-09-06 06:17:43.137794] I [monitor(monitor):261:monitor] Monitor: Changelog Agent died, Aborting Worker brick=/data/gluster-dist/distvol<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[2018-09-06 06:17:43.138214] I [monitor(monitor):279:monitor] Monitor: worker died in startup phase brick=/data/gluster-dist/distvol<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[2018-09-06 06:17:53.144072] I [monitor(monitor):158:monitor] Monitor: starting gsyncd worker brick=/data/gluster-dist/distvol slave_node=gluster-poc-sj<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[2018-09-06 06:17:53.276853] I [monitor(monitor):261:monitor] Monitor: Changelog Agent died, Aborting Worker brick=/data/gluster-dist/distvol<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[2018-09-06 06:17:53.277327] I [monitor(monitor):279:monitor] Monitor: worker died in startup phase brick=/data/gluster-dist/distvol<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Could anyone please help?<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#888888"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#888888">/Krishna<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#888888"> <o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.gluster.org_mailman_listinfo_gluster-2Dusers&d=DwMFaQ&c=aUq983L2pue2FqKFoP6PGHMJQyoJ7kl3s3GZ-_haXqY&r=0E5nRoxLsT2ZXgCpJM_6ZItAWQ2jH8rVLG6tiXhoLFE&m=zfrxmLB-zXT7RSou-WQ9fI9aIoumCEbWelm3E2GuwQo&s=QXfkhcIvtb7xfvCBJ3HvqbnW_1eizMd8D1TEyDO75tc&e=" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<br>
-- <o:p></o:p></p>
<div>
<div>
<div>
<p class="MsoNormal">Thanks and Regards,<o:p></o:p></p>
</div>
<p class="MsoNormal">Kotresh H R<o:p></o:p></p>
</div>
</div>
</div>
</div>
</body>
</html>