<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
        {font-family:"Yu Gothic";
        panose-1:2 11 4 0 0 0 0 0 0 0;}
@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
        {font-family:"\@Yu Gothic";
        panose-1:2 11 4 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:11.0pt;
        font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {mso-style-priority:99;
        color:purple;
        text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
        {mso-style-name:msonormal;
        mso-margin-top-alt:auto;
        margin-right:0in;
        mso-margin-bottom-alt:auto;
        margin-left:0in;
        font-size:11.0pt;
        font-family:"Calibri",sans-serif;}
span.EmailStyle19
        {mso-style-type:personal-reply;
        font-family:"Calibri",sans-serif;
        color:windowtext;}
.MsoChpDefault
        {mso-style-type:export-only;
        font-family:"Calibri",sans-serif;}
@page WordSection1
        {size:8.5in 11.0in;
        margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
        {page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Hi Kotresh,<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">Thank you so much for you input. Geo-replication is now showing “Active” atleast for 1 master node. But its still at faulty state for the 2<sup>nd</sup> master server.
<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">Below is the detail. <o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">[root@gluster-poc-noida glusterfs]# gluster volume geo-replication glusterep gluster-poc-sj::glusterep status<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">MASTER NODE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; MASTER VOL&nbsp;&nbsp;&nbsp; MASTER BRICK&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; SLAVE USER&nbsp;&nbsp;&nbsp; SLAVE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; SLAVE NODE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; STATUS&nbsp;&nbsp;&nbsp; CRAWL STATUS&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LAST_SYNCED<o:p></o:p></p>
<p class="MsoNormal">--------------------------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal">gluster-poc-noida&nbsp;&nbsp;&nbsp; glusterep&nbsp;&nbsp;&nbsp;&nbsp; /data/gluster/gv0&nbsp;&nbsp;&nbsp; root&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; gluster-poc-sj::glusterep&nbsp;&nbsp;&nbsp; gluster-poc-sj&nbsp;&nbsp;&nbsp; Active&nbsp;&nbsp;&nbsp; Changelog Crawl&nbsp;&nbsp;&nbsp; 2018-08-29 23:56:06<o:p></o:p></p>
<p class="MsoNormal">noi-poc-gluster&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; glusterep&nbsp;&nbsp;&nbsp;&nbsp; /data/gluster/gv0&nbsp;&nbsp;&nbsp; root&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; gluster-poc-sj::glusterep&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Faulty&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">[root@gluster-poc-noida glusterfs]# gluster volume status<o:p></o:p></p>
<p class="MsoNormal">Status of volume: glusterep<o:p></o:p></p>
<p class="MsoNormal">Gluster process&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;TCP Port&nbsp; RDMA Port&nbsp; Online&nbsp; Pid<o:p></o:p></p>
<p class="MsoNormal">------------------------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal">Brick gluster-poc-noida:/data/gluster/gv0&nbsp;&nbsp; 49152&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 22463<o:p></o:p></p>
<p class="MsoNormal">Brick noi-poc-gluster:/data/gluster/gv0&nbsp;&nbsp;&nbsp;&nbsp; 49152&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 19471<o:p></o:p></p>
<p class="MsoNormal">Self-heal Daemon on localhost&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 32087<o:p></o:p></p>
<p class="MsoNormal">Self-heal Daemon on noi-poc-gluster&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Y&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 6272<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">Task Status of Volume glusterep<o:p></o:p></p>
<p class="MsoNormal">------------------------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal">There are no active volume tasks<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">[root@gluster-poc-noida glusterfs]# gluster volume info<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">Volume Name: glusterep<o:p></o:p></p>
<p class="MsoNormal">Type: Replicate<o:p></o:p></p>
<p class="MsoNormal">Volume ID: 4a71bc94-14ce-4b2c-abc4-e6a9a9765161<o:p></o:p></p>
<p class="MsoNormal">Status: Started<o:p></o:p></p>
<p class="MsoNormal">Snapshot Count: 0<o:p></o:p></p>
<p class="MsoNormal">Number of Bricks: 1 x 2 = 2<o:p></o:p></p>
<p class="MsoNormal">Transport-type: tcp<o:p></o:p></p>
<p class="MsoNormal">Bricks:<o:p></o:p></p>
<p class="MsoNormal">Brick1: gluster-poc-noida:/data/gluster/gv0<o:p></o:p></p>
<p class="MsoNormal">Brick2: noi-poc-gluster:/data/gluster/gv0<o:p></o:p></p>
<p class="MsoNormal">Options Reconfigured:<o:p></o:p></p>
<p class="MsoNormal">transport.address-family: inet<o:p></o:p></p>
<p class="MsoNormal">nfs.disable: on<o:p></o:p></p>
<p class="MsoNormal">performance.client-io-threads: off<o:p></o:p></p>
<p class="MsoNormal">geo-replication.indexing: on<o:p></o:p></p>
<p class="MsoNormal">geo-replication.ignore-pid-check: on<o:p></o:p></p>
<p class="MsoNormal">changelog.changelog: on<o:p></o:p></p>
<p class="MsoNormal">[root@gluster-poc-noida glusterfs]#<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">Could you please help me in that also please?<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">It would be really a great help from your side. <o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">/Krishna<o:p></o:p></p>
<p class="MsoNormal"><b>From:</b> Kotresh Hiremath Ravishankar &lt;khiremat@redhat.com&gt;
<br>
<b>Sent:</b> Wednesday, August 29, 2018 10:47 AM<br>
<b>To:</b> Krishna Verma &lt;kverma@cadence.com&gt;<br>
<b>Cc:</b> Sunny Kumar &lt;sunkumar@redhat.com&gt;; Gluster Users &lt;gluster-users@gluster.org&gt;<br>
<b>Subject:</b> Re: [Gluster-users] Upgrade to 4.1.2 geo-replication does not work<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="color:red">EXTERNAL MAIL</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Answer inline<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<div>
<p class="MsoNormal">On Tue, Aug 28, 2018 at 4:28 PM, Krishna Verma &lt;<a href="mailto:kverma@cadence.com" target="_blank">kverma@cadence.com</a>&gt; wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hi Kotresh,<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I created the links before. Below is the detail.
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]# ls -l /usr/lib64 | grep libgfch<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">lrwxrwxrwx&nbsp;&nbsp; 1 root root&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 30 Aug 28 14:59 libgfchangelog.so -&gt; /usr/lib64/libgfchangelog.so.1<o:p></o:p></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
</div>
<div>
<p class="MsoNormal">The link created is pointing to wrong library. Please fix this<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
</div>
<div>
<p class="MsoNormal">#cd /usr/lib64<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">#rm libgfchangelog.so<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">#ln -s &quot;libgfchangelog.so.0.0.1&quot; libgfchangelog.so<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">lrwxrwxrwx&nbsp;&nbsp; 1 root root&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 23 Aug 23 23:35 libgfchangelog.so.0 -&gt; libgfchangelog.so.0.0.1<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">-rwxr-xr-x&nbsp;&nbsp; 1 root root&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 63384 Jul 24 19:11 libgfchangelog.so.0.0.1<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]# locate libgfchangelog.so<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">/usr/lib64/libgfchangelog.so.0<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">/usr/lib64/libgfchangelog.so.0.0.1<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Is it looks good what we exactly need or di I need to create any more link or How to get “libgfchangelog.so” file if missing.
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">/Krishna<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b>From:</b> Kotresh Hiremath Ravishankar &lt;<a href="mailto:khiremat@redhat.com" target="_blank">khiremat@redhat.com</a>&gt;
<br>
<b>Sent:</b> Tuesday, August 28, 2018 4:22 PM<br>
<b>To:</b> Krishna Verma &lt;<a href="mailto:kverma@cadence.com" target="_blank">kverma@cadence.com</a>&gt;<br>
<b>Cc:</b> Sunny Kumar &lt;<a href="mailto:sunkumar@redhat.com" target="_blank">sunkumar@redhat.com</a>&gt;; Gluster Users &lt;<a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a>&gt;<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><br>
<b>Subject:</b> Re: [Gluster-users] Upgrade to 4.1.2 geo-replication does not work<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><span style="color:red">EXTERNAL MAIL</span><o:p></o:p></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">Hi Krishna,<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">As per the output shared, I don't see the file &quot;libgfchangelog.so&quot; which is what is required.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I only see &quot;libgfchangelog.so.0&quot;. Please confirm &quot;libgfchangelog.so&quot; is present in &quot;/usr/lib64/&quot;.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">If not create a symlink similar to &quot;libgfchangelog.so.0&quot;<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">It should be something like below.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">#ls -l /usr/lib64 | grep libgfch<br>
-rwxr-xr-x. 1 root root&nbsp;&nbsp;&nbsp; 1078 Aug 28 05:56 <a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__libgfchangelog.la&amp;d=DwMFaQ&amp;c=aUq983L2pue2FqKFoP6PGHMJQyoJ7kl3s3GZ-_haXqY&amp;r=0E5nRoxLsT2ZXgCpJM_6ZItAWQ2jH8rVLG6tiXhoLFE&amp;m=77GIqpHy9HY8RQd6lKzSJ-Z1PCuIhZJ3I3IvIuDX-xo&amp;s=kIFnrBaSFV_DdqZezd6PXcDnD8Iy_gVN69ETZYtykEE&amp;e=" target="_blank">
libgfchangelog.la</a><br>
lrwxrwxrwx. 1 root root&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 23 Aug 28 05:56 libgfchangelog.so -&gt; libgfchangelog.so.0.0.1<br>
lrwxrwxrwx. 1 root root&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 23 Aug 28 05:56 libgfchangelog.so.0 -&gt; libgfchangelog.so.0.0.1<br>
-rwxr-xr-x. 1 root root&nbsp; 336888 Aug 28 05:56 libgfchangelog.so.0.0.1<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">On Tue, Aug 28, 2018 at 4:04 PM, Krishna Verma &lt;<a href="mailto:kverma@cadence.com" target="_blank">kverma@cadence.com</a>&gt; wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hi Kotresh,<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Thanks for the response, I did that also but nothing changed.
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]# ldconfig /usr/lib64<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]# ldconfig -p | grep libgfchangelog<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; libgfchangelog.so.0 (libc6,x86-64) =&gt; /usr/lib64/libgfchangelog.so.0<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]# gluster volume geo-replication glusterep gluster-poc-sj::glusterep stop<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Stopping geo-replication session between glusterep &amp; gluster-poc-sj::glusterep has been successful<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]# gluster volume geo-replication glusterep gluster-poc-sj::glusterep start<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Starting geo-replication session between glusterep &amp; gluster-poc-sj::glusterep has been successful<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]# gluster volume geo-replication glusterep gluster-poc-sj::glusterep status<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">MASTER NODE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; MASTER VOL&nbsp;&nbsp;&nbsp; MASTER BRICK&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; SLAVE USER&nbsp;&nbsp;&nbsp; SLAVE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; SLAVE NODE&nbsp;&nbsp;&nbsp; STATUS&nbsp;&nbsp;&nbsp; CRAWL STATUS&nbsp;&nbsp;&nbsp; LAST_SYNCED<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">-----------------------------------------------------------------------------------------------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">gluster-poc-noida&nbsp;&nbsp;&nbsp; glusterep&nbsp;&nbsp;&nbsp;&nbsp; /data/gluster/gv0&nbsp;&nbsp;&nbsp; root&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; gluster-poc-sj::glusterep&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Faulty&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">noi-poc-gluster&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; glusterep&nbsp;&nbsp;&nbsp;&nbsp; /data/gluster/gv0&nbsp;&nbsp;&nbsp; root&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;gluster-poc-sj::glusterep&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Faulty&nbsp;&nbsp;&nbsp; N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">[root@gluster-poc-noida ~]#<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">/Krishna<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b>From:</b> Kotresh Hiremath Ravishankar &lt;<a href="mailto:khiremat@redhat.com" target="_blank">khiremat@redhat.com</a>&gt;
<br>
<b>Sent:</b> Tuesday, August 28, 2018 4:00 PM<br>
<b>To:</b> Sunny Kumar &lt;<a href="mailto:sunkumar@redhat.com" target="_blank">sunkumar@redhat.com</a>&gt;<br>
<b>Cc:</b> Krishna Verma &lt;<a href="mailto:kverma@cadence.com" target="_blank">kverma@cadence.com</a>&gt;; Gluster Users &lt;<a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a>&gt;<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><br>
<b>Subject:</b> Re: [Gluster-users] Upgrade to 4.1.2 geo-replication does not work<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><span style="color:red">EXTERNAL MAIL</span><o:p></o:p></p>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">Hi Krishna,<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">Since your libraries are in /usr/lib64, you should be doing<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">#ldconfig /usr/lib64<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">Confirm that below command lists the library<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">#ldconfig -p | grep libgfchangelog<o:p></o:p></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">&nbsp;<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">On Tue, Aug 28, 2018 at 3:52 PM, Sunny Kumar &lt;<a href="mailto:sunkumar@redhat.com" target="_blank">sunkumar@redhat.com</a>&gt; wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">can you do ldconfig /usr/local/lib and share the output of ldconfig -p<br>
/usr/local/lib | grep libgf<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">On Tue, Aug 28, 2018 at 3:45 PM Krishna Verma &lt;<a href="mailto:kverma@cadence.com" target="_blank">kverma@cadence.com</a>&gt; wrote:<br>
&gt;<br>
&gt; Hi Sunny,<br>
&gt;<br>
&gt; I did the mentioned changes given in patch and restart the session for geo-replication. But again same errors in the logs.<br>
&gt;<br>
&gt; I have attaching the config files and logs here.<br>
&gt;<br>
&gt;<br>
&gt; [root@gluster-poc-noida ~]# gluster volume geo-replication glusterep gluster-poc-sj::glusterep stop<br>
&gt; Stopping geo-replication session between glusterep &amp; gluster-poc-sj::glusterep has been successful<br>
&gt; [root@gluster-poc-noida ~]# gluster volume geo-replication glusterep gluster-poc-sj::glusterep delete<br>
&gt; Deleting geo-replication session between glusterep &amp; gluster-poc-sj::glusterep has been successful<br>
&gt; [root@gluster-poc-noida ~]# gluster volume geo-replication glusterep gluster-poc-sj::glusterep create push-pem force<br>
&gt; Creating geo-replication session between glusterep &amp; gluster-poc-sj::glusterep has been successful<br>
&gt; [root@gluster-poc-noida ~]# gluster volume geo-replication glusterep gluster-poc-sj::glusterep start<br>
&gt; geo-replication start failed for glusterep gluster-poc-sj::glusterep<br>
&gt; geo-replication command failed<br>
&gt; [root@gluster-poc-noida ~]# gluster volume geo-replication glusterep gluster-poc-sj::glusterep start<br>
&gt; geo-replication start failed for glusterep gluster-poc-sj::glusterep<br>
&gt; geo-replication command failed<br>
&gt; [root@gluster-poc-noida ~]# vim /usr/libexec/glusterfs/python/syncdaemon/repce.py<br>
&gt; [root@gluster-poc-noida ~]# systemctl restart glusterd<br>
&gt; [root@gluster-poc-noida ~]# gluster volume geo-replication glusterep gluster-poc-sj::glusterep start<br>
&gt; Starting geo-replication session between glusterep &amp; gluster-poc-sj::glusterep has been successful<br>
&gt; [root@gluster-poc-noida ~]# gluster volume geo-replication glusterep gluster-poc-sj::glusterep status<br>
&gt;<br>
&gt; MASTER NODE&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; MASTER VOL&nbsp; &nbsp; MASTER BRICK&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;SLAVE USER&nbsp; &nbsp; SLAVE&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; SLAVE NODE&nbsp; &nbsp; STATUS&nbsp; &nbsp; CRAWL STATUS&nbsp; &nbsp; LAST_SYNCED<br>
&gt; -----------------------------------------------------------------------------------------------------------------------------------------------------<br>
&gt; gluster-poc-noida&nbsp; &nbsp; glusterep&nbsp; &nbsp; &nbsp;/data/gluster/gv0&nbsp; &nbsp; root&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; gluster-poc-sj::glusterep&nbsp; &nbsp; N/A&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Faulty&nbsp; &nbsp; N/A&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;N/A<br>
&gt; noi-poc-gluster&nbsp; &nbsp; &nbsp; glusterep&nbsp; &nbsp; &nbsp;/data/gluster/gv0&nbsp; &nbsp; root&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; gluster-poc-sj::glusterep&nbsp; &nbsp; N/A&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Faulty&nbsp; &nbsp; N/A&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;N/A<br>
&gt; [root@gluster-poc-noida ~]#<br>
&gt;<br>
&gt;<br>
&gt; /Krishna.<br>
&gt;<br>
&gt; -----Original Message-----<br>
&gt; From: Sunny Kumar &lt;<a href="mailto:sunkumar@redhat.com" target="_blank">sunkumar@redhat.com</a>&gt;<br>
&gt; Sent: Tuesday, August 28, 2018 3:17 PM<br>
&gt; To: Krishna Verma &lt;<a href="mailto:kverma@cadence.com" target="_blank">kverma@cadence.com</a>&gt;<br>
&gt; Cc: <a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a><br>
&gt; Subject: Re: [Gluster-users] Upgrade to 4.1.2 geo-replication does not work<br>
&gt;<br>
&gt; EXTERNAL MAIL<br>
&gt;<br>
&gt;<br>
&gt; With same log message ?<br>
&gt;<br>
&gt; Can you please verify that<br>
&gt; <a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__review.gluster.org_-23_c_glusterfs_-2B_20207_&amp;d=DwIBaQ&amp;c=aUq983L2pue2FqKFoP6PGHMJQyoJ7kl3s3GZ-_haXqY&amp;r=0E5nRoxLsT2ZXgCpJM_6ZItAWQ2jH8rVLG6tiXhoLFE&amp;m=F0ExtFUfa_YCktOGvy82x3IAxvi2GrbPR72jZ8beuYk&amp;s=fGtkmezHJj5YoLN3dUeVUCcYFnREHyOSk36mRjbTTEQ&amp;e=" target="_blank">
https://urldefense.proofpoint.com/v2/url?u=https-3A__review.gluster.org_-23_c_glusterfs_-2B_20207_&amp;d=DwIBaQ&amp;c=aUq983L2pue2FqKFoP6PGHMJQyoJ7kl3s3GZ-_haXqY&amp;r=0E5nRoxLsT2ZXgCpJM_6ZItAWQ2jH8rVLG6tiXhoLFE&amp;m=F0ExtFUfa_YCktOGvy82x3IAxvi2GrbPR72jZ8beuYk&amp;s=fGtkmezHJj5YoLN3dUeVUCcYFnREHyOSk36mRjbTTEQ&amp;e=</a>
 patch is present if not can you please apply that.<br>
&gt; and try with symlinking ln -s /usr/lib64/libgfchangelog.so.0 /usr/lib64/libgfchangelog.so.<br>
&gt;<br>
&gt; Please share the log also.<br>
&gt;<br>
&gt; Regards,<br>
&gt; Sunny<br>
&gt; On Tue, Aug 28, 2018 at 3:02 PM Krishna Verma &lt;<a href="mailto:kverma@cadence.com" target="_blank">kverma@cadence.com</a>&gt; wrote:<br>
&gt; &gt;<br>
&gt; &gt; Hi Sunny,<br>
&gt; &gt;<br>
&gt; &gt; Thanks for your response, I tried both, but still I am getting the same error.<br>
&gt; &gt;<br>
&gt; &gt;<br>
&gt; &gt; [root@noi-poc-gluster ~]# ldconfig /usr/lib [root@noi-poc-gluster ~]#<br>
&gt; &gt;<br>
&gt; &gt; [root@noi-poc-gluster ~]# ln -s /usr/lib64/libgfchangelog.so.1<br>
&gt; &gt; /usr/lib64/libgfchangelog.so [root@noi-poc-gluster ~]# ls -l<br>
&gt; &gt; /usr/lib64/libgfchangelog.so lrwxrwxrwx. 1 root root 30 Aug 28 14:59<br>
&gt; &gt; /usr/lib64/libgfchangelog.so -&gt; /usr/lib64/libgfchangelog.so.1<br>
&gt; &gt;<br>
&gt; &gt; /Krishna<br>
&gt; &gt;<br>
&gt; &gt; -----Original Message-----<br>
&gt; &gt; From: Sunny Kumar &lt;<a href="mailto:sunkumar@redhat.com" target="_blank">sunkumar@redhat.com</a>&gt;<br>
&gt; &gt; Sent: Tuesday, August 28, 2018 2:55 PM<br>
&gt; &gt; To: Krishna Verma &lt;<a href="mailto:kverma@cadence.com" target="_blank">kverma@cadence.com</a>&gt;<br>
&gt; &gt; Cc: <a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a><br>
&gt; &gt; Subject: Re: [Gluster-users] Upgrade to 4.1.2 geo-replication does not<br>
&gt; &gt; work<br>
&gt; &gt;<br>
&gt; &gt; EXTERNAL MAIL<br>
&gt; &gt;<br>
&gt; &gt;<br>
&gt; &gt; Hi Krish,<br>
&gt; &gt;<br>
&gt; &gt; You can run -<br>
&gt; &gt; #ldconfig /usr/lib<br>
&gt; &gt;<br>
&gt; &gt; If that still does not solves your problem you can do manual symlink<br>
&gt; &gt; like - ln -s /usr/lib64/libgfchangelog.so.1<br>
&gt; &gt; /usr/lib64/libgfchangelog.so<br>
&gt; &gt;<br>
&gt; &gt; Thanks,<br>
&gt; &gt; Sunny Kumar<br>
&gt; &gt; On Tue, Aug 28, 2018 at 1:47 PM Krishna Verma &lt;<a href="mailto:kverma@cadence.com" target="_blank">kverma@cadence.com</a>&gt; wrote:<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; Hi<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; I am getting below error in gsyncd.log<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; OSError: libgfchangelog.so: cannot open shared object file: No such<br>
&gt; &gt; &gt; file or directory<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; [2018-08-28 07:19:41.446785] E [repce(worker /data/gluster/gv0):197:__call__] RepceClient: call failed&nbsp; &nbsp; &nbsp; &nbsp;call=26469:139794524604224:1535440781.44&nbsp; &nbsp; &nbsp; &nbsp; method=init&nbsp; &nbsp; &nbsp;error=OSError<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; [2018-08-28 07:19:41.447041] E [syncdutils(worker /data/gluster/gv0):330:log_raise_exception] &lt;top&gt;: FAIL:<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; Traceback (most recent call last):<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;&nbsp; &nbsp;File &quot;/usr/libexec/glusterfs/python/syncdaemon/gsyncd.py&quot;, line<br>
&gt; &gt; &gt; 311, in main<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;&nbsp; &nbsp; &nbsp;func(args)<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;&nbsp; &nbsp;File &quot;/usr/libexec/glusterfs/python/syncdaemon/subcmds.py&quot;, line<br>
&gt; &gt; &gt; 72, in subcmd_worker<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;&nbsp; &nbsp; &nbsp;local.service_loop(remote)<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;&nbsp; &nbsp;File &quot;/usr/libexec/glusterfs/python/syncdaemon/resource.py&quot;, line<br>
&gt; &gt; &gt; 1236, in service_loop<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;&nbsp; &nbsp; &nbsp;changelog_agent.init()<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;&nbsp; &nbsp;File &quot;/usr/libexec/glusterfs/python/syncdaemon/repce.py&quot;, line<br>
&gt; &gt; &gt; 216, in __call__<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;&nbsp; &nbsp; &nbsp;return self.ins(self.meth, *a)<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;&nbsp; &nbsp;File &quot;/usr/libexec/glusterfs/python/syncdaemon/repce.py&quot;, line<br>
&gt; &gt; &gt; 198, in __call__<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;&nbsp; &nbsp; &nbsp;raise res<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; OSError: libgfchangelog.so: cannot open shared object file: No such<br>
&gt; &gt; &gt; file or directory<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; [2018-08-28 07:19:41.457555] I [repce(agent /data/gluster/gv0):80:service_loop] RepceServer: terminating on reaching EOF.<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; [2018-08-28 07:19:42.440184] I [monitor(monitor):272:monitor] Monitor:<br>
&gt; &gt; &gt; worker died in startup phase&nbsp; brick=/data/gluster/gv0<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; Below is my file location:<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; /usr/lib64/libgfchangelog.so.0<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; /usr/lib64/libgfchangelog.so.0.0.1<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; What I can do to fix it ?<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; /Krish<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; _______________________________________________<br>
&gt; &gt; &gt; Gluster-users mailing list<br>
&gt; &gt; &gt; <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
&gt; &gt; &gt; <a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.gluster.o" target="_blank">
https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.gluster.o</a><br>
&gt; &gt; &gt; rg<br>
&gt; &gt; &gt; _mailman_listinfo_gluster-2Dusers&amp;d=DwIBaQ&amp;c=aUq983L2pue2FqKFoP6PGHM<br>
&gt; &gt; &gt; JQ<br>
&gt; &gt; &gt; yoJ7kl3s3GZ-_haXqY&amp;r=0E5nRoxLsT2ZXgCpJM_6ZItAWQ2jH8rVLG6tiXhoLFE&amp;m=_<br>
&gt; &gt; &gt; u6<br>
&gt; &gt; &gt; vGRjlVsype7Z8hXDgCONilqVe4sIWkXNqqz2n3IQ&amp;s=i0EUwtUHurhJHyw9UPpepCdLB<br>
&gt; &gt; &gt; 70<br>
&gt; &gt; &gt; 1mkxoNZWYvU7XXug&amp;e=<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.gluster.org_mailman_listinfo_gluster-2Dusers&amp;d=DwMFaQ&amp;c=aUq983L2pue2FqKFoP6PGHMJQyoJ7kl3s3GZ-_haXqY&amp;r=0E5nRoxLsT2ZXgCpJM_6ZItAWQ2jH8rVLG6tiXhoLFE&amp;m=BuUVeXUwqxdQDoP-IWDI_JPFCQGrRFdzV9g0enLn8kM&amp;s=X0eVYgZ1emUQnEwRTg0AGbAWyoIwIyrE_gzmuolgiPE&amp;e=" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><br>
<br clear="all">
<br>
-- <o:p></o:p></p>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Thanks and Regards,<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Kotresh H R<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><br>
<br clear="all">
<br>
-- <o:p></o:p></p>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Thanks and Regards,<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Kotresh H R<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<br>
-- <o:p></o:p></p>
<div>
<div>
<div>
<p class="MsoNormal">Thanks and Regards,<o:p></o:p></p>
</div>
<p class="MsoNormal">Kotresh H R<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>