<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:2.0cm 42.5pt 2.0cm 3.0cm;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="RU" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thank you for reply Kotresh!<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I found the root of the issue. I started over geo-rep setup and erased the geo-replication.indexing on Master.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Replication worked fine if gluster volume is mounted natively or via nfs-ganesha server.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">But when I tried to make a change on a brick locally it did not go to Slave node.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"># mount | grep zdata<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">zdata on /zdata type zfs (rw,nosuid,noexec,noatime,xattr,noacl)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">zdata/cicd on /zdata/cicd type zfs (rw,nosuid,noexec,noatime,xattr,posixacl)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Then I mounted glusterfs locally and local changes started to go to Slave node too.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">BR, Alexey<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Kotresh Hiremath Ravishankar [mailto:khiremat@redhat.com]
<br>
<b>Sent:</b> Friday, July 05, 2019 5:20 PM<br>
<b>To:</b> Pasechny Alexey<br>
<b>Cc:</b> gluster-users@gluster.org<br>
<b>Subject:</b> Re: [Gluster-users] Geo-replication does not send filesystem changes<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">The session is moved from "history crawl" to "changelog crawl". After this point, there are no changelogs to be synced as per the logs.<o:p></o:p></p>
<div>
<p class="MsoNormal">Please checking in ".processing" directories if there are any pending changelogs to be synced at "/var/lib/misc/gluster/gsyncd/<session>/<brickpath>/.processing"<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">If there are no pending changelogs, then please check if the brick is up.<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Fri, Jul 5, 2019 at 5:29 PM Pasechny Alexey <<a href="mailto:Pasechny@iskrauraltel.ru">Pasechny@iskrauraltel.ru</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<p class="MsoNormal">Hi everyone,<br>
<br>
I have a problem with native geo-replication setup. It successfully starts, makes initial sync but does not send any filesystem data changes afterward.<br>
I'm using CentOS 7.6.1810 with official glusterfs-6.3-1.el7 build on top of ZFS on Linux.<br>
It is a single Master node with single brick and the same Slave node.<br>
<br>
# "gluster vol geo-rep status" command gives the following output<br>
MASTER NODE = gfs-alfa1<br>
MASTER VOL = cicd<br>
MASTER BRICK = /zdata/cicd/brick<br>
SLAVE USER = root<br>
SLAVE = gfs-alfa2::cicd<br>
SLAVE NODE = gfs-alfa2<br>
STATUS = Active<br>
CRAWL STATUS = Changelog Crawl<br>
LAST_SYNCED = 2019-07-05 12:08:17<br>
ENTRY = 0<br>
DATA = 0<br>
META = 0<br>
FAILURES = 0<br>
CHECKPOINT TIME = 2019-07-05 12:13:46<br>
CHECKPOINT COMPLETED = No<br>
<br>
I enabled DEBUG level log for gsyncd.log but did not get any error messages from it. Full log is available here:
<a href="https://pastebin.com/pXL4dBhZ" target="_blank">https://pastebin.com/pXL4dBhZ</a><br>
On both brick I disabled ctime feature because it is incompatible with old versions of gfs clients, enabling this feature does not help too.<br>
<br>
# gluster volume info<br>
Volume Name: cicd<br>
Type: Distribute<br>
Volume ID: 8f959a35-c7ab-4484-a1e8-9fa8e3a713b4<br>
Status: Started<br>
Snapshot Count: 0<br>
Number of Bricks: 1<br>
Transport-type: tcp<br>
Bricks:<br>
Brick1: gfs-alfa1:/zdata/cicd/brick<br>
Options Reconfigured:<br>
nfs.disable: on<br>
transport.address-family: inet<br>
features.ctime: off<br>
geo-replication.indexing: on<br>
geo-replication.ignore-pid-check: on<br>
changelog.changelog: on<br>
<br>
# gluster volume get cicd rollover-time<br>
Option Value<br>
------ -----<br>
changelog.rollover-time 15<br>
<br>
# gluster volume get cicd fsync-interval<br>
Option Value<br>
------ -----<br>
changelog.fsync-interval 5<br>
<br>
Could someone help me with debug of this geo-rep setup?<br>
Thank you!<br>
<br>
BR, Alexey<br>
<br>
<br>
________________________________<br>
<br>
В данной электронной почте и во всех ее вложениях может содержаться информация конфиденциального характера, предназначенная исключительно только для адресата. Если Вы по ошибке получили не предназначенное для Вас сообщение, пожалуйста, безотлагательно проинформируйте
об этом отправителя, а само сообщение немедленно уничтожьте. Физическому или юридическому лицу, не являющемуся адресатом почты, строго запрещается несанкционированно использовать, просматривать, пересылать, распространять, копировать или распоряжаться иным
способом содержимым такой почты.<br>
<br>
This e-mail and any attachments may contain confidential and/or privileged information and is intended solely for the addressee. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this
e-mail. Any unauthorised use, review, retransmissions, dissemination, copying or other use of this information by persons or entities other than the intended recipient is strictly prohibited.<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><br clear="all">
<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal">-- <o:p></o:p></p>
<div>
<div>
<div>
<p class="MsoNormal">Thanks and Regards,<o:p></o:p></p>
</div>
<p class="MsoNormal">Kotresh H R<o:p></o:p></p>
</div>
</div>
</div>
</body>
</html>