<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Dear Kotresh,<div class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Jul 24, 2018, at 12:44 AM, Kotresh Hiremath Ravishankar <<a href="mailto:khiremat@redhat.com" class="">khiremat@redhat.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class=""><div class=""><div class=""><div class=""><div class="">Hi Pablo,<br class=""><br class=""></div>The geo-rep status should go to Faulty if he connection to peer is broken.<br class=""></div></div></div></div></div></blockquote><div><br class=""></div><div>The geo-rep status don’t go to “faulty” after the “connection to peer is broken” on the event log.</div><br class=""><blockquote type="cite" class=""><div class=""><div dir="ltr" class=""><div class=""><div class="">Does node log files failing with same error? Are these logs repeating?<br class=""></div></div></div></div></blockquote><div><br class=""></div><div>The “connection to peer is broken” error is on the following log file. No new events are added after “connection to peer is broken” on the master.</div><div><br class=""></div><div>/var/log/glusterfs/geo-replication/vol_replicated/ssh%3A%2F%2Fgeoaccount1%4010.20.220.12%3Agluster%3A%2F%2F127.0.0.1%3Ageorep_1.log</div><br class=""><blockquote type="cite" class=""><div class=""><div dir="ltr" class=""><div class=""><div class="">Does stop and start geo-rep giving the same error?</div></div></div></div></blockquote><div><br class=""></div><div>I restarted the geo-rep process and keeps giving the same error.</div><div><br class=""></div><div>Another user reported the same problem last month.</div><div><br class=""></div><div><a href="https://bugzilla.redhat.com/show_bug.cgi?id=1595916" class="">https://bugzilla.redhat.com/show_bug.cgi?id=1595916</a></div><br class=""><blockquote type="cite" class=""><div class=""><div dir="ltr" class=""><div class=""><div class=""><br class=""></div><div class="">Thanks,<br class=""></div><div class="">Kotresh HR<br class=""></div></div></div><div class="gmail_extra"><br class=""><div class="gmail_quote">On Tue, Jul 24, 2018 at 1:47 AM, Pablo J Rebollo Sosa <span dir="ltr" class=""><<a href="mailto:pablo.rebollo@upr.edu" target="_blank" class="">pablo.rebollo@upr.edu</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word;line-break:after-white-space" class="">Hi,<div class=""><br class=""></div><div class="">I’m having problem with Gluster 3.12.11 geo-replication in CentOS 7.5. The process starts the geo-replication but after few minutes the log shows “connection to peer is broken”.</div><div class=""><br class=""></div><div class="">The “status detail” looks ok but no files are replicated.</div><div class=""><br class=""></div><div class=""><div class=""><font size="1" face="Courier" class="">[root@gluster1 vol_replicated]# gluster volume geo-replication vol_replicated <a href="mailto:geoaccount1@10.20.220.12" target="_blank" class="">geoaccount1@10.20.220.12</a>::<wbr class="">georep_1 status detail | sort</font></div><div class=""><font size="1" face="Courier" class=""><br class=""></font></div><div class=""><font size="1" face="Courier" class="">------------------------------<wbr class="">------------------------------<wbr class="">------------------------------<wbr class="">------------------------------<wbr class="">------------------------------<wbr class="">------------------------------<wbr class="">------------------------------<wbr class="">------------------------------<wbr class="">------------------------------<wbr class="">-------</font></div><div class=""><font size="1" face="Courier" class="">MASTER NODE MASTER VOL MASTER BRICK SLAVE USER SLAVE SLAVE NODE STATUS CRAWL STATUS LAST_SYNCED ENTRY DATA META FAILURES CHECKPOINT TIME CHECKPOINT COMPLETED CHECKPOINT COMPLETION TIME</font></div><div class=""><font size="1" face="Courier" class="">gluster1 vol_replicated /export/brick1/vol_replicated geoaccount1 <a href="mailto:geoaccount1@10.20.220.12" target="_blank" class="">geoaccount1@10.20.220.12</a>::<wbr class="">georep_1 10.20.220.12 Active Hybrid Crawl N/A 8191 6550 0 0 N/A N/A N/A</font></div><div class=""><font size="1" face="Courier" class="">gluster2 vol_replicated /export/brick1/vol_replicated geoaccount1 <a href="mailto:geoaccount1@10.20.220.12" target="_blank" class="">geoaccount1@10.20.220.12</a>::<wbr class="">georep_1 10.20.220.13 Passive N/A N/A N/A N/A N/A N/A N/A N/A N/A</font></div><div class=""><font size="1" face="Courier" class="">gluster3 vol_replicated /export/brick1/vol_replicated geoaccount1 <a href="mailto:geoaccount1@10.20.220.12" target="_blank" class="">geoaccount1@10.20.220.12</a>::<wbr class="">georep_1 10.20.220.12 Passive N/A N/A N/A N/A N/A N/A N/A N/A N/A</font></div><div class=""><font size="1" face="Courier" class="">gluster4 vol_replicated /export/brick1/vol_replicated geoaccount1 <a href="mailto:geoaccount1@10.20.220.12" target="_blank" class="">geoaccount1@10.20.220.12</a>::<wbr class="">georep_1 10.20.220.13 Active Hybrid Crawl N/A 8191 6532 0 0 N/A N/A N/A</font></div></div><div class=""><br class=""></div><div class="">These are the messages on the log file.</div><div class=""><br class=""></div><div class=""><div class=""><font size="1" face="Courier" class="">[2018-07-23 19:35:50.18026] I [gsyncdstatus(/export/brick1/<wbr class="">vol_replicated):276:set_<wbr class="">active] GeorepStatus: Worker Status Change status=Active</font></div><div class=""><font size="1" face="Courier" class="">[2018-07-23 19:35:50.19126] I [gsyncdstatus(/export/brick1/<wbr class="">vol_replicated):248:set_<wbr class="">worker_crawl_status] GeorepStatus: Crawl Status Change status=History Crawl</font></div><div class=""><font size="1" face="Courier" class="">[2018-07-23 19:35:50.19480] I [master(/export/brick1/vol_<wbr class="">replicated):1432:crawl] _GMaster: starting history crawl turns=1 stime=(0, 0) entry_stime=None etime=1532374550</font></div><div class=""><font size="1" face="Courier" class="">[2018-07-23 19:35:50.20056] E [repce(/export/brick1/vol_<wbr class="">replicated):117:worker] <top>: call failed:</font></div><div class=""><font size="1" face="Courier" class="">Traceback (most recent call last):</font></div><div class=""><font size="1" face="Courier" class=""> File "/usr/libexec/glusterfs/<wbr class="">python/syncdaemon/repce.py", line 113, in worker</font></div><div class=""><font size="1" face="Courier" class=""> res = getattr(self.obj, rmeth)(*in_data[2:])</font></div><div class=""><font size="1" face="Courier" class=""> File "/usr/libexec/glusterfs/<wbr class="">python/syncdaemon/<wbr class="">changelogagent.py", line 54, in history</font></div><div class=""><font size="1" face="Courier" class=""> num_parallel)</font></div><div class=""><font size="1" face="Courier" class=""> File "/usr/libexec/glusterfs/<wbr class="">python/syncdaemon/<wbr class="">libgfchangelog.py", line 103, in cl_history_changelog</font></div><div class=""><font size="1" face="Courier" class=""> raise ChangelogHistoryNotAvailable()</font></div><div class=""><font size="1" face="Courier" class="">ChangelogHistoryNotAvailable</font></div><div class=""><font size="1" face="Courier" class="">[2018-07-23 19:35:50.20999] E [repce(/export/brick1/vol_<wbr class="">replicated):209:__call__] RepceClient: call failed on peer call=39755:140602890745664:<wbr class="">1532374550.02 method=history error=<wbr class="">ChangelogHistoryNotAvailable</font></div><div class=""><font size="1" face="Courier" class="">[2018-07-23 19:35:50.21156] I [resource(/export/brick1/vol_<wbr class="">replicated):1675:service_loop] GLUSTER: Changelog history not available, using xsync</font></div><div class=""><font size="1" face="Courier" class="">[2018-07-23 19:35:50.28688] I [master(/export/brick1/vol_<wbr class="">replicated):1543:crawl] _GMaster: starting hybrid crawl stime=(0, 0)</font></div><div class=""><font size="1" face="Courier" class="">[2018-07-23 19:35:50.30505] I [gsyncdstatus(/export/brick1/<wbr class="">vol_replicated):248:set_<wbr class="">worker_crawl_status] GeorepStatus: Crawl Status Change status=Hybrid Crawl</font></div><div class=""><font size="1" face="Courier" class="">[2018-07-23 19:35:54.35396] I [master(/export/brick1/vol_<wbr class="">replicated):1554:crawl] _GMaster: processing xsync changelog path=/var/lib/misc/glusterfsd/<wbr class="">vol_replicated/ssh%3A%2F%<wbr class="">2Fgeoaccount1%4010.20.220.12%<wbr class="">3Agluster%3A%2F%2F127.0.0.1%<wbr class="">3Ageorep_1/<wbr class="">a68ebfef8cdf86c3c6e9a0d85969cd<wbr class="">3f/xsync/XSYNC-CHANGELOG.<wbr class="">1532374550</font></div><div class=""><font size="1" face="Courier" class="">[2018-07-23 19:36:11.590595] E [syncdutils(/export/brick1/<wbr class="">vol_replicated):304:log_raise_<wbr class="">exception] <top>: connection to peer is broken</font></div></div><div class=""><br class=""></div><div class="">Anyone have some clues to what might be wrong?</div><div class=""><br class=""></div><div class="">Best regards,</div><div class=""><br class=""></div><div class="">Pablo J. Rebollo-Sosa</div></div><br class="">______________________________<wbr class="">_________________<br class="">
Gluster-users mailing list<br class="">
<a href="mailto:Gluster-users@gluster.org" class="">Gluster-users@gluster.org</a><br class="">
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank" class="">https://lists.gluster.org/<wbr class="">mailman/listinfo/gluster-users</a><br class=""></blockquote></div><br class=""><br clear="all" class=""><br class="">-- <br class=""><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr" class=""><div class="">Thanks and Regards,<br class=""></div>Kotresh H R<br class=""></div></div>
</div>
</div></blockquote></div><br class=""></div></body></html>