[Gluster-users] Faulty status in Geo-replication

[Sunny Kumar]

Hi Deepu,
Can you share traceback from slave node.

/sunny


On Mon, Mar 9, 2020 at 5:08 AM deepu srinivasan <sdeepugd at gmail.com> wrote:
>
> Hi guys
> Have any update on this?
>
> On Thu, Mar 5, 2020, 12:30 PM deepu srinivasan <sdeepugd at gmail.com> wrote:
>>
>> Hi Users/Devs
>>
>> We are getting a faulty status for geo-replication and below are the logs. How to solve this issue?
>>>
>>> [2020-03-05 06:52:44.858073] E [repce(worker /home/sas/gluster/data/code-ide):214:__call__] RepceClient: call failed    call=232079:140660126910272:1583391154.92       method=entry_ops        error=OSError
>>> [2020-03-05 06:52:44.858309] E [syncdutils(worker /home/sas/gluster/data/code-ide):338:log_raise_exception] <top>: FAIL:
>>> Traceback (most recent call last):
>>>   File "/usr/libexec/glusterfs/python/syncdaemon/gsyncd.py", line 325, in main
>>>     func(args)
>>>   File "/usr/libexec/glusterfs/python/syncdaemon/subcmds.py", line 86, in subcmd_worker
>>>     local.service_loop(remote)
>>>   File "/usr/libexec/glusterfs/python/syncdaemon/resource.py", line 1297, in service_loop
>>>     g3.crawlwrap(oneshot=True)
>>>   File "/usr/libexec/glusterfs/python/syncdaemon/master.py", line 602, in crawlwrap
>>>     self.crawl()
>>>   File "/usr/libexec/glusterfs/python/syncdaemon/master.py", line 1592, in crawl
>>>     self.changelogs_batch_process(changes)
>>>   File "/usr/libexec/glusterfs/python/syncdaemon/master.py", line 1492, in changelogs_batch_process
>>>     self.process(batch)
>>>   File "/usr/libexec/glusterfs/python/syncdaemon/master.py", line 1327, in process
>>>     self.process_change(change, done, retry)
>>>   File "/usr/libexec/glusterfs/python/syncdaemon/master.py", line 1221, in process_change
>>>     failures = self.slave.server.entry_ops(entries)
>>>   File "/usr/libexec/glusterfs/python/syncdaemon/repce.py", line 233, in __call__
>>>     return self.ins(self.meth, *a)
>>>   File "/usr/libexec/glusterfs/python/syncdaemon/repce.py", line 215, in __call__
>>>     raise res
>>> OSError: [Errno 1] Operation not permitted
>>> [2020-03-05 06:52:44.887593] I [repce(agent /home/sas/gluster/data/code-ide):97:service_loop] RepceServer: terminating on reaching EOF.
>>> [2020-03-05 06:52:44.899364] I [gsyncdstatus(monitor):248:set_worker_status] GeorepStatus: Worker Status Change status=Faulty
>>> [2020-03-05 06:52:55.288171] I [gsyncdstatus(monitor):248:set_worker_status] GeorepStatus: Worker Status Change status=Initializing...
>>
>>
>> Our Setup Details
>> We have one volume at each DC. Below is the configuration
>>
>> Volume configuration2x3
>> Replication3
>> Distribution2
>> Gluster version7.0
>> Client TypeFuse Mount
>> Glusterd process
>> GeoReplication Sessionenabled
>> Gluster daemon permission in masterroot
>> Gluster daemon permission in slaveroot
>> Gsynd user daemon in masterroot
>> Gsynd user daemon in slavenon-root
>> Geo Replication configurationroot(master) - non-root(slave)
>>