[Gluster-users] Issues with Geo-replication (GlusterFS 6.3 on Ubuntu 18.04)

Alexander Iliev ailiev+gluster at mamul.org
Thu Aug 29 21:00:23 UTC 2019

Hello dear GlusterFS users list,

I have been trying to set up geo-replication between two clusters for 
some time now. The desired state is (Cluster #1) being replicated to 
(Cluster #2).

Here are some details about the setup:

Cluster #1: three nodes connected via a local network (, 
one replicated (3 replica) volume.

Cluster #2: three nodes connected via a local network (, 
one replicated (3 replica) volume.

The two clusters are connected to the Internet via separate network 

Only SSH (port 22) is open on cluster #2 nodes' adapters connected to 
the Internet.

All nodes are running Ubuntu 18.04 and GlusterFS 6.3 installed from [1].

The first time I followed the guide[2] everything went fine up until I 
reached the "Create the session" step. That was like a month ago, then I 
had to temporarily stop working in this and now I am coming back to it.

Currently, if I try to see the mountbroker status I get the following:

> # gluster-mountbroker status
> Traceback (most recent call last):
>   File "/usr/sbin/gluster-mountbroker", line 396, in <module>
>     runcli()
>   File "/usr/lib/python3/dist-packages/gluster/cliutils/cliutils.py", line 225, in runcli
>     cls.run(args)
>   File "/usr/sbin/gluster-mountbroker", line 275, in run
>     out = execute_in_peers("node-status")
>   File "/usr/lib/python3/dist-packages/gluster/cliutils/cliutils.py", 
line 127, in execute_in_peers
>     raise GlusterCmdException((rc, out, err, " ".join(cmd)))
> gluster.cliutils.cliutils.GlusterCmdException: (1, '', 'Unable to 
end. Error : Success\n', 'gluster system:: execute mountbroker.py 

And in /var/log/gluster/glusterd.log I have:

> [2019-08-10 15:24:21.418834] E [MSGID: 106336] 
[glusterd-geo-rep.c:5413:glusterd_op_sys_exec] 0-management: Unable to 
end. Error : Success
> [2019-08-10 15:24:21.418908] E [MSGID: 106122] 
[glusterd-syncop.c:1445:gd_commit_op_phase] 0-management: Commit of 
operation 'Volume Execute system commands' failed on localhost : Unable 
to end. Error : Success

So, I have two questions right now:

1) Is there anything wrong with my setup (networking, open ports, etc.)? 
Is it expected to work with this setup or should I redo it in a 
different way?
2) How can I troubleshoot the current status of my setup? Can I find out 
what's missing/wrong and continue from there or should I just start from 

[1] http://ppa.launchpad.net/gluster/glusterfs-6/ubuntu

Thank you!

Best regards,
alexander iliev

More information about the Gluster-users mailing list