[Gluster-users] How to use gluster for WAN/Data Center replication

[anthony garnier]

Hi,
The GSLB+RR is especially usefull for nfs client in fact, for gluster client, it's just for volfile.
The process to remove node entry from DNS is indeed manual, we are looking for a way to do it automaticaly, maybe with script....
What do you mean by "How do you ensure that a copy of file in one site definitely is saved on other site as well?"
Servers from replica1 and 2 are mixed between  the 2 datacenter,
Replica pool 1 : Brick 1,2,3,4
Replica pool 2 : Brick 5,6,7,8

Datacenter 1 : Brick 1,2,5,6
Datacenter 2 : Brick 3,4,7,8 

In this way, each Datacenter got 2 replica of the file. Each Datacenter could be independent if there is a Wan interruption.

Regards,
Anthony

> Date: Thu, 10 Mar 2011 12:00:53 -0800
> Subject: Re: How to use gluster for WAN/Data Center replication
> From: mohitanchlia at gmail.com
> To: sokar6012 at hotmail.com; gluster-users at gluster.org
> 
> Thanks for the info! I am assuming it's a manual process to remove
> nodes from the DNS?
> 
> If I am not wrong I think load balancing by default occurs for native
> gfs client that you are using. Initial mount is required only to read
> volfile.
> 
> How do you ensure that a copy of file in one site definitely is saved
> on other site as well?
> 
> On Thu, Mar 10, 2011 at 1:11 AM, anthony garnier <sokar6012 at hotmail.com> wrote:
> > Hi,
> > I have done a setup(see my setup below) on multi site datacenter with
> > gluster and currently it doesn't work properly but there is some workaround.
> > The main problem is that replication is synchronous and there is currently
> > no way to turn it in async mod. I've done some test
> > (iozone,tar,bonnie++,script...) and performance
> > is poor with small files especially. We are using an url to access servers :
> > glusterfs.cluster.inetcompany.com
> > This url is in DNS GSLB(geo DNS)+RR (Round Robin)
> > It means that client from datacenter 1 will always be binded randomly on
> > storage node from his Datacenter.
> > They use this command for mounting the filesystem :
> > mount -t glusterfs glusterfs.cluster.inetcompany.com:/venus
> > /users/glusterfs_mnt
> >
> > If one node fails , it is remove from de list of the DNS, client do a new
> > DNS query and he is binded on active node of his Datacenter.
> > You could use Wan accelerator also.
> >
> > We currently are in intra site mode and we are waiting for Async replication
> > feature expected in version 3.2. It should come soon.
> >
> >
> > Volume Name: venus
> > Type: Distributed-Replicate
> > Status: Started
> > Number of Bricks: 2 x 4 = 8
> > Transport-type: tcp
> > Bricks:
> > Brick1: serv1:/users/exp1  \
> > Brick2: serv2:/users/exp2   > Réplica pool 1 \
> > Brick3: serv3:/users/exp3  /                  \
> > Brick4: serv4:/users/exp4                       =Envoyer>Distribution
> > Brick5: serv5:/users/exp5  \                  /
> > Brick6: serv6:/users/exp6   > Réplica pool 2 /
> > Brick7: serv7:/users/exp7  /
> > Brick8: serv8:/users/exp8
> >
> > Datacenter 1 : Brick 1,2,5,6
> > Datacenter 2 : Brick 3,4,7,8
> > Distance between Datacenters : 500km
> > Latency between Datacenters : 11ms
> > Datarate between Datacenters : ~100Mb/s
> >
> >
> >
> > Regards,
> > Anthony
> >
> >
> >
> >>Message: 3
> >>Date: Wed, 9 Mar 2011 16:44:27 -0800
> >>From: Mohit Anchlia <mohitanchlia at gmail.com>
> >>Subject: [Gluster-users] How to use gluster for WAN/Data Center
> >>	replication
> >>To: gluster-users at gluster.org
> >>Message-ID:
> >>	<AANLkTi=dkK=zX0QdCfnKeLJ5nkF1dF3+g1hxDzFZNvwx at mail.gmail.com>
> >>Content-Type: text/plain; charset=ISO-8859-1
> >>
> >>How to setup gluster for WAN/Data Center replication? Are there others
> >>using it this way?
> >>
> >>Also, how to make the writes asynchronuous for data center replication?
> >>
> >>We have a requirement to replicate data to other data center as well.