[Gluster-users] Rsync

[Pavan Vilas Sondur]

Can you send us the volfiles and logfiles as well?

Pavan

On 23/09/09 10:08 +0100, Hiren Joshi wrote:
> 2.0.6-1.el5, it's a 6 brick distributed system which is mirrored over 2
> machines (each brick has a mirror on another machine, these mirrors are
> put in the hash).
> 
> An update, after running the rsync for a day, I killed it and remounted
> all the disks (the underlying filesystem, not the gluster) with noatime,
> the rsync completed in about 600 minutes. I'm now going to try one level
> up (about 1,000,000,000 dirs).
> 
> > -----Original Message-----
> > From: Pavan Vilas Sondur [mailto:pavan at gluster.com] 
> > Sent: 23 September 2009 07:55
> > To: Hiren Joshi
> > Cc: gluster-users at gluster.org
> > Subject: Re: Rsync
> > 
> > Hi Hiren,
> > What glusterfs version are you using? Can you send us the 
> > volfiles and the log files.
> > 
> > Pavan
> > 
> > On 22/09/09 16:01 +0100, Hiren Joshi wrote:
> > > I forgot to mention, the mount is mounted with direct-io, would this
> > > make a difference? 
> > > 
> > > > -----Original Message-----
> > > > From: gluster-users-bounces at gluster.org 
> > > > [mailto:gluster-users-bounces at gluster.org] On Behalf Of 
> > Hiren Joshi
> > > > Sent: 22 September 2009 11:40
> > > > To: gluster-users at gluster.org
> > > > Subject: [Gluster-users] Rsync
> > > > 
> > > > Hello all,
> > > >  
> > > > I'm getting what I think is bizarre behaviour.... I have 
> > about 400G to
> > > > rsync (rsync -av) onto a gluster share, the data is in a directory
> > > > structure which has about 1000 directories per parent and 
> > about 1000
> > > > directories in each of them.
> > > >  
> > > > When I try to rsync an end leaf directory (this has about 4 
> > > > dirs and 100
> > > > files in each) the operation takes about 10 seconds. When I 
> > > > go one level
> > > > above (1000 dirs with about 4 dirs in each with about 100 
> > > > files in each)
> > > > the operation takes about 10 minutes.
> > > >  
> > > > Now, if I then go one level above that (that's 1000 dirs with 
> > > > 1000 dirs
> > > > in each with about 4 dirs in each with about 100 files in 
> > each) the
> > > > operation takes days! Top shows glusterfsd takes 300-600% 
> > cpu usage
> > > > (2X4core), I have about 48G of memory (usage is 0% as expected).
> > > >  
> > > > Has anyone seen anything like this? How can I speed it up?
> > > >  
> > > > Thanks,
> > > >  
> > > > Josh.
> > > > 
> > > _______________________________________________
> > > Gluster-users mailing list
> > > Gluster-users at gluster.org
> > > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
> >