[Gluster-users] Quickest way to delete many small files

Jeff Darcy jdarcy at redhat.com
Wed Jun 12 14:48:33 UTC 2013

On 06/12/2013 10:26 AM, Pete Smith wrote:
> Hi
> We've got a directory with approx 1 million files. Mac user ... grr
> Is there a quick and dirty way to remove them?
> I was going with:
> ls | xargs rm
> but maybe rsync -a --delete empty/ full/
> would be less expensive?
> This is on a distributed replicated volume.


tl;dr The rsync method is likely to be faster because of readdir batching.  In 
fact, the results from that article are likely to be even more applicable to 
any distributed filesystem where readdir is even more expensive.  This 
difference is completely orthogonal to the difference between deleting files 
through a client mountpoint or directly on the brick, with or without renaming 

More information about the Gluster-users mailing list