[Gluster-users] Quickest way to delete many small files

Pablo paa.listas at gmail.com
Wed Jun 12 17:55:23 UTC 2013

So combining the two approaches I think that this may be a better solution?

tempdirname=`mktemp -d`
mv <dir> $tempdirname
mkdir <dir>

# rm -rf <tempdirname>
mkdir empty
rsync -a --delete empty/ $tempdirname
rmdir empty $tempdirname


El 12/06/2013 11:48 a.m., Jeff Darcy escribió:
> On 06/12/2013 10:26 AM, Pete Smith wrote:
>> Hi
>> We've got a directory with approx 1 million files. Mac user ... grr
>> Is there a quick and dirty way to remove them?
>> I was going with:
>> ls | xargs rm
>> but maybe rsync -a --delete empty/ full/
>> would be less expensive?
>> This is on a distributed replicated volume.
> http://linuxnote.net/jianingy/en/linux/a-fast-way-to-remove-huge-number-of-files.html 
> tl;dr The rsync method is likely to be faster because of readdir 
> batching.  In fact, the results from that article are likely to be 
> even more applicable to any distributed filesystem where readdir is 
> even more expensive.  This difference is completely orthogonal to the 
> difference between deleting files through a client mountpoint or 
> directly on the brick, with or without renaming first.
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users

More information about the Gluster-users mailing list