[Gluster-users] Quickest way to delete many small files
jdarcy at redhat.com
Wed Jun 12 14:48:33 UTC 2013
On 06/12/2013 10:26 AM, Pete Smith wrote:
> We've got a directory with approx 1 million files. Mac user ... grr
> Is there a quick and dirty way to remove them?
> I was going with:
> ls | xargs rm
> but maybe rsync -a --delete empty/ full/
> would be less expensive?
> This is on a distributed replicated volume.
tl;dr The rsync method is likely to be faster because of readdir batching. In
fact, the results from that article are likely to be even more applicable to
any distributed filesystem where readdir is even more expensive. This
difference is completely orthogonal to the difference between deleting files
through a client mountpoint or directly on the brick, with or without renaming
More information about the Gluster-users