[Gluster-users] Quickest way to delete many small files

[Pablo]

So combining the two approaches I think that this may be a better solution?

tempdirname=`mktemp -d`
mv <dir> $tempdirname
mkdir <dir>

# rm -rf <tempdirname>
mkdir empty
rsync -a --delete empty/ $tempdirname
rmdir empty $tempdirname



Regards,
Pablo.


El 12/06/2013 11:48 a.m., Jeff Darcy escribió:
> On 06/12/2013 10:26 AM, Pete Smith wrote:
>> Hi
>>
>> We've got a directory with approx 1 million files. Mac user ... grr
>>
>> Is there a quick and dirty way to remove them?
>>
>> I was going with:
>>
>> ls | xargs rm
>>
>> but maybe rsync -a --delete empty/ full/
>>
>> would be less expensive?
>>
>> This is on a distributed replicated volume.
>
>
> http://linuxnote.net/jianingy/en/linux/a-fast-way-to-remove-huge-number-of-files.html 
>
>
> tl;dr The rsync method is likely to be faster because of readdir 
> batching.  In fact, the results from that article are likely to be 
> even more applicable to any distributed filesystem where readdir is 
> even more expensive.  This difference is completely orthogonal to the 
> difference between deleting files through a client mountpoint or 
> directly on the brick, with or without renaming first.
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users
>