[Gluster-users] very bad performance on small files

[Joe Landman]

On 01/15/2011 10:31 AM, Pan, Henry wrote:
> Hello Gluster Gurus,
>
> I'm trying to find out what performance data you could get while
> trying eDiscovery searching application in a namespace with over 3
> billins small files on GlusterFS...

Hmmm ... are you searching within the files or the file names for patterns?

Gluster does have some pretty good caching facilities, with the downside 
being that we seem to catch lots of bugs in this layer.  There are 
pre-fetch capabilities as well.

The issue is that this is going to be a *very* seeky load.  The 
underlying system IOP rate will be one of the bounding elements.

-- 
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics, Inc.
email: landman at scalableinformatics.com
web  : http://scalableinformatics.com
        http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax  : +1 866 888 3112
cell : +1 734 612 4615