[Gluster-users] GlusterFS performance with small files.

[Vladislav Tchernev]

A nice solution of using NFS while preserving FUSE client redundancy
benefit.
http://community.gluster.org/a/nfs-performance-with-fuse-client-redundancy/

Cheers
Vlad

On Tue, Apr 3, 2012 at 1:17 PM, Jeff White <jaw171 at pitt.edu> wrote:

> Using Gluster's NFS instead of the native (FUSE) client can get you better
> performance with many small files but you lose functionality by doing that.
>
> There's lots of variance in all of this so the best thing you can do is
> test and benchmark on your own datasets and systems.
>
> Jeff White - Linux/Unix Systems Engineer
> University of Pittsburgh - CSSD
>
>
> On 04/03/2012 12:55 PM, Haris Zukanovic wrote:
>
>> Is there anything to do to optimize the read for small files in a
>> replicated gluster setup? The files reside allready on the server in
>> question in the brick.
>> Something like disable diverse checking for files that I know are not
>> updated often? For example web files like images uploaded through the
>> CMS. These files are uploaded once and never modified again...
>>
>> kind regards
>> Haris
>>
>> On 03/04/12 18.40, Bryan Whitehead wrote:
>>
>>> A bunch of small files is terrible performance. Really not much you
>>> can do about that. Store each mailbox in a single file. MailDir format
>>> is definitely going to suck.
>>>
>>> On Tue, Apr 3, 2012 at 3:05 AM, David Whiteman<davew at supanet.net.uk>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> I am currently looking into GlusterFS to use as a storage cluster for
>>>> our
>>>> email storage. I want to mount the storage from different servers (or
>>>> VMs),
>>>> services accessing the storage include exim, courier-imapd,
>>>> courier-pop3d.
>>>> Our emails are stored in MailDir format, which is many small files. I
>>>> have
>>>> read that GlusterFS doesn't perform very well with small files, is this
>>>> still the case?
>>>>
>>>> I would like to achieve similar (or better) performance to our current
>>>> NFS
>>>> setup, with the added redundancy that GlusterFS provides.
>>>>
>>>> Is there any utilities I can use to test the performance?
>>>>
>>>> Thanks in Advance
>>>> ______________________________**_________________
>>>> Gluster-users mailing list
>>>> Gluster-users at gluster.org
>>>> http://gluster.org/cgi-bin/**mailman/listinfo/gluster-users<http://gluster.org/cgi-bin/mailman/listinfo/gluster-users>
>>>>
>>> ______________________________**_________________
>>> Gluster-users mailing list
>>> Gluster-users at gluster.org
>>> http://gluster.org/cgi-bin/**mailman/listinfo/gluster-users<http://gluster.org/cgi-bin/mailman/listinfo/gluster-users>
>>>
>> ______________________________**_________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://gluster.org/cgi-bin/**mailman/listinfo/gluster-users<http://gluster.org/cgi-bin/mailman/listinfo/gluster-users>
>



-- 
----
Vladislav Tchernev
Senior System Administrator
Broadsign INT
+1 (514) 399-1184
www.broadsign.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20120404/1df19147/attachment.html>