[Gluster-users] GlusterFS Performance gigE

Henrique Haas henrique at dz6web.com
Sat Sep 11 17:20:36 UTC 2010


Hello Jacob,

Greater block sizes gave me much much better results, about *58MB/s* on a
1GigE !!!!
So.. my concern now is about smaller files be shared using Gluster.
Any tunning tips for these kind of files (I'm using Ext4 and Gluster 3.0.2)?

Thanks a lot for all those help me!

Cheers from Brazil!


On Fri, Sep 10, 2010 at 7:50 PM, Jacob Shucart <jacob at gluster.com> wrote:

> Henrique,
>
> Please try the test again with a larger block size to see how that changes
> the results.
>
> -----Original Message-----
> From: gluster-users-bounces at gluster.org
> [mailto:gluster-users-bounces at gluster.org] On Behalf Of Chris Layton
> Sent: Friday, September 10, 2010 3:32 PM
> To: Henrique Haas
> Cc: gluster-users at gluster.org
> Subject: Re: [Gluster-users] GlusterFS Performance gigE
>
> I agree something is wrong.
>
> Here is what I am getting on a more ISP grade setup (but no SAN sadly)
> also with no Ethernet tuning :
>
>
> dd if=/dev/zero of=/usr/local/sites/test.test bs=1M count=64
> 64+0 records in
> 64+0 records out
> 67108864 bytes (67 MB) copied, 0.754847 seconds, 88.9 MB/s
> dd if=/dev/zero of=/usr/local/sites/test.test bs=1M count=1024
> 1024+0 records in
> 1024+0 records out
> 1073741824 bytes (1.1 GB) copied, 13.9273 seconds, 77.1 MB/s
>
> I did some other testing using tiobench, iozone, and dt with similar
> (albeit MUCH more detailed) results.
>
> The setup above is using cluster/replicate between 2 remote bricks
> (raid10 SAS 15K). Also this was run during a low load window while there
> was still some light load on the webservers so this would be slightly
> higher if I could stop our webservers but that isn't a option for a few
> more days at least. Also we use lsycnd (inotify based) to sync changed
> files off to remote backup servers to overcome the limits on wirespeed
> with gluster (our remote nodes are 100Mb) so that has some brick/disk
> overhead as well.
>
> One thing you could do to help troubleshoot is run a speed test and use
> atop or sar tools to debug and also get a snapshot of the test for
> review.
>
>
> --
> Chris Layton
> Senior Systems Engineer
> WorldSpice Technologies
> chrisl at worldspice.net
> 901-843-9300
>
> On Fri, 2010-09-10 at 13:16 -0300, Henrique Haas wrote:
> > Hello people,
> >
> > For those have *GlusterFS running over GigE, what is the throughput you
> have
> > for write data?*
> > I have 3 nodes, running GNU/Linux Ubuntu Server 10.04, GlusterFS 3.0.2.
> > The network is GigE, dedicated switch.
> >
> > I am experiencing maximum 2 MB/sec running a "dd" over a client mount
> point.
> >
> > Thank you very much
> >
> > _______________________________________________
> > Gluster-users mailing list
> > Gluster-users at gluster.org
> > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>



-- 
Henrique Haas
+55 (51) 3028.6602
www.dz6web.com


More information about the Gluster-users mailing list