[Gluster-users] GlusterFS performance

Nikita A Kardashin differentlocal at gmail.com
Fri Mar 1 09:30:07 UTC 2013


Hello again!

I am complete rebuild my storage.
As base: ext4 over mdadm-raid1
Gluster volume in distributed-replicated mode with settings:

Options Reconfigured:
performance.cache-size: 1024MB
nfs.disable: on
performance.write-behind-window-size: 4MB
performance.io-thread-count: 64
features.quota: off
features.quota-timeout: 1800
performance.io-cache: on
performance.write-behind: on
performance.flush-behind: on
performance.read-ahead: on

As result, I got write performance about 80MB/s on dd if=/dev/zero
of=testfile.bin bs=100M count=10, but I also got some strange things.
If I try to execute above command inside virtual machine (KVM), first time
all going right - about 900MB/s (cache effect, I think), but if I run this
test again on existing file - task (dd) hungs up and can be stopped only by
Ctrl+C.

Overall virtual system latency is poor too. For example, apt-get upgrade
upgrading system very, very slow, freezing on "Unpacking replacement" and
other io-related steps.

Does glusterfs have any tuning options, that can help me?


2013/2/27 Brian Candler <B.Candler at pobox.com>

> On Wed, Feb 27, 2013 at 02:46:28PM +0000, Robert van Leeuwen wrote:
> > You could try to trunk the network on your client but 10Gbit ethernet (
> i suggest to use fiber, because of latency issues with copper 10Gbit)
>
> Aside: 10G with SFP+ direct-attach cables also works well, even though it's
> copper.  The latency problem is with 10Gbase-T (RJ45 / CAT6(a))
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users
>



-- 
With best regards,
differentlocal (www.differentlocal.ru | differentlocal at gmail.com),
System administrator.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20130301/2e9f4a1d/attachment.html>


More information about the Gluster-users mailing list