[Gluster-users] GlusterFS performance

[Joe Julian]

The kernel developers introduced a bug into ext4 that has yet to be 
fixed. If you use xfs you won't have those hangs.

On 03/01/2013 01:30 AM, Nikita A Kardashin wrote:
> Hello again!
>
> I am complete rebuild my storage.
> As base: ext4 over mdadm-raid1
> Gluster volume in distributed-replicated mode with settings:
>
> Options Reconfigured:
> performance.cache-size: 1024MB
> nfs.disable: on
> performance.write-behind-window-size: 4MB
> performance.io-thread-count: 64
> features.quota: off
> features.quota-timeout: 1800
> performance.io-cache: on
> performance.write-behind: on
> performance.flush-behind: on
> performance.read-ahead: on
>
> As result, I got write performance about 80MB/s on dd if=/dev/zero 
> of=testfile.bin bs=100M count=10, but I also got some strange things.
> If I try to execute above command inside virtual machine (KVM), first 
> time all going right - about 900MB/s (cache effect, I think), but if I 
> run this test again on existing file - task (dd) hungs up and can be 
> stopped only by Ctrl+C.
>
> Overall virtual system latency is poor too. For example, apt-get 
> upgrade upgrading system very, very slow, freezing on "Unpacking 
> replacement" and other io-related steps.
>
> Does glusterfs have any tuning options, that can help me?
>
>
> 2013/2/27 Brian Candler <B.Candler at pobox.com <mailto:B.Candler at pobox.com>>
>
>     On Wed, Feb 27, 2013 at 02:46:28PM +0000, Robert van Leeuwen wrote:
>     > You could try to trunk the network on your client but 10Gbit
>     ethernet ( i suggest to use fiber, because of latency issues with
>     copper 10Gbit)
>
>     Aside: 10G with SFP+ direct-attach cables also works well, even
>     though it's
>     copper.  The latency problem is with 10Gbase-T (RJ45 / CAT6(a))
>     _______________________________________________
>     Gluster-users mailing list
>     Gluster-users at gluster.org <mailto:Gluster-users at gluster.org>
>     http://supercolony.gluster.org/mailman/listinfo/gluster-users
>
>
>
>
> -- 
> With best regards,
> differentlocal (www.differentlocal.ru <http://www.differentlocal.ru> | 
> differentlocal at gmail.com <mailto:differentlocal at gmail.com>),
> System administrator.
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20130301/948a9f5a/attachment.html>