[Gluster-users] GlusterFS performance

Nikita A Kardashin differentlocal at gmail.com
Mon Mar 4 06:55:53 UTC 2013


Nothing changes afer reformating to xfs. Random freezes in write to
existing file from VM (from host everything is ok) :(

gluster version 3.3.1
qemu version 1.0



2013/3/2 Joe Julian <joe at julianfamily.org>

>  The kernel developers introduced a bug into ext4 that has yet to be
> fixed. If you use xfs you won't have those hangs.
>
>
> On 03/01/2013 01:30 AM, Nikita A Kardashin wrote:
>
> Hello again!
>
>  I am complete rebuild my storage.
> As base: ext4 over mdadm-raid1
> Gluster volume in distributed-replicated mode with settings:
>
>  Options Reconfigured:
> performance.cache-size: 1024MB
> nfs.disable: on
> performance.write-behind-window-size: 4MB
> performance.io-thread-count: 64
> features.quota: off
> features.quota-timeout: 1800
> performance.io-cache: on
> performance.write-behind: on
> performance.flush-behind: on
> performance.read-ahead: on
>
>  As result, I got write performance about 80MB/s on dd if=/dev/zero
> of=testfile.bin bs=100M count=10, but I also got some strange things.
> If I try to execute above command inside virtual machine (KVM), first time
> all going right - about 900MB/s (cache effect, I think), but if I run this
> test again on existing file - task (dd) hungs up and can be stopped only by
> Ctrl+C.
>
>  Overall virtual system latency is poor too. For example, apt-get upgrade
> upgrading system very, very slow, freezing on "Unpacking replacement" and
> other io-related steps.
>
>  Does glusterfs have any tuning options, that can help me?
>
>
> 2013/2/27 Brian Candler <B.Candler at pobox.com>
>
>> On Wed, Feb 27, 2013 at 02:46:28PM +0000, Robert van Leeuwen wrote:
>> > You could try to trunk the network on your client but 10Gbit ethernet (
>> i suggest to use fiber, because of latency issues with copper 10Gbit)
>>
>>  Aside: 10G with SFP+ direct-attach cables also works well, even though
>> it's
>> copper.  The latency problem is with 10Gbase-T (RJ45 / CAT6(a))
>>  _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> http://supercolony.gluster.org/mailman/listinfo/gluster-users
>>
>
>
>
>  --
> With best regards,
> differentlocal (www.differentlocal.ru | differentlocal at gmail.com),
> System administrator.
>
>
> _______________________________________________
> Gluster-users mailing listGluster-users at gluster.orghttp://supercolony.gluster.org/mailman/listinfo/gluster-users
>
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users
>



-- 
With best regards,
differentlocal (www.differentlocal.ru | differentlocal at gmail.com),
System administrator.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20130304/ceaf3df0/attachment.html>


More information about the Gluster-users mailing list