[Gluster-users] Performance

Alex Crow acrow at integrafin.co.uk
Mon Oct 31 16:31:30 UTC 2016


I last used GlusterFS around early 3.6. I could get great results for streaming large files. I was seeing up to 700MB/s with a DD test. Small file/metadata access wasn't right for our use, but for VMs it should be fine with a bit of tuning.

On 31 October 2016 15:33:06 GMT+00:00, Joe Julian <joe at julianfamily.org> wrote:
>On 10/31/2016 08:29 AM, Alastair Neil wrote:
>> What version of Gluster?  Are you using glusterfs or nfs mount?  Any 
>> other traffic on the network, is the cluster quiescent apart from
>your 
>> dd test?
>>
>
>What type of volume?
>
>> It does seem slow.  I have a three server cluster, using straight xfs
>
>> over 10G with Gluster 3.8 and glusterfs mounts and I see:
>>
>> [root at sb-c 192.168.10.49:VM]# sync; dd if=/dev/zero of=nfsp2 bs=1M 
>> count=1024; sync
>> 1024+0 records in
>> 1024+0 records out
>> 1073741824 bytes (1.1 GB) copied, 11.3322 s, 94.8 MB/s
>> [root at sb-c 192.168.10.49:VM]# sync; dd if=/dev/zero of=nfsp2 bs=1M 
>> count=10240; sync
>> 10240+0 records in
>> 10240+0 records out
>> 10737418240 bytes (11 GB) copied, 117.854 s, 91.1 MB/s
>>
>> this is on a cluster serving 5 ovirt nodes and about 60 running VMs.
>>
>>
>>
>> On 25 October 2016 at 12:50, Service Mail <ciclopeblu at gmail.com 
>> <mailto:ciclopeblu at gmail.com>> wrote:
>>
>>     Hello,
>>
>>     I have the following setup:
>>
>>     3x zfs raidz2 servers with a single gluster 3.8 replicated volume
>>     across a 10G network
>>
>>     Everything is working fine however performance looks very poor to
>me:
>>
>>
>>     root at Client:/test_mount# sync; dd if=/dev/zero of=nfsp2 bs=1M
>>     count=1024; sync
>>     1024+0 records in
>>     1024+0 records out
>>     1073741824 bytes (1.1 GB, 1.0 GiB) copied, 32.1786 s, 33.4 MB/s
>>
>>     root at Client:/test_mount# sync; dd if=/dev/zero of=nfsp2 bs=1M
>>     count=10240; sync
>>     10240+0 records in
>>     10240+0 records out
>>     10737418240 bytes (11 GB, 10 GiB) copied, 301.563 s, 35.6 MB/s
>>
>>     Are those reading normal? Where should I look to increase
>performance?
>>
>>     Thanks,
>>
>>     Ciclope
>>
>>
>>
>>
>>     _______________________________________________
>>     Gluster-users mailing list
>>     Gluster-users at gluster.org <mailto:Gluster-users at gluster.org>
>>     http://www.gluster.org/mailman/listinfo/gluster-users
>>     <http://www.gluster.org/mailman/listinfo/gluster-users>
>>
>>
>>
>>
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> http://www.gluster.org/mailman/listinfo/gluster-users
>
>
>
>------------------------------------------------------------------------
>
>_______________________________________________
>Gluster-users mailing list
>Gluster-users at gluster.org
>http://www.gluster.org/mailman/listinfo/gluster-users

-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.
--
This message is intended only for the addressee and may contain
confidential information. Unless you are that person, you may not
disclose its contents or use it in any way and are requested to delete
the message along with any attachments and notify us immediately.
This email is not intended to, nor should it be taken to, constitute advice.
The information provided is correct to our knowledge & belief and must not
be used as a substitute for obtaining tax, regulatory, investment, legal or
any other appropriate advice.

"Transact" is operated by Integrated Financial Arrangements Ltd.
29 Clement's Lane, London EC4N 7AE. Tel: (020) 7608 4900 Fax: (020) 7608 5300.
(Registered office: as above; Registered in England and Wales under
number: 3727592). Authorised and regulated by the Financial Conduct
Authority (entered on the Financial Services Register; no. 190856).
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20161031/6780fd5c/attachment.html>


More information about the Gluster-users mailing list