[Gluster-users] performance in 3.3

[Anand Avati]

I noticed you are mounting with direct-io-mode=enable. That disables kernel
readahead and can affect read perf.

Avati
On Oct 18, 2012 6:44 PM, "Doug Schouten" <dschoute at sfu.ca> wrote:

> Hi,
>
> I am noticing a rather slow read performance using GlusterFS 3.3 with the
> following configuration:
>
> Number of Bricks: 4
> Transport-type: tcp
> Bricks:
> Brick1: server1:/srv/data
> Brick2: server2:/srv/data
> Brick3: server3:/srv/data
> Brick4: server4:/srv/data
> Options Reconfigured:
> features.quota: off
> features.quota-timeout: 1800
> performance.flush-behind: on
> performance.io-thread-count: 64
> performance.quick-read: on
> performance.stat-prefetch: on
> performance.io-cache: on
> performance.write-behind: on
> performance.read-ahead: on
> performance.write-behind-**window-size: 4MB
> performance.cache-refresh-**timeout: 1
> performance.cache-size: 4GB
> nfs.rpc-auth-allow: none
> network.frame-timeout: 60
> nfs.disable: on
> performance.cache-max-file-**size: 1GB
>
>
> The servers are connected with bonded 1Gb ethernet, and have LSI MegaRAID
> arrays with 12x1 TB disks in RAID-6 array, using XFS file system mounted
> like:
>
> xfs     logbufs=8,logbsize=32k,**noatime,nodiratime  0    0
>
> and we use the FUSE client
>
> localhost:/global /global glusterfs defaults,direct-io-mode=**
> enable,log-level=WARNING,log-**file=/var/log/gluster.log 0 0
>
> Our files are all >= 2MB. When rsync-ing we see about 50MB/s read
> performance which improves to 250MB/s after the first copy. This indicates
> to me that the disk caching is working as expected. However I am rather
> surprised by the low 50MB/s read speed; this is too low to be limited by
> network, and the native disk read performance is way better. Is there some
> configuration that can improve this situation?
>
> thanks,
>
>
> --
>
>
>  Doug Schouten
>  Research Associate
>  TRIUMF
> ______________________________**_________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.**org/mailman/listinfo/gluster-**users<http://supercolony.gluster.org/mailman/listinfo/gluster-users>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20121018/b95203c1/attachment.html>