[Gluster-users] Performance expectations

[Gennadiy Nerubayev]

Hi all,

I'm using 2.0.0rc4 on a pair of infiniband connected servers. Both servers
are running 2.6.28.7, and are using ext4 on a local raid set as the storage
for Gluster. The speeds that I get writing to the aforementioned ext4 mount,
depending on benchmark and method, vary around 400MB/s (with dd) to 550MB/s+
(with iozone, bonnie, and dd directio). Next, I used the Gluster server and
client on both servers, with ib-verbs and replicate (see attached
configuration files). The best speeds that I get when writing to the Gluster
mount with this setup is about 150MB/s, going up to about 200MB/s when doing
simultaneous writes from both nodes. I tried a couple of configuration
tweaks such as writeback, but they don't seem to be having much effect.

Is there something I can do to bring the performance closer to the native
disk speed, or are there some inherent limitations somewhere that I should
be aware of?

Thanks!

-Gennadiy
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20090323/1bef674f/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: glusterfs.vol
Type: application/octet-stream
Size: 1138 bytes
Desc: not available
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20090323/1bef674f/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: glusterfsd.vol
Type: application/octet-stream
Size: 622 bytes
Desc: not available
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20090323/1bef674f/attachment-0001.obj>