[Gluster-users] RDMA Performance ?'s with 3.4.0

Justin Clift jclift at redhat.com
Wed Jul 17 14:01:33 UTC 2013

On 17/07/2013, at 2:46 PM, Ryan Aydelott wrote:
> In some basic testing using 2 RDMA gluster servers configured as a replicated pair, I'm seeing better significantly better performance with IPoIB versus RDMA only volumes (almost 2x in write performance and ~10-20% in read).  
> Has anyone had a similar experience?

For me, using stripe 2 and not in depth testing at the time (a few weeks ago
with the new RDMA code merged), I was getting good write performance (500MB/s)
but very bad read performance (80-90MB/s).

That was just on two initial gluster boxes, with the volume mounted to a third
one.  The volumes were RDMA only.  The 80-90MS/s figure seems awfully similar
to GigE kind of line speed though, so I wonder if something was somehow sending
the data down the wrong link.  (no idea, might not be)

I plan on looking at this stuff properly again in a while, but want to get a
proper multi-node regression testing suite set up and working first (so we can
all use it).  Maybe based on Autotest or similar (not sure yet).

Not sure if this info all helps... ;)

Regards and best wishes,

Justin Clift

Open Source and Standards @ Red Hat


More information about the Gluster-users mailing list