[Gluster-users] RDMA Performance ?'s with 3.4.0

[Justin Clift]

On 17/07/2013, at 2:46 PM, Ryan Aydelott wrote:
> In some basic testing using 2 RDMA gluster servers configured as a replicated pair, I'm seeing better significantly better performance with IPoIB versus RDMA only volumes (almost 2x in write performance and ~10-20% in read).  
> 
> Has anyone had a similar experience?

For me, using stripe 2 and not in depth testing at the time (a few weeks ago
with the new RDMA code merged), I was getting good write performance (500MB/s)
but very bad read performance (80-90MB/s).

That was just on two initial gluster boxes, with the volume mounted to a third
one.  The volumes were RDMA only.  The 80-90MS/s figure seems awfully similar
to GigE kind of line speed though, so I wonder if something was somehow sending
the data down the wrong link.  (no idea, might not be)

I plan on looking at this stuff properly again in a while, but want to get a
proper multi-node regression testing suite set up and working first (so we can
all use it).  Maybe based on Autotest or similar (not sure yet).

Not sure if this info all helps... ;)

Regards and best wishes,

Justin Clift

--
Open Source and Standards @ Red Hat

twitter.com/realjustinclift