[Gluster-users] 40 gig ethernet

Bryan Whitehead driver at megahappy.net
Fri Jun 14 19:13:53 UTC 2013

I'm using 40G Infiniband with IPoIB for gluster. Here are some ping
times (from host

[root at node0.cloud ~]# ping -c 10
PING ( 56(84) bytes of data.
64 bytes from icmp_seq=1 ttl=64 time=0.093 ms
64 bytes from icmp_seq=2 ttl=64 time=0.113 ms
64 bytes from icmp_seq=3 ttl=64 time=0.163 ms
64 bytes from icmp_seq=4 ttl=64 time=0.125 ms
64 bytes from icmp_seq=5 ttl=64 time=0.125 ms
64 bytes from icmp_seq=6 ttl=64 time=0.125 ms
64 bytes from icmp_seq=7 ttl=64 time=0.198 ms
64 bytes from icmp_seq=8 ttl=64 time=0.171 ms
64 bytes from icmp_seq=9 ttl=64 time=0.194 ms
64 bytes from icmp_seq=10 ttl=64 time=0.115 ms

--- ping statistics ---
10 packets transmitted, 10 received, 0% packet loss, time 8999ms
rtt min/avg/max/mdev = 0.093/0.142/0.198/0.035 ms

On Fri, Jun 14, 2013 at 7:03 AM, Nathan Stratton <nathan at robotics.net> wrote:
> I have been playing around with Gluster on and off for the last 6 years or
> so. Most of the things that have been keeping me from using it have been
> related to latency.
> In the past I have been using 10 gig infiniband or 10 gig ethernet, recently
> the price of 40 gig ethernet has fallen quite a bit with guys like Arista.
> My question is, is this worth it at all for something like Gluster? The port
> to port latency looks impressive at under 4 microseconds, but I don't yet
> know what total system to system latency would look like assuming QSPF+
> copper cables and linux stack.
> --
> Nathan Stratton                                               Founder, CTO
> Exario Networks, Inc.
> nathan at robotics.net                                     nathan at
> exarionetworks.com
> http://www.robotics.net
> http://www.exarionetworks.com/
> Building the WebRTC solutions today that your customers will demand
> tomorrow.
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users

More information about the Gluster-users mailing list