[Gluster-users] 40 gig ethernet

[sal poliandro]

Most of the 40gb stuff is designed for mostly East/West traffic as that
tends to be the majority of traffic in the datacenter these days. All the
big guys make platforms that can keep full port to port across the platform
between 4-7.

40gb has not fallen that far where it is not still a decent size investment
to do right and as someone who keeps trying to fit gluster into production
I have found that other storage platforms always beat out gluster in top
end hardware. When 40gb is more high end and the 100gb starts to take
marketshare gluster may work in some enviornments but when running top of
the line network and server gear the TCO of a commerical storage product
(and the support that comes with it) always wins, at least for me.

On a side not the native linux drivers have not really kept up with the
40gb cards. Linux still has issues with some 10gb cards. If you are going
40gb talk to the people that license the dna driver.  They are in paramus
nj and do a lot of higer end networks with proper Linux drivers. The media
(dac cables or om4 mtp) dont seem to affect performance much as long as you
dont push the dac longer than 3-5 meeters.

Salvatore "Popsikle" Poliandro

Sent from my mobile, please excuse any typos. One day we will have mobile
devices where we don't need this footer :)
 On Jun 14, 2013 10:04 AM, "Nathan Stratton" <nathan at robotics.net> wrote:

> I have been playing around with Gluster on and off for the last 6 years or
> so. Most of the things that have been keeping me from using it have been
> related to latency.
>
> In the past I have been using 10 gig infiniband or 10 gig ethernet,
> recently the price of 40 gig ethernet has fallen quite a bit with guys like
> Arista.
>
> My question is, is this worth it at all for something like Gluster? The
> port to port latency looks impressive at under 4 microseconds, but I don't
> yet know what total system to system latency would look like assuming QSPF+
> copper cables and linux stack.
>
> --
> ><>
> Nathan Stratton                                               Founder, CTO
> Exario Networks, Inc.
> nathan at robotics.net                                     nathan at
> exarionetworks.com
> http://www.robotics.net
> http://www.exarionetworks.com/
>
> Building the WebRTC solutions today that your customers will demand
> tomorrow.
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20130616/7a8e5904/attachment.html>