[Gluster-users] tuning

[Joe Landman]

On 07/07/2011 10:01 AM, Papp Tamas wrote:
> On 2011-07-07 15:42, Joe Landman wrote:
>>> The same on the cluster volume is ~50-60 MB/s.
>>
>>
>> This is what you expect over GE, more towards the lower end of the
>> range (assuming a non-optimized driver and network stack).
>
> Why? It's GE, 60MB/s is about ~500Mbit. I expect to be at least
> ~900Mbit. Am I dreaming?:)

This is very dependent upon the IO patterns, driver, switch, port 
contention, ...

We do see 900+ Mb/s (it makes more sense to talk about this in terms of 
MB/s).  Best case you will see over a 1 GbE wire is about 117 MB/s +/- 
some.  To get there, you need to be doing large enough writes/reads for 
it to be meaningful, not suffer port contention, and a few other things.

[...]

>> I don't understand this. What are your needs, and what are your
>> expectations based upon those needs? Do you have the right equipment
>> to meet the needs, or do you need to buy more/better equipment to meet
>> the needs?
>
> 800-1000Mbit/s would be enough to me.

Try removing the channel bond.

> Actually I had never tested, that would be the optimal for our purposes.
> We do the best from the tools we have, and if it's not enough, the boss
> starting to think over it...
> I know, this is not the best way, but we have this:)
>
> What can be the bottleneck for our system, GE?
> Would 10GE for server help on this much more (single machines to cluster
> connection).

This is a complex and hard question to answer, and it involves a deep 
investigation of your system, the IO patterns, etc.



>
>
> Thank you,
>
> tamas
>
> ps.: What do you mean on optimizing network stack, jumbo frame?
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users


-- 
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics Inc.
email: landman at scalableinformatics.com
web  : http://scalableinformatics.com
        http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax  : +1 866 888 3112
cell : +1 734 612 4615