[Gluster-devel] Re: [Gluster-users] I/O fair share to avoid I/O bottlenecks on small clsuters

[Ran]

You guys are talking about network IO im taking about the gluster server disk IO
the idea to shape the trafic does make sence seens the virt machines
server do use network to get to the disks(gluster)
but what about if there are say 5 KVM servers(with VPS's) all on
gluster what do you do then ? its not quite fair share seens every
server has its own fair share and doesnt see the others .

Also there are other applications that uses gluster like mail etc..
and i see that gluster IO is very high very often cousing the all
storage not to work .
Its very disturbing .



2010/1/31, Gordan Bobic <gordan at bobich.net>:
> Traffic shaping with tc and iptables are your friends. ;)
> Of course, if you are genuinely running out of bandwidth nothing will
> solve the lack of bandwidth, but if you merely need to make sure it is
> distributed more fairly and sensibly between the machines, it can be done.
>
> Typically I would put each guest VM into a class limited to 50% of the
> host bandwidth, and put them at equal priority, with a few packet
> scheduling tweaks (e.g. prioritizing small packets, ACKs, ssh, ping,
> etc.) That way the network I/O can be kept responsive, while no one VM
> would be allowed to eat all the available bandwidth.
>
> Gordan
>
> Mickey Mazarick wrote:
>> Can you tell us a little more about your setup? I'm running many
>> hundreds of vms on our cluster but I found infiniband is necessary if
>> you have any large amount of io (databases, lots of drive access etc).
>>
>> You may simply be saturating your io if you only have a single gigabit
>> interface to your storage. Things like NFS mount can direct all your io
>> down one gig link and can be the death knell to your distributed
>> parallel filer.
>>
>> -Mic
>>
>> Ran wrote:
>>> Hi ,
>>> I recently posted an issue regarding a situation that happen when
>>> say 1 virtual machine images takes down the entire server IO
>>> then the entire storage become slow in such way that noting work
>>> emails , web etc...
>>> gluster gays posted that virtual machine is a main goal of the storage
>>> and that they probebly implement a fair share IO options to avoid this
>>> cases .
>>>
>>> Can anyone tell me what are the plans for this , it apear to me that
>>> this is 1 of the most important issues on such storage seens it is not
>>> possible to run more then a few virtual machins in parallel .
>>>
>>> Many thanks ,
>>> _______________________________________________
>>> Gluster-users mailing list
>>> Gluster-users at gluster.org
>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>>
>>
>>
>>
>> _______________________________________________
>> Gluster-devel mailing list
>> Gluster-devel at nongnu.org
>> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>
>
>
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at nongnu.org
> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>