[Gluster-users] Possible to put some sort of qos/rate-limit on glusterfsd?

[James]

On Sun, Feb 2, 2014 at 12:46 AM, Andrew Lau <andrew at andrewklau.com> wrote:
> Hi all,
Hi,

>
> Sadly my google skills aren't finding me any results - is there an option to
> limit the CPU usage and/or the disk IO intensity of glusterfsd.
This is what cgroups are for. Looking forward to you setting this up
and telling us how it goes and what the optimized values are. AFAIK,
gluster doesn't have anything built in to limit this. I actually don't
think that it makes sense for it to either.

>
> Example scenario, oVirt + gluster on the same host when it comes to adding
> an extra host + replicated brick the original host with the brick goes crazy
> with 500% cpu as it copies just under 1TB of data across to the new
> replicated brick. Going crazy I mean everything else will hang, simple "ls"
> command will take 30+ seconds.
Not sure what the correct solution is here. Maybe other gluster dev's
can comment. Although it's really not detailed and you comment is
unclear, so i'd elaborate before expecting a good response.

>
> Limiting the network bandwidth to 200Mbps seems to solve this issue, I'm
> quite sure this is a CPU issue rather than IO so I was wondering if there's
> any possibility to limit this down so the nic's itself don't have to get
> rate limited.
I occasionally use shorewall+puppet-gluster to rate limit the network
interfaces. Puppet-Gluster could do per interface and per port/gluster
connection throttling.

>
> Thanks,
> Andrew

HTH,
James