[Gluster-users] How to Speed UP heal process in Glusterfs 3.10.1

[Pranith Kumar Karampuri]

Some thoughts based on this mail thread:
1) At the moment heals happen in parallel only for files not directories.
i.e. same shd process doesn't heal 2 directories at a time. But it can do
as many file heals as shd-max-threads option. That could be the reason why
Amudhan faced better performance after a while, but it is a bit difficult
to confirm without data.

2) When a file is undergoing I/O both shd and mount will contend for locks
to do I/O from bricks this probably is the reason for the slowness in I/O.
it will last only until the file is healed in parallel with the I/O from
users.

3) Serkan, Amudhan, it would be nice to have feedback about what do you
feel are the bottlenecks so that we can come up with next set of
performance improvements. One of the newer enhancements Sunil is working on
is to be able to heal larger chunks in one go rather than ~128KB chunks. It
will be configurable upto 128MB I think, this will improve throughput. Next
set of enhancements would concentrate on reducing network round trips in
doing heal and doing parallel heals of directories.


On Tue, Apr 18, 2017 at 6:22 PM, Serkan Çoban <cobanserkan at gmail.com> wrote:

> >Is this by design ? Is it tuneable ? 10MB/s/brick is too low for us.
> >We will use 10GB ethernet, healing 10MB/s/brick would be a bottleneck.
>
> That is the maximum if you are using EC volumes, I don't know about
> other volume configurations.
> With 3.9.0 parallel self heal of EC volumes should be faster though.
>
>
>
> On Tue, Apr 18, 2017 at 1:38 PM, Gandalf Corvotempesta
> <gandalf.corvotempesta at gmail.com> wrote:
> > 2017-04-18 9:36 GMT+02:00 Serkan Çoban <cobanserkan at gmail.com>:
> >> Nope, healing speed is 10MB/sec/brick, each brick heals with this
> >> speed, so one brick or one server each will heal in one week...
> >
> > Is this by design ? Is it tuneable ? 10MB/s/brick is too low for us.
> > We will use 10GB ethernet, healing 10MB/s/brick would be a bottleneck.
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-users
>



-- 
Pranith
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170419/4a71a92b/attachment.html>