[Gluster-users] Fwd: disperse heal speed up

[Serkan Çoban]

Hi Xavier,

Can you help me about the below issue? How can I increase the disperse
heal speed?
Also I would be grateful if you have detailed documentation about disperse heal,
why heal happens on disperse volume, how it is triggered? Which nodes
participate in heal process? Any client interaction?

Serkan


---------- Forwarded message ----------
From: Serkan Çoban <cobanserkan at gmail.com>
Date: Fri, Apr 8, 2016 at 5:46 PM
Subject: disperse heal speed up
To: Gluster Users <gluster-users at gluster.org>


Hi,

I am testing heal speed of disperse volume and what I see is 5-10MB/s per node.
I increased disperse.background-heals to 32 and
disperse.heal-wait-qlength to 256, but still no difference.
One thing I noticed is that, when I kill a brick process, reformat it
and restart it heal speed is nearly 20x (200MB/s/node)

But when I kill the brick, then write 100TB data, and start brick
afterwords heal is slow (5-10MB/s/node)

What is the difference between two scenarios? Why one heal is slow and
other is fast? How can I increase disperse heal speed? Should I
increase thread count to 128 or 256? I am on 78x(16+4) disperse volume
and my servers are pretty strong (2x14 cores with 512GB ram, each node
has 26x8TB disks)

Gluster version is 3.7.10.

Thanks,
Serkan