<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jun 20, 2017 at 8:13 PM, Jeff Darcy <span dir="ltr"><<a href="mailto:jeff@pl.atyp.us" target="_blank">jeff@pl.atyp.us</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><u></u>
<div><span class="gmail-"><div style="font-family:Arial"><br></div>
<div><br></div>
<div><br></div>
<div>On Tue, Jun 20, 2017, at 08:45 AM, Raghavendra Talur wrote:<br></div>
<blockquote type="cite"><div dir="ltr"><span class="gmail-m_2869222441537027442font" style="font-family:monospace," monospace"">Here is the data I gathered while debugging the considerable increase in memory consumption by brick process when brick multiplexing is on.<br><br>before adding 14th brick to it: 3163 MB<br>before glusterfs_graph_init is called 3171 (8 MB increase)<br>io-stats init 3180 (9 MB increase)<br>index init 3181 (1 MB increase)<br>bitrot-stub init 3182 (1 MB increase)<br>changelog init 3206 (24 MB increase)<br>posix init 3230 (24 MB increase)<br>glusterfs_autoscale_threads 3238 (8 MB increase)<br>end of glusterfs_handle_attach<br><br>Every brick attach is taking about 75 MB of virtual memory and it is consistent. Need help from respective xlators owners to confirm if init of those xlators really takes that much memory.<br><br>This is all Virtual memory data, resident memory is very nicely at 40 MB after 14 bricks.</span></div>
</blockquote><div style="font-family:Arial"><br></div>
</span><div style="font-family:Arial">Do you have the equivalent numbers for memory consumption of 14 bricks *without* multiplexing?<br></div></div></blockquote><div><br></div><div><br></div><div>Each process takes 795MB of virtual memory and resident memory is 10MB each.</div><div>Just to be clear, I am not saying that brick multiplexing isn't working. The aim is to prevent the glusterfsd process from getting OOM killed because 200 bricks when multiplexed consume 20GB of virtual memory.<br></div><div>If it is found that the additional usage of 75MB of virtual memory per every brick attach can't be removed/reduced, then the only solution would be to fix issue 151 [1] by limiting multiplexed bricks.<br></div><div>[1] <a href="https://github.com/gluster/glusterfs/issues/151">https://github.com/gluster/glusterfs/issues/151</a><br></div><div><br></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div style="font-family:Arial"></div>
<div style="font-family:Arial"><br></div>
<div style="font-family:Arial"><br></div>
</div>
<br>______________________________<wbr>_________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org">Gluster-devel@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-devel</a><br></blockquote></div><br></div></div>