[Bugs] [Bug 1348095] GlusterFS memory leak on bricks reconnection

bugzilla at redhat.com bugzilla at redhat.com
Thu Jun 23 09:07:35 UTC 2016


https://bugzilla.redhat.com/show_bug.cgi?id=1348095



--- Comment #3 from Pranith Kumar K <pkarampu at redhat.com> ---
(In reply to Joonas Vilenius from comment #2)
> We've been using GlusterFS as a storage backend for OpenStack (Kilo) Cinder
> on CentOS 7 and have experienced quite a bit of memory leak issues starting
> with 3.6.9. We then upgraded to 3.7.11 in which the leak was roughly 10x
> less but still very much there as can be seen from these graphs
> http://ajaton.net/glusterfs/ - this unfortunately causes libvirtd to run out
> of memory over the time (hours/days) which again causes other issues. Our
> journey to 3.8.0 faced other major difficulties (bug filed 1348935) so we
> are back in 3.7.11. 
> 
> We can reproduce the issue fastest by simply creating an instance and volume
> and then keep attaching/detaching the volume to the instance until libvirtd
> dies. It is also enough to just have the mount there to have the leak
> visible. We have only observed so far the memory consumption of libvirtd
> (VmSize and VmRSS as graphed on above link).
> 
> I'm just adding the info here as was discussed on IRC, please let me know if
> there is anything i can do to help debugging the issue!

Joonas,
     Are you using gfapi+libvirt for your setup? I believe the issue you are
reporting is a bit different from what Oleksandr reported because no
disconnects are involved. Do you think you can recreate the same issue with
fuse mount? If yes, we can take statedumps of the mount process and then we
know what could be the process that is leaking.

Pranith

-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.


More information about the Bugs mailing list