[Bugs] [Bug 1261234] New: Possible memory leak during rebalance with large quantity of files

[bugzilla at redhat.com]

https://bugzilla.redhat.com/show_bug.cgi?id=1261234

            Bug ID: 1261234
           Summary: Possible memory leak during rebalance with large
                    quantity of files
           Product: GlusterFS
           Version: 3.7.3
         Component: glusterd
          Severity: high
          Assignee: bugs at gluster.org
          Reporter: max at injapan.ru
                CC: bugs at gluster.org, gluster-bugs at redhat.com



Created attachment 1071537
  --> https://bugzilla.redhat.com/attachment.cgi?id=1071537&action=edit
statedump of rebalance process

Description of problem:
Gluster distributed volume with 4 bricks fails to rebalance due to memory
exhaustion.

I have a gluster distributed volume with 4 bricks on one physical server (this
seems strange but there are reasons for this). Bricks are formatted with ext4.
Volume spans 57T of storage space and currently contains ~2.5T in 30M files,
mostly located on brick 1. Rebalance fix-layout completed successfully, but
main rebalance fails to complete as server runs out of memory.

I've tried running
echo 2 > /proc/sys/vm/drop_caches

After approximately 24hrs server starts thrashing.

Version-Release number of selected component (if applicable):
glusterfs 3.7.3 built on Jul 28 2015 14:28:57

How reproducible:
Always

Steps to Reproduce:
1. Start rebalance
2. Wait ~24hrs

Actual results:
Server starts thrashing due to memory exhaustion.

Expected results:
Memory occupated by gluster remains relatively constant.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.