[Gluster-users] Old story - glusterfs memory usage

[Raghavendra G]

Hi,

Does your mount point has large number of files? Did you try droping caches
(using echo 3 > /proc/sys/vm/drop_caches) after doing du? If yes, what were
the results?

regards,
On Thu, Mar 25, 2010 at 2:38 PM, Krzysztof Strasburger <
strasbur at chkw386.ch.pwr.wroc.pl> wrote:

> I upgraded today from 2.0.8 to 3.0.3.
> The first sad impression was that unify no longer works, but it is not that
> important. Not a surprise. Switched to dht. Tried my old "du" test:
> du /home
> (/home is a glusterfs filesystem, of course ;) and saw again the bad old
> unlimited increase of glusterfs clients memory usage. I hoped that the
> problem went to quick-read, but it didn't.
> So switched back to 2.0.10rc1, to restore unify.
> And then did a simple test, to be sure that no translators are to be
> blamed.
> I created the following, trivial setup:
>
> file loopback.vol:
> volume loopback
>  type storage/posix
>  option directory /root/loopback
> end-volume
>
> And then mounted /root/loopback on /root/loop-test:
>
> mount -t glusterfs loopback.vol /root/loop-test
>
> Do you see? No translators, even no server and networking. Just a loopback
> to a directory on the local machine.
>
> I copied then the /usr directory to /root/loop-test (c.a. 160000 files).
> And then ran "du /root/loop-test".
> Memory usage of respective glusterfs process went up from 16 MB to 50 MB.
> I could reproduce it perfectly by umounting /root/loop-test, mounting it
> again and re-running "du".
> More files touched mean more memory used by glusterfs.
> This is not a memory leak. Repeating this "du" does not cause memory
> usage go even a single byte up. Glusterfs client keeps somewhere an
> information about _every file touched_, and keeps it _forever_. As the
> situation
> did not improve since the times of glusterfs 1.3, I assume this behavior
> to be a part of its design. IMHO a wrong one. This is not a feature,
> this is a bug. It costs memory and probably performace too, if it is a kind
> of cache (with millions of entries, potentially).
> I filed a bug report almost one year ago - no change. Dear other users of
> glusterfs - are you at least able to reproduce this memory consumption
> problem? If it occurs on my site only, then the reason is somewhere in my
> system setup, otherwise - let us do something about it, finally.
> It is not in translators, it is in the core of glusterfs.
> With regards
> Krzysztof Strasburger
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>



-- 
Raghavendra G