[Gluster-devel] inode list memory usage

[Harshavardhana]

On 02/26/2010 03:58 AM, Mike Terzo wrote:
> On Thu, Feb 25, 2010 at 1:49 PM, Harshavardhana<harsha at gluster.com>  wrote:
>    
>> On Thu, Feb 25, 2010 at 11:46 AM, Shehjar Tikoo<shehjart at gluster.com>
>> wrote:
>>      
>>> Mike Terzo wrote:
>>>        
>>>> I have a very simple glusterfs config setup. I have 2 tcp hosts
>>>> configured as:
>>>>
>>>> volume LABVOL
>>>>         type cluster/replicate
>>>>         option block-size 4MB
>>>>         subvolumes gfs1 gfs2
>>>> end-volume
>>>>
>>>>          
>> Could you share with us your entire volume files? and the version of
>> glusterfs under use?.
>> There is no such option for "cluster/replicate" called "option block-size
>> 4MB"
>>      
> That's my fault, that's left over from when I was using stripe.
>
> Here's my config:
>
> volume gfs1
>      type protocol/client
>      option transport-type tcp
>      option transport.socket.nodelay on
>      option remote-host gluster1
>      option remote-subvolume brick
> end-volume
>
> volume gfs2
>      type protocol/client
>      option transport-type tcp
>      option transport.socket.nodelay on
>      option remote-host gluster2
>      option remote-subvolume brick
> end-volume
>
> volume LABVOL
>      type cluster/replicate
>      option block-size 4MB
>      subvolumes gfs1 gfs2
> end-volume
>
> volume readahead
>    type performance/read-ahead
>    option page-count 8           # 2 is default option
>    option force-atime-update off # default is off
>    subvolumes LABVOL
> end-volume
>
> volume writebehind
>      type performance/write-behind
>      option window-size 4MB
>      subvolumes readahead
> end-volume
>
> volume threads
>      type performance/io-threads
>      option thread-count 3
>      subvolumes writebehind
> end-volume
>
> volume cache
>      type performance/io-cache
>      option cache-size 16MB
>      subvolumes threads
> end-volume
>
>
> I've tried echo 2>  /proc/sys/vm/drop_caches and that still hasn't
> worked along with calling sync, and found some mention of echo 3 into
> drop_caches as well.
>
> None seem to help.
>
> I added -DDEBUG to my compile, i'm still trying to understand
> everything in that file.
>
> Here's what valgrind is telling me is using all the memory:
>
> ==17821== 16,967,936 bytes in 132,562 blocks are possibly lost in loss
> record 66 of 67
> ==17821==    at 0x4A1AD7D: calloc (vg_replace_malloc.c:279)
> ==17821==    by 0x4B47EEC: __inode_create (inode.c:460)
> ==17821==    by 0x4B480F7: inode_new (inode.c:500)
> ==17821==    by 0x608E9BE: fuse_lookup (fuse-bridge.c:596)
> ==17821==    by 0x609BE8F: fuse_thread_proc (fuse-bridge.c:3182)
> ==17821==    by 0x4D820F9: start_thread (in /lib/libpthread-2.3.6.so)
> ==17821==    by 0x4F58CE1: clone (in /lib/libc-2.3.6.so)
> ==17821==
> ==17821==
> ==17821== 31,815,600 bytes in 132,565 blocks are still reachable in
> loss record 67 of 67
> ==17821==    at 0x4A1AD7D: calloc (vg_replace_malloc.c:279)
> ==17821==    by 0x4B48013: __inode_create (inode.c:475)
> ==17821==    by 0x4B480F7: inode_new (inode.c:500)
> ==17821==    by 0x608E9BE: fuse_lookup (fuse-bridge.c:596)
> ==17821==    by 0x609BE8F: fuse_thread_proc (fuse-bridge.c:3182)
> ==17821==    by 0x4D820F9: start_thread (in /lib/libpthread-2.3.6.so)
> ==17821==    by 0x4F58CE1: clone (in /lib/libc-2.3.6.so)
> ==17821==
>
> These continue to grow.
>
> thanks
> --mike terzo
>
>    
Can you state the glusterfs version under use here?. There is a patch 
for inode invalidation which is under review.

Regards
Harshavardhana
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at nongnu.org
> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>
>    


-- 
Harshavardhana
http://www.gluster.com