[Gluster-users] Memory usage high on server sides

[Chris Jin]

Hi, I just installed glusterfs 3.0.3 on three servers, and copied 300GB
small files in thousands of directories from our old file system to
glusterfs. The 300GB files are replicated to two of the three servers.
It took us about 16 hours. However, after it finished, the glusterfs
process still hold about 700MB memory, which is about 30% of the total
memory. Could someone tell me why? And is there a solution for this?

By the way, we suppose to use internal ip address for clients to connect
servers. But it sometimes use external ip address to connect servers.
How can I solve this problem?

The following are the server vol file and error messages.

volume posix1
  type storage/posix
  option directory /gfs/r2/f1
end-volume

volume locks1
    type features/locks
    subvolumes posix1
end-volume

volume brick1
    type performance/io-threads
    option thread-count 8
    subvolumes locks1
end-volume

volume server-tcp
    type protocol/server
    option transport-type tcp
    option auth.addr.brick1.allow 192.168.0.*
    option transport.socket.listen-port 6991
    option transport.socket.nodelay on
    subvolumes brick1
end-volume



[2010-04-12 14:20:14] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.135.58.12:1017
[2010-04-12 14:20:14] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.135.58.12:1017
[2010-04-12 14:20:14] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1016
[2010-04-12 14:20:14] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1016
[2010-04-12 14:20:14] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1017 disconnected
[2010-04-12 14:20:14] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1016 disconnected
[2010-04-12 14:20:14] N [server-helpers.c:842:server_connection_destroy]
server-tcp: destroyed connection of
s7.pikiware.com-4657-2010/04/12-08:09:39:823330-s2
[2010-04-12 14:20:24] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1013
[2010-04-12 14:20:24] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1013
[2010-04-12 14:20:24] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1012
[2010-04-12 14:20:24] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1012
[2010-04-12 14:20:24] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1013 disconnected
[2010-04-12 14:20:24] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1012 disconnected
[2010-04-12 14:20:24] N [server-helpers.c:842:server_connection_destroy]
server-tcp: destroyed connection of
s7.pikiware.com-4657-2010/04/12-08:09:39:823330-s2
[2010-04-12 14:20:34] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1009
[2010-04-12 14:20:34] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1009
[2010-04-12 14:20:34] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1008
[2010-04-12 14:20:34] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1008
[2010-04-12 14:20:34] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1009 disconnected
[2010-04-12 14:20:34] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1008 disconnected
[2010-04-12 14:20:34] N [server-helpers.c:842:server_connection_destroy]
server-tcp: destroyed connection of
s7.pikiware.com-4657-2010/04/12-08:09:39:823330-s2
[2010-04-12 14:20:44] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1001
[2010-04-12 14:20:44] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1001
[2010-04-12 14:20:44] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1000
[2010-04-12 14:20:44] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1000
[2010-04-12 14:20:44] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1001 disconnected
[2010-04-12 14:20:44] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1000 disconnected