[Gluster-users] glusterfs/nfs OOM killed

[Paul Robert Marino]

you ran out of ram
tune your box or take stuff off of it if its running any thing else.
when you run out of memory the kernel just kills whatever process it
happens to find first it may or may not be the actuall process at
fault.

On Thu, Mar 20, 2014 at 9:42 AM, Jens Laas <jens.laas at uadm.uu.se> wrote:
>
> 4GB server (RHEL6).
> glusterfs-3.4.2-1.el6.x86_64 etc from gluster site.
>
> Copying files via NFS to gluster.
>
> Out of memory: Kill process 18225 (glusterfs) score 660 or sacrifice child
> Killed process 18225, UID 0, (glusterfs) total-vm:3675904kB, anon-rss:3422940kB,
> file-rss:2072kB
>
> [2014-03-20 13:19:24.951428] D [nfs3-helpers.c:1618:nfs3_log_common_call]
> 0-nfs-nfsv3: XID: 9fd2b6b3, ACCESS: args: FH: exportid
> c172abbc-6cc8-4b65-ad35-c34f10b53869, gfid cc40b980-8a77-4cbb-ba23-147e37059a2d
> [2014-03-20 13:19:24.951550] D [mem-pool.c:422:mem_get]
> (-->/usr/lib64/glusterfs/3.4.2/xlator/nfs/server.so(nfs3svc_access+0x7c)
> [0x7ffff3110b8c]
> (-->/usr/lib64/glusterfs/3.4.2/xlator/nfs/server.so(nfs3_access+0xfd)
> [0x7ffff311082d]
> (-->/usr/lib64/glusterfs/3.4.2/xlator/nfs/server.so(nfs3_call_state_init+0x45)
> [0x7ffff310b535]))) 0-mem-pool: Mem pool is full. Callocing mem
> [2014-03-20 13:19:24.951684] D [afr-common.c:745:afr_get_call_child]
> 0-gv0-replicate-0: Returning 0, call_child: 1, last_index: -1
> [2014-03-20 13:19:24.952050] D [nfs3-helpers.c:3380:nfs3_log_common_res]
> 0-nfs-nfsv3: XID: 9fd2b6b3, ACCESS: NFS: 0(Call completed successfully.), POSIX:
> 7(Argument list too long)
> [2014-03-20 13:19:24.952458] D [nfs3-helpers.c:1675:nfs3_log_create_call]
> 0-nfs-nfsv3: XID: a0d2b6b3, CREATE: args: FH: exportid
> c172abbc-6cc8-4b65-ad35-c34f10b53869, gfid cc40b980-8a77-4cbb-ba23-147e37059a2d,
> name: 1.0, mode: EXCLUSIVE
> [2014-03-20 13:19:24.952522] D [mem-pool.c:422:mem_get]
> (-->/usr/lib64/glusterfs/3.4.2/xlator/nfs/server.so(nfs3svc_create+0xa7)
> [0x7ffff3115e27]
> (-->/usr/lib64/glusterfs/3.4.2/xlator/nfs/server.so(nfs3_create+0x38b)
> [0x7ffff3115c5b]
> (-->/usr/lib64/glusterfs/3.4.2/xlator/nfs/server.so(nfs3_call_state_init+0x45)
> [0x7ffff310b535]))) 0-mem-pool: Mem pool is full. Callocing mem
> [2014-03-20 13:19:24.954278] D
> [afr-transaction.c:1144:afr_post_nonblocking_entrylk_cbk] 0-gv0-replicate-0: Non
> blocking entrylks done. Proceeding to FOP
> [2014-03-20 13:19:24.966742] D [afr-lk-common.c:447:transaction_lk_op]
> 0-gv0-replicate-0: lk op is for a transaction
> [2014-03-20 13:19:24.967190] D
> [afr-transaction.c:1094:afr_post_nonblocking_inodelk_cbk] 0-gv0-replicate-0: Non
> blocking inodelks done. Proceeding to FOP
> [2014-03-20 13:19:24.967324] D [client-rpc-fops.c:2789:client_fdctx_destroy]
> 0-gv0-client-0: sending release on fd
> [2014-03-20 13:19:24.967362] D [client-rpc-fops.c:2789:client_fdctx_destroy]
> 0-gv0-client-1: sending release on fd
> [2014-03-20 13:19:24.967485] D [nfs3-helpers.c:3449:nfs3_log_newfh_res]
> 0-nfs-nfsv3: XID: a0d2b6b3, CREATE: NFS: 0(Call completed successfully.), POSIX:
> 0(Success), FH: exportid c172abbc-6cc8-4b65-ad35-c34f10b53869, gfid
> be79d2ff-0339-435f-ac36-b313e089e245
> [Thread 0x7ffff0e27700 (LWP 18236) exited]
> [Thread 0x7ffff4852700 (LWP 18231) exited]
> [Thread 0x7ffff568a700 (LWP 18230) exited]
> [Thread 0x7ffff608b700 (LWP 18229) exited]
> [Thread 0x7ffff6a8c700 (LWP 18228) exited]
>
> Program terminated with signal SIGKILL, Killed.
> The program no longer exists.
> (gdb)
>
> Regards,
> Jens
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users