[Bugs] [Bug 1228100] New: Disperse volume: brick logs are getting filled with "anonymous fd creation failed" messages

[bugzilla at redhat.com]

https://bugzilla.redhat.com/show_bug.cgi?id=1228100

            Bug ID: 1228100
           Summary: Disperse volume: brick logs are getting filled with
                    "anonymous fd creation failed" messages
           Product: GlusterFS
           Version: 3.7.0
         Component: disperse
          Keywords: Triaged
          Severity: high
          Priority: medium
          Assignee: bugs at gluster.org
          Reporter: aspandey at redhat.com
                CC: aspandey at redhat.com, bugs at gluster.org,
                    byarlaga at redhat.com, gluster-bugs at redhat.com,
                    pkarampu at redhat.com, rkavunga at redhat.com
        Depends On: 1202758
            Blocks: 1186580 (qe_tracker_everglades), 1224136



+++ This bug was initially created as a clone of Bug #1202758 +++

Description of problem:
======================= 

Brick logs are getting filled with below messages and the filesystem is full
within no time.

[2015-03-17 11:56:04.171990] W [server-resolve.c:425:resolve_anonfd_simple]
0-server: inode for the gfid (ea84b493-b049-487a-825b-cb4bece296d7) is not
found. anonymous fd creation failed
[2015-03-17 11:56:04.172063] W [server-resolve.c:425:resolve_anonfd_simple]
0-server: inode for the gfid (ea84b493-b049-487a-825b-cb4bece296d7) is not
found. anonymous fd creation failed
[2015-03-17 11:56:04.172489] W [server-resolve.c:425:resolve_anonfd_simple]
0-server: inode for the gfid (b8bb35ff-1641-49c8-8ce2-b07f35fd4ef7) is not
found. anonymous fd creation failed
[2015-03-17 11:56:04.172567] W [server-resolve.c:425:resolve_anonfd_simple]
0-server: inode for the gfid (b8bb35ff-1641-49c8-8ce2-b07f35fd4ef7) is not
found. anonymous fd creation failed

Version-Release number of selected component (if applicable):
=============================================================
[root at vertigo tmp]# gluster --version
glusterfs 3.7dev built on Mar 12 2015 01:40:59
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General
Public License.
[root at vertigo tmp]# 

How reproducible:
=================
Tried once


Steps to Reproduce:
1. Create a 1x(8+4) disperse volume and nfs/fuse mount on the client
2. Untar linux kernel images in parallel of about 20 instances
3. Bring down 4 bricks for some time and bring them back up with "gluster
volume start force"
4. Trigger full heal from server
5. On the client do a 'du -sh  ." on the untarred directory. (Not sure if this
has to do anything with log getting filled up)

Actual results:


Expected results:


Additional info:
================
sosreports of server and clients will be attached.

--- Additional comment from Ashish Pandey on 2015-05-12 07:58:04 EDT ---

I tried to reproduce the issue with latest code but could not see such 
("anonymous fd creation failed") logs and failures.
During these steps logs were getting created but I could not find anything
which may cause logs filled.
Please check with latest code and see if you still see the above logs or any
other problematic logs.

--- Additional comment from Anand Avati on 2015-05-19 07:37:53 EDT ---

REVIEW: http://review.gluster.org/10829 (Changing log level from Warning to
Debug) posted (#1) for review on master by Ashish Pandey (aspandey at redhat.com)

--- Additional comment from Anand Avati on 2015-05-28 22:36:13 EDT ---

COMMIT: http://review.gluster.org/10829 committed in master by Pranith Kumar
Karampuri (pkarampu at redhat.com) 
------
commit e6934debda3a67b5666f1aa30b33c5267de49d84
Author: Ashish Pandey <aspandey at redhat.com>
Date:   Tue May 19 17:04:55 2015 +0530

    Changing log level from Warning to Debug

    Change-Id: Ic4306ebb5a58c2ca310e973bb562be1ca3e4885f
    BUG: 1202758
    Signed-off-by: Ashish Pandey <aspandey at redhat.com>
    Reviewed-on: http://review.gluster.org/10829
    Tested-by: NetBSD Build System
    Reviewed-by: Pranith Kumar Karampuri <pkarampu at redhat.com>


Referenced Bugs:

https://bugzilla.redhat.com/show_bug.cgi?id=1186580
[Bug 1186580] QE tracker bug for Everglades
https://bugzilla.redhat.com/show_bug.cgi?id=1202758
[Bug 1202758] Disperse volume: brick logs are getting filled with
"anonymous fd creation failed" messages
https://bugzilla.redhat.com/show_bug.cgi?id=1224136
[Bug 1224136] Disperse volume: brick logs are getting filled with
"anonymous fd creation failed" messages
-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.