[Bugs] [Bug 1224136] New: Disperse volume: brick logs are getting filled with "anonymous fd creation failed" messages

[bugzilla at redhat.com]

https://bugzilla.redhat.com/show_bug.cgi?id=1224136

            Bug ID: 1224136
           Summary: Disperse volume: brick logs are getting filled with
                    "anonymous fd creation failed" messages
           Product: Red Hat Gluster Storage
           Version: 3.1
         Component: glusterfs
     Sub Component: disperse
          Keywords: Triaged
          Severity: high
          Priority: medium
          Assignee: rhs-bugs at redhat.com
          Reporter: byarlaga at redhat.com
        QA Contact: byarlaga at redhat.com
                CC: aspandey at redhat.com, bugs at gluster.org,
                    byarlaga at redhat.com, gluster-bugs at redhat.com,
                    pkarampu at redhat.com, rkavunga at redhat.com
        Depends On: 1202758
            Blocks: 1186580 (qe_tracker_everglades)
             Group: redhat



+++ This bug was initially created as a clone of Bug #1202758 +++

Description of problem:
======================= 

Brick logs are getting filled with below messages and the filesystem is full
within no time.

[2015-03-17 11:56:04.171990] W [server-resolve.c:425:resolve_anonfd_simple]
0-server: inode for the gfid (ea84b493-b049-487a-825b-cb4bece296d7) is not
found. anonymous fd creation failed
[2015-03-17 11:56:04.172063] W [server-resolve.c:425:resolve_anonfd_simple]
0-server: inode for the gfid (ea84b493-b049-487a-825b-cb4bece296d7) is not
found. anonymous fd creation failed
[2015-03-17 11:56:04.172489] W [server-resolve.c:425:resolve_anonfd_simple]
0-server: inode for the gfid (b8bb35ff-1641-49c8-8ce2-b07f35fd4ef7) is not
found. anonymous fd creation failed
[2015-03-17 11:56:04.172567] W [server-resolve.c:425:resolve_anonfd_simple]
0-server: inode for the gfid (b8bb35ff-1641-49c8-8ce2-b07f35fd4ef7) is not
found. anonymous fd creation failed

Version-Release number of selected component (if applicable):
=============================================================
[root at vertigo tmp]# gluster --version
glusterfs 3.7dev built on Mar 12 2015 01:40:59
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General
Public License.
[root at vertigo tmp]# 

How reproducible:
=================
Tried once


Steps to Reproduce:
1. Create a 1x(8+4) disperse volume and nfs/fuse mount on the client
2. Untar linux kernel images in parallel of about 20 instances
3. Bring down 4 bricks for some time and bring them back up with "gluster
volume start force"
4. Trigger full heal from server
5. On the client do a 'du -sh  ." on the untarred directory. (Not sure if this
has to do anything with log getting filled up)

Actual results:


Expected results:


Additional info:
================
sosreports of server and clients will be attached.

--- Additional comment from Ashish Pandey on 2015-05-12 07:58:04 EDT ---

I tried to reproduce the issue with latest code but could not see such 
("anonymous fd creation failed") logs and failures.
During these steps logs were getting created but I could not find anything
which may cause logs filled.
Please check with latest code and see if you still see the above logs or any
other problematic logs.

--- Additional comment from Anand Avati on 2015-05-19 07:37:53 EDT ---

REVIEW: http://review.gluster.org/10829 (Changing log level from Warning to
Debug) posted (#1) for review on master by Ashish Pandey (aspandey at redhat.com)


Referenced Bugs:

https://bugzilla.redhat.com/show_bug.cgi?id=1186580
[Bug 1186580] QE tracker bug for Everglades
https://bugzilla.redhat.com/show_bug.cgi?id=1202758
[Bug 1202758] Disperse volume: brick logs are getting filled with
"anonymous fd creation failed" messages
-- 
You are receiving this mail because:
You are on the CC list for the bug.
Unsubscribe from this bug https://bugzilla.redhat.com/token.cgi?t=Y0PcrEatAH&a=cc_unsubscribe