[Bugs] [Bug 1230152] New: While running i/o's from cifs mount huge logging errors related to quick_read performance xlator : invalid argument:iobuf

Wed Jun 10 11:06:59 UTC 2015

https://bugzilla.redhat.com/show_bug.cgi?id=1230152

            Bug ID: 1230152
           Summary: While running i/o's from cifs mount huge logging
                    errors related to quick_read performance xlator :
                    invalid argument:iobuf
           Product: Red Hat Gluster Storage
           Version: 3.1
         Component: gluster-afr
          Severity: high
          Assignee: pkarampu at redhat.com
          Reporter: sbhaloth at redhat.com
        QA Contact: storage-qa-internal at redhat.com
                CC: bugs at gluster.org, gluster-bugs at redhat.com,
                    ravishankar at redhat.com
        Depends On: 1214168
            Blocks: 1186580 (qe_tracker_everglades)

+++ This bug was initially created as a clone of Bug #1214168 +++

Description of problem:
*****************************************
While running i/o's from the cifs mount there is huge logging error related to
quick_read performance xlator.

[2015-04-21 09:53:56.777612] E [iobuf.c:790:iobuf_unref] (-->
/usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7ffe259f4190] (-->
/usr/lib64/glusterfs/3.7dev/xlator/performance/quick-read.so(qr_readv_cached+0xb7)[0x7ffe1b5baec7]
(-->
/usr/lib64/glusterfs/3.7dev/xlator/performance/quick-read.so(qr_readv+0x62)[0x7ffe1b5bb4e2]
(--> /usr/lib64/libglusterfs.so.0(default_readv_resume+0x14d)[0x7ffe259fe63d]
(--> /usr/lib64/libglusterfs.so.0(call_resume_wind+0x33a)[0x7ffe25a160ca] )))))
0-iobuf: invalid argument: iobuf
[2015-04-21 09:53:56.777993] E [iobuf.c:896:iobref_unref] (-->
/usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x7ffe259f4190] (-->
/usr/lib64/glusterfs/3.7dev/xlator/performance/quick-read.so(qr_readv_cached+0xc1)[0x7ffe1b5baed1]
(-->
/usr/lib64/glusterfs/3.7dev/xlator/performance/quick-read.so(qr_readv+0x62)[0x7ffe1b5bb4e2]
(--> /usr/lib64/libglusterfs.so.0(default_readv_resume+0x14d)[0x7ffe259fe63d]
(--> /usr/lib64/libglusterfs.so.0(call_resume_wind+0x33a)[0x7ffe25a160ca] )))))
0-iobuf: invalid argument: iobref

Version-Release number of selected component (if applicable):
glusterfs-3.7dev-0.1009.git8b987be.el6.x86_64

How reproducible:
Always

Steps to Reproduce:
1. Run i/o's from cifs mount
2. Check logs for errors.

Actual results:
**********************
Huge error in the logs related to quick_read performance xlator.

Expected results:
********************
There should not be such errors.

Additional info:

--- Additional comment from Anand Avati on 2015-04-22 03:12:20 EDT ---

REVIEW: http://review.gluster.org/10329 (quick-read: Do a null check before
unref) posted (#1) for review on release-3.7 by Ravishankar N
(ravishankar at redhat.com)

--- Additional comment from Anand Avati on 2015-04-27 00:14:12 EDT ---

REVIEW: http://review.gluster.org/10329 (quick-read: Do a null check before
unref) posted (#2) for review on release-3.7 by Ravishankar N
(ravishankar at redhat.com)

--- Additional comment from Anand Avati on 2015-04-29 01:01:43 EDT ---

COMMIT: http://review.gluster.org/10329 committed in release-3.7 by Vijay
Bellur (vbellur at redhat.com) 
------
commit de909177699bdf0e084476e8191834be56edd9b0
Author: Ravishankar N <ravishankar at redhat.com>
Date:   Mon Apr 13 05:47:09 2015 +0000

    quick-read: Do a null check before unref

    Backport of http://review.gluster.org/10206

    Commit 4ea5b8d2046b9e0bc7f24cdf1b2e72ab8b462c9e seems to have removed the
check
    as a part of static analyis fixes but I'm seeing errors in the client log.

    ---------------------
    touch  /mnt/fuse_mnt/zero-byte-file
    echo 3 > /proc/sys/vm/drop_caches
    cat  /mnt/fuse_mnt/zero-byte-file

    mount log:
    [2015-04-13 05:52:21.683256] E [iobuf.c:790:iobuf_unref] (-->
    /usr/local/lib/libglusterfs.so.0(_gf_log_callingfn+0x232)[0x7feda12c0e24]
(-->
    /usr/local/lib/libglusterfs.so.0(iobuf_unref+0x56)[0x7feda1304c8e] (-->

/usr/local/lib/glusterfs/3.7dev/xlator/performance/quick-read.so(qr_readv_cached+0x466)[0x7fed95b7e2fc]
    (-->

/usr/local/lib/glusterfs/3.7dev/xlator/performance/quick-read.so(qr_readv+0x70)[0x7fed95b7e385]
    (-->

/usr/local/lib/libglusterfs.so.0(default_readv_resume+0x270)[0x7feda12d4401]
    ))))) 0-iobuf: invalid argument: iobuf

    ---------------------

    Change-Id: Ia6b29165cdef8783a716fe1e72d3d13bf0220aae
    BUG: 1214168
    Signed-off-by: Ravishankar N <ravishankar at redhat.com>
    Reviewed-on: http://review.gluster.org/10329
    Tested-by: NetBSD Build System
    Reviewed-by: Raghavendra Talur <rtalur at redhat.com>
    Tested-by: Raghavendra Talur <rtalur at redhat.com>
    Reviewed-by: Vijay Bellur <vbellur at redhat.com>

--- Additional comment from Niels de Vos on 2015-05-14 13:27:23 EDT ---

This bug is getting closed because a release has been made available that
should address the reported issue. In case the problem is still not fixed with
glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages
for several distributions should become available in the near future. Keep an
eye on the Gluster Users mailinglist [2] and the update infrastructure for your
distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

--- Additional comment from Niels de Vos on 2015-05-14 13:28:44 EDT ---

This bug is getting closed because a release has been made available that
should address the reported issue. In case the problem is still not fixed with
glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages
for several distributions should become available in the near future. Keep an
eye on the Gluster Users mailinglist [2] and the update infrastructure for your
distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

--- Additional comment from Niels de Vos on 2015-05-14 13:35:20 EDT ---

This bug is getting closed because a release has been made available that
should address the reported issue. In case the problem is still not fixed with
glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages
for several distributions should become available in the near future. Keep an
eye on the Gluster Users mailinglist [2] and the update infrastructure for your
distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

Referenced Bugs:

https://bugzilla.redhat.com/show_bug.cgi?id=1186580
[Bug 1186580] QE tracker bug for Everglades
https://bugzilla.redhat.com/show_bug.cgi?id=1214168
[Bug 1214168] While running i/o's from cifs mount huge logging errors
related to quick_read performance xlator : invalid argument:iobuf
-- 
You are receiving this mail because:
You are on the CC list for the bug.
Unsubscribe from this bug https://bugzilla.redhat.com/token.cgi?t=dpzTWHlmpN&a=cc_unsubscribe