[Bugs] [Bug 1312762] New: [geo-rep]: Session goes to faulty with Errno 13: Permission denied

[bugzilla at redhat.com]

https://bugzilla.redhat.com/show_bug.cgi?id=1312762

            Bug ID: 1312762
           Summary: [geo-rep]: Session goes to faulty with Errno 13:
                    Permission denied
           Product: GlusterFS
           Version: 3.7.8
         Component: geo-replication
          Severity: high
          Assignee: bugs at gluster.org
          Reporter: rhinduja at redhat.com
                CC: bugs at gluster.org



Description of problem:
=======================

During geo-rep automation testing found the worker died during history crawl
with following traceback on slave:

Traceback (most recent call last):
  File "/usr/libexec/glusterfs/python/syncdaemon/repce.py", line 113, in worker
    res = getattr(self.obj, rmeth)(*in_data[2:])
  File "/usr/libexec/glusterfs/python/syncdaemon/resource.py", line 737, in
entry_ops
    [ESTALE, EINVAL])
  File "/usr/libexec/glusterfs/python/syncdaemon/syncdutils.py", line 475, in
errno_wrap
    return call(*arg)
  File "/usr/libexec/glusterfs/python/syncdaemon/libcxattr.py", line 78, in
lsetxattr
    cls.raise_oserr()
  File "/usr/libexec/glusterfs/python/syncdaemon/libcxattr.py", line 37, in
raise_oserr
    raise OSError(errn, os.strerror(errn))
OSError: [Errno 13] Permission denied

slave.gluster.log shows following:

[2016-02-28 19:26:49.777548] W [fuse-bridge.c:1282:fuse_err_cbk]
0-glusterfs-fuse: 7: SETXATTR() /.gfid/042c10ee-949c-4eb9-ad07-3c961d03c3e7 =>
-1 (Permission denied)
[2016-02-28 19:26:49.795919] I [fuse-bridge.c:4986:fuse_thread_proc] 0-fuse:
unmounting /tmp/gsyncd-aux-mount-sTOH1n
[2016-02-28 19:26:49.798300] W [glusterfsd.c:1236:cleanup_and_exit]
(-->/lib64/libpthread.so.0(+0x7dc5) [0x7f94b60ccdc5]
-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7f94b7737905]
-->/usr/sbin/glusterfs(cleanup_and_exit+0x69) [0x7f94b7737789] ) 0-: received
signum (15), shutting down
[2016-02-28 19:26:49.798347] I [fuse-bridge.c:5685:fini] 0-fuse: Unmounting
'/tmp/gsyncd-aux-mount-sTOH1n'.
[2016-02-28 19:26:49.832822] W [fuse-bridge.c:1282:fuse_err_cbk]
0-glusterfs-fuse: 7: SETXATTR() /.gfid/9c874be7-978e-418d-8282-1ac15270ff2b =>
-1 (Permission denied)
[2016-02-28 19:26:49.851560] I [fuse-bridge.c:4986:fuse_thread_proc] 0-fuse:
unmounting /tmp/gsyncd-aux-mount-mtH5zL
[2016-02-28 19:26:49.852168] W [glusterfsd.c:1236:cleanup_and_exit]
(-->/lib64/libpthread.so.0(+0x7dc5) [0x7fa17d764dc5]
-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7fa17edcf905]
-->/usr/sbin/glusterfs(cleanup_and_exit+0x69) [0x7fa17edcf789] ) 0-: received
signum (15), shutting down
[2016-02-28 19:26:49.852220] I [fuse-bridge.c:5685:fini] 0-fuse: Unmounting
'/tmp/gsyncd-aux-mount-mtH5zL'.



Version-Release number of selected component (if applicable):
==============================================================
glusterfs-3.7.8-1.el7.x86_64


How reproducible:
=================
Happens with combination of fops like chgrp,chown,rename,hardlinks


Steps to Reproduce:
===================
1. Run geo-rep automation test suite with export testcases as:
[geo_rahul at skywalker distaf]$ echo $testcases
changelog-test-create changelog-test-chmod changelog-test-chown
changelog-test-chgrp changelog-test-symlink changelog-test-hardlink
changelog-test-truncate changelog-test-rename xsync-test-create
xsync-test-chmod xsync-test-chown xsync-test-chgrp xsync-test-symlink
xsync-test-hardlink xsync-test-truncate history-test-create history-test-chmod
history-test-chown history-test-chgrp history-test-symlink
history-test-hardlink history-test-truncate history-test-rename
history-dynamic-create history-dynamic-chmod history-dynamic-chown
history-dynamic-chgrp history-dynamic-symlink history-dynamic-hardlink
history-dynamic-truncate history-dynamic-rename
[geo_rahul at skywalker distaf]$ 

Actual results:
===============

[geo_rahul at skywalker distaf]$ time python main.py -d "geo_rep" -t "$testcases"
test_1_changelog-test-create (__main__.gluster_tests) ... ok
test_2_changelog-test-chmod (__main__.gluster_tests) ... ok
test_3_changelog-test-chown (__main__.gluster_tests) ... ok
test_4_changelog-test-chgrp (__main__.gluster_tests) ... ok
test_5_changelog-test-symlink (__main__.gluster_tests) ... ok
test_6_changelog-test-hardlink (__main__.gluster_tests) ... ok
test_7_changelog-test-truncate (__main__.gluster_tests) ... ok
test_8_changelog-test-rename (__main__.gluster_tests) ... ok
test_9_xsync-test-create (__main__.gluster_tests) ... ok
test_10_xsync-test-chmod (__main__.gluster_tests) ... ok
test_11_xsync-test-chown (__main__.gluster_tests) ... ok
test_12_xsync-test-chgrp (__main__.gluster_tests) ... ok
test_13_xsync-test-symlink (__main__.gluster_tests) ... ok
test_14_xsync-test-hardlink (__main__.gluster_tests) ... ok
test_15_xsync-test-truncate (__main__.gluster_tests) ... ok
test_16_history-test-create (__main__.gluster_tests) ... ok
test_17_history-test-chmod (__main__.gluster_tests) ... ok
test_18_history-test-chown (__main__.gluster_tests) ... ok
test_19_history-test-chgrp (__main__.gluster_tests) ... ok
test_20_history-test-symlink (__main__.gluster_tests) ... ok
test_21_history-test-hardlink (__main__.gluster_tests) ... ok
test_22_history-test-truncate (__main__.gluster_tests) ... ok
test_23_history-test-rename (__main__.gluster_tests) ... ok
test_24_history-dynamic-create (__main__.gluster_tests) ... FAIL
test_25_history-dynamic-chmod (__main__.gluster_tests) ... FAIL

Expected results:
=================

Session should not go to faulty and history cases should also be successful

-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.