[Gluster-devel] setfacl: testfile: Remote I/O error (zfsonlinux, gluster 3.6, CentOS 6.6)

Tue Nov 25 05:36:31 UTC 2014

We found that it is not gluster issue but zfs.

[root at fractal-c92e mnt]# touch testfile

[root at fractal-c92e mnt]# setfacl -m u:14:r testfile
setfacl: testfile: Operation not supported

Thanks,
Kiran

On Tue, Nov 25, 2014 at 10:59 AM, Kiran Patil <kiran at fractalio.com> wrote:

> d-backends-brick0.log file contents:
> -----------------------------------------------
> [2014-11-25 05:11:33.080409] I [MSGID: 100030] [glusterfsd.c:2018:main]
> 0-/usr/local/sbin/glusterfsd: Started running /usr/local/sbin/glusterfsd
> version 3.6.1 (args: /usr/local/sbin/glusterfsd -s fractal-c92e.fractal.lan
> --volfile-id patchy.fractal-c92e.fractal.lan.d-backends-brick0 -p
> /var/lib/glusterd/vols/patchy/run/fractal-c92e.fractal.lan-d-backends-brick0.pid
> -S /var/run/cfe03a7c541a9c1c850d543e6e0918ac.socket --brick-name
> /d/backends/brick0 -l /var/log/glusterfs/bricks/d-backends-brick0.log
> --xlator-option *-posix.glusterd-uuid=c96fcb89-965a-4c5c-902a-6a9a80441119
> --brick-port 49152 --xlator-option patchy-server.listen-port=49152)
> [2014-11-25 05:11:33.116700] I [graph.c:269:gf_add_cmdline_options]
> 0-patchy-server: adding option 'listen-port' for volume 'patchy-server'
> with value '49152'
> [2014-11-25 05:11:33.116761] I [graph.c:269:gf_add_cmdline_options]
> 0-patchy-posix: adding option 'glusterd-uuid' for volume 'patchy-posix'
> with value 'c96fcb89-965a-4c5c-902a-6a9a80441119'
> [2014-11-25 05:11:33.119334] I
> [rpcsvc.c:2142:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured
> rpc.outstanding-rpc-limit with value 64
> [2014-11-25 05:11:33.119548] W [options.c:898:xl_opt_validate]
> 0-patchy-server: option 'listen-port' is deprecated, preferred is
> 'transport.socket.listen-port', continuing with correction
> [2014-11-25 05:11:33.174277] W [posix.c:5681:init] 0-patchy-posix: Posix
> access control list is not supported.
> [2014-11-25 05:11:33.181185] W [graph.c:344:_log_if_unknown_option]
> 0-patchy-server: option 'rpc-auth.auth-glusterfs' is not recognized
> [2014-11-25 05:11:33.181295] W [graph.c:344:_log_if_unknown_option]
> 0-patchy-server: option 'rpc-auth.auth-unix' is not recognized
> [2014-11-25 05:11:33.181337] W [graph.c:344:_log_if_unknown_option]
> 0-patchy-server: option 'rpc-auth.auth-null' is not recognized
> [2014-11-25 05:11:33.181406] W [graph.c:344:_log_if_unknown_option]
> 0-patchy-quota: option 'timeout' is not recognized
> Final graph:
>
> +------------------------------------------------------------------------------+
>   1: volume patchy-posix
>   2:     type storage/posix
>   3:     option glusterd-uuid c96fcb89-965a-4c5c-902a-6a9a80441119
>   4:     option directory /d/backends/brick0
>   5:     option volume-id 3338a2e4-7c97-4462-854e-e0eee73dc707
>   6: end-volume
>   7:
>   8: volume patchy-changelog
>   9:     type features/changelog
>  10:     option changelog-brick /d/backends/brick0
>  11:     option changelog-dir /d/backends/brick0/.glusterfs/changelogs
>  12:     option changelog-barrier-timeout 120
>  13:     subvolumes patchy-posix
>  14: end-volume
>  15:
>  16: volume patchy-access-control
>  17:     type features/access-control
>  18:     subvolumes patchy-changelog
>  19: end-volume
>  20:
>  21: volume patchy-locks
>  22:     type features/locks
>  23:     subvolumes patchy-access-control
>  24: end-volume
>  25:
>  26: volume patchy-io-threads
>  27:     type performance/io-threads
>  28:     subvolumes patchy-locks
>  29: end-volume
>  30:
>  31: volume patchy-barrier
>  32:     type features/barrier
>  33:     option barrier disable
>  34:     option barrier-timeout 120
>  35:     subvolumes patchy-io-threads
>  36: end-volume
>  37:
>  38: volume patchy-index
>  39:     type features/index
>  40:     option index-base /d/backends/brick0/.glusterfs/indices
>  41:     subvolumes patchy-barrier
>  42: end-volume
>  43:
>  44: volume patchy-marker
>  45:     type features/marker
>  46:     option volume-uuid 3338a2e4-7c97-4462-854e-e0eee73dc707
>  47:     option timestamp-file /var/lib/glusterd/vols/patchy/marker.tstamp
>  48:     option xtime off
>  49:     option gsync-force-xtime off
>  50:     option quota off
>  51:     subvolumes patchy-index
>  52: end-volume
>  53:
>  54: volume patchy-quota
>  55:     type features/quota
>  56:     option volume-uuid patchy
>  57:     option server-quota off
>  58:     option timeout 0
>  59:     option deem-statfs off
>  60:     subvolumes patchy-marker
>  61: end-volume
>  62:
>  63: volume /d/backends/brick0
>  64:     type debug/io-stats
>  65:     option latency-measurement off
>  66:     option count-fop-hits off
>  67:     subvolumes patchy-quota
>  68: end-volume
>  69:
>  70: volume patchy-server
>  71:     type protocol/server
>  72:     option transport.socket.listen-port 49152
>  73:     option rpc-auth.auth-glusterfs on
>  74:     option rpc-auth.auth-unix on
>  75:     option rpc-auth.auth-null on
>  76:     option transport-type tcp
>  77:     option auth.login./d/backends/brick0.allow
> 2725ffee-f51f-4553-a3dc-143f69b50115
>  78:     option auth.login.2725ffee-f51f-4553-a3dc-143f69b50115.password
> 18f7d813-349b-476e-81a5-3d348e661d60
>  79:     option auth.addr./d/backends/brick0.allow *
>  80:     subvolumes /d/backends/brick0
>  81: end-volume
>  82:
>
> +------------------------------------------------------------------------------+
> [2014-11-25 05:11:37.098820] I [login.c:82:gf_auth] 0-auth/login: allowed
> user names: 2725ffee-f51f-4553-a3dc-143f69b50115
> [2014-11-25 05:11:37.098881] I [server-handshake.c:585:server_setvolume]
> 0-patchy-server: accepted client from
> fractal-c92e.fractal.lan-2793-2014/11/25-05:11:33:79268-patchy-client-0-0-0
> (version: 3.6.1)
> [2014-11-25 05:12:49.700853] E [posix-helpers.c:939:posix_handle_pair]
> 0-patchy-posix:
> /d/backends/brick0/.glusterfs/b4/9b/b49bdf80-6af2-4750-a8ad-fdb56920657a:
> key:system.posix_acl_access flags: 0 length:44 error:Operation not supported
>
> Thanks,
> Kiran
>
> On Tue, Nov 25, 2014 at 12:10 AM, Vijay Bellur <vbellur at redhat.com> wrote:
>
>> On 11/24/2014 05:55 PM, Kiran Patil wrote:
>>
>>> getrlimit(RLIMIT_NOFILE, {rlim_cur=1024, rlim_max=4*1024}) = 0
>>> lstat("testfile", {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
>>> getxattr("testfile", "system.posix_acl_access", 0x7fff9ce10d00, 132) =
>>> -1 ENODATA (No data available)
>>> stat("testfile", {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
>>> setxattr("testfile", "system.posix_acl_access",
>>> "\x02\x00\x00\x00\x01\x00\x06\x00\xff\xff\xff\xff\x02\x00\
>>> x04\x00\x0e\x00\x00\x00\x04\x00\x04\x00\xff\xff\xff\xff\
>>> x10\x00\x04\x00\xff\xff\xff\xff
>>> \x00\x04\x00\xff\xff\xff\xff", 44, 0) = -1 EREMOTEIO (Remote I/O error)
>>>
>>
>> Do you happen to know from the logs which translator sends back this
>> error? Logs from the brick that contain "testfile" and the nfs server to
>> which the nfs client is connected would be a good place to begin with.
>>
>> Thanks,
>> Vijay
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-devel/attachments/20141125/1334581e/attachment-0001.html>