[Gluster-devel] setfacl: testfile: Remote I/O error (zfsonlinux, gluster 3.6, CentOS 6.6)

Niels de Vos ndevos at redhat.com
Tue Nov 25 08:35:22 UTC 2014


On Tue, Nov 25, 2014 at 11:14:10AM +0530, Kiran Patil wrote:
> zfs set acltype=posixacl mnt resolved the issue.

Nice find! Could you add that option yoo the ZFS page in the wiki
please?

    http://gluster.org/community/documentation/index.php/GlusterOnZFS

Thanks,
Niels


> 
> Thanks,
> Kiran.
> 
> On Tue, Nov 25, 2014 at 11:06 AM, Kiran Patil <kiran at fractalio.com> wrote:
> 
> > We found that it is not gluster issue but zfs.
> >
> > [root at fractal-c92e mnt]# touch testfile
> >
> > [root at fractal-c92e mnt]# setfacl -m u:14:r testfile
> > setfacl: testfile: Operation not supported
> >
> > Thanks,
> > Kiran
> >
> > On Tue, Nov 25, 2014 at 10:59 AM, Kiran Patil <kiran at fractalio.com> wrote:
> >
> >> d-backends-brick0.log file contents:
> >> -----------------------------------------------
> >> [2014-11-25 05:11:33.080409] I [MSGID: 100030] [glusterfsd.c:2018:main]
> >> 0-/usr/local/sbin/glusterfsd: Started running /usr/local/sbin/glusterfsd
> >> version 3.6.1 (args: /usr/local/sbin/glusterfsd -s fractal-c92e.fractal.lan
> >> --volfile-id patchy.fractal-c92e.fractal.lan.d-backends-brick0 -p
> >> /var/lib/glusterd/vols/patchy/run/fractal-c92e.fractal.lan-d-backends-brick0.pid
> >> -S /var/run/cfe03a7c541a9c1c850d543e6e0918ac.socket --brick-name
> >> /d/backends/brick0 -l /var/log/glusterfs/bricks/d-backends-brick0.log
> >> --xlator-option *-posix.glusterd-uuid=c96fcb89-965a-4c5c-902a-6a9a80441119
> >> --brick-port 49152 --xlator-option patchy-server.listen-port=49152)
> >> [2014-11-25 05:11:33.116700] I [graph.c:269:gf_add_cmdline_options]
> >> 0-patchy-server: adding option 'listen-port' for volume 'patchy-server'
> >> with value '49152'
> >> [2014-11-25 05:11:33.116761] I [graph.c:269:gf_add_cmdline_options]
> >> 0-patchy-posix: adding option 'glusterd-uuid' for volume 'patchy-posix'
> >> with value 'c96fcb89-965a-4c5c-902a-6a9a80441119'
> >> [2014-11-25 05:11:33.119334] I
> >> [rpcsvc.c:2142:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured
> >> rpc.outstanding-rpc-limit with value 64
> >> [2014-11-25 05:11:33.119548] W [options.c:898:xl_opt_validate]
> >> 0-patchy-server: option 'listen-port' is deprecated, preferred is
> >> 'transport.socket.listen-port', continuing with correction
> >> [2014-11-25 05:11:33.174277] W [posix.c:5681:init] 0-patchy-posix: Posix
> >> access control list is not supported.
> >> [2014-11-25 05:11:33.181185] W [graph.c:344:_log_if_unknown_option]
> >> 0-patchy-server: option 'rpc-auth.auth-glusterfs' is not recognized
> >> [2014-11-25 05:11:33.181295] W [graph.c:344:_log_if_unknown_option]
> >> 0-patchy-server: option 'rpc-auth.auth-unix' is not recognized
> >> [2014-11-25 05:11:33.181337] W [graph.c:344:_log_if_unknown_option]
> >> 0-patchy-server: option 'rpc-auth.auth-null' is not recognized
> >> [2014-11-25 05:11:33.181406] W [graph.c:344:_log_if_unknown_option]
> >> 0-patchy-quota: option 'timeout' is not recognized
> >> Final graph:
> >>
> >> +------------------------------------------------------------------------------+
> >>   1: volume patchy-posix
> >>   2:     type storage/posix
> >>   3:     option glusterd-uuid c96fcb89-965a-4c5c-902a-6a9a80441119
> >>   4:     option directory /d/backends/brick0
> >>   5:     option volume-id 3338a2e4-7c97-4462-854e-e0eee73dc707
> >>   6: end-volume
> >>   7:
> >>   8: volume patchy-changelog
> >>   9:     type features/changelog
> >>  10:     option changelog-brick /d/backends/brick0
> >>  11:     option changelog-dir /d/backends/brick0/.glusterfs/changelogs
> >>  12:     option changelog-barrier-timeout 120
> >>  13:     subvolumes patchy-posix
> >>  14: end-volume
> >>  15:
> >>  16: volume patchy-access-control
> >>  17:     type features/access-control
> >>  18:     subvolumes patchy-changelog
> >>  19: end-volume
> >>  20:
> >>  21: volume patchy-locks
> >>  22:     type features/locks
> >>  23:     subvolumes patchy-access-control
> >>  24: end-volume
> >>  25:
> >>  26: volume patchy-io-threads
> >>  27:     type performance/io-threads
> >>  28:     subvolumes patchy-locks
> >>  29: end-volume
> >>  30:
> >>  31: volume patchy-barrier
> >>  32:     type features/barrier
> >>  33:     option barrier disable
> >>  34:     option barrier-timeout 120
> >>  35:     subvolumes patchy-io-threads
> >>  36: end-volume
> >>  37:
> >>  38: volume patchy-index
> >>  39:     type features/index
> >>  40:     option index-base /d/backends/brick0/.glusterfs/indices
> >>  41:     subvolumes patchy-barrier
> >>  42: end-volume
> >>  43:
> >>  44: volume patchy-marker
> >>  45:     type features/marker
> >>  46:     option volume-uuid 3338a2e4-7c97-4462-854e-e0eee73dc707
> >>  47:     option timestamp-file /var/lib/glusterd/vols/patchy/marker.tstamp
> >>  48:     option xtime off
> >>  49:     option gsync-force-xtime off
> >>  50:     option quota off
> >>  51:     subvolumes patchy-index
> >>  52: end-volume
> >>  53:
> >>  54: volume patchy-quota
> >>  55:     type features/quota
> >>  56:     option volume-uuid patchy
> >>  57:     option server-quota off
> >>  58:     option timeout 0
> >>  59:     option deem-statfs off
> >>  60:     subvolumes patchy-marker
> >>  61: end-volume
> >>  62:
> >>  63: volume /d/backends/brick0
> >>  64:     type debug/io-stats
> >>  65:     option latency-measurement off
> >>  66:     option count-fop-hits off
> >>  67:     subvolumes patchy-quota
> >>  68: end-volume
> >>  69:
> >>  70: volume patchy-server
> >>  71:     type protocol/server
> >>  72:     option transport.socket.listen-port 49152
> >>  73:     option rpc-auth.auth-glusterfs on
> >>  74:     option rpc-auth.auth-unix on
> >>  75:     option rpc-auth.auth-null on
> >>  76:     option transport-type tcp
> >>  77:     option auth.login./d/backends/brick0.allow
> >> 2725ffee-f51f-4553-a3dc-143f69b50115
> >>  78:     option auth.login.2725ffee-f51f-4553-a3dc-143f69b50115.password
> >> 18f7d813-349b-476e-81a5-3d348e661d60
> >>  79:     option auth.addr./d/backends/brick0.allow *
> >>  80:     subvolumes /d/backends/brick0
> >>  81: end-volume
> >>  82:
> >>
> >> +------------------------------------------------------------------------------+
> >> [2014-11-25 05:11:37.098820] I [login.c:82:gf_auth] 0-auth/login: allowed
> >> user names: 2725ffee-f51f-4553-a3dc-143f69b50115
> >> [2014-11-25 05:11:37.098881] I [server-handshake.c:585:server_setvolume]
> >> 0-patchy-server: accepted client from
> >> fractal-c92e.fractal.lan-2793-2014/11/25-05:11:33:79268-patchy-client-0-0-0
> >> (version: 3.6.1)
> >> [2014-11-25 05:12:49.700853] E [posix-helpers.c:939:posix_handle_pair]
> >> 0-patchy-posix:
> >> /d/backends/brick0/.glusterfs/b4/9b/b49bdf80-6af2-4750-a8ad-fdb56920657a:
> >> key:system.posix_acl_access flags: 0 length:44 error:Operation not supported
> >>
> >> Thanks,
> >> Kiran
> >>
> >> On Tue, Nov 25, 2014 at 12:10 AM, Vijay Bellur <vbellur at redhat.com>
> >> wrote:
> >>
> >>> On 11/24/2014 05:55 PM, Kiran Patil wrote:
> >>>
> >>>> getrlimit(RLIMIT_NOFILE, {rlim_cur=1024, rlim_max=4*1024}) = 0
> >>>> lstat("testfile", {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
> >>>> getxattr("testfile", "system.posix_acl_access", 0x7fff9ce10d00, 132) =
> >>>> -1 ENODATA (No data available)
> >>>> stat("testfile", {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
> >>>> setxattr("testfile", "system.posix_acl_access",
> >>>> "\x02\x00\x00\x00\x01\x00\x06\x00\xff\xff\xff\xff\x02\x00\
> >>>> x04\x00\x0e\x00\x00\x00\x04\x00\x04\x00\xff\xff\xff\xff\
> >>>> x10\x00\x04\x00\xff\xff\xff\xff
> >>>> \x00\x04\x00\xff\xff\xff\xff", 44, 0) = -1 EREMOTEIO (Remote I/O error)
> >>>>
> >>>
> >>> Do you happen to know from the logs which translator sends back this
> >>> error? Logs from the brick that contain "testfile" and the nfs server to
> >>> which the nfs client is connected would be a good place to begin with.
> >>>
> >>> Thanks,
> >>> Vijay
> >>>
> >>
> >>
> >

> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-devel

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 181 bytes
Desc: not available
URL: <http://supercolony.gluster.org/pipermail/gluster-devel/attachments/20141125/468e6d8d/attachment-0001.sig>


More information about the Gluster-devel mailing list