[Gluster-users] One error/warning message after upgrade 5.11 -> 6.8

Thu May 28 14:02:48 UTC 2020

Yesterday another ovirt user hit the issue (or similar one)  after gluster v6.6 to 6.8 upgrade.
I guess Adrian can provide the logs, so we check if it is the same issue or not.

Best Regards,
Strahil Nikolov

На 28 май 2020 г. 14:15:55 GMT+03:00, Alan Orth <alan.orth at gmail.com> написа:
>We upgraded from 5.10 or 5.11 (can't remember) to 6.8 a few months ago
>and
>I see a lot of these type of "Permission denied" errors in our brick
>logs
>as well.
>
>[2020-05-24 00:52:43.681065] I [MSGID: 115060]
>[server-rpc-fops.c:938:_gf_server_log_setxattr_failure] 0-homes-server:
>35337278: SETXATTR /user/public_html/xdf_applications
>(96e88263-71ae-4228-997b-f4d47fcebc39) ==> set-ctime-mdata, client:
>CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0,
>error-xlator: homes-access-control
>[2020-05-24 00:52:43.681080] I [MSGID: 115060]
>[server-rpc-fops_v2.c:898:server4_setxattr_cbk] 0-homes-server: client:
>CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0,
>error-xlator: homes-access-control [Permission denied]
>[2020-05-24 00:52:43.968633] I [MSGID: 139001]
>[posix-acl.c:263:posix_acl_log_permit_denied] 0-homes-access-control:
>client:
>CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0,
>gfid: db01821c-6402-4ce5-bba6-41cdedb98191,
>req(uid:48,gid:48,perm:2,ngrps:1),
>ctx(uid:957,gid:957,in-groups:0,perm:664,updated-fop:LOOKUP, acl:-)
>[Permission denied]
>[2020-05-24 00:52:43.968671] I [MSGID: 115060]
>[server-rpc-fops.c:938:_gf_server_log_setxattr_failure] 0-homes-server:
>35337285: SETXATTR /user/public_html/.htaccess
>(db01821c-6402-4ce5-bba6-41cdedb98191) ==> set-ctime-mdata, client:
>CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0,
>error-xlator: homes-access-control
>[2020-05-24 00:52:43.968683] I [MSGID: 115060]
>[server-rpc-fops_v2.c:898:server4_setxattr_cbk] 0-homes-server: client:
>CTX_ID:2467b1b0-4fc4-4e29-89f7-6472abc905ad-GRAPH_ID:0-PID:4028-HOST:server1.org-PC_NAME:homes-client-4-RECON_NO:-0,
>error-xlator: homes-access-control [Permission denied]
>
>There are thousands of these in my brick logs over the past months.
>Volume
>is distribute replicate with replica 2 on GlusterFS 6.8. Client is 6.8.
>Underlying filesystem on the bricks is XFS. As far as I can see there
>is no
>problem accessing any of these files from the FUSE mount, so I don't
>even
>know what permission denied means in this context.
>
>Hope that with the troubleshooting. Cheers!
>
>On Tue, Apr 21, 2020 at 8:00 PM Amar Tumballi <amar at kadalu.io> wrote:
>
>> There seems to be a burst of issues when people upgraded to 5.x or
>6.x
>> from 3.12 (Thanks to you and Strahil, who have reported most of
>them).
>>
>> Latest update from Strahil is that if files are copied fresh on 7.5
>> series, there are no issues.
>>
>> We are in process of identifying the patch, and also provide an
>option to
>> disable 'acl' for testing. Will update once we identify the issue.
>>
>> Regards,
>> Amar
>>
>>
>>
>> On Sat, Apr 11, 2020 at 11:10 AM Hu Bert <revirii at googlemail.com>
>wrote:
>>
>>> Hi,
>>>
>>> no one has seen such messages?
>>>
>>> Regards,
>>> Hubert
>>>
>>> Am Mo., 6. Apr. 2020 um 06:13 Uhr schrieb Hu Bert
><revirii at googlemail.com
>>> >:
>>> >
>>> > Hello,
>>> >
>>> > i just upgraded my servers and clients from 5.11 to 6.8; besides
>one
>>> > connection problem to the gluster download server everything went
>>> > fine.
>>> >
>>> > On the 3 gluster servers i mount the 2 volumes as well, and only
>there
>>> > (and not on all the other clients) there are some messages in the
>log
>>> > file of both mount logs:
>>> >
>>> > [2020-04-06 04:10:53.552561] W [MSGID: 114031]
>>> > [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk]
>>> > 0-persistent-client-2: remote operation failed [Permission denied]
>>> > [2020-04-06 04:10:53.552635] W [MSGID: 114031]
>>> > [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk]
>>> > 0-persistent-client-1: remote operation failed [Permission denied]
>>> > [2020-04-06 04:10:53.552639] W [MSGID: 114031]
>>> > [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk]
>>> > 0-persistent-client-0: remote operation failed [Permission denied]
>>> > [2020-04-06 04:10:53.553226] E [MSGID: 148002]
>>> > [utime.c:146:gf_utime_set_mdata_setxattr_cbk] 0-persistent-utime:
>dict
>>> > set of key for set-ctime-mdata failed [Permission denied]
>>> > The message "W [MSGID: 114031]
>>> > [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk]
>>> > 0-persistent-client-2: remote operation failed [Permission
>denied]"
>>> > repeated 4 times between [2020-04-06 04:10:53.552561] and
>[2020-04-06
>>> > 04:10:53.745542]
>>> > The message "W [MSGID: 114031]
>>> > [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk]
>>> > 0-persistent-client-1: remote operation failed [Permission
>denied]"
>>> > repeated 4 times between [2020-04-06 04:10:53.552635] and
>[2020-04-06
>>> > 04:10:53.745610]
>>> > The message "W [MSGID: 114031]
>>> > [client-rpc-fops_v2.c:851:client4_0_setxattr_cbk]
>>> > 0-persistent-client-0: remote operation failed [Permission
>denied]"
>>> > repeated 4 times between [2020-04-06 04:10:53.552639] and
>[2020-04-06
>>> > 04:10:53.745632]
>>> > The message "E [MSGID: 148002]
>>> > [utime.c:146:gf_utime_set_mdata_setxattr_cbk] 0-persistent-utime:
>dict
>>> > set of key for set-ctime-mdata failed [Permission denied]"
>repeated 4
>>> > times between [2020-04-06 04:10:53.553226] and [2020-04-06
>>> > 04:10:53.746080]
>>> >
>>> > Anything to worry about?
>>> >
>>> >
>>> > Regards,
>>> > Hubert
>>> ________
>>>
>>>
>>>
>>> Community Meeting Calendar:
>>>
>>> Schedule -
>>> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
>>> Bridge: https://bluejeans.com/441850968
>>>
>>> Gluster-users mailing list
>>> Gluster-users at gluster.org
>>> https://lists.gluster.org/mailman/listinfo/gluster-users
>>>
>>
>>
>> --
>> --
>> https://kadalu.io
>> Container Storage made easy!
>>
>> ________
>>
>>
>>
>> Community Meeting Calendar:
>>
>> Schedule -
>> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
>> Bridge: https://bluejeans.com/441850968
>>
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> https://lists.gluster.org/mailman/listinfo/gluster-users
>>