[Gluster-users] URGENT: Update issues from 3.6.6 to 3.10.2 Accessing files via samba come up with permission denied

[Diego Remolina]

Please download the log file from this link:

https://drive.google.com/open?id=0B8EAPWIe4oyKN0h0X1pZVkRWVEU

Let me know if you need any other log files.

Diego

On Wed, May 31, 2017 at 11:19 AM, Raghavendra Talur <rtalur at redhat.com> wrote:
> If possible please share the glusterfs-* log files from /var/log/samba.
>
> This might be because of cluster.lookup-optimize. Adding Poornima and
> Raghavendra Gowdappa to help with this.
>
>
> On Wed, May 31, 2017 at 1:03 AM, Diego Remolina <dijuremo at gmail.com> wrote:
>> This is a bit puzzling, not sure what difference it would make, but:
>>
>> 1. Try to open file that has a problem, ie. MyRevitFile.rvt
>> Revit opens and shows a window that says access denied.
>>
>> 2. Rename file, i.e from windows explorer right click, rename to
>> MyRevitFile2.rvt
>>
>> 3. Without opening the file, rename file back to the original, i.e
>> MyRevitFile.rvt
>>
>> 4. Double click on file and now it will open just fine without the
>> Access Denied error.
>>
>> Any explanation for this? Could the rename operation be forcing or
>> updating some attributes that then allow the file to open?
>>
>> Diego
>>
>> On Tue, May 30, 2017 at 10:57 AM, Diego Remolina <dijuremo at gmail.com> wrote:
>>> This is what I see in the logs set from smb.conf via line ->
>>> glusterfs:logfile = /var/log/samba/glusterfs-projects.log
>>>
>>> [2017-05-30 14:52:31.051524] E [MSGID: 123001]
>>> [io-cache.c:564:ioc_open_cbk] 0-export-io-cache: inode context is NULL
>>> (a97bc9bb-68cf-4a69-aef7-39766b323c14) [Invalid argument]
>>> [2017-05-30 14:52:31.241850] W [MSGID: 114031]
>>> [client-rpc-fops.c:1100:client3_3_getxattr_cbk] 0-export-client-0:
>>> remote operation failed. Path:
>>> /projects/INACTIVE/WESTCOAST/Automotive/Acura/AS-Acura of Richmond/02
>>> DRAWINGS/02 ARCH/CrownAcura-SD02-ArchModel.rvt (a97bc9bb-68cf-4a69-
>>> aef7-39766b323c14). Key: glusterfs.get_real_filename:desktop.ini [Not
>>> a directory]
>>> [2017-05-30 14:52:31.242956] W [MSGID: 114031]
>>> [client-rpc-fops.c:1100:client3_3_getxattr_cbk] 0-export-client-1:
>>> remote operation failed. Path:
>>> /projects/INACTIVE/WESTCOAST/Automotive/Acura/AS-Acura of Richmond/02
>>> DRAWINGS/02 ARCH/CrownAcura-SD02-ArchModel.rvt (a97bc9bb-68cf-4a69-
>>> aef7-39766b323c14). Key: glusterfs.get_real_filename:desktop.ini [Not
>>> a directory]
>>>
>>>
>>> On Tue, May 30, 2017 at 10:37 AM, Diego Remolina <dijuremo at gmail.com> wrote:
>>>> Hi,
>>>>
>>>> Over the weekend we updated a two server glusterfs 3.6.6 install to
>>>> 3.10.2 We also updated samba and samba-vfs to the latest in CentOS. I
>>>> enabled several of the newer caching features from gluster 3.9 for
>>>> small file performance and samba, and we now seem to have some issues
>>>> with accessing files from glusterfs. When users try to access some
>>>> files, they get a Permission denied message. This seems to be only via
>>>> samba as I am able to su - username and then do strings on the file.
>>>>
>>>> [root at ysmha02 gluster-backups]# rpm -qa | grep gluster
>>>> glusterfs-client-xlators-3.10.2-1.el7.x86_64
>>>> glusterfs-server-3.10.2-1.el7.x86_64
>>>> glusterfs-api-3.10.2-1.el7.x86_64
>>>> glusterfs-3.10.2-1.el7.x86_64
>>>> glusterfs-cli-3.10.2-1.el7.x86_64
>>>> centos-release-gluster310-1.0-1.el7.centos.noarch
>>>> samba-vfs-glusterfs-4.4.4-14.el7_3.x86_64
>>>> glusterfs-fuse-3.10.2-1.el7.x86_64
>>>> glusterfs-libs-3.10.2-1.el7.x86_64
>>>> glusterfs-rdma-3.10.2-1.el7.x86_64
>>>>
>>>> [root at ysmha02 gluster-backups]# rpm -qa | grep samba
>>>> samba-common-libs-4.4.4-14.el7_3.x86_64
>>>> samba-common-tools-4.4.4-14.el7_3.x86_64
>>>> samba-libs-4.4.4-14.el7_3.x86_64
>>>> samba-4.4.4-14.el7_3.x86_64
>>>> samba-client-libs-4.4.4-14.el7_3.x86_64
>>>> samba-vfs-glusterfs-4.4.4-14.el7_3.x86_64
>>>> samba-common-4.4.4-14.el7_3.noarch
>>>>
>>>> On the samba logs for the machine I notice something weird, samba
>>>> seems to be trying to stat the file we are trying as a directory to
>>>> see if it contains desktop.ini:
>>>>
>>>> [2017/05/30 10:13:07.297026,  0]
>>>> ../source3/modules/vfs_glusterfs.c:870(vfs_gluster_stat)
>>>>  glfs_stat(ACTIVE/Automotive/FORD/AN - Ford East/02
>>>> DRAWINGS/CURRENT/AN-FORD EAST_04-05-17_CD_R17.rvt/desktop.ini) failed:
>>>> Not a directory
>>>> [2017/05/30 10:13:07.298155,  0]
>>>> ../source3/modules/vfs_glusterfs.c:870(vfs_gluster_stat)
>>>>  glfs_stat(ACTIVE/Automotive/FORD/AN - Ford East/02
>>>> DRAWINGS/CURRENT/AN-FORD EAST_04-05-17_CD_R17.rvt/desktop.ini) failed:
>>>> Not a directory
>>>>
>>>> This seems to be happening only with files with the .rvt extension.
>>>> Though these files are usually larger in size vs other smaller excel,
>>>> power point, etc files.
>>>>
>>>> Here are the complete options for the volume:
>>>>
>>>> https://pastebin.com/ZH2vMsMN
>>>>
>>>> I turned off performance.cache-samba-metadata again to see if that
>>>> would help, but seems it does not help.
>>>>
>>>> I really appreciate any help with this.
>>>>
>>>> DIego
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> http://lists.gluster.org/mailman/listinfo/gluster-users