[Gluster-users] URGENT: Update issues from 3.6.6 to 3.10.2 Accessing files via samba come up with permission denied

[Diego Remolina]

This is a bit puzzling, not sure what difference it would make, but:

1. Try to open file that has a problem, ie. MyRevitFile.rvt
Revit opens and shows a window that says access denied.

2. Rename file, i.e from windows explorer right click, rename to
MyRevitFile2.rvt

3. Without opening the file, rename file back to the original, i.e
MyRevitFile.rvt

4. Double click on file and now it will open just fine without the
Access Denied error.

Any explanation for this? Could the rename operation be forcing or
updating some attributes that then allow the file to open?

Diego

On Tue, May 30, 2017 at 10:57 AM, Diego Remolina <dijuremo at gmail.com> wrote:
> This is what I see in the logs set from smb.conf via line ->
> glusterfs:logfile = /var/log/samba/glusterfs-projects.log
>
> [2017-05-30 14:52:31.051524] E [MSGID: 123001]
> [io-cache.c:564:ioc_open_cbk] 0-export-io-cache: inode context is NULL
> (a97bc9bb-68cf-4a69-aef7-39766b323c14) [Invalid argument]
> [2017-05-30 14:52:31.241850] W [MSGID: 114031]
> [client-rpc-fops.c:1100:client3_3_getxattr_cbk] 0-export-client-0:
> remote operation failed. Path:
> /projects/INACTIVE/WESTCOAST/Automotive/Acura/AS-Acura of Richmond/02
> DRAWINGS/02 ARCH/CrownAcura-SD02-ArchModel.rvt (a97bc9bb-68cf-4a69-
> aef7-39766b323c14). Key: glusterfs.get_real_filename:desktop.ini [Not
> a directory]
> [2017-05-30 14:52:31.242956] W [MSGID: 114031]
> [client-rpc-fops.c:1100:client3_3_getxattr_cbk] 0-export-client-1:
> remote operation failed. Path:
> /projects/INACTIVE/WESTCOAST/Automotive/Acura/AS-Acura of Richmond/02
> DRAWINGS/02 ARCH/CrownAcura-SD02-ArchModel.rvt (a97bc9bb-68cf-4a69-
> aef7-39766b323c14). Key: glusterfs.get_real_filename:desktop.ini [Not
> a directory]
>
>
> On Tue, May 30, 2017 at 10:37 AM, Diego Remolina <dijuremo at gmail.com> wrote:
>> Hi,
>>
>> Over the weekend we updated a two server glusterfs 3.6.6 install to
>> 3.10.2 We also updated samba and samba-vfs to the latest in CentOS. I
>> enabled several of the newer caching features from gluster 3.9 for
>> small file performance and samba, and we now seem to have some issues
>> with accessing files from glusterfs. When users try to access some
>> files, they get a Permission denied message. This seems to be only via
>> samba as I am able to su - username and then do strings on the file.
>>
>> [root at ysmha02 gluster-backups]# rpm -qa | grep gluster
>> glusterfs-client-xlators-3.10.2-1.el7.x86_64
>> glusterfs-server-3.10.2-1.el7.x86_64
>> glusterfs-api-3.10.2-1.el7.x86_64
>> glusterfs-3.10.2-1.el7.x86_64
>> glusterfs-cli-3.10.2-1.el7.x86_64
>> centos-release-gluster310-1.0-1.el7.centos.noarch
>> samba-vfs-glusterfs-4.4.4-14.el7_3.x86_64
>> glusterfs-fuse-3.10.2-1.el7.x86_64
>> glusterfs-libs-3.10.2-1.el7.x86_64
>> glusterfs-rdma-3.10.2-1.el7.x86_64
>>
>> [root at ysmha02 gluster-backups]# rpm -qa | grep samba
>> samba-common-libs-4.4.4-14.el7_3.x86_64
>> samba-common-tools-4.4.4-14.el7_3.x86_64
>> samba-libs-4.4.4-14.el7_3.x86_64
>> samba-4.4.4-14.el7_3.x86_64
>> samba-client-libs-4.4.4-14.el7_3.x86_64
>> samba-vfs-glusterfs-4.4.4-14.el7_3.x86_64
>> samba-common-4.4.4-14.el7_3.noarch
>>
>> On the samba logs for the machine I notice something weird, samba
>> seems to be trying to stat the file we are trying as a directory to
>> see if it contains desktop.ini:
>>
>> [2017/05/30 10:13:07.297026,  0]
>> ../source3/modules/vfs_glusterfs.c:870(vfs_gluster_stat)
>>  glfs_stat(ACTIVE/Automotive/FORD/AN - Ford East/02
>> DRAWINGS/CURRENT/AN-FORD EAST_04-05-17_CD_R17.rvt/desktop.ini) failed:
>> Not a directory
>> [2017/05/30 10:13:07.298155,  0]
>> ../source3/modules/vfs_glusterfs.c:870(vfs_gluster_stat)
>>  glfs_stat(ACTIVE/Automotive/FORD/AN - Ford East/02
>> DRAWINGS/CURRENT/AN-FORD EAST_04-05-17_CD_R17.rvt/desktop.ini) failed:
>> Not a directory
>>
>> This seems to be happening only with files with the .rvt extension.
>> Though these files are usually larger in size vs other smaller excel,
>> power point, etc files.
>>
>> Here are the complete options for the volume:
>>
>> https://pastebin.com/ZH2vMsMN
>>
>> I turned off performance.cache-samba-metadata again to see if that
>> would help, but seems it does not help.
>>
>> I really appreciate any help with this.
>>
>> DIego