[Gluster-devel] [NFS-ganesha] unlink file remains in ./glusterfs/unlinks after delete file

[Soumya Koduri]

Hi,

On 06/30/2016 11:56 AM, 梁正和 wrote:
> Hi,
>
> I'm trying to export gluster-volume by nfs-ganesha.
>
> After create --> Some I/O --> delete file from nfs mount point.
> The file has been moved to ./glusterfs/unlinkls.

There was an fd leak when a file is created using gfapi handleops (which 
NFS-Ganesha uses) and FWIU, if there is an open fd, glusterfs-server 
moves the file being removed to ".glusterfs/unlink" folder unless its 
inode entry gets purged when the inode table which it maintains gets 
full or the brick process is restarted.

The fix for "glfd" leak is already merged in master - 
"http://review.gluster.org/#/c/14532/"

Will backport this patch to 3.7 branch. If 3.7.13 merge window gets 
closed, the fix shall be available in 3.7.14. Till then to get past this 
issue, request to restart brick process.

Thanks,
Soumya

>
> Excepted result: no files in the unlink folder.
>
> Environment: single gluster server with
>
>     nfs-ganesha version: 2.2.0-6
>     glusterfs version: 3.7.12
>
> # Gluster volume info
>
>     Volume Name: for_nfs
>     Type: Distribute
>     Volume ID: 5db07be3-0f09-413e-a857-33982c1a41e7
>     Status: Started
>     Number of Bricks: 1
>     Transport-type: tcp
>     Bricks:
>     Brick1: server1:/export/d1/fs
>     Options Reconfigured:
>     performance.readdir-ahead: on
>
>
> # ganesha_mgr show_exports
>
>     Exports:
>       Id, path,    nfsv3, mnt, nlm4, rquota,nfsv40, nfsv41, nfsv42, 9p, last
>      2,  /for_nfs,  0,  0,  0,  0,  1,  0,  0,  0, Thu Jun 30 22:08:36
>     2016, 346097480 nsecs
>      0,  /,  0,  0,  0,  0,  0,  0,  0,  0, Thu Jun 30 22:00:21 2016,
>     516560773 nsecs
>
>
>
> Steps to Reproduce:
> 1. Create a gluster volume and share threoug nfs-ganesha
> 2. On the nfs mount point, do some file operation (ex echo foor >> bar)
> 3. Delete bar from the nfs mount point
>
> Result: file bar has been move to unlink folder
>
>     # pwd
>
>         /export/d1/fs/.glusterfs/unlink
>
>     # ls
>
>         cef0380d-8300-44ee-8e78-9e773938c935
>
>
>     # cat cef0380d-8300-44ee-8e78-9e773938c935
>
>         foo
>
> Thanks,
>
> --
> 梁正和 Jheng-He Liang
> otirafuu at gmail.com <mailto:navys23 at gmail.com>
>
>
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
>