[Gluster-devel] nfsv3 client writing file gets Invalid argument on glusterfs with quota on

[Kinglong Mee]

On 2018/3/7 10:59, Kinglong Mee wrote:
> When using nfsv3 on glusterfs-3.13.1-1.el7.x86_64 and nfs-ganesha-2.6.0-0.2rc3.el7.centos.x86_64,
> I gets strange "Invalid argument" when writing file.
> 
> 1. With quota disabled;
> nfs client mount nfs-ganesha share, and do 'll' in the testing directory.
> 
> 2. Enable quota;
> # getfattr -d -m . -e hex /root/rpmbuild/gvtest/nfs-ganesha/testfile92
> getfattr: Removing leading '/' from absolute path names
> # file: root/rpmbuild/gvtest/nfs-ganesha/testfile92
> trusted.gfid=0xe2edaac0eca8420ebbbcba7e56bbd240
> trusted.gfid2path.b3250af8fa558e66=0x39663134343566662d653530332d343831352d396635312d3236633565366332633137642f7465737466696c653932
> trusted.glusterfs.quota.9f1445ff-e503-4815-9f51-26c5e6c2c17d.contri.3=0x00000000000002000000000000000001
> 
> Notice: testfile92 without trusted.pgfid xattr.

The trusted.pgfid will be created by the next name lookup; nameless lookup don't create it.

> 3. restart glusterfs volume by "gluster volume stop/start gvtest"

Restarting glusterfsd here cleanup all inode cache from memory;
after starting, inode of testfile92's parent is NULL.

> 4. echo somedata > testfile92

Because, nfs-ganesha and nfs client has cache for testfile92,
before write fops, no name lookup happens that trusted.pgfid is not created for testfile92.

Quota_writev call quota_build_ancestry building the ancestry in quota_check_limit,
but testfile92 doesn't contain trusted.pgfid, so that write fops failed with Invalid argument.

I have no idea of fixing this problem, any comments are welcome.

thanks,
Kinglong Mee

> 5. ll testfile92
> -rw-r--r-- 1 root root    0 Mar  6 21:43 testfile92
> 
> There are some error in brick log message,
> [2018-03-07 02:30:19.222045] W [MSGID: 120003] [quota.c:821:quota_build_ancestry_cbk] 0-gvtest-quota: parent is NULL [Invalid argument]
> [2018-03-07 02:30:32.328977] W [marker-quota.c:33:mq_loc_copy] 0-marker: src loc is not valid
> [2018-03-07 02:30:32.329001] E [marker-quota.c:1488:mq_initiate_quota_task] 0-gvtest-marker: loc copy failed
> The message "W [MSGID: 120003] [quota.c:821:quota_build_ancestry_cbk] 0-gvtest-quota: parent is NULL [Invalid argument]" repeated 136 times between [2018-03-07 02:30:19.222045] and [2018-03-07 02:30:32.329708]
> [2018-03-07 02:30:32.329725] E [MSGID: 115067] [server-rpc-fops.c:1407:server_writev_cbk] 0-gvtest-server: 211: WRITEV 5 (e2edaac0-eca8-420e-bbbc-ba7e56bbd240), client: CENTOS7-MINI-2758-2018/03/07-02:26:14:328922-gvtest-client-1-0-2, error-xlator: gvtest-quota [Invalid argument]
> [2018-03-07 02:43:18.435729] W [MSGID: 120003] [quota.c:821:quota_build_ancestry_cbk] 0-gvtest-quota: parent is NULL [Invalid argument]
> [2018-03-07 02:43:18.435781] E [MSGID: 115067] [server-rpc-fops.c:1407:server_writev_cbk] 0-gvtest-server: 387: WRITEV 5 (e2edaac0-eca8-420e-bbbc-ba7e56bbd240), client: CENTOS7-MINI-2758-2018/03/07-02:26:14:328922-gvtest-client-1-0-2, error-xlator: gvtest-quota [Invalid argument]
> 
> Ps, the corresponding tcpdump is attached.
> 
>