[Gluster-users] GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)

Wed Mar 26 15:25:14 UTC 2014

Hello all,

I'm having some trouble with nfs access to a gluster volume. When I connect the share as a gluster volume, everything is fine.
The problem starts, however, when I try to access it through nfs.
We're running rhel 6.4 with gluster 3.4.2-1. The brick is on a disk formatted ext4 (64 bit) of 20 TB (not good, I know, I know, it's only a temporary situation)

directory that causes issues (this changes randomly from time to time):
/brick-xiv/caviar_data11/2011/201106/20110610/37

---- gluster server
ll /brick-xiv/caviar_data11/2011/201106/20110610/
...
drwxrwsr-x 2 960 1003 12288 Jun 15  2011 36
drwxrwsr-x 2 960 1003 12288 Jun 15  2011 37
drwxrwsr-x 2 960 1003  4096 Jun 10  2011 38
drwxrwsr-x 2 960 1003  4096 Jun 14  2011 39
drwxrwsr-x 2 960 1003 12288 Jun 15  2011 40
...

---- win 7 nfs client-----
Access is denied

---- linux nfs client-----
mount -t nfs -o vers=3,tcp lpr-nas01:/caviar_data11 /media/

[root at lpr-nas01 glusterfs]# ll /media/2011/201106/20110610/37
ls: /media/2011/201106/20110610/37: No such file or directory
ls: /media/2011/201106/20110610/37/NN.0000073942064.00001.pdf: No such file or directory
ls: /media/2011/201106/20110610/37/NN.0000073992450.00010.tif: No such file or directory
ls: /media/2011/201106/20110610/37/NN.0000073992757.00012.tif: No such file or directory
ls: /media/2011/201106/20110610/37/NN.0000073939027.00001.pdf: No such file or directory
...
total 4793
-rwxrwxr-x 0 nfsnobody 1003 43120 Jun 10  2011 NN.0000073872953.00001.pdf
-rwxrwxr-x 0 nfsnobody 1003 43120 Jun 10  2011 NN.0000073873465.00001.pdf
-rwxrwxr-x 0 nfsnobody 1003 43120 Jun 10  2011 NN.0000073873469.00001.pdf
....

ll /media/2011/201106/20110614:
ls: cannot access /media/2011/201106/20110614/37: No such file or directory
..
drwxrwsr-x 2 nfsnobody 1003 12288 Jun 14  2011 35
drwxrwsr-x 2 nfsnobody 1003 12288 Jun 14  2011 36
d????????? ? ?         ?        ?            ? 37
drwxrwsr-x 2 nfsnobody 1003  4096 Jun 15  2011 38
drwxrwsr-x 2       960 1003 12288 Jun 14  2011 39
drwxrwsr-x 2       960 1003 12288 Jun 14  2011 40

------nfs.log------
[2014-03-26 14:58:55.280545] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.280743] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.280794] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.280807] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec1252e, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.281313] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.281540] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.281563] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.281574] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec1252f, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.282425] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.282596] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.282620] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.282631] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12530, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.283216] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.283339] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.283361] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.283371] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12531, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.283864] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.284005] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.284032] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.284043] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12532, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.284629] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.284753] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.284793] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.284839] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12533, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.288616] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.288755] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.288778] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.288789] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12534, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.289496] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.289665] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.289689] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.289699] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12535, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.290394] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.290592] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.290616] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.290632] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12536, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.291738] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.291867] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.291890] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.291901] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12537, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.293460] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.293585] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.293607] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.293618] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12538, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.294157] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.294279] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.294300] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.294310] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12539, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.295102] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.295225] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.295247] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.295267] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec1253a, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.295970] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.296093] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.296115] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.296125] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec1253b, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.390010] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.390389] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.390498] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.390528] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec1253c, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.391242] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.391710] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.391766] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.391792] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec1253d, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.443142] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.443511] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.443536] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.443547] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec1253e, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.444749] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.445058] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.445117] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.445129] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec1253f, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.445993] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.446340] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.446439] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.446473] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12540, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.447712] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.448014] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.448067] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.448100] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12541, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.458461] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.458593] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.458615] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.458626] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12542, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.459170] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.459303] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.459329] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.459340] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12543, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.459789] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.459918] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.459940] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.459951] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12544, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.460434] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.460600] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.460622] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.460632] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12545, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.461136] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.461258] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.461279] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.461290] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12546, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.461777] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.461916] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.461938] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.461955] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12547, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.462474] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.462635] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.462657] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.462667] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12548, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.463176] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.463295] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.463316] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.463326] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec12549, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.463808] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.463929] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.463951] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.463961] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec1254a, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:55.464550] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:55.464681] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:55.464703] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:55.464713] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec1254b, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:56.496178] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:56.496435] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:56.496485] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:56.496501] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec1254c, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
[2014-03-26 14:58:56.497124] E [dht-helper.c:429:dht_subvol_get_hashed] (-->/usr/lib64/glusterfs/3.4.2/xlator/debug/io-stats.so(io_stats_lookup+0x157) [0x7fa2cd5432e7] (-->/usr/lib64/libglusterfs.so.0(default_lookup+0x6d) [0x3dfe01c03d] (-->/usr/lib64/glusterfs/3.4.2/xlator/cluster/distribute.so(dht_lookup+0xa7e) [0x7fa2cd985f2e]))) 0-caviar_data11-dht: invalid argument: loc->parent
[2014-03-26 14:58:56.497345] W [client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-caviar_data11-client-0: remote operation failed: Invalid argument. Path: <gfid:00000000-0000-0000-0000-000000000000> (00000000-0000-0000-0000-000000000000)
[2014-03-26 14:58:56.497372] E [nfs3.c:755:nfs3_getattr_resume] 0-nfs-nfsv3: Unable to resolve FH: (192.168.148.46:966) caviar_data11 : 00000000-0000-0000-0000-000000000000
[2014-03-26 14:58:56.497385] W [nfs3-helpers.c:3380:nfs3_log_common_res] 0-nfs-nfsv3: XID: 1ec1254d, GETATTR: NFS: 2(No such file or directory), POSIX: 14(Bad address)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20140326/c096db33/attachment.html>