[Gluster-users] Can't delete files after add brick and rebalance.

[kenji kondo]

Hi Guys,

I'm using the GlusterFS version 3.3.2.
I have a problem that unable to delete files as below

---------------------
$ cat log/d0105f.ai.hook
hello!
$ rm log/d0105f.ai.hook
rm: cannot remove `log/d0105f.ai.hook': No such file or directory
---------------------

This problem was found after add brick and rebalance.
I don't know this problem is relate to the rebalance.
So I checked the log in /var/log/glusterfs, and I found below suspicious
messages.

---------------------
$ tail /var/log/glusterfs/grid-kk.hs.log
[2015-01-20 09:49:44.491634] W [client3_1-fops.c:647:client3_1_unlink_cbk]
1-vol12-client-11: remote operation failed: No such file or directory
[2015-01-20 09:49:44.491696] W [fuse-bridge.c:1029:fuse_unlink_cbk]
0-glusterfs-fuse: 2982544: UNLINK() /hotchip/log/d0105f.ai.hook => -1 (No
such file or directory)
---------------------


I know above text file 'd0105f.ai.hook' exist in one gluster server with
below command.

---------------------
$ sudo getfattr -m . -n trusted.glusterfs.pathinfo log/d0105f.ai.hook
trusted.glusterfs.pathinfo="(<DISTRIBUTE:vol12-dht>
<POSIX(/export12/brick):gfs14:/export12/brick/hotchip/log/d0105f.ai.hook>)"

$ ssh gfs14
[@gfs14 /]$ ls /export12/brick/hotchip/log/d0105f.ai.hook
/export12/brick/rdcurve/log/d0105f.ai.book.o1441124.100
---------------------

Exactly, I could find the file in the brick on the server 'gfs14'.
Additionally I knew two facts that if I rename the file name to another
with 'mv' command,
I can delete it with new file name.
Furthermore, if I mount the volume newly, I could delete the file.

I think this situation is strange. Is this bug or something?


Best regards,
K. Kondo
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150123/f7f92d42/attachment.html>