[Gluster-users] Cannot remove files

[Pierre Léonard]

Hi HUANG,

I got that problem some time. It came for my different volumes when one 
node  quit the volume management because of a network problem, or more 
often because of a glusterd daemon stop.

So You have to control that all the glusterd daemon are on on each node 
"service glusterd status" if you find one stopped restart it.
Then you have to do a rebalance operation on each volume manage by all 
the node of your glusterd file system :

gluster volume rebalance <volumeName> start
...

That take some time in backgroud, depending  of the node number and the 
size. After that you will get back the logical vision of your file s.

I do that yesterday on my 14 nodes gluster cluster. The question is now 
to monitor the glusterd daemon in order to restart it when it stop. I 
will use webmin which can monitor any services.

Hoping that it help you.

Pierre Léonard
> Dear all,
>
> I found a strange cases that I remove the directory from server side including the hide files under .gluster/, while I can still list the directory.
>
>
> Server side:
>
>
> ls: /data1/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data2/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data3/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data4/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data5/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data6/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data7/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data8/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data9/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data10/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data11/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data12/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data13/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data14/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data15/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data16/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data17/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> ls: /data18/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
>
> Client side:
>
> [root at hep ~]# ls /datafs/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log/ -l
> total 0
> ?--------- ? ? ? ?            ? ana101.csh
> ?--------- ? ? ? ?            ? ana103.csh
> ?--------- ? ? ? ?            ? ana39.csh
> ?--------- ? ? ? ?            ? ana45.csh
> ?--------- ? ? ? ?            ? ana55.csh
> ?--------- ? ? ? ?            ? ana5.csh
> ?--------- ? ? ? ?            ? ana65.csh
> ?--------- ? ? ? ?            ? ana68.csh
> ?--------- ? ? ? ?            ? ana69.csh
> ?--------- ? ? ? ?            ? ana82.csh
> ?--------- ? ? ? ?            ? ana83.csh
> ?--------- ? ? ? ?            ? ana87.csh
> ?--------- ? ? ? ?            ? ana99.csh
>
> So, it's weird that we can see the deleted directory exist from client.
>
> We deployed glusterfs-3.5.2 and set 2 replicas.
>
> Did someone know this issue? And how can I delete the directory clearly?
>
> Thank you very much in advance. Looking forward to your reply.
>
> Thanks,
> Qiulan
>
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users