[Gluster-users] Cannot remove files

[HUANG Qiulan]

Hi Pierre,

Thank you for your constructive suggestion.

I'll have a try and let you know.

I have one question about what you mentioned the logical version of files. Does it mean all the files in gluster labeled with version?


Thank you very much!

Cheers,
Qiulan

> -----Original Messages-----
> From: "Pierre Léonard" <pierre-mgp-jouy.inra at agsic.net>
> Sent Time: Wednesday, May 27, 2015
> To: "HUANG Qiulan" <huangql at ihep.ac.cn>, gluster-users at gluster.org
> Cc: pierre-mgp-jouy.inra at agsic.net
> Subject: Re: [Gluster-users] Cannot remove files
> 
> Hi HUANG,
> 
> I got that problem some time. It came for my different volumes when one 
> node  quit the volume management because of a network problem, or more 
> often because of a glusterd daemon stop.
> 
> So You have to control that all the glusterd daemon are on on each node 
> "service glusterd status" if you find one stopped restart it.
> Then you have to do a rebalance operation on each volume manage by all 
> the node of your glusterd file system :
> 
> gluster volume rebalance <volumeName> start
> ...
> 
> That take some time in backgroud, depending  of the node number and the 
> size. After that you will get back the logical vision of your file s.
> 
> I do that yesterday on my 14 nodes gluster cluster. The question is now 
> to monitor the glusterd daemon in order to restart it when it stop. I 
> will use webmin which can monitor any services.
> 
> Hoping that it help you.
> 
> Pierre Léonard
> > Dear all,
> >
> > I found a strange cases that I remove the directory from server side including the hide files under .gluster/, while I can still list the directory.
> >
> >
> > Server side:
> >
> >
> > ls: /data1/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data2/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data3/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data4/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data5/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data6/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data7/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data8/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data9/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data10/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data11/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data12/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data13/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data14/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data15/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data16/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data17/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> > ls: /data18/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory
> >
> > Client side:
> >
> > [root at hep ~]# ls /datafs/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log/ -l
> > total 0
> > ?--------- ? ? ? ?            ? ana101.csh
> > ?--------- ? ? ? ?            ? ana103.csh
> > ?--------- ? ? ? ?            ? ana39.csh
> > ?--------- ? ? ? ?            ? ana45.csh
> > ?--------- ? ? ? ?            ? ana55.csh
> > ?--------- ? ? ? ?            ? ana5.csh
> > ?--------- ? ? ? ?            ? ana65.csh
> > ?--------- ? ? ? ?            ? ana68.csh
> > ?--------- ? ? ? ?            ? ana69.csh
> > ?--------- ? ? ? ?            ? ana82.csh
> > ?--------- ? ? ? ?            ? ana83.csh
> > ?--------- ? ? ? ?            ? ana87.csh
> > ?--------- ? ? ? ?            ? ana99.csh
> >
> > So, it's weird that we can see the deleted directory exist from client.
> >
> > We deployed glusterfs-3.5.2 and set 2 replicas.
> >
> > Did someone know this issue? And how can I delete the directory clearly?
> >
> > Thank you very much in advance. Looking forward to your reply.
> >
> > Thanks,
> > Qiulan
> >
> >
> >
> > _______________________________________________
> > Gluster-users mailing list
> > Gluster-users at gluster.org
> > http://www.gluster.org/mailman/listinfo/gluster-users
>