[Gluster-users] Anyone have that find command handy

[Joe Landman]

On 07/21/2011 12:35 PM, Mohit Anchlia wrote:
> Did this occur after adding or removing a brick and then running rebalance?

Adding and rebalance.

>
> On Thu, Jul 21, 2011 at 8:30 AM, Joe Landman
> <landman at scalableinformatics.com>  wrote:
>> On 07/21/2011 11:21 AM, Joe Landman wrote:
>>>
>>> On 07/21/2011 11:17 AM, Burnash, James wrote:
>>>>
>>>> Hi Joe.
>>>>
>>
>> Found it:
>>
>>    find $local -type f -perm +01000 -exec rm -v '{}' \;
>>
>> for $local
>>
>>
>>>> Before I answer - can you share your volume info dump?
>>>
>>> This is
>>>
>>> [root at X02 ~]# gluster volume info
>>>
>>> Volume Name: brick1
>>> Type: Distribute
>>> Status: Started
>>> Number of Bricks: 4
>>> Transport-type: tcp
>>> Bricks:
>>> Brick1: X01:/data/glusterfs/dht
>>> Brick2: X02:/data/glusterfs/dht
>>> Brick3: X03:/data/brick-sdc2/glusterfs/dht
>>> Brick4: X03:/data/brick-sdd2/glusterfs/dht
>>>
>>>
>>>>
>>>> My understanding is that those "link" files are valid if you have my
>>>> kind of config - which is distributed-replicate across 2 mirrored
>>>> pairs of backed servers. If the request for a file come into the pair
>>>> that do not have that file physically on their storage, the "link"
>>>> file is created to point to the actual location on the other mirror.
>>>> At least ... that is what I think it's supposed to do ...
>>>
>>> They are a known bug from 2.0.x time frame. I am searching my emails
>>> from 2 years ago for the magic command that removes them.
>>>
>>>>
>>>> James Burnash Unix Engineer Knight Capital Group
>>>>
>>>>
>>>> -----Original Message----- From: gluster-users-bounces at gluster.org
>>>> [mailto:gluster-users-bounces at gluster.org] On Behalf Of Joe Landman
>>>> Sent: Thursday, July 21, 2011 11:11 AM To: gluster-users Subject:
>>>> [Gluster-users] Anyone have that find command handy
>>>>
>>>> Ran into a situation that I thought had been corrected in the 2.0.x
>>>> time frame.
>>>>
>>>> [root at X03 ~]# ls -alF
>>>>
>>>> /data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
>>>>
>>>>
>>>>
>>>
>>> /data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
>>>
>>>> ---------T 1 root root 0 Jul 19 18:08
>>>>
>>>> /data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
>>>>
>>>>
>>>>
>>> ---------T 1 root root 0 Jul 21 10:48
>>>>
>>>>
>>>> /data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
>>>>
>>>>
>>>> and the real files
>>>>
>>>> [root at X02 ~]# ls -alF
>>>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_*
>>>> -rw-r--r-- 1 oracle oinstall 984227914 Jul 21 11:05
>>>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip
>>>>
>>>>
>>> -rw-r--r-- 1 root root 17028780 Jul 20 13:00
>>>>
>>>>
>>>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats
>>>>
>>>>
>>>> Note the permissions on the first as compared to the second. This
>>>> came from a rebalance operation with 3.1.5.
>>>>
>>>> Anyone have that handy
>>>>
>>>> find -perm XXXX -exec rm {}
>>>>
>>>> command handy so we can scan for and remove the ghost files? I can
>>>> search for it in my old emails, just figured I'd ask.
>>>>
>>>> -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc.
>>>> email: landman at scalableinformatics.com web :
>>>> http://scalableinformatics.com
>>>> http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121
>>>> fax : +1 866 888 3112 cell : +1 734 612 4615
>>>> _______________________________________________ Gluster-users mailing
>>>> list Gluster-users at gluster.org
>>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>>>
>>>>
>>>> DISCLAIMER: This e-mail, and any attachments thereto, is intended
>>>> only for use by the addressee(s) named herein and may contain legally
>>>> privileged and/or confidential information. If you are not the
>>>> intended recipient of this e-mail, you are hereby notified that any
>>>> dissemination, distribution or copying of this e-mail, and any
>>>> attachments thereto, is strictly prohibited. If you have received
>>>> this in error, please immediately notify me and permanently delete
>>>> the original and any copy of any e-mail and any printout thereof.
>>>> E-mail transmission cannot be guaranteed to be secure or error-free.
>>>> The sender therefore does not accept liability for any errors or
>>>> omissions in the contents of this message which arise as a result of
>>>> e-mail transmission. NOTICE REGARDING PRIVACY AND CONFIDENTIALITY
>>>> Knight Capital Group may, at its discretion, monitor and review the
>>>> content of all e-mail communications. http://www.knight.com
>>>
>>>
>>
>>
>> --
>> Joseph Landman, Ph.D
>> Founder and CEO
>> Scalable Informatics, Inc.
>> email: landman at scalableinformatics.com
>> web  : http://scalableinformatics.com
>>        http://scalableinformatics.com/sicluster
>> phone: +1 734 786 8423 x121
>> fax  : +1 866 888 3112
>> cell : +1 734 612 4615
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>


-- 
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics, Inc.
email: landman at scalableinformatics.com
web  : http://scalableinformatics.com
        http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax  : +1 866 888 3112
cell : +1 734 612 4615