[Gluster-users] Self-healing not healing 27k files on GlusterFS 4.1.5 3 nodes replica

[mabi]

Thank you Ravi for your answer. I have now set the afr xattr as you suggested and I am running the "find . | xargs -d '\n' stat" on my gluster fuse mount for this volume.

This volume has around 3 million of files and directories so it will take a long time to finish I suppose. Do I really need to run this find over the whole volume starting from its root?

Note that I added the "-d '\n'" option in xargs in order to deal with filenames which have spaces inside.


‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Saturday, November 17, 2018 6:04 AM, Ravishankar N <ravishankar at redhat.com> wrote:

> Okay so for all files and dirs, node 2 seems to be the bad copy. Try the
> following:
>
> 1.  On both node 1 and node3, set theafr xattr for dir10:
>     setfattr -n trusted.afr.myvol-pro-client-1 -v 0x000000000000000100000001
>     /data/myvol-private/brick/data/dir1/dir2/dir3/dir4/dir5/dir6/dir7/dir8/dir9/dir10
>
> 2.  Fuse mount the volume temporarily in some location and from that
>     mount point, do a `find .|xargs stat >/dev/null`
>
>
> 3. Run`gluster volume heal $volname`
>
> HTH,
> Ravi
>
> On 11/16/2018 09:07 PM, mabi wrote:
>
> > And finally here is the output of a getfattr from both files from the 3 nodes:
> > FILE 1: /data/dir1/dir2/dir3/dir4/dir5/dir6/dir7/dir8/dir9/dir10/dir11/oc_dir/fileKey
> > NODE 1:
> > trusted.afr.dirty=0x000000000000000000000000
> > trusted.afr.myvol-pro-client-1=0x000000020000000100000000
> > trusted.gfid=0xaae4098a1a7141559cc9e564b89957cf
> > trusted.gfid2path.9a863b050c1975ed=0x32356532363136622d346662362d346232612d383934352d3161666339353666666631392f66696c654b6579
> > NODE 2:
> > trusted.afr.dirty=0x000000000000000000000000
> > trusted.gfid=0x48ccb52b788f4361b33fad43157b8ea8
> > trusted.gfid2path.32a8dc56983f7b8f=0x64396163313932632d653835652d343430322d616631302d3535353166353837656439612f66696c654b6579
> > NODE 3:
> > trusted.afr.dirty=0x000000000000000000000000
> > trusted.afr.myvol-pro-client-1=0x000000020000000100000000
> > trusted.gfid=0xaae4098a1a7141559cc9e564b89957cf
> > trusted.gfid2path.9a863b050c1975ed=0x32356532363136622d346662362d346232612d383934352d3161666339353666666631392f66696c654b6579
> > FILE 2: /data/dir1/dir2/dir3/dir4/dir5/dir6/dir7/dir8/dir9/dir10/dir11/oc_dir/username.shareKey
> > NODE 1:
> > trusted.afr.dirty=0x000000000000000000000000
> > trusted.afr.myvol-pro-client-1=0x000000020000000100000000
> > trusted.gfid=0x3c92459b8fa146699a3db38b8d41c360
> > trusted.gfid2path.510dd4750ef350f9=0x32356532363136622d346662362d346232612d383934352d3161666339353666666631392f6a6d406d616765726c2e63682e73686172654b6579
> > NODE 2:
> > trusted.afr.dirty=0x000000000000000000000000
> > trusted.gfid=0xae880a4f19824bc6a3baabe2e3c62ace
> > trusted.gfid2path.0c0f97b97351b4af=0x64396163313932632d653835652d343430322d616631302d3535353166353837656439612f6a6d406d616765726c2e63682e73686172654b6579
> > NODE 3:
> > trusted.afr.dirty=0x000000000000000000000000
> > trusted.afr.myvol-pro-client-1=0x000000020000000100000000
> > trusted.gfid=0x3c92459b8fa146699a3db38b8d41c360
> > trusted.gfid2path.510dd4750ef350f9=0x32356532363136622d346662362d346232612d383934352d3161666339353666666631392f6a6d406d616765726c2e63682e73686172654b6579