<div dir="ltr"><div>Hey Tamal,<br><br></div>Sorry for the delay. See my comments inline.<br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Feb 28, 2017 at 10:29 AM, Tamal Saha <span dir="ltr"><<a href="mailto:tamal@appscode.com" target="_blank">tamal@appscode.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi,</div><div>I am running a GlusterFS cluster in Kubernetes. This has a single 1x2 volume. I am dealing with a split-brain sitution. During debugging I noticed that, the files in the backend bricks does not have the proper trusted.afr xattr. Given this volume has 2 bricks, I should see</div><div>files with the following 2 afr, I am guessing:</div><div><br></div><div>trusted.afr.vol-client-0</div><div>trusted.afr.vol-client-1</div><div><br></div><div>But I see files with xattrs below:</div><div><br></div><div>trusted.afr.vol-client-2</div><div>trusted.afr.vol-client-3</div><div>trusted.afr.vol-client-5</div><div><br></div><div>As I run the bricks as pods in Kubernetes, I have from time to time added and removed bricks fron this volume. Basically the pod IPs changed when the pods get restarted. My questions are:</div><div><br></div><div>1. Am I seeing wrong trusted.afr?</div></div></blockquote><div>AFAIK, the numbers 2,3,and 5 you are seeing in trusted.afr is because you had added bricks to your volume. This is because of the change [1].<br></div><div>I suspect that you are getting 3 brick IDs in the changelog, since it was 1x3 volume after adding the brick to the volume.<br></div><div>You can check for the brick IDs/name of the trusted.afr attributes in the vol file "<volname>.tcp-fuse.vol" and grep for "afr-pending-xattr"<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>2. When I remove-brick and add a new brick and then run heal full, does it reapply the trusted.afrs properly?</div></div></blockquote><div>What do you mean by reapplying trusted.afr? Are you referring to changing the values of attributes or changing the brick IDs?<br><br>[1] <a href="https://github.com/gluster/glusterfs-specs/blob/master/done/GlusterFS%203.6/Persistent%20AFR%20Changelog%20xattributes.md">https://github.com/gluster/glusterfs-specs/blob/master/done/GlusterFS%203.6/Persistent%20AFR%20Changelog%20xattributes.md</a><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><br></div><div>Thanks,</div><div>-Tamal</div><div><br></div>
</div>
<br>______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-users</a><br></blockquote></div><br></div></div>