<div dir="ltr"><div><div>Hi Ludwig,<br><br></div>There is no way to resolve gfid split-brains with type mismatch. You have to do it manually by following the steps in [1].<br></div><div>In case of type mismatch it is recommended to resolve it manually. But for only gfid mismatch in 3.11 we have a way to<br></div><div>resolve it by using the *favorite-child-policy*.<br></div><div>Since the file is not important, you can go with deleting that.<br></div><div><br>[1] <a href="https://gluster.readthedocs.io/en/latest/Troubleshooting/split-brain/#fixing-directory-entry-split-brain">https://gluster.readthedocs.io/en/latest/Troubleshooting/split-brain/#fixing-directory-entry-split-brain</a><br><br></div><div>HTH,<br></div><div>Karthik<br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jun 15, 2017 at 8:23 AM, Ludwig Gamache <span dir="ltr">&lt;<a href="mailto:ludwig@elementai.com" target="_blank">ludwig@elementai.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I am new to gluster but already like it. I did a maintenance last week where I shutdown both nodes (one after each others). I had many files that needed to be healed after that. Everything worked well, except for 1 file. It is in split-brain, with 2 different GFID. I read the documentation but it only covers the cases where the GFID is the same on both bricks. BTW, I am running Gluster 3.10.<div><br></div><div>Here are some details...</div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[root@NAS-01 .glusterfs]# gluster volume heal data01 info</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Brick 192.168.186.11:/mnt/DATA/data</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">/abc/.zsh_history </span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">/abc - Is in split-brain</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:14px"><span style="font-variant-ligatures:no-common-ligatures"></span><br></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Status: Connected</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Number of entries: 2</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:14px"><span style="font-variant-ligatures:no-common-ligatures"></span><br></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Brick 192.168.186.12:/mnt/DATA/data</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">/abc - Is in split-brain</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:14px"><span style="font-variant-ligatures:no-common-ligatures"></span><br></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">/abc/.zsh_history </span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Status: Connected</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Number of entries: 2</span></p><div><span style="font-variant-ligatures:no-common-ligatures"><br></span></div><div>On brick 1:</div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[root@NAS-01 abc]# ls -lart</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">total 75</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">dr</span><span style="font-variant-ligatures:no-common-ligatures">wxr-xr-x.  2 root  root  2 Jun  8 13:26 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(76,122,255)">.zsh_history</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">drwxr-xr-x.  3 12078 root  3 Jun 12 11:36 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(76,122,255)">.</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">drwxrwxrwt. 17 root  root 17 Jun 12 12:20 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0);background-color:rgb(0,217,0)">..</span></p></div><div><br></div><div>On brick 2:</div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[root@DC-MTL-NAS-02 abc]# ls -lart</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">total 66</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">-rw-rw-r--.  2 12078 12078 1085 Jun 12 04:42 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(230,230,230);background-color:rgb(0,0,179)">.zsh_history</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">drwxr-xr-x.  2 12078 root     3 Jun 12 10:36 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(76,122,255)">.</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">drwxrwxrwt. 17 root  root    17 Jun 12 11:20 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0);background-color:rgb(0,217,0)">..</span></p></div><div><br></div><div>Notice that on one brick, it is a file and on the other one it is a directory.</div><div><br></div><div>On brick 1:</div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[root@NAS-01 abc]# getfattr -d -m . -e hex /mnt/DATA/data/abc/.zsh_<wbr>history</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">getfattr: Removing leading &#39;/&#39; from absolute path names</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"># file: mnt/DATA/data/abc/.zsh_history</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">security.selinux=<wbr>0x73797374656d5f753a6f626a6563<wbr>745f723a756e6c6162656c65645f74<wbr>3a733000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.afr.data01-client-0=<wbr>0x000000000000000000000000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.afr.data01-client-1=<wbr>0x000000000000000200000000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.gfid=<wbr>0xdee43407139d41f091d13e106a51<wbr>f262</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.glusterfs.dht=<wbr>0x000000010000000000000000ffff<wbr>ffff</span></p></div><div><br></div><div>On brick 2:</div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">root@NAS-02 abc]# getfattr -d -m . -e hex /mnt/DATA/data/abc/.zsh_<wbr>history </span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">getfattr: Removing leading &#39;/&#39; from absolute path names</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"># file: mnt/DATA/data/abc/.zsh_history</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">security.selinux=<wbr>0x73797374656d5f753a6f626a6563<wbr>745f723a756e6c6162656c65645f74<wbr>3a733000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.afr.data01-client-0=<wbr>0x000000170000000200000000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.afr.data01-client-1=<wbr>0x000000000000000000000000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.bit-rot.version=<wbr>0x060000000000000059397acd0005<wbr>dadd</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:&#39;Andale Mono&#39;;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.gfid=<wbr>0xa70ae9af887a4a37875f5c7c81eb<wbr>c803</span></p></div><div><br></div><div>Any recommendation on how to recover from that? BTW, the file is not important and I could easily get rid of it without impact. So, if this is an easy solution...</div><div><br></div><div>Regards,</div><span class="HOEnZb"><font color="#888888"><div><br></div>-- <br><div class="m_-1290886068418900218gmail_signature"><div dir="ltr"><div dir="ltr"><span style="color:rgb(136,136,136)">Ludwig Gamache</span><br><div style="color:rgb(136,136,136)"><div dir="ltr"><div dir="ltr"><br></div></div></div></div></div></div>
</font></span></div></div>
<br>______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br></blockquote></div><br></div>