<div dir="ltr">I am new to gluster but already like it. I did a maintenance last week where I shutdown both nodes (one after each others). I had many files that needed to be healed after that. Everything worked well, except for 1 file. It is in split-brain, with 2 different GFID. I read the documentation but it only covers the cases where the GFID is the same on both bricks. BTW, I am running Gluster 3.10.<div><br></div><div>Here are some details...</div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[root@NAS-01 .glusterfs]# gluster volume heal data01 info</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Brick 192.168.186.11:/mnt/DATA/data</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">/abc/.zsh_history </span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">/abc - Is in split-brain</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:14px"><span style="font-variant-ligatures:no-common-ligatures"></span><br></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Status: Connected</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Number of entries: 2</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:14px"><span style="font-variant-ligatures:no-common-ligatures"></span><br></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Brick 192.168.186.12:/mnt/DATA/data</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">/abc - Is in split-brain</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:14px"><span style="font-variant-ligatures:no-common-ligatures"></span><br></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">/abc/.zsh_history </span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Status: Connected</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Number of entries: 2</span></p><div><span style="font-variant-ligatures:no-common-ligatures"><br></span></div><div>On brick 1:</div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[root@NAS-01 abc]# ls -lart</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">total 75</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">dr</span><span style="font-variant-ligatures:no-common-ligatures">wxr-xr-x. 2 root root 2 Jun 8 13:26 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(76,122,255)">.zsh_history</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">drwxr-xr-x. 3 12078 root 3 Jun 12 11:36 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(76,122,255)">.</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">drwxrwxrwt. 17 root root 17 Jun 12 12:20 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0);background-color:rgb(0,217,0)">..</span></p></div><div><br></div><div>On brick 2:</div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[root@DC-MTL-NAS-02 abc]# ls -lart</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">total 66</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">-rw-rw-r--. 2 12078 12078 1085 Jun 12 04:42 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(230,230,230);background-color:rgb(0,0,179)">.zsh_history</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">drwxr-xr-x. 2 12078 root 3 Jun 12 10:36 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(76,122,255)">.</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">drwxrwxrwt. 17 root root 17 Jun 12 11:20 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0);background-color:rgb(0,217,0)">..</span></p></div><div><br></div><div>Notice that on one brick, it is a file and on the other one it is a directory.</div><div><br></div><div>On brick 1:</div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">[root@NAS-01 abc]# getfattr -d -m . -e hex /mnt/DATA/data/abc/.zsh_history</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">getfattr: Removing leading '/' from absolute path names</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"># file: mnt/DATA/data/abc/.zsh_history</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">security.selinux=0x73797374656d5f753a6f626a6563745f723a756e6c6162656c65645f743a733000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.afr.data01-client-0=0x000000000000000000000000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.afr.data01-client-1=0x000000000000000200000000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.gfid=0xdee43407139d41f091d13e106a51f262</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.glusterfs.dht=0x000000010000000000000000ffffffff</span></p></div><div><br></div><div>On brick 2:</div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">root@NAS-02 abc]# getfattr -d -m . -e hex /mnt/DATA/data/abc/.zsh_history </span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">getfattr: Removing leading '/' from absolute path names</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"># file: mnt/DATA/data/abc/.zsh_history</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">security.selinux=0x73797374656d5f753a6f626a6563745f723a756e6c6162656c65645f743a733000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.afr.data01-client-0=0x000000170000000200000000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.afr.data01-client-1=0x000000000000000000000000</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.bit-rot.version=0x060000000000000059397acd0005dadd</span></p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">trusted.gfid=0xa70ae9af887a4a37875f5c7c81ebc803</span></p></div><div><br></div><div>Any recommendation on how to recover from that? BTW, the file is not important and I could easily get rid of it without impact. So, if this is an easy solution...</div><div><br></div><div>Regards,</div><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><div dir="ltr"><span style="color:rgb(136,136,136)">Ludwig Gamache</span><br><div style="color:rgb(136,136,136)"><div dir="ltr"><div dir="ltr"><br></div></div></div></div></div></div>
</div></div>