<html>
  <head>
    <meta content="text/html; charset=windows-1252"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <p>Can you please explain How we ended up in this scenario. I think
      that will help to understand more about this scenarios and why
      gluster recommend replica 3 or arbiter volume.</p>
    <p>Regards</p>
    <p>Rafi KC<br>
    </p>
    <br>
    <div class="moz-cite-prefix">On 06/15/2017 10:46 AM, Karthik
      Subrahmanya wrote:<br>
    </div>
    <blockquote
cite="mid:CAHRDaUEA2N0ayPkZDJPif46PVfB+UpgkqdEjE8FMLN5yq3qbVA@mail.gmail.com"
      type="cite">
      <div dir="ltr">
        <div>
          <div>Hi Ludwig,<br>
            <br>
          </div>
          There is no way to resolve gfid split-brains with type
          mismatch. You have to do it manually by following the steps in
          [1].<br>
        </div>
        <div>In case of type mismatch it is recommended to resolve it
          manually. But for only gfid mismatch in 3.11 we have a way to<br>
        </div>
        <div>resolve it by using the *favorite-child-policy*.<br>
        </div>
        <div>Since the file is not important, you can go with deleting
          that.<br>
        </div>
        <div><br>
          [1] <a moz-do-not-send="true"
href="https://gluster.readthedocs.io/en/latest/Troubleshooting/split-brain/#fixing-directory-entry-split-brain">https://gluster.readthedocs.io/en/latest/Troubleshooting/split-brain/#fixing-directory-entry-split-brain</a><br>
          <br>
        </div>
        <div>HTH,<br>
        </div>
        <div>Karthik<br>
        </div>
      </div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">On Thu, Jun 15, 2017 at 8:23 AM, Ludwig
          Gamache <span dir="ltr">&lt;<a moz-do-not-send="true"
              href="mailto:ludwig@elementai.com" target="_blank">ludwig@elementai.com</a>&gt;</span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0
            .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div dir="ltr">I am new to gluster but already like it. I
              did a maintenance last week where I shutdown both nodes
              (one after each others). I had many files that needed to
              be healed after that. Everything worked well, except for 1
              file. It is in split-brain, with 2 different GFID. I read
              the documentation but it only covers the cases where the
              GFID is the same on both bricks. BTW, I am running Gluster
              3.10.
              <div><br>
              </div>
              <div>Here are some details...</div>
              <div>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                    style="font-variant-ligatures:no-common-ligatures">[root@NAS-01
                    .glusterfs]# gluster volume heal data01 info</span></p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                    style="font-variant-ligatures:no-common-ligatures">Brick
                    192.168.186.11:/mnt/DATA/data</span></p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                    style="font-variant-ligatures:no-common-ligatures">/abc/.zsh_history </span></p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                    style="font-variant-ligatures:no-common-ligatures">/abc
                    - Is in split-brain</span></p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:14px"><span
                    style="font-variant-ligatures:no-common-ligatures"></span><br>
                </p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                    style="font-variant-ligatures:no-common-ligatures">Status:
                    Connected</span></p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                    style="font-variant-ligatures:no-common-ligatures">Number
                    of entries: 2</span></p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:14px"><span
                    style="font-variant-ligatures:no-common-ligatures"></span><br>
                </p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                    style="font-variant-ligatures:no-common-ligatures">Brick
                    192.168.186.12:/mnt/DATA/data</span></p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                    style="font-variant-ligatures:no-common-ligatures">/abc
                    - Is in split-brain</span></p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:14px"><span
                    style="font-variant-ligatures:no-common-ligatures"></span><br>
                </p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                    style="font-variant-ligatures:no-common-ligatures">/abc/.zsh_history </span></p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                    style="font-variant-ligatures:no-common-ligatures">Status:
                    Connected</span></p>
                <p
                  style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                    style="font-variant-ligatures:no-common-ligatures">Number
                    of entries: 2</span></p>
                <div><span
                    style="font-variant-ligatures:no-common-ligatures"><br>
                  </span></div>
                <div>On brick 1:</div>
                <div>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">[root@NAS-01
                      abc]# ls -lart</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">total
                      75</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">dr</span><span
                      style="font-variant-ligatures:no-common-ligatures">wxr-xr-x. 
                      2 root  root  2 Jun  8 13:26 </span><span
                      style="font-variant-ligatures:no-common-ligatures;color:rgb(76,122,255)">.zsh_history</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">drwxr-xr-x. 
                      3 12078 root  3 Jun 12 11:36 </span><span
                      style="font-variant-ligatures:no-common-ligatures;color:rgb(76,122,255)">.</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">drwxrwxrwt.
                      17 root  root 17 Jun 12 12:20 </span><span
style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0);background-color:rgb(0,217,0)">..</span></p>
                </div>
                <div><br>
                </div>
                <div>On brick 2:</div>
                <div>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">[root@DC-MTL-NAS-02
                      abc]# ls -lart</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">total
                      66</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">-rw-rw-r--. 
                      2 12078 12078 1085 Jun 12 04:42 </span><span
style="font-variant-ligatures:no-common-ligatures;color:rgb(230,230,230);background-color:rgb(0,0,179)">.zsh_history</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">drwxr-xr-x. 
                      2 12078 root     3 Jun 12 10:36 </span><span
                      style="font-variant-ligatures:no-common-ligatures;color:rgb(76,122,255)">.</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">drwxrwxrwt.
                      17 root  root    17 Jun 12 11:20 </span><span
style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0);background-color:rgb(0,217,0)">..</span></p>
                </div>
                <div><br>
                </div>
                <div>Notice that on one brick, it is a file and on the
                  other one it is a directory.</div>
                <div><br>
                </div>
                <div>On brick 1:</div>
                <div>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">[root@NAS-01
                      abc]# getfattr -d -m . -e hex
                      /mnt/DATA/data/abc/.zsh_<wbr>history</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">getfattr:
                      Removing leading '/' from absolute path names</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">#
                      file: mnt/DATA/data/abc/.zsh_history</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">security.selinux=<wbr>0x73797374656d5f753a6f626a6563<wbr>745f723a756e6c6162656c65645f74<wbr>3a733000</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">trusted.afr.data01-client-0=<wbr>0x000000000000000000000000</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">trusted.afr.data01-client-1=<wbr>0x000000000000000200000000</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">trusted.gfid=<wbr>0xdee43407139d41f091d13e106a51<wbr>f262</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">trusted.glusterfs.dht=<wbr>0x000000010000000000000000ffff<wbr>ffff</span></p>
                </div>
                <div><br>
                </div>
                <div>On brick 2:</div>
                <div>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">root@NAS-02
                      abc]# getfattr -d -m . -e hex
                      /mnt/DATA/data/abc/.zsh_<wbr>history </span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">getfattr:
                      Removing leading '/' from absolute path names</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">#
                      file: mnt/DATA/data/abc/.zsh_history</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">security.selinux=<wbr>0x73797374656d5f753a6f626a6563<wbr>745f723a756e6c6162656c65645f74<wbr>3a733000</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">trusted.afr.data01-client-0=<wbr>0x000000170000000200000000</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">trusted.afr.data01-client-1=<wbr>0x000000000000000000000000</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">trusted.bit-rot.version=<wbr>0x060000000000000059397acd0005<wbr>dadd</span></p>
                  <p
                    style="margin:0px;font-size:12px;line-height:normal;font-family:'Andale
Mono';color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span
                      style="font-variant-ligatures:no-common-ligatures">trusted.gfid=<wbr>0xa70ae9af887a4a37875f5c7c81eb<wbr>c803</span></p>
                </div>
                <div><br>
                </div>
                <div>Any recommendation on how to recover from that?
                  BTW, the file is not important and I could easily get
                  rid of it without impact. So, if this is an easy
                  solution...</div>
                <div><br>
                </div>
                <div>Regards,</div>
                <span class="HOEnZb"><font color="#888888">
                    <div><br>
                    </div>
                    -- <br>
                    <div class="m_-1290886068418900218gmail_signature">
                      <div dir="ltr">
                        <div dir="ltr"><span
                            style="color:rgb(136,136,136)">Ludwig
                            Gamache</span><br>
                          <div style="color:rgb(136,136,136)">
                            <div dir="ltr">
                              <div dir="ltr"><br>
                              </div>
                            </div>
                          </div>
                        </div>
                      </div>
                    </div>
                  </font></span></div>
            </div>
            <br>
            ______________________________<wbr>_________________<br>
            Gluster-users mailing list<br>
            <a moz-do-not-send="true"
              href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
            <a moz-do-not-send="true"
              href="http://lists.gluster.org/mailman/listinfo/gluster-users"
              rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br>
          </blockquote>
        </div>
        <br>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://lists.gluster.org/mailman/listinfo/gluster-users">http://lists.gluster.org/mailman/listinfo/gluster-users</a></pre>
    </blockquote>
    <br>
  </body>
</html>