<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html;
      charset=windows-1252">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <p>Hi Ravi,</p>
    <p>thanks for your answer, sure there you go:</p>
    <p># gluster volume heal applicatif info<br>
      Brick ipvr7.xxx:/mnt/gluster-applicatif/brick<br>
      &lt;gfid:e3b5ef36-a635-4e0e-bd97-d204a1f8e7ed&gt; <br>
      &lt;gfid:f8030467-b7a3-4744-a945-ff0b532e9401&gt; <br>
      &lt;gfid:def47b0b-b77e-4f0e-a402-b83c0f2d354b&gt; <br>
      &lt;gfid:46f76502-b1d5-43af-8c42-3d833e86eb44&gt; <br>
      &lt;gfid:d27a71d2-6d53-413d-b88c-33edea202cc2&gt; <br>
      &lt;gfid:7e7f02b2-3f2d-41ff-9cad-cd3b5a1e506a&gt; <br>
      Status: Connected<br>
      Number of entries: 6<br>
      <br>
      Brick ipvr8.xxx:/mnt/gluster-applicatif/brick<br>
      &lt;gfid:47ddf66f-a5e9-4490-8cd7-88e8b812cdbd&gt; <br>
      &lt;gfid:8057d06e-5323-47ff-8168-d983c4a82475&gt; <br>
      &lt;gfid:5b2ea4e4-ce84-4f07-bd66-5a0e17edb2b0&gt; <br>
      &lt;gfid:baedf8a2-1a3f-4219-86a1-c19f51f08f4e&gt; <br>
      &lt;gfid:8261c22c-e85a-4d0e-b057-196b744f3558&gt; <br>
      &lt;gfid:842b30c1-6016-45bd-9685-6be76911bd98&gt; <br>
      &lt;gfid:1fcaef0f-c97d-41e6-87cd-cd02f197bf38&gt; <br>
      &lt;gfid:9d041c80-b7e4-4012-a097-3db5b09fe471&gt; <br>
      &lt;gfid:ff48a14a-c1d5-45c6-a52a-b3e2402d0316&gt; <br>
      &lt;gfid:01409b23-eff2-4bda-966e-ab6133784001&gt; <br>
      &lt;gfid:c723e484-63fc-4267-b3f0-4090194370a0&gt; <br>
      &lt;gfid:fb1339a8-803f-4e29-b0dc-244e6c4427ed&gt; <br>
      &lt;gfid:056f3bba-6324-4cd8-b08d-bdf0fca44104&gt; <br>
      &lt;gfid:a8f6d7e5-0ff2-4747-89f3-87592597adda&gt; <br>
      &lt;gfid:3f6438a0-2712-4a09-9bff-d5a3027362b4&gt; <br>
      &lt;gfid:392c8e2f-9da4-4af8-a387-bfdfea2f404e&gt; <br>
      &lt;gfid:37e1edfd-9f58-4da3-8abe-819670c70906&gt; <br>
      &lt;gfid:15b7cdb3-aae8-4ca5-b28c-e87a3e599c9b&gt; <br>
      &lt;gfid:1d087e51-fb40-4606-8bb5-58936fb11a4c&gt; <br>
      &lt;gfid:bb0352b9-4a5e-4075-9179-05c3a5766cf4&gt; <br>
      &lt;gfid:40133fcf-a1fb-4d60-b169-e2355b66fb53&gt; <br>
      &lt;gfid:00f75963-1b4a-4d75-9558-36b7d85bd30b&gt; <br>
      &lt;gfid:2c0babdf-c828-475e-b2f5-0f44441fffdc&gt; <br>
      &lt;gfid:bbeff672-43ef-48c9-a3a2-96264aa46152&gt; <br>
      &lt;gfid:6c0969dd-bd30-4ba0-a7e5-ba4b3a972b9f&gt; <br>
      &lt;gfid:4c81ea14-56f4-4b30-8fff-c088fe4b3dff&gt; <br>
      &lt;gfid:1072cda3-53c9-4b95-992d-f102f6f87209&gt; <br>
      &lt;gfid:2e8f9f29-78f9-4402-bc0c-e63af8cf77d6&gt; <br>
      &lt;gfid:eeaa2765-44f4-4891-8502-5787b1310de2&gt; <br>
      Status: Connected<br>
      Number of entries: 29<br>
      <br>
      Brick ipvr9.xxx:/mnt/gluster-applicatif/brick<br>
      &lt;gfid:e3b5ef36-a635-4e0e-bd97-d204a1f8e7ed&gt; <br>
      &lt;gfid:f8030467-b7a3-4744-a945-ff0b532e9401&gt; <br>
      &lt;gfid:def47b0b-b77e-4f0e-a402-b83c0f2d354b&gt; <br>
      &lt;gfid:46f76502-b1d5-43af-8c42-3d833e86eb44&gt; <br>
      &lt;gfid:d27a71d2-6d53-413d-b88c-33edea202cc2&gt; <br>
      &lt;gfid:7e7f02b2-3f2d-41ff-9cad-cd3b5a1e506a&gt; <br>
      Status: Connected<br>
      Number of entries: 6<br>
    </p>
    <br>
    # gluster volume heal applicatif info split-brain<br>
    Brick ipvr7.xxx:/mnt/gluster-applicatif/brick<br>
    Status: Connected<br>
    Number of entries in split-brain: 0<br>
    <br>
    Brick ipvr8.xxx:/mnt/gluster-applicatif/brick<br>
    Status: Connected<br>
    Number of entries in split-brain: 0<br>
    <br>
    Brick ipvr9.xxx:/mnt/gluster-applicatif/brick<br>
    Status: Connected<br>
    Number of entries in split-brain: 0<br>
    <br>
    Doesn't it seem odd that the first command give some different
    output ?<br>
    <br>
    <div class="moz-cite-prefix">Le 07/07/2017 à 11:31, Ravishankar N a
      écrit :<br>
    </div>
    <blockquote type="cite"
      cite="mid:e4295115-8e0c-f007-966e-7c323f760ad7@redhat.com">
      <meta content="text/html; charset=windows-1252"
        http-equiv="Content-Type">
      <div class="moz-cite-prefix">On 07/07/2017 01:23 PM, Florian Leleu
        wrote:<br>
      </div>
      <blockquote
        cite="mid:d3cd07eb-77c1-89ad-2f7e-f36b1d673041@cognix-systems.com"
        type="cite">
        <meta http-equiv="content-type" content="text/html;
          charset=windows-1252">
        <p>Hello everyone,</p>
        <p>first time on the ML so excuse me if I'm not following well
          the rules, I'll improve if I get comments.<br>
        </p>
        <p>We got one volume "applicatif" on three nodes (2 and 1
          arbiter), each following command was made on node ipvr8.xxx:</p>
        <p># gluster volume info applicatif<br>
           <br>
          Volume Name: applicatif<br>
          Type: Replicate<br>
          Volume ID: ac222863-9210-4354-9636-2c822b332504<br>
          Status: Started<br>
          Snapshot Count: 0<br>
          Number of Bricks: 1 x (2 + 1) = 3<br>
          Transport-type: tcp<br>
          Bricks:<br>
          Brick1: ipvr7.xxx:/mnt/gluster-applicatif/brick<br>
          Brick2: ipvr8.xxx:/mnt/gluster-applicatif/brick<br>
          Brick3: ipvr9.xxx:/mnt/gluster-applicatif/brick (arbiter)<br>
          Options Reconfigured:<br>
          performance.read-ahead: on<br>
          performance.cache-size: 1024MB<br>
          performance.quick-read: off<br>
          performance.stat-prefetch: on<br>
          performance.io-cache: off<br>
          transport.address-family: inet<br>
          performance.readdir-ahead: on<br>
          nfs.disable: off</p>
        <p># gluster volume status applicatif<br>
          Status of volume: applicatif<br>
          Gluster process                             TCP Port  RDMA
          Port  Online  Pid<br>
------------------------------------------------------------------------------<br>
          Brick ipvr7.xxx:/mnt/gluster-applicatif/<br>
          brick                                       49154    
          0          Y       2814 <br>
          Brick ipvr8.xxx:/mnt/gluster-applicatif/<br>
          brick                                       49154    
          0          Y       2672 <br>
          Brick ipvr9.xxx:/mnt/gluster-applicatif/<br>
          brick                                       49154    
          0          Y       3424 <br>
          NFS Server on localhost                     2049     
          0          Y       26530<br>
          Self-heal Daemon on localhost               N/A      
          N/A        Y       26538<br>
          NFS Server on ipvr9.xxx                  2049      0         
          Y       12238<br>
          Self-heal Daemon on ipvr9.xxx            N/A       N/A       
          Y       12246<br>
          NFS Server on ipvr7.xxx                  2049      0         
          Y       2234 <br>
          Self-heal Daemon on ipvr7.xxx            N/A       N/A       
          Y       2243 <br>
           <br>
          Task Status of Volume applicatif<br>
------------------------------------------------------------------------------<br>
          There are no active volume tasks<br>
        </p>
        <p>The volume is mounted with autofs (nfs) in /home/applicatif
          and one folder is "broken":</p>
        <p>l /home/applicatif/services/<br>
          ls: cannot access /home/applicatif/services/snooper:
          Input/output error<br>
          total 16<br>
          lrwxrwxrwx  1 applicatif applicatif    9 Apr  6 15:53 config
          -&gt; ../config<br>
          lrwxrwxrwx  1 applicatif applicatif    7 Apr  6 15:54 .pwd
          -&gt; ../.pwd<br>
          drwxr-xr-x  3 applicatif applicatif 4096 Apr 12 10:24
          querybuilder<br>
          d?????????  ? ?          ?             ?            ? snooper<br>
          drwxr-xr-x  3 applicatif applicatif 4096 Jul  6 02:57
          snooper_new<br>
          drwxr-xr-x 16 applicatif applicatif 4096 Jul  6 02:58
          snooper_old<br>
          drwxr-xr-x  4 applicatif applicatif 4096 Jul  4 23:45 ssnooper</p>
        <p>I checked wether there was a heal, and it seems so:</p>
        <p># gluster volume heal applicatif statistics heal-count<br>
          Gathering count of entries to be healed on volume applicatif
          has been successful <br>
          <br>
          Brick ipvr7.xxx:/mnt/gluster-applicatif/brick<br>
          Number of entries: 8<br>
          <br>
          Brick ipvr8.xxx:/mnt/gluster-applicatif/brick<br>
          Number of entries: 29<br>
          <br>
          Brick ipvr9.xxx:/mnt/gluster-applicatif/brick<br>
          Number of entries: 8</p>
        <p>But actually in the brick on each server the folder "snooper"
          is fine.</p>
        <p>I tried rebooting the servers, restarting gluster after
          killing every process using it but it's not working.</p>
        <p>Has anyone already experienced that ? Any help would be nice.<br>
        </p>
      </blockquote>
      <br>
      Can you share the output of `gluster volume heal &lt;volname&gt;
      info` and `gluster volume heal &lt;volname&gt; info split-brain`?
      If the second command shows entries, please also share the
      getfattr output from the bricks for these files (getfattr -d -m .
      -e hex /brick/path/to/file).<br>
      -Ravi<br>
      <blockquote
        cite="mid:d3cd07eb-77c1-89ad-2f7e-f36b1d673041@cognix-systems.com"
        type="cite">
        <p> </p>
        <p>Thanks a lot !<br>
        </p>
        <div class="moz-signature">-- <br>
          <table style="background: #fff; border-collapse: collapse;
            border: 0; font-family: Arial, Verdana, Trebuchet MS;
            font-size: 12px;" border="0" cellspacing="0" cellpadding="0">
            <tbody>
              <tr>
                <td colspan="6" style="font-size: 12px; font-weight:
                  normal; color: #2e2f34; font-family: Arial, Verdana,
                  Trebuchet MS;">
                  <p style="margin-top: 1em; margin-bottom: 1em;
                    font-size: 12px; font-weight: normal; color:
                    #2e2f34; font-family: Arial, Verdana, Trebuchet MS;">Cordialement,<br>
                    <br>
                  </p>
                </td>
              </tr>
              <tr>
                <td style="color: white;" width="132" height="101"
                  valign="top"> <a moz-do-not-send="true"
                    href="http://www.cognix-systems.com/" style="color:
                    white; text-decoration: none;"> <img
                      src="cid:part1.7ED1958A.D29E7DCE@cognix-systems.com"
                      alt="" style="display: block;" class=""> </a> </td>
                <td width="12" height="101" valign="top"> </td>
                <td height="101" valign="top">
                  <p style="margin-top: 0; margin-bottom: 1em;
                    font-family: Arial, Verdana, Trebuchet MS;
                    line-height: 1.3;"><span style="font-size: 14px;
                      font-weight: bold; color: #d48314; font-family:
                      Arial, Verdana, Trebuchet MS;">Florian LELEU</span><br>
                    <span style="font-size: 12px; font-weight: normal;
                      color: #2e2f34; font-family: Arial, Verdana,
                      Trebuchet MS;">Responsable Hosting, Cognix Systems</span></p>
                  <p style="margin-top: 1em; margin-bottom: 1em;
                    font-size: 12px; font-weight: normal; color:
                    #2e2f34; font-family: Arial, Verdana, Trebuchet MS;
                    line-height: 1.3;"><strong style="color: #d48314;
                      font-weight: bold;">Rennes</strong> <span
                      style="font-size: 12px; color: #d48314;
                      font-weight: normal; font-family: Arial, Verdana,
                      Trebuchet MS;">|</span> Brest <span
                      style="font-size: 12px; color: #d48314;
                      font-weight: normal; font-family: Arial, Verdana,
                      Trebuchet MS;">|</span> Saint-Malo <span
                      style="font-size: 12px; color: #d48314;
                      font-weight: normal; font-family: Arial, Verdana,
                      Trebuchet MS;">|</span> Paris<br>
                    <a moz-do-not-send="true"
                      href="mailto:florian.leleu@cognix-systems.com"
                      style="color: #d48314; font-weight: normal;
                      text-decoration: underline;"><span style="color:
                        #d48314; font-weight: normal; text-decoration:
                        underline;">florian.leleu@cognix-systems.com</span></a></p>
                  <p style="margin-top: 1em; margin-bottom: 0;
                    font-size: 12px; font-weight: normal; color:
                    #2e2f34; font-family: Arial, Verdana, Trebuchet MS;"><span
                      style="font-weight: bold;">Tél. :</span> 02 99 27
                    75 92</p>
                </td>
                <td width="12" height="101" valign="top"> </td>
                <td style="border-left: 1px solid #eecda1;" width="12"
                  height="101" valign="top"> </td>
                <td valign="top">
                  <div style="margin-bottom: 10px;"><a
                      moz-do-not-send="true"
                      href="https://www.facebook.com/cognix.systems/"
                      style="color: white; text-decoration: none;"> <img
src="cid:part4.0EA0F45A.7BAE963B@cognix-systems.com" alt="Facebook
                        Cognix Systems" style="display: block;" class="">
                    </a></div>
                  <div style="margin-bottom: 10px;"><a
                      moz-do-not-send="true"
                      href="https://twitter.com/cognixsystems"
                      style="color: white; text-decoration: none;"> <img
src="cid:part6.1015CB21.9EA77AC4@cognix-systems.com" alt="Twitter Cognix
                        Systems" style="display: block;" class=""> </a></div>
                  <div style=""><a moz-do-not-send="true"
                      href="http://www.cognix-systems.com/"
                      style="color: white; text-decoration: none;"> <img
src="cid:part8.A29AA8CD.7FC7EC7B@cognix-systems.com" alt="Logo Cognix
                        Systems" style="display: block;" class=""> </a></div>
                </td>
              </tr>
            </tbody>
          </table>
        </div>
        <br>
        <fieldset class="mimeAttachmentHeader"></fieldset>
        <br>
        <pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org" moz-do-not-send="true">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://lists.gluster.org/mailman/listinfo/gluster-users" moz-do-not-send="true">http://lists.gluster.org/mailman/listinfo/gluster-users</a></pre>
      </blockquote>
      <p><br>
      </p>
    </blockquote>
    <br>
    <div class="moz-signature">-- <br>
      <table style="background: #fff; border-collapse: collapse; border:
        0; font-family: Arial, Verdana, Trebuchet MS; font-size: 12px;"
        border="0" cellspacing="0" cellpadding="0">
        <tbody>
          <tr>
            <td colspan="6" style="font-size: 12px; font-weight: normal;
              color: #2e2f34; font-family: Arial, Verdana, Trebuchet
              MS;">
              <p style="margin-top: 1em; margin-bottom: 1em; font-size:
                12px; font-weight: normal; color: #2e2f34; font-family:
                Arial, Verdana, Trebuchet MS;">Cordialement,<br>
                <br>
              </p>
            </td>
          </tr>
          <tr>
            <td style="color: white;" width="132" height="101"
              valign="top"> <a href="http://www.cognix-systems.com/"
                style="color: white; text-decoration: none;"> <img
                  src="cid:part12.226844B5.E6879D22@cognix-systems.com"
                  alt="" style="display: block;"> </a> </td>
            <td width="12" height="101" valign="top"> </td>
            <td height="101" valign="top">
              <p style="margin-top: 0; margin-bottom: 1em; font-family:
                Arial, Verdana, Trebuchet MS; line-height: 1.3;"><span
                  style="font-size: 14px; font-weight: bold; color:
                  #d48314; font-family: Arial, Verdana, Trebuchet MS;">Florian
                  LELEU</span><br>
                <span style="font-size: 12px; font-weight: normal;
                  color: #2e2f34; font-family: Arial, Verdana, Trebuchet
                  MS;">Responsable Hosting, Cognix Systems</span></p>
              <p style="margin-top: 1em; margin-bottom: 1em; font-size:
                12px; font-weight: normal; color: #2e2f34; font-family:
                Arial, Verdana, Trebuchet MS; line-height: 1.3;"><strong
                  style="color: #d48314; font-weight: bold;">Rennes</strong> <span
                  style="font-size: 12px; color: #d48314; font-weight:
                  normal; font-family: Arial, Verdana, Trebuchet MS;">|</span> Brest <span
                  style="font-size: 12px; color: #d48314; font-weight:
                  normal; font-family: Arial, Verdana, Trebuchet MS;">|</span> Saint-Malo <span
                  style="font-size: 12px; color: #d48314; font-weight:
                  normal; font-family: Arial, Verdana, Trebuchet MS;">|</span> Paris<br>
                <a href="mailto:florian.leleu@cognix-systems.com"
                  style="color: #d48314; font-weight: normal;
                  text-decoration: underline;"><span style="color:
                    #d48314; font-weight: normal; text-decoration:
                    underline;">florian.leleu@cognix-systems.com</span></a></p>
              <p style="margin-top: 1em; margin-bottom: 0; font-size:
                12px; font-weight: normal; color: #2e2f34; font-family:
                Arial, Verdana, Trebuchet MS;"><span style="font-weight:
                  bold;">Tél. :</span> 02 99 27 75 92</p>
            </td>
            <td width="12" height="101" valign="top"> </td>
            <td style="border-left: 1px solid #eecda1;" width="12"
              height="101" valign="top"> </td>
            <td valign="top">
              <div style="margin-bottom: 10px;"><a
                  href="https://www.facebook.com/cognix.systems/"
                  style="color: white; text-decoration: none;"> <img
                    src="cid:part4.0EA0F45A.7BAE963B@cognix-systems.com"
                    alt="Facebook Cognix Systems" style="display:
                    block;"> </a></div>
              <div style="margin-bottom: 10px;"><a
                  href="https://twitter.com/cognixsystems" style="color:
                  white; text-decoration: none;"> <img
                    src="cid:part6.1015CB21.9EA77AC4@cognix-systems.com"
                    alt="Twitter Cognix Systems" style="display: block;">
                </a></div>
              <div style=""><a href="http://www.cognix-systems.com/"
                  style="color: white; text-decoration: none;"> <img
                    src="cid:part8.A29AA8CD.7FC7EC7B@cognix-systems.com"
                    alt="Logo Cognix Systems" style="display: block;"> </a></div>
            </td>
          </tr>
        </tbody>
      </table>
    </div>
  </body>
</html>