<div dir="ltr">Hi,<div><br></div><div>Which version of gluster you are using?</div><div><br></div><div>You can find which file is that using the following command</div><div>find &lt;brickpath&gt; -samefile &lt;brickpath/.glusterfs/&lt;first two bits of gfid&gt;/&lt;next 2 bits of gfid&gt;/&lt;full gfid&gt;<br></div><div><br></div><div>Please provide the getfatr output of the file which is in split brain.</div><div>The steps to recover from split-brain can be found here,</div><div><a href="http://gluster.readthedocs.io/en/latest/Troubleshooting/resolving-splitbrain/">http://gluster.readthedocs.io/en/latest/Troubleshooting/resolving-splitbrain/</a><br></div><div><br></div><div>HTH,</div><div>Karthik</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 22, 2018 at 4:03 AM, Joe Julian <span dir="ltr">&lt;<a href="mailto:joe@julianfamily.org" target="_blank">joe@julianfamily.org</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">How do I find what  &quot;eafb8799-4e7a-4264-9213-<wbr>26997c5a4693&quot;  is?<br>
<br>
</span><a href="https://docs.gluster.org/en/v3/Troubleshooting/gfid-to-path/" rel="noreferrer" target="_blank">https://docs.gluster.org/en/<wbr>v3/Troubleshooting/gfid-to-<wbr>path/</a><br>
<div><div class="h5"><br>
On May 21, 2018 3:22:01 PM PDT, Thing &lt;<a href="mailto:thing.thing@gmail.com">thing.thing@gmail.com</a>&gt; wrote:<br>
&gt;Hi,<br>
&gt;<br>
&gt;I seem to have a split brain issue, but I cannot figure out where this<br>
&gt;is<br>
&gt;and what it is, can someone help me pls,  I cant find what to fix here.<br>
&gt;<br>
&gt;==========<br>
&gt;root@salt-001:~# salt gluster* cmd.run &#39;df -h&#39;<br>
&gt;<a href="http://glusterp2.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp2.graywitch.co.nz</a>:<br>
&gt;    Filesystem                                               Size  Used<br>
&gt;Avail Use% Mounted on<br>
&gt;    /dev/mapper/centos-root                                   19G  3.4G<br>
&gt; 16G  19% /<br>
&gt;    devtmpfs                                                 3.8G     0<br>
&gt;3.8G   0% /dev<br>
&gt;    tmpfs                                                    3.8G   12K<br>
&gt;3.8G   1% /dev/shm<br>
&gt;    tmpfs                                                    3.8G  9.1M<br>
&gt;3.8G   1% /run<br>
&gt;    tmpfs                                                    3.8G     0<br>
&gt;3.8G   0% /sys/fs/cgroup<br>
&gt;    /dev/mapper/centos-tmp                                   3.8G   33M<br>
&gt;3.7G   1% /tmp<br>
&gt;    /dev/mapper/centos-var                                    19G  213M<br>
&gt; 19G   2% /var<br>
&gt;    /dev/mapper/centos-home                                   47G   38M<br>
&gt; 47G   1% /home<br>
&gt;    /dev/mapper/centos-data1                                 112G   33M<br>
&gt;112G   1% /data1<br>
&gt;    /dev/mapper/centos-var_lib                               9.4G  178M<br>
&gt;9.2G   2% /var/lib<br>
&gt;    /dev/mapper/vg--gluster--prod-<wbr>-1--2-gluster--prod--1--2  932G  264G<br>
&gt;668G  29% /bricks/brick1<br>
&gt;    /dev/sda1                                                950M  235M<br>
&gt;715M  25% /boot<br>
&gt;    tmpfs                                                    771M   12K<br>
&gt;771M   1% /run/user/42<br>
&gt;    glusterp2:gv0/glusterp2/images                           932G  273G<br>
&gt;659G  30% /var/lib/libvirt/images<br>
&gt;    glusterp2:gv0                                            932G  273G<br>
&gt;659G  30% /isos<br>
&gt;    tmpfs                                                    771M   48K<br>
&gt;771M   1% /run/user/1000<br>
&gt;    tmpfs                                                    771M     0<br>
&gt;771M   0% /run/user/0<br>
&gt;<a href="http://glusterp1.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp1.graywitch.co.nz</a>:<br>
&gt;   Filesystem                                     Size  Used Avail Use%<br>
&gt;Mounted on<br>
&gt; /dev/mapper/centos-root                         20G  3.5G   17G  18% /<br>
&gt;   devtmpfs                                       3.8G     0  3.8G   0%<br>
&gt;/dev<br>
&gt;   tmpfs                                          3.8G   12K  3.8G   1%<br>
&gt;/dev/shm<br>
&gt;   tmpfs                                          3.8G  9.0M  3.8G   1%<br>
&gt;/run<br>
&gt;   tmpfs                                          3.8G     0  3.8G   0%<br>
&gt;/sys/fs/cgroup<br>
&gt;   /dev/sda1                                      969M  206M  713M  23%<br>
&gt;/boot<br>
&gt;   /dev/mapper/centos-home                         50G  4.3G   46G   9%<br>
&gt;/home<br>
&gt;   /dev/mapper/centos-tmp                         3.9G   33M  3.9G   1%<br>
&gt;/tmp<br>
&gt;   /dev/mapper/centos-data1                       120G   36M  120G   1%<br>
&gt;/data1<br>
&gt;   /dev/mapper/vg--gluster--<wbr>prod1-gluster--prod1  932G  260G  673G  28%<br>
&gt;/bricks/brick1<br>
&gt;   /dev/mapper/centos-var                          20G  413M   20G   3%<br>
&gt;/var<br>
&gt;   /dev/mapper/centos00-var_lib                   9.4G  179M  9.2G   2%<br>
&gt;/var/lib<br>
&gt;   tmpfs                                          771M  8.0K  771M   1%<br>
&gt;/run/user/42<br>
&gt;   glusterp1:gv0                                  932G  273G  659G  30%<br>
&gt;/isos<br>
&gt;   glusterp1:gv0/glusterp1/images                 932G  273G  659G  30%<br>
&gt;/var/lib/libvirt/images<br>
&gt;<a href="http://glusterp3.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp3.graywitch.co.nz</a>:<br>
&gt;    Filesystem                                               Size  Used<br>
&gt;Avail Use% Mounted on<br>
&gt;    /dev/mapper/centos-root                                   20G  3.5G<br>
&gt; 17G  18% /<br>
&gt;    devtmpfs                                                 3.8G     0<br>
&gt;3.8G   0% /dev<br>
&gt;    tmpfs                                                    3.8G   12K<br>
&gt;3.8G   1% /dev/shm<br>
&gt;    tmpfs                                                    3.8G  9.0M<br>
&gt;3.8G   1% /run<br>
&gt;    tmpfs                                                    3.8G     0<br>
&gt;3.8G   0% /sys/fs/cgroup<br>
&gt;    /dev/sda1                                                969M  206M<br>
&gt;713M  23% /boot<br>
&gt;    /dev/mapper/centos-var                                    20G  206M<br>
&gt; 20G   2% /var<br>
&gt;    /dev/mapper/centos-tmp                                   3.9G   33M<br>
&gt;3.9G   1% /tmp<br>
&gt;    /dev/mapper/centos-home                                   50G   37M<br>
&gt; 50G   1% /home<br>
&gt;    /dev/mapper/centos-data01                                120G   33M<br>
&gt;120G   1% /data1<br>
&gt;    /dev/mapper/centos00-var_lib                             9.4G  180M<br>
&gt;9.2G   2% /var/lib<br>
&gt;    /dev/mapper/vg--gluster--prod-<wbr>-1--3-gluster--prod--1--3  932G  262G<br>
&gt;670G  29% /bricks/brick1<br>
&gt;    glusterp3:gv0                                            932G  273G<br>
&gt;659G  30% /isos<br>
&gt;    glusterp3:gv0/glusterp3/images                           932G  273G<br>
&gt;659G  30% /var/lib/libvirt/images<br>
&gt;    tmpfs                                                    771M   12K<br>
&gt;771M   1% /run/user/42<br>
&gt;root@salt-001:~# salt gluster* cmd.run &#39;getfattr -d -m . -e hex<br>
&gt;/bricks/brick1/gv0&#39;<br>
&gt;<a href="http://glusterp2.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp2.graywitch.co.nz</a>:<br>
&gt;    getfattr: Removing leading &#39;/&#39; from absolute path names<br>
&gt;    # file: bricks/brick1/gv0<br>
&gt;<br>
&gt;security.selinux=<wbr>0x73797374656d5f753a6f626a6563<wbr>745f723a756e6c6162656c65645f74<wbr>3a733000<br>
&gt;    trusted.gfid=<wbr>0x0000000000000000000000000000<wbr>0001<br>
&gt;    trusted.glusterfs.dht=<wbr>0x000000010000000000000000ffff<wbr>ffff<br>
&gt;    trusted.glusterfs.volume-id=<wbr>0xcfceb3535f0e4cf18b533ccfb1f0<wbr>91d3<br>
&gt;<a href="http://glusterp3.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp3.graywitch.co.nz</a>:<br>
&gt;    getfattr: Removing leading &#39;/&#39; from absolute path names<br>
&gt;    # file: bricks/brick1/gv0<br>
&gt;<br>
&gt;security.selinux=<wbr>0x73797374656d5f753a6f626a6563<wbr>745f723a756e6c6162656c65645f74<wbr>3a733000<br>
&gt;    trusted.gfid=<wbr>0x0000000000000000000000000000<wbr>0001<br>
&gt;    trusted.glusterfs.dht=<wbr>0x000000010000000000000000ffff<wbr>ffff<br>
&gt;    trusted.glusterfs.volume-id=<wbr>0xcfceb3535f0e4cf18b533ccfb1f0<wbr>91d3<br>
&gt;<a href="http://glusterp1.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp1.graywitch.co.nz</a>:<br>
&gt;    getfattr: Removing leading &#39;/&#39; from absolute path names<br>
&gt;    # file: bricks/brick1/gv0<br>
&gt;<br>
&gt;security.selinux=<wbr>0x73797374656d5f753a6f626a6563<wbr>745f723a756e6c6162656c65645f74<wbr>3a733000<br>
&gt;    trusted.gfid=<wbr>0x0000000000000000000000000000<wbr>0001<br>
&gt;    trusted.glusterfs.dht=<wbr>0x000000010000000000000000ffff<wbr>ffff<br>
&gt;    trusted.glusterfs.volume-id=<wbr>0xcfceb3535f0e4cf18b533ccfb1f0<wbr>91d3<br>
&gt;root@salt-001:~# salt gluster* cmd.run &#39;gluster volume heal gv0 info&#39;<br>
&gt;<a href="http://glusterp2.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp2.graywitch.co.nz</a>:<br>
&gt;    Brick glusterp1:/bricks/brick1/gv0<br>
&gt;    &lt;gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693&gt; - Is in split-brain<br>
&gt;<br>
&gt;    Status: Connected<br>
&gt;    Number of entries: 1<br>
&gt;<br>
&gt;    Brick glusterp2:/bricks/brick1/gv0<br>
&gt;    &lt;gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693&gt; - Is in split-brain<br>
&gt;<br>
&gt;    Status: Connected<br>
&gt;    Number of entries: 1<br>
&gt;<br>
&gt;    Brick glusterp3:/bricks/brick1/gv0<br>
&gt;    &lt;gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693&gt; - Is in split-brain<br>
&gt;<br>
&gt;    Status: Connected<br>
&gt;    Number of entries: 1<br>
&gt;<a href="http://glusterp3.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp3.graywitch.co.nz</a>:<br>
&gt;    Brick glusterp1:/bricks/brick1/gv0<br>
&gt;    &lt;gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693&gt; - Is in split-brain<br>
&gt;<br>
&gt;    Status: Connected<br>
&gt;    Number of entries: 1<br>
&gt;<br>
&gt;    Brick glusterp2:/bricks/brick1/gv0<br>
&gt;    &lt;gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693&gt; - Is in split-brain<br>
&gt;<br>
&gt;    Status: Connected<br>
&gt;    Number of entries: 1<br>
&gt;<br>
&gt;    Brick glusterp3:/bricks/brick1/gv0<br>
&gt;    &lt;gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693&gt; - Is in split-brain<br>
&gt;<br>
&gt;    Status: Connected<br>
&gt;    Number of entries: 1<br>
&gt;<a href="http://glusterp1.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp1.graywitch.co.nz</a>:<br>
&gt;    Brick glusterp1:/bricks/brick1/gv0<br>
&gt;    &lt;gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693&gt; - Is in split-brain<br>
&gt;<br>
&gt;    Status: Connected<br>
&gt;    Number of entries: 1<br>
&gt;<br>
&gt;    Brick glusterp2:/bricks/brick1/gv0<br>
&gt;    &lt;gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693&gt; - Is in split-brain<br>
&gt;<br>
&gt;    Status: Connected<br>
&gt;    Number of entries: 1<br>
&gt;<br>
&gt;    Brick glusterp3:/bricks/brick1/gv0<br>
&gt;    &lt;gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693&gt; - Is in split-brain<br>
&gt;<br>
&gt;    Status: Connected<br>
&gt;    Number of entries: 1<br>
&gt;root@salt-001:~# salt gluster* cmd.run &#39;getfattr -d -m . -e hex<br>
&gt;/bricks/brick1/&#39;<br>
&gt;<a href="http://glusterp2.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp2.graywitch.co.nz</a>:<br>
&gt;<a href="http://glusterp3.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp3.graywitch.co.nz</a>:<br>
&gt;<a href="http://glusterp1.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp1.graywitch.co.nz</a>:<br>
&gt;root@salt-001:~# salt gluster* cmd.run &#39;gluster volume info gv0&#39;<br>
&gt;<a href="http://glusterp2.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp2.graywitch.co.nz</a>:<br>
&gt;<br>
&gt;    Volume Name: gv0<br>
&gt;    Type: Replicate<br>
&gt;    Volume ID: cfceb353-5f0e-4cf1-8b53-<wbr>3ccfb1f091d3<br>
&gt;    Status: Started<br>
&gt;    Snapshot Count: 0<br>
&gt;    Number of Bricks: 1 x 3 = 3<br>
&gt;    Transport-type: tcp<br>
&gt;    Bricks:<br>
&gt;    Brick1: glusterp1:/bricks/brick1/gv0<br>
&gt;    Brick2: glusterp2:/bricks/brick1/gv0<br>
&gt;    Brick3: glusterp3:/bricks/brick1/gv0<br>
&gt;    Options Reconfigured:<br>
&gt;    transport.address-family: inet<br>
&gt;    nfs.disable: on<br>
&gt;    performance.client-io-threads: off<br>
&gt;<a href="http://glusterp1.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp1.graywitch.co.nz</a>:<br>
&gt;<br>
&gt;    Volume Name: gv0<br>
&gt;    Type: Replicate<br>
&gt;    Volume ID: cfceb353-5f0e-4cf1-8b53-<wbr>3ccfb1f091d3<br>
&gt;    Status: Started<br>
&gt;    Snapshot Count: 0<br>
&gt;    Number of Bricks: 1 x 3 = 3<br>
&gt;    Transport-type: tcp<br>
&gt;    Bricks:<br>
&gt;    Brick1: glusterp1:/bricks/brick1/gv0<br>
&gt;    Brick2: glusterp2:/bricks/brick1/gv0<br>
&gt;    Brick3: glusterp3:/bricks/brick1/gv0<br>
&gt;    Options Reconfigured:<br>
&gt;    performance.client-io-threads: off<br>
&gt;    nfs.disable: on<br>
&gt;    transport.address-family: inet<br>
&gt;<a href="http://glusterp3.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp3.graywitch.co.nz</a>:<br>
&gt;<br>
&gt;    Volume Name: gv0<br>
&gt;    Type: Replicate<br>
&gt;    Volume ID: cfceb353-5f0e-4cf1-8b53-<wbr>3ccfb1f091d3<br>
&gt;    Status: Started<br>
&gt;    Snapshot Count: 0<br>
&gt;    Number of Bricks: 1 x 3 = 3<br>
&gt;    Transport-type: tcp<br>
&gt;    Bricks:<br>
&gt;    Brick1: glusterp1:/bricks/brick1/gv0<br>
&gt;    Brick2: glusterp2:/bricks/brick1/gv0<br>
&gt;    Brick3: glusterp3:/bricks/brick1/gv0<br>
&gt;    Options Reconfigured:<br>
&gt;    performance.client-io-threads: off<br>
&gt;    nfs.disable: on<br>
&gt;    transport.address-family: inet<br>
&gt;root@salt-001:~#<br>
&gt;<br>
&gt;===========<br>
&gt;<br>
&gt;<br>
&gt;How do I find what  &quot;eafb8799-4e7a-4264-9213-<wbr>26997c5a4693&quot;  is?<br>
</div></div>______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br>
</blockquote></div><br></div>