<div dir="ltr">Hi,<div><br></div><div>Which version of gluster you are using?</div><div><br></div><div>You can find which file is that using the following command</div><div>find <brickpath> -samefile <brickpath/.glusterfs/<first two bits of gfid>/<next 2 bits of gfid>/<full gfid><br></div><div><br></div><div>Please provide the getfatr output of the file which is in split brain.</div><div>The steps to recover from split-brain can be found here,</div><div><a href="http://gluster.readthedocs.io/en/latest/Troubleshooting/resolving-splitbrain/">http://gluster.readthedocs.io/en/latest/Troubleshooting/resolving-splitbrain/</a><br></div><div><br></div><div>HTH,</div><div>Karthik</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 22, 2018 at 4:03 AM, Joe Julian <span dir="ltr"><<a href="mailto:joe@julianfamily.org" target="_blank">joe@julianfamily.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">How do I find what "eafb8799-4e7a-4264-9213-<wbr>26997c5a4693" is?<br>
<br>
</span><a href="https://docs.gluster.org/en/v3/Troubleshooting/gfid-to-path/" rel="noreferrer" target="_blank">https://docs.gluster.org/en/<wbr>v3/Troubleshooting/gfid-to-<wbr>path/</a><br>
<div><div class="h5"><br>
On May 21, 2018 3:22:01 PM PDT, Thing <<a href="mailto:thing.thing@gmail.com">thing.thing@gmail.com</a>> wrote:<br>
>Hi,<br>
><br>
>I seem to have a split brain issue, but I cannot figure out where this<br>
>is<br>
>and what it is, can someone help me pls, I cant find what to fix here.<br>
><br>
>==========<br>
>root@salt-001:~# salt gluster* cmd.run 'df -h'<br>
><a href="http://glusterp2.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp2.graywitch.co.nz</a>:<br>
> Filesystem Size Used<br>
>Avail Use% Mounted on<br>
> /dev/mapper/centos-root 19G 3.4G<br>
> 16G 19% /<br>
> devtmpfs 3.8G 0<br>
>3.8G 0% /dev<br>
> tmpfs 3.8G 12K<br>
>3.8G 1% /dev/shm<br>
> tmpfs 3.8G 9.1M<br>
>3.8G 1% /run<br>
> tmpfs 3.8G 0<br>
>3.8G 0% /sys/fs/cgroup<br>
> /dev/mapper/centos-tmp 3.8G 33M<br>
>3.7G 1% /tmp<br>
> /dev/mapper/centos-var 19G 213M<br>
> 19G 2% /var<br>
> /dev/mapper/centos-home 47G 38M<br>
> 47G 1% /home<br>
> /dev/mapper/centos-data1 112G 33M<br>
>112G 1% /data1<br>
> /dev/mapper/centos-var_lib 9.4G 178M<br>
>9.2G 2% /var/lib<br>
> /dev/mapper/vg--gluster--prod-<wbr>-1--2-gluster--prod--1--2 932G 264G<br>
>668G 29% /bricks/brick1<br>
> /dev/sda1 950M 235M<br>
>715M 25% /boot<br>
> tmpfs 771M 12K<br>
>771M 1% /run/user/42<br>
> glusterp2:gv0/glusterp2/images 932G 273G<br>
>659G 30% /var/lib/libvirt/images<br>
> glusterp2:gv0 932G 273G<br>
>659G 30% /isos<br>
> tmpfs 771M 48K<br>
>771M 1% /run/user/1000<br>
> tmpfs 771M 0<br>
>771M 0% /run/user/0<br>
><a href="http://glusterp1.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp1.graywitch.co.nz</a>:<br>
> Filesystem Size Used Avail Use%<br>
>Mounted on<br>
> /dev/mapper/centos-root 20G 3.5G 17G 18% /<br>
> devtmpfs 3.8G 0 3.8G 0%<br>
>/dev<br>
> tmpfs 3.8G 12K 3.8G 1%<br>
>/dev/shm<br>
> tmpfs 3.8G 9.0M 3.8G 1%<br>
>/run<br>
> tmpfs 3.8G 0 3.8G 0%<br>
>/sys/fs/cgroup<br>
> /dev/sda1 969M 206M 713M 23%<br>
>/boot<br>
> /dev/mapper/centos-home 50G 4.3G 46G 9%<br>
>/home<br>
> /dev/mapper/centos-tmp 3.9G 33M 3.9G 1%<br>
>/tmp<br>
> /dev/mapper/centos-data1 120G 36M 120G 1%<br>
>/data1<br>
> /dev/mapper/vg--gluster--<wbr>prod1-gluster--prod1 932G 260G 673G 28%<br>
>/bricks/brick1<br>
> /dev/mapper/centos-var 20G 413M 20G 3%<br>
>/var<br>
> /dev/mapper/centos00-var_lib 9.4G 179M 9.2G 2%<br>
>/var/lib<br>
> tmpfs 771M 8.0K 771M 1%<br>
>/run/user/42<br>
> glusterp1:gv0 932G 273G 659G 30%<br>
>/isos<br>
> glusterp1:gv0/glusterp1/images 932G 273G 659G 30%<br>
>/var/lib/libvirt/images<br>
><a href="http://glusterp3.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp3.graywitch.co.nz</a>:<br>
> Filesystem Size Used<br>
>Avail Use% Mounted on<br>
> /dev/mapper/centos-root 20G 3.5G<br>
> 17G 18% /<br>
> devtmpfs 3.8G 0<br>
>3.8G 0% /dev<br>
> tmpfs 3.8G 12K<br>
>3.8G 1% /dev/shm<br>
> tmpfs 3.8G 9.0M<br>
>3.8G 1% /run<br>
> tmpfs 3.8G 0<br>
>3.8G 0% /sys/fs/cgroup<br>
> /dev/sda1 969M 206M<br>
>713M 23% /boot<br>
> /dev/mapper/centos-var 20G 206M<br>
> 20G 2% /var<br>
> /dev/mapper/centos-tmp 3.9G 33M<br>
>3.9G 1% /tmp<br>
> /dev/mapper/centos-home 50G 37M<br>
> 50G 1% /home<br>
> /dev/mapper/centos-data01 120G 33M<br>
>120G 1% /data1<br>
> /dev/mapper/centos00-var_lib 9.4G 180M<br>
>9.2G 2% /var/lib<br>
> /dev/mapper/vg--gluster--prod-<wbr>-1--3-gluster--prod--1--3 932G 262G<br>
>670G 29% /bricks/brick1<br>
> glusterp3:gv0 932G 273G<br>
>659G 30% /isos<br>
> glusterp3:gv0/glusterp3/images 932G 273G<br>
>659G 30% /var/lib/libvirt/images<br>
> tmpfs 771M 12K<br>
>771M 1% /run/user/42<br>
>root@salt-001:~# salt gluster* cmd.run 'getfattr -d -m . -e hex<br>
>/bricks/brick1/gv0'<br>
><a href="http://glusterp2.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp2.graywitch.co.nz</a>:<br>
> getfattr: Removing leading '/' from absolute path names<br>
> # file: bricks/brick1/gv0<br>
><br>
>security.selinux=<wbr>0x73797374656d5f753a6f626a6563<wbr>745f723a756e6c6162656c65645f74<wbr>3a733000<br>
> trusted.gfid=<wbr>0x0000000000000000000000000000<wbr>0001<br>
> trusted.glusterfs.dht=<wbr>0x000000010000000000000000ffff<wbr>ffff<br>
> trusted.glusterfs.volume-id=<wbr>0xcfceb3535f0e4cf18b533ccfb1f0<wbr>91d3<br>
><a href="http://glusterp3.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp3.graywitch.co.nz</a>:<br>
> getfattr: Removing leading '/' from absolute path names<br>
> # file: bricks/brick1/gv0<br>
><br>
>security.selinux=<wbr>0x73797374656d5f753a6f626a6563<wbr>745f723a756e6c6162656c65645f74<wbr>3a733000<br>
> trusted.gfid=<wbr>0x0000000000000000000000000000<wbr>0001<br>
> trusted.glusterfs.dht=<wbr>0x000000010000000000000000ffff<wbr>ffff<br>
> trusted.glusterfs.volume-id=<wbr>0xcfceb3535f0e4cf18b533ccfb1f0<wbr>91d3<br>
><a href="http://glusterp1.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp1.graywitch.co.nz</a>:<br>
> getfattr: Removing leading '/' from absolute path names<br>
> # file: bricks/brick1/gv0<br>
><br>
>security.selinux=<wbr>0x73797374656d5f753a6f626a6563<wbr>745f723a756e6c6162656c65645f74<wbr>3a733000<br>
> trusted.gfid=<wbr>0x0000000000000000000000000000<wbr>0001<br>
> trusted.glusterfs.dht=<wbr>0x000000010000000000000000ffff<wbr>ffff<br>
> trusted.glusterfs.volume-id=<wbr>0xcfceb3535f0e4cf18b533ccfb1f0<wbr>91d3<br>
>root@salt-001:~# salt gluster* cmd.run 'gluster volume heal gv0 info'<br>
><a href="http://glusterp2.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp2.graywitch.co.nz</a>:<br>
> Brick glusterp1:/bricks/brick1/gv0<br>
> <gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693> - Is in split-brain<br>
><br>
> Status: Connected<br>
> Number of entries: 1<br>
><br>
> Brick glusterp2:/bricks/brick1/gv0<br>
> <gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693> - Is in split-brain<br>
><br>
> Status: Connected<br>
> Number of entries: 1<br>
><br>
> Brick glusterp3:/bricks/brick1/gv0<br>
> <gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693> - Is in split-brain<br>
><br>
> Status: Connected<br>
> Number of entries: 1<br>
><a href="http://glusterp3.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp3.graywitch.co.nz</a>:<br>
> Brick glusterp1:/bricks/brick1/gv0<br>
> <gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693> - Is in split-brain<br>
><br>
> Status: Connected<br>
> Number of entries: 1<br>
><br>
> Brick glusterp2:/bricks/brick1/gv0<br>
> <gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693> - Is in split-brain<br>
><br>
> Status: Connected<br>
> Number of entries: 1<br>
><br>
> Brick glusterp3:/bricks/brick1/gv0<br>
> <gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693> - Is in split-brain<br>
><br>
> Status: Connected<br>
> Number of entries: 1<br>
><a href="http://glusterp1.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp1.graywitch.co.nz</a>:<br>
> Brick glusterp1:/bricks/brick1/gv0<br>
> <gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693> - Is in split-brain<br>
><br>
> Status: Connected<br>
> Number of entries: 1<br>
><br>
> Brick glusterp2:/bricks/brick1/gv0<br>
> <gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693> - Is in split-brain<br>
><br>
> Status: Connected<br>
> Number of entries: 1<br>
><br>
> Brick glusterp3:/bricks/brick1/gv0<br>
> <gfid:eafb8799-4e7a-4264-9213-<wbr>26997c5a4693> - Is in split-brain<br>
><br>
> Status: Connected<br>
> Number of entries: 1<br>
>root@salt-001:~# salt gluster* cmd.run 'getfattr -d -m . -e hex<br>
>/bricks/brick1/'<br>
><a href="http://glusterp2.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp2.graywitch.co.nz</a>:<br>
><a href="http://glusterp3.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp3.graywitch.co.nz</a>:<br>
><a href="http://glusterp1.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp1.graywitch.co.nz</a>:<br>
>root@salt-001:~# salt gluster* cmd.run 'gluster volume info gv0'<br>
><a href="http://glusterp2.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp2.graywitch.co.nz</a>:<br>
><br>
> Volume Name: gv0<br>
> Type: Replicate<br>
> Volume ID: cfceb353-5f0e-4cf1-8b53-<wbr>3ccfb1f091d3<br>
> Status: Started<br>
> Snapshot Count: 0<br>
> Number of Bricks: 1 x 3 = 3<br>
> Transport-type: tcp<br>
> Bricks:<br>
> Brick1: glusterp1:/bricks/brick1/gv0<br>
> Brick2: glusterp2:/bricks/brick1/gv0<br>
> Brick3: glusterp3:/bricks/brick1/gv0<br>
> Options Reconfigured:<br>
> transport.address-family: inet<br>
> nfs.disable: on<br>
> performance.client-io-threads: off<br>
><a href="http://glusterp1.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp1.graywitch.co.nz</a>:<br>
><br>
> Volume Name: gv0<br>
> Type: Replicate<br>
> Volume ID: cfceb353-5f0e-4cf1-8b53-<wbr>3ccfb1f091d3<br>
> Status: Started<br>
> Snapshot Count: 0<br>
> Number of Bricks: 1 x 3 = 3<br>
> Transport-type: tcp<br>
> Bricks:<br>
> Brick1: glusterp1:/bricks/brick1/gv0<br>
> Brick2: glusterp2:/bricks/brick1/gv0<br>
> Brick3: glusterp3:/bricks/brick1/gv0<br>
> Options Reconfigured:<br>
> performance.client-io-threads: off<br>
> nfs.disable: on<br>
> transport.address-family: inet<br>
><a href="http://glusterp3.graywitch.co.nz" rel="noreferrer" target="_blank">glusterp3.graywitch.co.nz</a>:<br>
><br>
> Volume Name: gv0<br>
> Type: Replicate<br>
> Volume ID: cfceb353-5f0e-4cf1-8b53-<wbr>3ccfb1f091d3<br>
> Status: Started<br>
> Snapshot Count: 0<br>
> Number of Bricks: 1 x 3 = 3<br>
> Transport-type: tcp<br>
> Bricks:<br>
> Brick1: glusterp1:/bricks/brick1/gv0<br>
> Brick2: glusterp2:/bricks/brick1/gv0<br>
> Brick3: glusterp3:/bricks/brick1/gv0<br>
> Options Reconfigured:<br>
> performance.client-io-threads: off<br>
> nfs.disable: on<br>
> transport.address-family: inet<br>
>root@salt-001:~#<br>
><br>
>===========<br>
><br>
><br>
>How do I find what "eafb8799-4e7a-4264-9213-<wbr>26997c5a4693" is?<br>
</div></div>______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br>
</blockquote></div><br></div>