<div dir="ltr"><div dir="ltr"><div>Hi Ravi,</div><div><br></div><div>The existing two nodes aren't in split-brain, at least that I'm aware of. Running "gluster volume status all" doesn't show any problem.</div><div><br></div><div>I'm not sure what "in metadata" means. Can you please explain that one?</div><div><br></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, 17 May 2019 at 22:43, Ravishankar N <<a href="mailto:ravishankar@redhat.com">ravishankar@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div bgcolor="#FFFFFF">
<p><br>
</p>
<div class="gmail-m_-4751794853294020704moz-cite-prefix">On 17/05/19 5:59 AM, David Cunningham
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div>Hello,</div>
<div><br>
</div>
<div>We're adding an arbiter node to an existing
volume and having an issue. Can anyone help? The
root cause error appears to be
"00000000-0000-0000-0000-000000000001: failed to
resolve (Transport endpoint is not connected)",
as below.</div>
<div><br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
<p>Was your root directory of the replica 2 volume in metadata or
entry split-brain? If yes, you need to resolve it before
proceeding with the add-brick.<br>
</p>
<p>-Ravi<br>
</p>
<p><br>
</p>
<blockquote type="cite">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div>We are running glusterfs 5.6.1. Thanks in
advance for any assistance!<br>
</div>
<div><br>
</div>
<div>On existing node gfs1, trying to add new
arbiter node gfs3:</div>
<div><br>
</div>
<div># gluster volume add-brick gvol0 replica 3
arbiter 1 gfs3:/nodirectwritedata/gluster/gvol0<br>
volume add-brick: failed: Commit failed on gfs3.
Please check log file for details.<br>
<br>
</div>
<div>On new node gfs3 in
gvol0-add-brick-mount.log:</div>
<div><br>
</div>
<div>[2019-05-17 01:20:22.689721] I
[fuse-bridge.c:4267:fuse_init] 0-glusterfs-fuse:
FUSE inited with protocol versions: glusterfs
7.24 kernel 7.22<br>
[2019-05-17 01:20:22.689778] I
[fuse-bridge.c:4878:fuse_graph_sync] 0-fuse:
switched to graph 0<br>
[2019-05-17 01:20:22.694897] E
[fuse-bridge.c:4336:fuse_first_lookup] 0-fuse:
first lookup on root failed (Transport endpoint
is not connected)<br>
[2019-05-17 01:20:22.699770] W
[fuse-resolve.c:127:fuse_resolve_gfid_cbk]
0-fuse: 00000000-0000-0000-0000-000000000001:
failed to resolve (Transport endpoint is not
connected)<br>
[2019-05-17 01:20:22.699834] W
[fuse-bridge.c:3294:fuse_setxattr_resume]
0-glusterfs-fuse: 2: SETXATTR
00000000-0000-0000-0000-000000000001/1
(trusted.add-brick) resolution failed<br>
[2019-05-17 01:20:22.715656] I
[fuse-bridge.c:5144:fuse_thread_proc] 0-fuse:
initating unmount of /tmp/mntQAtu3f<br>
[2019-05-17 01:20:22.715865] W
[glusterfsd.c:1500:cleanup_and_exit]
(-->/lib64/libpthread.so.0(+0x7dd5)
[0x7fb223bf6dd5]
-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5)
[0x560886581e75]
-->/usr/sbin/glusterfs(cleanup_and_exit+0x6b)
[0x560886581ceb] ) 0-: received signum (15),
shutting down<br>
[2019-05-17 01:20:22.715926] I
[fuse-bridge.c:5914:fini] 0-fuse: Unmounting
'/tmp/mntQAtu3f'.<br>
[2019-05-17 01:20:22.715953] I
[fuse-bridge.c:5919:fini] 0-fuse: Closing fuse
connection to '/tmp/mntQAtu3f'.<br>
</div>
<div><br>
</div>
<div>Processes running on new node gfs3:</div>
<div><br>
</div>
<div># ps -ef | grep gluster<br>
root 6832 1 0 20:17 ? 00:00:00
/usr/sbin/glusterd -p /var/run/glusterd.pid
--log-level INFO<br>
root 15799 1 0 20:17 ? 00:00:00
/usr/sbin/glusterfs -s localhost --volfile-id
gluster/glustershd -p
/var/run/gluster/glustershd/glustershd.pid -l
/var/log/glusterfs/glustershd.log -S
/var/run/gluster/24c12b09f93eec8e.socket
--xlator-option
*replicate*.node-uuid=2069cfb3-c798-47e3-8cf8-3c584cf7c412
--process-name glustershd<br>
root 16856 16735 0 21:21 pts/0 00:00:00
grep --color=auto gluster<br>
<br>
</div>
-- <br>
<div dir="ltr" class="gmail-m_-4751794853294020704gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>David Cunningham,
Voisonics Limited<br>
<a href="http://voisonics.com/" target="_blank">http://voisonics.com/</a><br>
USA: +1 213 221 1092<br>
New Zealand: +64 (0)28 2558
3782</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<fieldset class="gmail-m_-4751794853294020704mimeAttachmentHeader"></fieldset>
<pre class="gmail-m_-4751794853294020704moz-quote-pre">_______________________________________________
Gluster-users mailing list
<a class="gmail-m_-4751794853294020704moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>
<a class="gmail-m_-4751794853294020704moz-txt-link-freetext" href="https://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
</div>
</blockquote></div><br clear="all"><br>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>David Cunningham, Voisonics Limited<br><a href="http://voisonics.com/" target="_blank">http://voisonics.com/</a><br>USA: +1 213 221 1092<br>New Zealand: +64 (0)28 2558 3782</div></div></div></div></div></div></div></div></div></div></div>