<html><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8"><title></title><style type="text/css">.felamimail-body-blockquote {margin: 5px 10px 0 3px;padding-left: 10px;border-left: 2px solid #000088;} </style></head><body>Hi,<div style="">i had similar problem. In my case the rebalance didnt finish because of not enough free space to migrate the space to other nodes. Reason was 1% Reservation Options which is setup by default in distributed, but i set it to 0%, which was ignored by gluster</div><div style=""><br></div><div style="">Greatings </div><div style="">Taste<br><br><br>Am 25.05.2019 07:00:13, schrieb Nithya Balachandran:
<br><blockquote class="felamimail-body-blockquote" style="font-size: 13px;"><div dir="ltr">Hi Brandon,<div><br></div><div>Please send the following:</div><div><br></div><div>1. the gluster volume info</div><div>2. Information about which brick was removed</div><div>3. The rebalance log file for all nodes hosting removed bricks.</div><div><br></div><div>Regards,</div><div>Nithya</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, 24 May 2019 at 19:33, Ravishankar N <<a href="mailto:ravishankar@redhat.com" target="_blank">ravishankar@redhat.com</a>> wrote:<br></div><blockquote class="felamimail-body-blockquote" style="margin:0px 0px 0px .8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex;">
<div>
<p>Adding a few DHT folks for some possible suggestions.<br></p>
<p>-Ravi<br></p>
<div class="gmail-m_-7323981135833334150moz-cite-prefix">On 23/05/19 11:15 PM,
<a class="gmail-m_-7323981135833334150moz-txt-link-abbreviated" href="mailto:brandon@thinkhuge.net" target="_blank">brandon@thinkhuge.net</a> wrote:<br></div>
<blockquote class="felamimail-body-blockquote">
<div class="gmail-m_-7323981135833334150WordSection1">
<p class="MsoNormal"><span style="font-size:14pt;">Does anyone
know what should be done on a glusterfs v5.6 "gluster volume
remove-brick" operation that fails? I'm trying to remove 1
of 8 distributed smaller nodes for replacement with larger
node. <span style="text-decoration:underline;"></span><span style="text-decoration:underline;"></span></span></p>
<p class="MsoNormal"><span style="font-size:14pt;"><span style="text-decoration:underline;"></span> <span style="text-decoration:underline;"></span></span></p>
<p class="MsoNormal"><span style="font-size:14pt;">The "gluster
volume remove-brick ... status" command reports status
failed and failures = "3" <span style="text-decoration:underline;"></span><span style="text-decoration:underline;"></span></span></p>
<p class="MsoNormal"><span style="font-size:14pt;"><span style="text-decoration:underline;"></span> <span style="text-decoration:underline;"></span></span></p>
<p class="MsoNormal"><span style="font-size:14pt;">cat
/var/log/glusterfs/volbackups-rebalance.log <span style="text-decoration:underline;"></span><span style="text-decoration:underline;"></span></span></p>
<p class="MsoNormal"><span style="font-size:14pt;">... <span style="text-decoration:underline;"></span><span style="text-decoration:underline;"></span></span></p>
<p class="MsoNormal"><span style="font-size:14pt;">[2019-05-23
16:43:37.442283] I [MSGID: 109028]
[dht-rebalance.c:5070:gf_defrag_status_get]
0-volbackups-dht: Rebalance is failed. Time taken is 545.00
secs <span style="text-decoration:underline;"></span><span style="text-decoration:underline;"></span></span></p>
<p class="MsoNormal"><span style="font-size:14pt;"><span style="text-decoration:underline;"></span> <span style="text-decoration:underline;"></span></span></p>
<p class="MsoNormal"><span style="font-size:14pt;">All servers
are confirmed in good communications and updated and freshly
rebooted and retried the remove-brick few times with fail
each time<span style="text-decoration:underline;"></span><span style="text-decoration:underline;"></span></span></p>
<p class="MsoNormal"><span style="font-size:14pt;"><span style="text-decoration:underline;"></span> <span style="text-decoration:underline;"></span></span></p>
</div>
<br><pre class="gmail-m_-7323981135833334150moz-quote-pre">_______________________________________________
Gluster-users mailing list
<a class="gmail-m_-7323981135833334150moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>
<a class="gmail-m_-7323981135833334150moz-txt-link-freetext" href="https://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
</div>
</blockquote></div>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8"><title></title><style type="text/css">.felamimail-body-blockquote {margin: 5px 10px 0 3px;padding-left: 10px;border-left: 2px solid #000088;} </style>_______________________________________________<br>Gluster-users mailing list<br>Gluster-users@gluster.org<br><a href="https://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a></blockquote><br></div></body></html>