<p dir="ltr">Hi Herb,</p>
<p dir="ltr">First check your data usage, as you need free space on the remaining bricks. You have to remove bricks multiple per replica set.<br>
For replica 2 distributed volume you must specify 2 bricks at least , or any number multiple by 2 (2,4,6,8 bricks).</p>
<p dir="ltr">The removal consists of several actions .</p>
<p dir="ltr">1. Starting removal via :</p>
<p dir="ltr">gluster volume remove-brick <VOLNAME> <BRICKNAME> start</p>
<p dir="ltr">This actually only migrates the data to the rest of the bricks.</p>
<p dir="ltr">2. Check status via:</p>
<p dir="ltr">gluster volume remove-brick <VOLNAME> <BRICKNAME> status</p>
<p dir="ltr">Once completed, check the logs for any rebalance issuues.</p>
<p dir="ltr">You can verify data/inode count on the brick via:</p>
<p dir="ltr">gluster volume status <VOLNAME> detail<br></p>
<p dir="ltr">If everything is fine proceed with the actual removal:</p>
<p dir="ltr"># gluster volume remove-brick <VOLNAME> <BRICKNAME> commit<br></p>
<p dir="ltr">5. Last verify the volume status.</p>
<p dir="ltr">Source:<br>
<a href="https://docs.gluster.org/en/latest/Administrator%20Guide/Managing%20Volumes/#shrinking-volumes">https://docs.gluster.org/en/latest/Administrator%20Guide/Managing%20Volumes/#shrinking-volumes</a></p>
<p dir="ltr">Best Regards,<br>
Strahil Nikolov<br>
</p>
<div class="quote">On Oct 25, 2019 20:26, Herb Burnswell <herbert.burnswell@gmail.com> wrote:<br type='attribution'><blockquote class="quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Thank you for the reply Strahil.</div><div><br /></div><div>Unfortunately we did do the rebalance already so the data should be written across all brinks currently. I'm fine with pulling these newly added bricks out of the volume. However, is it as simple as pulling them out and the data will rebalance to the disks that are left?</div><div><br /></div><div>Thanks,</div><div><br /></div><div>HB </div><br /><div class="elided-text"><div dir="ltr">On Sat, Oct 19, 2019 at 4:13 PM Strahil Nikolov <<a href="mailto:hunter86_bg@yahoo.com">hunter86_bg@yahoo.com</a>> wrote:<br /></div><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb( 204 , 204 , 204 );padding-left:1ex"><div><div style="font-size:16px"><div style="font-family:'courier new' , 'courier' , 'monaco' , monospace , sans-serif"></div>
<div dir="ltr">Most probably this means that data on <div style="font-family:'courier new' , 'courier' , 'monaco' , monospace , sans-serif"><span style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif">Brick server1:/gluster_bricks/data3 49164 0 Y 4625 </span><br style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif" /><span style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif">Brick server1:/gluster_bricks/data4 49165 0 Y 4644</span></div><div style="font-family:'courier new' , 'courier' , 'monaco' , monospace , sans-serif"><span style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif"><br /></span></div><div dir="ltr" style="font-family:'courier new' , 'courier' , 'monaco' , monospace , sans-serif"><span style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif">is the same and when server1 goes down , you will have no access to the data on this set.</span></div><div dir="ltr" style="font-family:'courier new' , 'courier' , 'monaco' , monospace , sans-serif"><span style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif">Same should be valid for :</span></div><div dir="ltr"><div style="font-family:'courier new' , 'courier' , 'monaco' , monospace , sans-serif"><span style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif">Brick server1:/gluster_bricks/data5 49166 0 Y 5088 </span><br style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif" /><span style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif">Brick server1:/gluster_bricks/data6 49167 0 Y 5128 </span><br style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif" /><span style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif">Brick server2:/gluster_bricks/data3 49168 0 Y 22314</span><br style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif" /><span style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif">Brick server2:/gluster_bricks/data4 49169 0 Y 22345</span><br style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif" /><span style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif">Brick server2:/gluster_bricks/data5 49170 0 Y 22889</span><br style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif" /><span style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif">Brick server2:/gluster_bricks/data6 49171 0 Y 22932</span></div><div style="font-family:'courier new' , 'courier' , 'monaco' , monospace , sans-serif"><span style="color:rgb( 38 , 40 , 42 );font-family:'helvetica neue' , 'helvetica' , 'arial' , sans-serif"><br /></span></div><div dir="ltr"><font color="#26282a" face="Helvetica Neue, Helvetica, Arial, sans-serif">I would remove those bricks and add them again this type always specifying one bri</font></div></div></div></div></div></blockquote></div></div></blockquote></div>