<html><body><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; color: #000000"><div>I am currently playing with concatenating main file + shards together. Is it safe to assume that a shard with the same ID and sequence number (5da7d7b9-7ff3-48d2-8dcd-4939364bda1f.242 for example) is identical across bricks? That is, I can copy all the shards into a single location overwriting and/or discarding duplicates, then concatenate them together in order? Or is it a more complex?<br></div><div><br data-mce-bogus="1"></div><hr id="zwchr" data-marker="__DIVIDER__"><div data-marker="__HEADERS__"><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"anthony" <anthony@vofr.net><br><b>To: </b>"gluster-users" <gluster-users@gluster.org><br><b>Sent: </b>Tuesday, September 7, 2021 10:18:07 AM<br><b>Subject: </b>Re: [Gluster-users] Recovering from remove-brick where shards did not rebalance<br></blockquote></div><div data-marker="__QUOTED_TEXT__"><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><div style="font-family:'arial' , 'helvetica' , sans-serif;font-size:10pt;color:#000000"><div>I've been playing with re-adding the bricks and here is some interesting behavior.</div><br><div>When I try to force add the bricks to the volume while it's running, I get complaints about one of the bricks already being a member of a volume. If I stop the volume, I can then force-add the bricks. However, the volume won't start without force. Once the volume is force started, all of the bricks remain offline.<br></div><br><div>I feel like I'm close...but not quite there...<br></div><br><hr id="zwchr"><div><blockquote style="border-left:2px solid #1010ff;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:'helvetica' , 'arial' , sans-serif;font-size:12pt"><b>From: </b>"anthony" <anthony@vofr.net><br><b>To: </b>"Strahil Nikolov" <hunter86_bg@yahoo.com><br><b>Cc: </b>"gluster-users" <gluster-users@gluster.org><br><b>Sent: </b>Tuesday, September 7, 2021 7:45:44 AM<br><b>Subject: </b>Re: [Gluster-users] Recovering from remove-brick where shards did not rebalance<br></blockquote></div><div><blockquote style="border-left:2px solid #1010ff;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:'helvetica' , 'arial' , sans-serif;font-size:12pt"><div style="font-family:'arial' , 'helvetica' , sans-serif;font-size:10pt;color:#000000"><div>I was contemplating these options, actually, but not finding anything in my research showing someone had tried either before gave me pause.</div><br><div>One thing I wasn't sure about when doing a force add-brick was if gluster would wipe the existing data from the added bricks. Sounds like that may not be the case?</div><br><div>With regards to concatenating the main file + shards, how would I go about identifying the shards that pair with the main file? I see the shards have sequence numbers, but I'm not sure how to match the identifier to the main file.</div><br><div>Thanks!!</div><br><hr id="zwchr"><div><blockquote style="border-left:2px solid #1010ff;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:'helvetica' , 'arial' , sans-serif;font-size:12pt"><b>From: </b>"Strahil Nikolov" <hunter86_bg@yahoo.com><br><b>To: </b>"anthony" <anthony@vofr.net>, "gluster-users" <gluster-users@gluster.org><br><b>Sent: </b>Tuesday, September 7, 2021 6:02:36 AM<br><b>Subject: </b>Re: [Gluster-users] Recovering from remove-brick where shards did not rebalance<br></blockquote></div><div><blockquote style="border-left:2px solid #1010ff;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:'helvetica' , 'arial' , sans-serif;font-size:12pt">The data should be recoverable by concatenating the main file with all shards. Then you can copy the data back via the FUSE mount point.<div id="yMail_cursorElementTracker_1631019624966"><br></div><div id="yMail_cursorElementTracker_1631019625189">I think that some users reported that add-brick with the force option allows to 'undo' the situation and 're-add' the data, but I have never tried that and I cannot guarantee that it will even work.</div><div id="yMail_cursorElementTracker_1631019671394"><br></div><div id="yMail_cursorElementTracker_1631019671588">The simplest way is to recover from a recent backup , but sometimes this leads to a data loss.</div><div id="yMail_cursorElementTracker_1631019697845"><br></div><div id="yMail_cursorElementTracker_1631019698066">Best Regards,</div><div id="yMail_cursorElementTracker_1631019701411">Strahil Nikolov<br> <br> <blockquote style="margin:0 0 20px 0"> <div style="font-family:'roboto' , sans-serif;color:#6d00f6"> <div>On Tue, Sep 7, 2021 at 9:29, Anthony Hoppe</div><div><anthony@vofr.net> wrote:</div> </div> <div style="padding:10px 0 0 20px;margin:10px 0 0 0;border-left:1px solid #6d00f6"> <div dir="ltr">Hello,<br></div><div dir="ltr"><br></div><div dir="ltr">I did a bad thing and did a remove-brick on a set of bricks in a distributed-replicate volume where rebalancing did not successfully rebalance all files. In sleuthing around the various bricks on the 3 node pool, it appears that a number of the files within the volume may have been stored as shards. With that, I'm unsure how to proceed with recovery.<br></div><div dir="ltr"><br></div><div dir="ltr">Is it possible to re-add the removed bricks somehow and then do a heal? Or is there a way to recover data from shards somehow?<br></div><div dir="ltr"><br></div><div dir="ltr">Thanks!<br></div><div dir="ltr">________<br></div><div dir="ltr"><br></div><div dir="ltr"><br></div><div dir="ltr"><br></div><div dir="ltr">Community Meeting Calendar:<br></div><div dir="ltr"><br></div><div dir="ltr">Schedule -<br></div><div dir="ltr">Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC<br></div><div dir="ltr">Bridge: <a href="https://meet.google.com/cpu-eiue-hvk" rel="nofollow noopener noreferrer nofollow noopener noreferrer nofollow noopener noreferrer" target="_blank">https://meet.google.com/cpu-eiue-hvk</a><br></div><div dir="ltr">Gluster-users mailing list<br></div><div dir="ltr"><a href="mailto:Gluster-users@gluster.org" rel="nofollow noopener noreferrer nofollow noopener noreferrer nofollow noopener noreferrer" target="_blank">Gluster-users@gluster.org</a><br></div><div dir="ltr"><a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="nofollow noopener noreferrer nofollow noopener noreferrer nofollow noopener noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br></div> </div> </blockquote></div></blockquote></div></div></blockquote></div></div><br></blockquote></div></div></body></html>