Yep, you have to bring back hydra4:/gluster1/data<div id="yMail_cursorElementTracker_1627742898732"><br></div><div id="yMail_cursorElementTracker_1627742900930">You can mount again /gluster1/data (don't forget SELINUX) and then use gluster's reset-brick to rebuild that brick.</div><div id="yMail_cursorElementTracker_1627742967283"><br></div><div id="yMail_cursorElementTracker_1627742968029">Most probably you have an entry that was saved on hydra4:/gluster1/data and the arbiter but was not pushed to the surviving brick (based on the entry in the arbiter)</div><div id="yMail_cursorElementTracker_1627743029430"><br></div><div id="yMail_cursorElementTracker_1627743029599">Usually, I use method 2 from https://docs.gluster.org/en/latest/Troubleshooting/gfid-to-path/ to identify the file and then you can check the status of that file on the bricks (and if necessary restore from backup). You should do that only after you have brought back hydra4:/gluster1/data to the volume.</div><div id="yMail_cursorElementTracker_1627743099143"><br></div><div id="yMail_cursorElementTracker_1627743102241">You should also reconsider the brick layout, as in some cases a single hydra failure (whole server) will kill a subvolume and all VMs' disks on that subvolume will be unavailable.</div><div id="yMail_cursorElementTracker_1627743162022"><br></div><div id="yMail_cursorElementTracker_1627743162190"><br></div><div id="yMail_cursorElementTracker_1627743162417">Best Regards,</div><div id="yMail_cursorElementTracker_1627743166908">Strahil Nikolov<br> <br> <blockquote style="margin: 0 0 20px 0;"> <div style="font-family:Roboto, sans-serif; color:#6D00F6;"> <div>On Sat, Jul 31, 2021 at 2:18, Valerio Luccio</div><div><valerio.luccio@nyu.edu> wrote:</div> </div> <div style="padding: 10px 0 0 20px; margin: 10px 0 0 0; border-left: 1px solid #6D00F6;"> <div id="yiv4817917644"><div>
<p>Strahil,</p>
<p>did some more digging into the heal info output.</p>
<p>Found also the following:</p>
<blockquote>
<pre>[...]
Brick hydra4:/gluster1/data
Status: Transport endpoint is not connected
Number of entries: -
Brick hydra3:/arbiter/2
<gfid:2aa223b0-77f5-441e-bc76-34c8d459eeaa>
[...]
</pre>
</blockquote>
<p>So, to augment what I wrote before, the errors appear in "Brick
hydra3:/gluster3/data" and "Brick hydra3:/arbiter/2", plus that
"Transport endpoint is not connected" for "Brick
hydra4:/gluster1/data".</p>
<p>I need to add that hydra4:/gluster1 is the RAID that had major
hardware failure.</p><div class="yiv4817917644yqt2457066900" id="yiv4817917644yqtfd39184"><br clear="none">
</div><div class="yiv4817917644yqt2457066900" id="yiv4817917644yqtfd49789">
<div class="yiv4817917644moz-signature">-- <br clear="none">
<table cellspacing="0" cellpadding="0"><tbody><tr><td colspan="1" rowspan="1">As a result of Coronavirus-related precautions, NYU and
the Center for Brain Imaging operations will be managed
remotely until further notice.</td></tr><tr><td colspan="1" rowspan="1">All telephone calls and e-mail correspondence are being
monitored remotely during our normal business hours of
9am-5pm, Monday through Friday.</td></tr><tr><td colspan="1" rowspan="1"> </td></tr><tr><td colspan="1" rowspan="1">For MRI scanner-related emergency, please contact: Keith
Sanzenbach at <a rel="nofollow noopener noreferrer" shape="rect" class="yiv4817917644moz-txt-link-abbreviated" ymailto="mailto:keith.sanzenbach@nyu.edu" target="_blank" href="mailto:keith.sanzenbach@nyu.edu">keith.sanzenbach@nyu.edu</a> and/or Pablo
Velasco at <a rel="nofollow noopener noreferrer" shape="rect" class="yiv4817917644moz-txt-link-abbreviated" ymailto="mailto:pablo.velasco@nyu.edu" target="_blank" href="mailto:pablo.velasco@nyu.edu">pablo.velasco@nyu.edu</a></td></tr><tr><td colspan="1" rowspan="1">For computer/hardware/software emergency, please
contact: Valerio Luccio at <a rel="nofollow noopener noreferrer" shape="rect" class="yiv4817917644moz-txt-link-abbreviated" ymailto="mailto:valerio.luccio@nyu.edu" target="_blank" href="mailto:valerio.luccio@nyu.edu">valerio.luccio@nyu.edu</a></td></tr><tr><td colspan="1" rowspan="1">For TMS/EEG-related emergency, please contact: Chrysa
Papadaniil at <a rel="nofollow noopener noreferrer" shape="rect" class="yiv4817917644moz-txt-link-abbreviated" ymailto="mailto:chrysa@nyu.edu" target="_blank" href="mailto:chrysa@nyu.edu">chrysa@nyu.edu</a></td></tr><tr><td colspan="1" rowspan="1">For CBI-related administrative emergency, please
contact: Jennifer Mangan at <a rel="nofollow noopener noreferrer" shape="rect" class="yiv4817917644moz-txt-link-abbreviated" ymailto="mailto:jennifer.mangan@nyu.edu" target="_blank" href="mailto:jennifer.mangan@nyu.edu">jennifer.mangan@nyu.edu</a></td></tr></tbody></table>
<p>
</p>
<table style="color:gray;" cellspacing="0" cellpadding="0"><tbody><tr><td colspan="1" rowspan="1">Valerio Luccio</td><td colspan="1" rowspan="1"> </td><td colspan="1" rowspan="1">(212) 998-8736</td></tr><tr><td colspan="1" rowspan="1">Center for Brain Imaging</td><td colspan="1" rowspan="1"> </td><td colspan="1" rowspan="1">4 Washington Place, Room 158</td></tr><tr><td colspan="1" rowspan="1">New York University</td><td colspan="1" rowspan="1"> </td><td colspan="1" rowspan="1">New York, NY 10003</td></tr></tbody></table>
<p>
</p>
<blockquote>"In an open world, who needs windows or gates ?"</blockquote>
</div>
</div></div></div> </div> </blockquote></div>