<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Jul 7, 2017 at 9:15 PM, Pranith Kumar Karampuri <span dir="ltr"><<a href="mailto:pkarampu@redhat.com" target="_blank">pkarampu@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>Did anything special happen on these two bricks? It can't happen in the I/O path:<br>posix_removexattr() has:<br> 0 if (!strcmp (GFID_XATTR_KEY, name)) { <wbr> <wbr> <wbr> <wbr> <br> 1 gf_msg (this->name, GF_LOG_WARNING, 0, P_MSG_XATTR_NOT_REMOVED, <br> 2 "Remove xattr called on gfid for file %s", real_path); <br> 3 op_ret = -1; <wbr> <br> 4 goto out; <wbr> <br> 5 } <wbr> <wbr> <br> 6 if (!strcmp (GF_XATTR_VOL_ID_KEY, name)) { <wbr> <br> 7 gf_msg (this->name, GF_LOG_WARNING, 0, P_MSG_XATTR_NOT_REMOVED, <br> 8 "Remove xattr called on volume-id for file %s", <br> 9 real_path); <wbr> <br> 10 op_ret = -1; <wbr> <br> 11 goto out; <wbr> <br> 12 } <br><br></div>I just found that op_errno is not set correctly, but it can't happen in the I/O path, so self-heal/rebalance are off the hook.<br><br></div><div>I also grepped for any removexattr of trusted.gfid from glusterd and didn't find any.<br><br></div><div>So one thing that used to happen was that sometimes when machines reboot, the brick mounts wouldn't happen and this would lead to absence of both trusted.gfid and volume-id. So at the moment this is my wild guess.<br></div></div></blockquote><div><br></div><div>Fix for this was to mount the bricks. But considering that you guys did setting of the xattrs instead, I am guessing the other data was intact and only these particular xattrs were missing? I wonder what new problem this is.<br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div></div><div><br></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="h5">On Fri, Jul 7, 2017 at 8:39 PM, Ankireddypalle Reddy <span dir="ltr"><<a href="mailto:areddy@commvault.com" target="_blank">areddy@commvault.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5">
<div link="blue" vlink="purple" lang="EN-US">
<div class="m_-6655560758201185436m_5471498391887908807WordSection1">
<p class="MsoNormal">Hi,<u></u><u></u></p>
<p class="MsoNormal"> We faced an issue in the production today. We had to stop the volume and reboot all the servers in the cluster. Once the servers rebooted starting of the volume failed because the following extended attributes were not present on
all the bricks on 2 servers. <u></u><u></u></p>
<p class="m_-6655560758201185436m_5471498391887908807MsoListParagraph"><u></u><span>1)<span style="font:7.0pt "Times New Roman"">
</span></span><u></u>trusted.gfid<u></u><u></u></p>
<p class="m_-6655560758201185436m_5471498391887908807MsoListParagraph"><u></u><span>2)<span style="font:7.0pt "Times New Roman"">
</span></span><u></u>trusted.glusterfs.volume-id<u></u><u></u></p>
<p class="MsoNormal" style="margin-left:.25in"><u></u> <u></u></p>
<p class="MsoNormal" style="margin-left:.25in">We had to manually set these extended attributes to start the volume. Are there any such known issues.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Thanks and Regards,<u></u><u></u></p>
<p class="MsoNormal">Ram <u></u><u></u></p>
</div>
<div>***************************Leg<wbr>al Disclaimer********************<wbr>*******<div>"This communication may contain confidential and privileged material for the<div>sole use of the intended recipient. Any unauthorized review, use or distribution<div>by others is strictly prohibited. If you have received the message by mistake,<div>please advise the sender by reply email and delete the message. Thank you."<div>******************************<wbr>******************************<wbr>**********</div>
</div></div></div></div></div></div><br></div></div>______________________________<wbr>_________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-devel</a><span class="HOEnZb"><font color="#888888"><br></font></span></blockquote></div><span class="HOEnZb"><font color="#888888"><br><br clear="all"><br>-- <br><div class="m_-6655560758201185436gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Pranith<br></div></div>
</font></span></div></div>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Pranith<br></div></div>
</div></div>