<div dir="ltr"><div dir="ltr">Nithyya, <span style="color:rgb(32,33,36);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px;letter-spacing:0.2px;white-space:nowrap">Raghavendra</span><span style="color:rgb(32,33,36);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px;font-weight:700;letter-spacing:0.2px;white-space:nowrap">, </span>Davide</div><div dir="ltr"><br></div><div dir="ltr">Thank you for your help.<br><table cellpadding="0" class="m_-4896914366449954708gmail-ajC" style="border-spacing:0px;font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:12.8px"><tbody><tr class="m_-4896914366449954708gmail-UszGxc m_-4896914366449954708gmail-ajv"><td colspan="2" class="m_-4896914366449954708gmail-gL" style="vertical-align:top;width:auto;padding:6px 0px"><span class="m_-4896914366449954708gmail-gI" style="vertical-align:top"><span class="m_-4896914366449954708gmail-qu"><span name="Nithya Balachandran" class="m_-4896914366449954708gmail-gD" style="color:rgb(32,33,36);font-size:0.875rem;white-space:nowrap;display:inline;vertical-align:top;letter-spacing:0.2px;line-height:20px"><br><b>>how the permissions are displayed for the file on the servers?<br></b><br>Trying to answer this question is what fixed the problem. It looked just fine on all 3 servers. And it looks like running "ls" on the servers fixed it on the clients. I had to repeat it on all 3 servers. <br>It fixed file permissions on 2 clients and made the file show up on the 3rd client.<br><br>Even though it fixed the file permissions and I could now view contents of the file, the software was still having issues with renaming ".download_suspensions.memo.writing" to ".download_suspensions.memo"<br>When I tried to replace the file manually, I got<br>$ mv .download_suspensions.memo.writing .download_suspensions.memo<br style="box-sizing:border-box;color:rgb(36,41,46);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI Emoji","Segoe UI Symbol";letter-spacing:normal;white-space:normal"><span style="color:rgb(36,41,46);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI Emoji","Segoe UI Symbol";letter-spacing:normal;white-space:normal">mv: ‘.download_suspensions.memo.writing’ and ‘.download_suspensions.memo’ are the same file<br></span><br>I ended up removing both files and having the software rebuild them.<br><br>><b>Wondering whether its a case of split brain.<br></b>Very possible. All 3 servers were rebooted. It brought down linux cluster running on the same 3 servers as well.<br><br class="m_-4896914366449954708gmail-Apple-interchange-newline"></span></span></span></td></tr></tbody></table></div><div><div class="gmail_quote"><div> <br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="gmail_quote"><div dir="ltr">On Thu, Jan 10, 2019 at 10:00 AM Raghavendra Gowdappa <<a href="mailto:rgowdapp@redhat.com" target="_blank">rgowdapp@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr">On Wed, Jan 9, 2019 at 7:48 PM Dmitry Isakbayev <<a href="mailto:isakdim@gmail.com" target="_blank">isakdim@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>I am seeing a broken file that exists on 2 out of 3 nodes. </div></div></div></div></blockquote><div><br></div><div>Wondering whether its a case of split brain.<br> <br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div> The application trying to use the file throws file permissions error. ls, rm, mv, touch all throw "Input/output error"</div><div><br></div><div>$ ls -la <br></div><div><div>ls: cannot access .download_suspensions.memo: Input/output error</div><div>drwxrwxr-x. 2 ossadmin ossadmin 4096 Jan 9 08:06 .<br></div><div>drwxrwxr-x. 5 ossadmin ossadmin 4096 Jan 3 11:36 ..</div><div>-?????????? ? ? ? ? ? .download_suspensions.memo<br></div></div><div><br></div><div><div>$ rm ".download_suspensions.memo"</div><div>rm: cannot remove ‘.download_suspensions.memo’: Input/output error</div></div><div><br></div><div><div><br></div><div><br></div><br class="m_-4896914366449954708gmail-m_8637765594171135177gmail-m_3974030042881498188gmail-m_8184650081931859386gmail-Apple-interchange-newline"></div><div><br></div></div></div></div>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a></blockquote></div></div>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a></blockquote></div><br clear="all"><br>-- <br><div dir="ltr" class="m_-4896914366449954708gmail-m_8637765594171135177gmail_signature"><span style="display:block;font-size:11pt;font-family:"Century Gothic";color:rgb(0,53,128)"><div style="color:rgb(0,53,128);font-family:Arial,Helvetica,sans-serif;font-weight:bold;font-size:15px"><div>Davide Obbi</div><div style="font-weight:normal;font-size:13px;color:rgb(0,174,239)">Senior System Administrator<br><br></div><div style="font-weight:normal;font-size:13px;color:rgb(102,102,102)">Booking.com B.V.<br>Vijzelstraat 66-80 Amsterdam 1017HL Netherlands</div><div style="font-weight:normal;font-size:13px;color:rgb(102,102,102)"><span style="color:rgb(0,174,239)">Direct </span>+31207031558<br></div><div style="font-weight:normal;font-size:13px;color:rgb(102,102,102)"><div style="font-weight:bold;font-size:16px;color:rgb(0,53,128)"><a href="https://www.booking.com/" style="color:rgb(0,127,255);background-image:initial;background-position:initial;background-repeat:initial" target="_blank"><img src="https://bstatic.com/static/img/siglogo.jpg" alt="Booking.com" title="Booking.com"></a></div><div><span style="font-size:11px">Empowering people to experience the world since 1996</span></div><div><span style="font-size:11px">43 languages, 214+ offices worldwide, 141,000+ global destinations, 29 million reported listings <br></span><span style="font-size:11px">Subsidiary of Booking Holdings Inc. (NASDAQ: BKNG)</span></div></div></div></span></div>
</blockquote></div></div></div>