<div dir="ltr"><div>Greetings all and thank you for your contribution to this discussion.<br><br></div>Amar and <span class="gmail-qu" tabindex="-1"><span name="Sankarshan Mukhopadhyay" class="gmail-gD">Sankarshan</span></span>, regarding your comments:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>* First of all, when we looked at log very early in project's life,
our idea was based mostly on kernel logs (/var/log/messages). We
decided, as a file-system, because it is very active with I/Os and
should run for years together without failing, there should be NO log
messages when the system is healthy, which should be 99%+ time.</div><div><br></div><div>*
Now, if there are no logs when everything is healthy, and most of the
things are healthy 99% of the time, naturally the focus was not
'performance' of logging infra, but the correctness. This is where, the
strict ordering through locks to preserve the timestamps of logs, and
have it organized came by.<br></div></blockquote><div> I believe this can be said about pretty much every software - nothing is designed to break (except maybe <span class="gmail-st"><em>piñatas</em></span>?).<br></div><div>I am curious though - when the project had begun, there were no INFO levels logs? These logs are logged even when everything is healthy.<br></div><div>In any case, we can set the history aside and focus on the present, and I believe many components were upgraded and improved over time and it looks like the logger was left behind, and is seems there are consequences for this now.<br><br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">That is interesting observation. For this alone, can we have an option
to disable all logging during regression? That would fasten up things
for normal runs immediately.</blockquote><div>We had an idea that could have improved CI time, but because the test module is built in such a way that each test starts gluster by itself, our idea was not feasible as it would require modification to all the tests (we wanted to run tests with no logging, and do log only when a test fails, on the re-run).<br></div><div>Anyway, IMO, turning off logging does not help us at all handle the core problem, and I also believe it may send a wrong message to our users ("our logging is not good enough so we decide to get rid of it instead of improving it").<br></div><div>And I fully agree with <span class="gmail-qu" tabindex="-1"><span name="Sankarshan Mukhopadhyay" class="gmail-gD">Sankarshan's comment:<br></span></span><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span class="gmail-qu" tabindex="-1"><span name="Sankarshan Mukhopadhyay" class="gmail-gD">If having quicker regression runs is the objective, then perhaps we
should not look at turning off logging to accomplish them. Instead,
there ought to be additional aspects which can be reviewed with turning
off logging being the last available option.<br></span></span></blockquote><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>Please make sure, we have minimum dependency on this project, and also
the install steps are easy for your project. One of the reasons Gluster
succeeded is because it is very easy to install (and uninstall), without
much dependencies. I personally would like to keep that behavior same. <br></div></blockquote><div>I did not mean for it to be a dependency for the project, I suggested that as an alternative logging solution that would be fully integrated into gluster. <br></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>I am in agreement with Sankarshan, who responded in another thread about
tools like EFK/ELK stack for centralized logging. By moving to
centralized logging, and having proper structure for logging, the
initial goals we had wouldn't be broken, and we will have better
performance even when we are logging in DEBUG mode.</div></blockquote><div>I do not know enough about EFK/ELK to base an opinion, but I understand from your comments that this is considered standard components for logging etc'.<br></div><div>I'm not against this at all but I do need to investigate more before I could share my thoughts on the technical aspects.<br><br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">[Amar] This, in my opinion is a good reason to undertake this activity. Mainly
because we should be having our logging infra similar with other tools,
and one shouldn't be having a learning curve to understand gluster's
logging.</blockquote><div></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>[Sankarshan] The original proposal from Barak has merit for planning towards an alpha form to be available.</div></blockquote><div>I'm very happy to hear this, as it gives me confidence in my actions, thank you.</div><div> <br></div><div>Unfortunately, I've been informed that I'm not to pursue this initiative at the current time, as there are other, higher, priorities that requires resources and it was decided not to dedicate them for this initiative.<br></div><div>I do hope that when the time is right, we could revisit this discussion and see how we can advance on that front.</div><div>If anyone has insight he'd like to share, I'd be happy to discuss it.<br><br></div><div>Thank you all very much,<br></div></div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Nov 27, 2019 at 4:33 AM Sankarshan Mukhopadhyay <<a href="mailto:sankarshan.mukhopadhyay@gmail.com">sankarshan.mukhopadhyay@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Nov 27, 2019 at 7:44 AM Amar Tumballi <<a href="mailto:amarts@gmail.com" target="_blank">amarts@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr">Hi Barak,<div><br></div><div>My replies inline.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Nov 21, 2019 at 6:34 PM Barak Sason Rofman <<a href="mailto:bsasonro@redhat.com" target="_blank">bsasonro@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt" id="gmail-m_-4024145762707102886gmail-m_-6963305442557278708gmail-m_4511241659698650777gmail-docs-internal-guid-2211c633-7fff-c4eb-83dd-3e2c2e691e75"><br></p></div></blockquote></div></div></blockquote><div><br></div><div>[snip]</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt" id="gmail-m_-4024145762707102886gmail-m_-6963305442557278708gmail-m_4511241659698650777gmail-docs-internal-guid-2211c633-7fff-c4eb-83dd-3e2c2e691e75"></p></div></blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Initial tests, done by <b>removing logging from the regression testing, shows an improvement of about 20% in run time</b>. This indicates we’re taking a pretty heavy performance hit just because of the logging activity.</span></p><br></div></blockquote><div><br></div><div>That is interesting observation. For this alone, can we have an option to disable all logging during regression? That would fasten up things for normal runs immediately.</div><div></div></div></div></blockquote><div><br></div><div>If having quicker regression runs is the objective, then perhaps we should not look at turning off logging to accomplish them. Instead, there ought to be additional aspects which can be reviewed with turning off logging being the last available option.<br></div></div></div>
_______________________________________________<br>
<br>
Community Meeting Calendar:<br>
<br>
APAC Schedule -<br>
Every 2nd and 4th Tuesday at 11:30 AM IST<br>
Bridge: <a href="https://bluejeans.com/441850968" rel="noreferrer" target="_blank">https://bluejeans.com/441850968</a><br>
<br>
<br>
NA/EMEA Schedule -<br>
Every 1st and 3rd Tuesday at 01:00 PM EDT<br>
Bridge: <a href="https://bluejeans.com/441850968" rel="noreferrer" target="_blank">https://bluejeans.com/441850968</a><br>
<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-devel</a><br>
<br>
</blockquote></div><br clear="all"><br>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div style="margin-left:44px"><div style="margin-bottom:0px;margin-left:0px;padding-bottom:5px"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div><font face="RedHatText, sans-serif"><span style="font-size:14px;text-transform:capitalize"><b>Barak Sason Rofman</b></span></font><br></div></div></div></div></div></div></div></div></div></div><div style="margin-left:44px"><div style="margin-bottom:0px;margin-left:0px;padding-bottom:5px"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="margin:0px;font-size:14px;color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;padding:0px;text-transform:uppercase"><span style="font-family:RedHatText,sans-serif;font-size:12px;text-transform:capitalize;font-weight:normal;color:rgb(34,34,34)">Gluster Storage </span><span style="font-family:RedHatText,sans-serif;font-size:12px;text-transform:capitalize;font-weight:normal;color:rgb(34,34,34)">Development</span></p></div></div></div></div></div></div></div></div></div></div><div style="margin-left:44px"><div style="margin-bottom:0px;margin-left:0px;padding-bottom:5px"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="margin:0px 0px 4px;font-size:12px;font-family:RedHatText,sans-serif"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px" target="_blank">Red Hat Israel</a></p><div style="margin-bottom:4px"><p style="margin:0px;font-size:12px;font-family:RedHatText,sans-serif">34 Jerusalem rd. Ra'anana, 43501</p></div><p style="margin:0px;font-size:12px;font-family:RedHatText,sans-serif"><span style="margin:0px;padding:0px">bsasonro<a href="mailto:adi@redhat.com" style="color:rgb(0,0,0);margin:0px" target="_blank">@redhat.com</a> </span> T: <u>+972-9-7692304</u><br>M: <u>+972-52-4326355</u></p><div style="margin-top:12px"><table border="0"><tbody><tr><td width="100px"><a href="https://red.ht/sig" style="color:rgb(17,85,204)" target="_blank"><img src="https://static.redhat.com/libs/redhat/brand-assets/latest/corp/logo.png" width="90" height="auto"></a></td></tr></tbody></table></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>