<div dir="ltr"><br><br><div class="gmail_quote"><div dir="ltr">On Tue, Aug 14, 2018 at 5:31 PM Shyam Ranganathan <<a href="mailto:srangana@redhat.com">srangana@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
The intention is that master and release branches are always maintained<br>
in good working order. This involves, tests and related checks passing<br>
*always*.<br>
<br>
When this situation is breached, correcting it immediately is better<br>
than letting it build up, as that would entail longer times and more<br>
people to fix things up.<br>
<br>
In an ideal world, if nightly runs fail, the next thing done would be to<br>
examine patches that were added between the 2 runs, and see if they are<br>
the cause for failure, and back them out.<br></blockquote><div><br></div><div>To be clear, at this point, we'll need to lock down master as well until it's green again. If we know that master is broken, it's best we find the culprit and back it out/land a fix. If it's backed out, the author has a chance to fix the issue and re-land their patch. The problem with a broken master is that we may break it yet again and it will be more difficult to track down future failures.</div><div><br></div><div>This is more inconvenience, but this is what will help in the health of the project long-term.<br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
Hence calling to backout patches is something that would happen more<br>
regularly in the future if things are breaking.<br>
<br>
Lock down may happen if 2 consecutive nightly builds fail, so as to<br>
rectify the situation ASAP, and then move onto other work.<br>
<br>
In short, what I wanted to say is that preventing lock downs in the<br>
future, is not a state we aspire for. Lock downs may/will happen, it is<br>
done to get the branches stable quicker, than spend long times trying to<br>
find what caused the instability in the first place.<br></blockquote><div><br></div><div>Also adding a note that release branches have already been locked for a few releases in case nobody has noticed. Only release managers can land to release branches. This is done specifically so that the same process can happen there as well. <br></div></div><br clear="all"><br>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">nigelb<br></div></div></div>