<div dir="ltr"><div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jun 20, 2017 at 9:17 AM, Nigel Babu <span dir="ltr"><<a href="mailto:nigelb@redhat.com" target="_blank">nigelb@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hello folks,<br>
<br>
Amar has proposed[1] these changes in the past and I'd like to announce us going<br>
live with them as we've not received any strong feedback against it.<br>
<br>
## Centos Regression<br>
* On master, we only run tests/basic as pre-merge testing.<br></blockquote><div><br></div><div>I should have read this and Amar's email thread more carefully but unfortunately I missed to read the above point in both the cases, so apologies. I think running only tests/basic on master is not *sufficient* given our goal is to have more test coverages coming from each patch and I expect most of the patches if not all will have tests added and if we don't run the full regression suite this eventually means we don't test the patch on master. Also I'm not sure how reactive we are against the regression test burn failure reports, so if things go bad and if we don't react to it immediately it'd be difficult to get the master branch back to stable state. I'd suggest (and request) that we should run the full regression test suite on Centos.<br><br> <br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
* On release branches, we will run the entire suite of tests.<br>
* Our regular regression-test-burn-in and regression-test-with-multiplex will<br>
continue to run the full suite of tests as they currently do.<br>
<br>
## NetBSD Regression<br>
* We will not run a netbsd7-regression as required pre-merge test anymore.<br>
However, you should be able to trigger it with "recheck netbsd".<br>
* A green NetBSD will no longer be required for merging patches, however if you<br>
have a -1 vote, it will remain a blocker. This is so that reviewers can<br>
request a full NetBSD run, especially on release branches.<br>
* We will do a periodic NetBSD regression run on all currently maintained<br>
branches (3.8, 3.10, and 3.11 at the moment) and master.<br>
<br>
## Additional Changes<br>
* As full regression runs per patch is run on release branches only (other than<br>
the nightly on master), any failures need proper attention and possible RCA.<br>
A re-trigger in the hopes of getting a green is no longer acceptable for<br>
release branches.<br>
* fstat will soon track the regression-test-burn-in and<br>
regression-test-with-multiplex<wbr>.<br>
* As soon as we have the new jobs up, we'll add them to fstat so we can track<br>
failure patterns.<br>
<br>
The CentOS changes are already in production. The NetBSD changes will land in<br>
production today.<br>
<br>
[1]: <a href="http://lists.gluster.org/pipermail/gluster-devel/2017-May/052868.html" rel="noreferrer" target="_blank">http://lists.gluster.org/piper<wbr>mail/gluster-devel/2017-May/<wbr>052868.html</a><br>
<br>
--<br>
nigelb<br>
______________________________<wbr>_________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-devel</a><br>
</blockquote></div><br></div></div></div>