<div dir="ltr">This is a nice way to validate the patch for us.<div><br></div><div>Question I have is did we measure the time benefit of running them in parallel with containers?</div><div><br></div><div>Would be great to see the result in getting this tested in a cloud env, with 5 parallel threads and 10 parallel threads. </div><div><br></div><div>-Amar</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Jun 14, 2019 at 7:44 PM Aravinda <<a href="mailto:avishwan@redhat.com">avishwan@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">**gluster-tester** is a framework to run existing "*.t" test files in<br>
parallel using containers.<br>
<br>
Install and usage instructions are available in the following<br>
repository.<br>
<br>
<a href="https://github.com/aravindavk/gluster-tester" rel="noreferrer" target="_blank">https://github.com/aravindavk/gluster-tester</a><br>
<br>
## Completed:<br>
- Create a base container image with all the dependencies installed.<br>
- Create a tester container image with requested refspec(or latest<br>
master) compiled and installed.<br>
- SSH setup in containers required to test Geo-replication<br>
- Take `--num-parallel` option and spawn the containers with ready<br>
infra for running tests<br>
- Split the tests based on the number of parallel jobs specified.<br>
- Execute the tests in parallel in each container and watch for the<br>
status.<br>
- Archive only failed tests(Optionally enable logs for successful tests<br>
using `--preserve-success-logs`)<br>
<br>
## Pending:<br>
- NFS related tests are not running since the required changes are<br>
pending while creating the container image. (To know the failures run<br>
gluster-tester with `--include-nfs-tests` option)<br>
- Filter support while running the tests(To enable/disable tests on the<br>
run time)<br>
- Some Loop based tests are failing(I think due to shared `/dev/loop*`)<br>
- A few tests are timing out(Due to this overall test duration is more)<br>
- Once tests are started, showing real-time status is pending(Now<br>
status is checked in `<logdir>/regression-<job>.log` for example<br>
`/var/log/gluster-tester/regression-3.log`<br>
- If the base image is not built before running tests, it gives an<br>
error. Need to re-trigger the base container image step if not built.<br>
(Issue: <a href="https://github.com/aravindavk/gluster-tester/issues/11" rel="noreferrer" target="_blank">https://github.com/aravindavk/gluster-tester/issues/11</a>)<br>
- Creating an archive of core files<br>
- Creating a single archive from all jobs/containers<br>
- Testing `--ignore-from` feature to ignore the tests<br>
- Improvements to the status output<br>
- Cleanup(Stop test containers, and delete)<br>
<br>
I opened an issue to collect the details of failed tests. I will<br>
continue to update that issue as and when I capture failed tests in my<br>
setup.<br>
<a href="https://github.com/aravindavk/gluster-tester/issues/9" rel="noreferrer" target="_blank">https://github.com/aravindavk/gluster-tester/issues/9</a><br>
<br>
Feel free to suggest any feature improvements. Contributions are<br>
welcome.<br>
<a href="https://github.com/aravindavk/gluster-tester/issues" rel="noreferrer" target="_blank">https://github.com/aravindavk/gluster-tester/issues</a><br>
<br>
--<br>
Regards<br>
Aravinda<br>
<a href="http://aravindavk.in" rel="noreferrer" target="_blank">http://aravindavk.in</a><br>
<br>
<br>
_______________________________________________<br>
<br>
Community Meeting Calendar:<br>
<br>
APAC Schedule -<br>
Every 2nd and 4th Tuesday at 11:30 AM IST<br>
Bridge: <a href="https://bluejeans.com/836554017" rel="noreferrer" target="_blank">https://bluejeans.com/836554017</a><br>
<br>
NA/EMEA Schedule -<br>
Every 1st and 3rd Tuesday at 01:00 PM EDT<br>
Bridge: <a href="https://bluejeans.com/486278655" rel="noreferrer" target="_blank">https://bluejeans.com/486278655</a><br>
<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-devel</a><br>
<br>
<br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div>Amar Tumballi (amarts)<br></div></div></div></div></div>