<div dir="ltr">Hi Deepshikha,<div><br></div><div>Are you looking into this failure? I can still see this happening for all the regression runs.</div><div><br></div><div>Thanks & Regards,</div><div>Karthik</div></div><br><div class="gmail_quote"><div dir="ltr">On Sun, Jul 8, 2018 at 7:18 AM Atin Mukherjee <<a href="mailto:amukherj@redhat.com">amukherj@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><a href="https://build.gluster.org/job/regression-test-with-multiplex/794/display/redirect" target="_blank">https://build.gluster.org/job/regression-test-with-multiplex/794/display/redirect</a> has the same test failing. Is the reason of the failure different given this is on jenkins?</div></div><div><br><div class="gmail_quote"><div dir="ltr">On Sat, 7 Jul 2018 at 19:12, Deepshikha Khandelwal <<a href="mailto:dkhandel@redhat.com" target="_blank">dkhandel@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi folks,<br>
<br>
The issue[1] has been resolved. Now the softserve instance will be<br>
having 2GB RAM i.e. same as that of the Jenkins builder's sizing<br>
configurations.<br>
<br>
[1] <a href="https://github.com/gluster/softserve/issues/40" rel="noreferrer" target="_blank">https://github.com/gluster/softserve/issues/40</a><br>
<br>
Thanks,<br>
Deepshikha Khandelwal<br>
<br>
On Fri, Jul 6, 2018 at 6:14 PM, Karthik Subrahmanya <<a href="mailto:ksubrahm@redhat.com" target="_blank">ksubrahm@redhat.com</a>> wrote:<br>
><br>
><br>
> On Fri 6 Jul, 2018, 5:18 PM Deepshikha Khandelwal, <<a href="mailto:dkhandel@redhat.com" target="_blank">dkhandel@redhat.com</a>><br>
> wrote:<br>
>><br>
>> Hi Poornima/Karthik,<br>
>><br>
>> We've looked into the memory error that this softserve instance have<br>
>> showed up. These machine instances have 1GB RAM which is not in the<br>
>> case with the Jenkins builder. It's 2GB RAM there.<br>
>><br>
>> We've created the issue [1] and will solve it sooner.<br>
><br>
> Great. Thanks for the update.<br>
>><br>
>><br>
>> Sorry for the inconvenience.<br>
>><br>
>> [1] <a href="https://github.com/gluster/softserve/issues/40" rel="noreferrer" target="_blank">https://github.com/gluster/softserve/issues/40</a><br>
>><br>
>> Thanks,<br>
>> Deepshikha Khandelwal<br>
>><br>
>> On Fri, Jul 6, 2018 at 3:44 PM, Karthik Subrahmanya <<a href="mailto:ksubrahm@redhat.com" target="_blank">ksubrahm@redhat.com</a>><br>
>> wrote:<br>
>> > Thanks Poornima for the analysis.<br>
>> > Can someone work on fixing this please?<br>
>> ><br>
>> > ~Karthik<br>
>> ><br>
>> > On Fri, Jul 6, 2018 at 3:17 PM Poornima Gurusiddaiah<br>
>> > <<a href="mailto:pgurusid@redhat.com" target="_blank">pgurusid@redhat.com</a>><br>
>> > wrote:<br>
>> >><br>
>> >> The same test case is failing for my patch as well [1]. I requested for<br>
>> >> a<br>
>> >> regression system and tried to reproduce it.<br>
>> >> From my analysis, the brick process (mutiplexed) is consuming a lot of<br>
>> >> memory, and is being OOM killed. The regression has 1GB ram and the<br>
>> >> process<br>
>> >> is consuming more than 1GB. 1GB for 120 bricks is acceptable<br>
>> >> considering<br>
>> >> there is 1000 threads in that brick process.<br>
>> >> Ways to fix:<br>
>> >> - Increase the regression system RAM size OR<br>
>> >> - Decrease the number of volumes in the test case.<br>
>> >><br>
>> >> But what is strange is why the test passes sometimes for some patches.<br>
>> >> There could be some bug/? in memory consumption.<br>
>> >><br>
>> >> Regards,<br>
>> >> Poornima<br>
>> >><br>
>> >><br>
>> >> On Fri, Jul 6, 2018 at 2:11 PM, Karthik Subrahmanya<br>
>> >> <<a href="mailto:ksubrahm@redhat.com" target="_blank">ksubrahm@redhat.com</a>><br>
>> >> wrote:<br>
>> >>><br>
>> >>> Hi,<br>
>> >>><br>
>> >>> $subject is failing on centos regression for most of the patches with<br>
>> >>> timeout error.<br>
>> >>><br>
>> >>> 07:32:34<br>
>> >>><br>
>> >>> ================================================================================<br>
>> >>> 07:32:34 [07:33:05] Running tests in file<br>
>> >>> ./tests/bugs/core/bug-1432542-mpx-restart-crash.t<br>
>> >>> 07:32:34 Timeout set is 300, default 200<br>
>> >>> 07:37:34 ./tests/bugs/core/bug-1432542-mpx-restart-crash.t timed out<br>
>> >>> after 300 seconds<br>
>> >>> 07:37:34 ./tests/bugs/core/bug-1432542-mpx-restart-crash.t: bad status<br>
>> >>> 124<br>
>> >>> 07:37:34<br>
>> >>> 07:37:34 *********************************<br>
>> >>> 07:37:34 * REGRESSION FAILED *<br>
>> >>> 07:37:34 * Retrying failed tests in case *<br>
>> >>> 07:37:34 * we got some spurious failures *<br>
>> >>> 07:37:34 *********************************<br>
>> >>> 07:37:34<br>
>> >>> 07:42:34 ./tests/bugs/core/bug-1432542-mpx-restart-crash.t timed out<br>
>> >>> after 300 seconds<br>
>> >>> 07:42:34 End of test ./tests/bugs/core/bug-1432542-mpx-restart-crash.t<br>
>> >>> 07:42:34<br>
>> >>><br>
>> >>> ================================================================================<br>
>> >>><br>
>> >>> Can anyone take a look?<br>
>> >>><br>
>> >>> Thanks,<br>
>> >>> Karthik<br>
>> >>><br>
>> >>><br>
>> >>><br>
>> >>> _______________________________________________<br>
>> >>> Gluster-devel mailing list<br>
>> >>> <a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
>> >>> <a href="https://lists.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-devel</a><br>
>> >><br>
>> >><br>
>> ><br>
>> > _______________________________________________<br>
>> > Gluster-infra mailing list<br>
>> > <a href="mailto:Gluster-infra@gluster.org" target="_blank">Gluster-infra@gluster.org</a><br>
>> > <a href="https://lists.gluster.org/mailman/listinfo/gluster-infra" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-infra</a><br>
_______________________________________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-devel</a><br>
</blockquote></div></div>-- <br><div dir="ltr" class="m_-4859419650416721006gmail_signature" data-smartmail="gmail_signature">- Atin (atinm)</div>
</blockquote></div>