[Gluster-devel] Regression host hung on tests/basic/afr/split-brain-healing.t

[Justin Clift]

Thinking about this more, I think I know what may have happened.

Not knowing any better (then), I probably put the slave offline (so nothing
else would run), but Aborted the job hung job in Jenkins.  That probably
would have then run the cleanup bits for Jenkins, which may have removed
the Gluster volume.

That kind of fits what we see with this host.  I guess for now I'll get
this VM rebuilt and put back online... and the next time there's a hang I
won't Abort the job in Jenkins before reporting it. :)

+ Justin


On 27 Feb 2015, at 08:45, Krutika Dhananjay <kdhananj at redhat.com> wrote:
> Hi,
> 
> It looks like the setup has been cleaned up? Volume 'patchy' seems to be gone now.
> 
> -Krutika
> 
> From: "Justin Clift" <justin at gluster.org>
> To: "Pranith Kumar Karampuri" <pkarampu at redhat.com>
> Cc: "Gluster Devel" <gluster-devel at gluster.org>, "Ravishankar N" <ravishankar at redhat.com>, "Krutika Dhananjay" <kdhananj at redhat.com>, "Anuradha Talur" <atalur at redhat.com>
> Sent: Thursday, February 26, 2015 5:11:20 PM
> Subject: Re: Regression host hung on tests/basic/afr/split-brain-healing.t
> 
> On 26 Feb 2015, at 08:57, Pranith Kumar Karampuri <pkarampu at redhat.com> wrote:
> > On 02/26/2015 02:54 AM, Justin Clift wrote:
> >> Anyone have an interest in a regression test VM that's (presently) hung on
> >> tests/basic/afr/split-brain-healing.t?  Likely to be a spurious error.
> >> 
> >> I can either reboot the VM and put it back into service, or I can leave it
> >> for someone to log into and figure out why it's hung.
> >> 
> >> Trying to decide which way to go. :)
> > Justin,
> >    I copied others who are working on afr as well so that they can take a look.
> 
> Thanks.  It's slave28, and this is where it's hung (just checked):
> 
>   root  17491     1  0 Feb25 ?  S   0:00 sudo -E bash -x /opt/qa/regression.sh
>   root  17492 17491  0 Feb25 ?  S   0:00  \_ bash -x /opt/qa/regression.sh
>   root  17499 17492  0 Feb25 ?  S   0:00      \_ /bin/bash ./run-tests.sh
>   root  17514 17499  0 Feb25 ?  S   0:00          \_ /usr/bin/perl /usr/bin/prove -rf --timer ./tests
>   root   1749 17514  0 Feb25 ?  S   0:00              \_ /bin/bash ./tests/basic/afr/split-brain-healing.t
>   root   2906  1749  0 Feb25 ?  Sl  0:06                  \_ gluster --mode=script --wignore volume heal patchy split-brain bigger-file /file1
>   root   2915  2906  0 Feb25 ?  Sl  0:02                      \_ /build/install/sbin/glfsheal patchy bigger-file /file1
> 
> You guys are welcome to log into it and "do stuff".  It has the normal
> jenkins ssh auth for our Rackspace slaves.
> 
> Please let me know when it's no longer needed, so I can put it back into
> service. :)
> 
> + Justin
> 
> --
> GlusterFS - http://www.gluster.org
> 
> An open source, distributed file system scaling to several
> petabytes, and handling thousands of clients.
> 
> My personal twitter: twitter.com/realjustinclift
> 
> 

--
GlusterFS - http://www.gluster.org

An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.

My personal twitter: twitter.com/realjustinclift