[Gluster-devel] Spurious failures

[Kotresh Hiremath Ravishankar]

Hi Krutika,

Looks like the prerequisites for geo-replication to work is changed
in slave21

Hi Michael,

Could you please check following settings are made in all linux regression machines?
Or provide me with root password so that I can verify.

1. Setup Passwordless SSH for the root user:
         
2. Add below line in /root/.bashrc. This is required as geo-rep does "gluster --version" via ssh
   and it can't find the gluster PATH via ssh.
     export PATH=$PATH:/build/install/sbin:/build/install/bin

Once above settings are done, the following script should output proper version.

-------------------
#!/bin/bash

function SSHM()
{
    ssh -q \
        -oPasswordAuthentication=no \
        -oStrictHostKeyChecking=no \
        -oControlMaster=yes \
        "$@";
}

function cmd_slave()
{
    local cmd_line;
    cmd_line=$(cat <<EOF
function do_verify() {
ver=\$(gluster --version | head -1 | cut -f2 -d " ");
echo \$ver;
};
source /etc/profile && do_verify;
EOF
);
echo $cmd_line;
}[root at slave32 ~]

HOST=$1
cmd_line=$(cmd_slave);
ver=`SSHM root@$HOST bash -c "'$cmd_line'"`;
echo $ver
-------------------------

I could verify for slave32. 
[root at slave32 ~]# vi /tmp/gver.sh 
[root at slave32 ~]# /tmp/gver.sh slave32
3.8dev

Please help me in verifying the same for all the linux regression machines.


Thanks and Regards,
Kotresh H R

----- Original Message -----
> From: "Kotresh Hiremath Ravishankar" <khiremat at redhat.com>
> To: "Krutika Dhananjay" <kdhananj at redhat.com>
> Cc: "Atin Mukherjee" <amukherj at redhat.com>, "Gluster Devel" <gluster-devel at gluster.org>, "Gaurav Garg"
> <ggarg at redhat.com>, "Aravinda" <avishwan at redhat.com>
> Sent: Wednesday, September 23, 2015 12:31:12 PM
> Subject: Re: Spurious failures
> 
> Hi Krutika,
> 
> It's failing with
> 
> ++ gluster --mode=script --wignore volume geo-rep master
> slave21.cloud.gluster.org::slave create push-pem
> Gluster version mismatch between master and slave.
> 
> I will look into it.
> 
> Thanks and Regards,
> Kotresh H R
> 
> ----- Original Message -----
> > From: "Krutika Dhananjay" <kdhananj at redhat.com>
> > To: "Atin Mukherjee" <amukherj at redhat.com>
> > Cc: "Gluster Devel" <gluster-devel at gluster.org>, "Gaurav Garg"
> > <ggarg at redhat.com>, "Aravinda" <avishwan at redhat.com>,
> > "Kotresh Hiremath Ravishankar" <khiremat at redhat.com>
> > Sent: Tuesday, September 22, 2015 9:03:44 PM
> > Subject: Re: Spurious failures
> > 
> > Ah! Sorry. I didn't read that line. :)
> > 
> > Just figured even ./tests/geo-rep/georep-basic-dr-rsync.t is added to bad
> > tests list.
> > 
> > So it's just /tests/geo-rep/georep-basic-dr-tarssh.t for now.
> > 
> > Thanks Atin!
> > 
> > -Krutika
> > 
> > ----- Original Message -----
> > 
> > > From: "Atin Mukherjee" <amukherj at redhat.com>
> > > To: "Krutika Dhananjay" <kdhananj at redhat.com>
> > > Cc: "Gluster Devel" <gluster-devel at gluster.org>, "Gaurav Garg"
> > > <ggarg at redhat.com>, "Aravinda" <avishwan at redhat.com>, "Kotresh Hiremath
> > > Ravishankar" <khiremat at redhat.com>
> > > Sent: Tuesday, September 22, 2015 8:51:22 PM
> > > Subject: Re: Spurious failures
> > 
> > > ./tests/bugs/glusterd/bug-1238706-daemons-stop-on-peer-cleanup.t (Wstat:
> > > 0 Tests: 8 Failed: 2)
> > > Failed tests: 6, 8
> > > Files=1, Tests=8, 48 wallclock secs ( 0.01 usr 0.01 sys + 0.88 cusr
> > > 0.56 csys = 1.46 CPU)
> > > Result: FAIL
> > > ./tests/bugs/glusterd/bug-1238706-daemons-stop-on-peer-cleanup.t: bad
> > > status 1
> > > *Ignoring failure from known-bad test
> > > ./tests/bugs/glusterd/bug-1238706-daemons-stop-on-peer-cleanup.t*
> > > [11:24:16] ./tests/bugs/glusterd/bug-1242543-replace-brick.t .. ok
> > > 17587 ms
> > > [11:24:16]
> > > All tests successful
> > 
> > > On 09/22/2015 08:46 PM, Krutika Dhananjay wrote:
> > > > https://build.gluster.org/job/rackspace-regression-2GB-triggered/14421/consoleFull
> > > >
> > > > Ctrl + f 'not ok'.
> > > >
> > > > -Krutika
> > > >
> > > > ------------------------------------------------------------------------
> > > >
> > > > *From: *"Atin Mukherjee" <amukherj at redhat.com>
> > > > *To: *"Krutika Dhananjay" <kdhananj at redhat.com>, "Gluster Devel"
> > > > <gluster-devel at gluster.org>
> > > > *Cc: *"Gaurav Garg" <ggarg at redhat.com>, "Aravinda"
> > > > <avishwan at redhat.com>, "Kotresh Hiremath Ravishankar"
> > > > <khiremat at redhat.com>
> > > > *Sent: *Tuesday, September 22, 2015 8:39:56 PM
> > > > *Subject: *Re: Spurious failures
> > > >
> > > > Krutika,
> > > >
> > > > ./tests/bugs/glusterd/bug-1238706-daemons-stop-on-peer-cleanup.t is
> > > > already a part of bad_tests () in both mainline and 3.7. Could you
> > > > provide me the link where this test has failed explicitly and that has
> > > > caused the regression to fail?
> > > >
> > > > ~Atin
> > > >
> > > >
> > > > On 09/22/2015 07:27 PM, Krutika Dhananjay wrote:
> > > > > Hi,
> > > > >
> > > > > The following tests seem to be failing consistently on the build
> > > > > machines in Linux:
> > > > >
> > > > > ./tests/bugs/glusterd/bug-1238706-daemons-stop-on-peer-cleanup.t ..
> > > > >
> > > > > ./tests/geo-rep/georep-basic-dr-rsync.t ..
> > > > >
> > > > > ./tests/geo-rep/georep-basic-dr-tarssh.t ..
> > > > >
> > > > > I have added these tests into the tracker etherpad.
> > > > >
> > > > > Meanwhile could someone from geo-rep and glusterd team take a look or
> > > > > perhaps move them to bad tests list?
> > > > >
> > > > >
> > > > > Here is one place where the three tests failed:
> > > > >
> > > > https://build.gluster.org/job/rackspace-regression-2GB-triggered/14421/consoleFull
> > > > >
> > > > > -Krutika
> > > > >
> > > >
> > > >
> > 
>