[Gluster-devel] Running Vagrant tests on the CentOS CI (WAS: Re: 3.7.9 update)

[Niels de Vos]

On Wed, Mar 16, 2016 at 12:48:06AM +0530, M S Vishwanath Bhat wrote:
> On 15 March 2016 at 20:34, Niels de Vos <ndevos at redhat.com> wrote:
> 
> > On Tue, Mar 15, 2016 at 09:04:48AM -0400, Jeff Darcy wrote:
> > > > Yes, Right now we get the machine from duffy instantly. If it is not
> > instant,
> > > > it means no machines are in ready state and we will have to wait few
> > more
> > > > minutes (~5 minutes) to get them.
> > >
> > > If machines are available to be allocated instantly, does that mean
> > they're
> > > being re-used across allocations?  Or are there just so many extra
> > machines
> > > in the pool that there's time to re-provision in the background before
> > they
> > > get re-used again?
> >
> > Yes, indeed. Once a test has been run and the machine is released back
> > to Duffy, it will get cleanly installed. Last time the CentOS team
> > explained about their community CI, they had ~250 physical machines for
> > testing available. Details are in their wiki:
> >   https://wiki.centos.org/QaWiki/PubHardware
> >
> > > > But I think vagrant is very useful anywhere else (in non CentOS CI
> > infra).
> > > > But I wasn't sure *in* CentOS CI, since the machines required for
> > distaf are
> > > > available via duffy. So I wasn't sure where vagrant would fit in.
> > > >
> > > > But if the plan is to run the existing regression tests by spawning vms
> > > > inside the machines provided by duffy, then I think it can be done.
> > Although
> > > > someone will have to try that out see if it provides any advantage.
> > >
> > > I think the advantages would be two-fold.
> > >
> > > (a) The environment within a vagrant box is one we can control more than
> > > might be possible within duffy.
> > >
> > > (b) It's an environment that we can replicate with certainty in other
> > > host environments where duffy doesn't exist.
> >
> > (c) it would be possible to run tests on non-CentOS distributions
> >
> > We can place the Vagrant box files/images/whatever on
> > artifacts.ci.centos.org so that all systems in the CI have local access
> > to them. Let me know if you want me to get that done and someone else
> > can then configure a Jenkins job to run tests in Vagrant. It'll
> > basically need scripts like these:
> >
> > https://github.com/gluster/glusterfs-patch-acceptance-tests/tree/master/centos-ci/libgfapi-python
> 
> 
> So these vagrant images have to be run on the machines provisioned by
> duffy. Depending on the configuration of that machines we can have more
> than one vagrant image running there. Perhaps that will solve our problem
> of not having an extra disk for testing. But I still think it would be an
> overkill to run them inside the duffy machines.
> 
> But in any case, distaf tests *can* run inside vagrant images, as long as
> they have sshd running and can be connected with an IP address. So we can
> actually try to it out.

I think we should get it running in the CentOS CI, even if it is only to
verify that the Vagrant configuration works. We probably do not want to
break it and have developers trying to figure out why is doesn't work.

I hope/expect Raghavendra Talur to mostly guide this effort. Once the
basics are setup, it would be much easier to extend the tests and
eventually run distaf in Vagrant too.

Niels
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: not available
URL: <http://www.gluster.org/pipermail/gluster-devel/attachments/20160316/df0d1305/attachment.sig>