Tests give a false negative

[José Antonio Rey]

When I run the tests on GCE, juju version 1.25, it fails. The tests go into a loop, where bundletester bootstraps, and the tests try to bootstrap again but cannot because it's already bootstrapped.

[Louis Bouchard (louis)]

Hello,

I am a bit puzzled by this bug. I have seen the same behavior on Openstack as well, but it is not systematic.

There is nothing in the amulet test that would lead to that. It is similar code as the one in the LAMP charm tests that I used as an example :

http://bazaar.launchpad.net/~charmers/charms/precise/lamp/trunk/view/head:/tests/10-deploy-test.py

I am testing with juju 1.24 though.

Any thought ?

...Louis

[Louis Bouchard (louis)]

For the record, here is an example of ONE test being run twice even if the $ make test was only issued once :

ubuntu@louis-bouchard-bastion:~/charms/trusty/crashdump$ make test
juju-test INFO : Starting test run on louis-bouchard using Juju 1.24.0
juju-test DEBUG : Loading configuration options from testplan YAML
juju-test DEBUG : Creating a new Conductor
juju-test.conductor DEBUG : Starting a bootstrap for louis-bouchard, kill after 300
juju-test.conductor DEBUG : Running the following: juju bootstrap -e louis-bouchard
Bootstrapping environment "louis-bouchard"
Starting new instance for initial state server
Launching instance
 - 092ec756-e02b-4999-a3aa-39e139824d4d
Installing Juju agent on bootstrap instance
Waiting for address
Attempting to connect to 10.5.0.122:22
Warning: Permanently added '10.5.0.122' (ECDSA) to the list of known hosts.
Logging to /var/log/cloud-init-output.log on remote host
Running apt-get update
Running apt-get upgrade
Installing package: curl
Installing package: cpu-checker
Installing package: bridge-utils
Installing package: rsyslog-gnutls
Installing package: cloud-utils
Installing package: cloud-image-utils
Installing package: tmux
Fetching tools: curl -sSfw 'tools from %{url_effective} downloaded: HTTP %{http_code}; time %{time_total}s; size %{
size_download} bytes; speed %{speed_download} bytes/s ' --retry 10 -o $bin/tools.tar.gz <[https://streams.canonical
.com/juju/tools/releases/juju-1.24.0-trusty-amd64.tgz]>
Bootstrapping Juju machine agent
Starting Juju machine agent (jujud-machine-0)
Bootstrap agent installed
Waiting for API to become available [82/664]
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Waiting for API to become available
Bootstrap complete
juju-test.conductor DEBUG : Waiting for bootstrap
juju-test.conductor DEBUG : Still not bootstrapped
juju-test.conductor DEBUG : Running the following: juju status -e louis-bouchard
juju-test.conductor DEBUG : State for 1.24.0: started
juju-test.conductor.00-setup DEBUG : Running 00-setup (tests/00-setup)
+ dpkg -s amulet
+ '[' 0 -ne 0 ']'
juju-test.conductor.00-setup DEBUG : Package: amulet
Status: install ok installed
Priority: optional
Section: python
Installed-Size: 26
Maintainer: Ubuntu Developers <email address hidden>
Architecture: all
Version: 1.10.1-0ubuntu1~ubuntu14.04.1~ppa1
Depends: python3-amulet (>= 1.10.0), python-amulet (>= 1.10.0)
Description: Testing harness for Juju Charms
Original-Maintaine...