| 2016-04-24 17:29:25 |
Curtis Hovey |
description |
This was observed in bootsstrapping 1.21.3-precise-amd64 but may also affect more recent jujus
http://data.vapour.ws/juju-ci/products/version-2458/aws-upgrade-precise-amd64/build-2491/consoleText
Partial log:
125cca7406a4edc1345d5ef7562514adfc097b34bb903a4e6f258369d90a342f /var/lib/juju/tools/1.21.3-precise-amd64/tools.tar.gz
2015-03-18 04:40:24 INFO juju.cmd supercommand.go:37 running jujud [1.21.3-precise-amd64 gc]
2015-03-18 04:40:24 DEBUG juju.agent agent.go:400 read agent config, format "1.18"
2015-03-18 04:40:24 INFO juju.network network.go:110 setting prefer-ipv6 to false
2015-03-18 04:40:24 INFO juju.provider.ec2 ec2.go:211 opening environment "aws-upgrade-precise-amd64"
2015-03-18 04:40:26 INFO juju.agent identity.go:20 writing system identity file
2015-03-18 04:40:26 DEBUG juju.cmd.jujud bootstrap.go:279 starting mongo
2015-03-18 04:40:26 DEBUG juju.cmd.jujud bootstrap.go:304 calling ensureMongoServer
2015-03-18 04:40:26 INFO juju.mongo mongo.go:212 Ensuring mongo server is running; data directory /var/lib/juju; port 37017
2015-03-18 04:40:26 INFO juju.mongo mongo.go:376 installing mongodb-server
2015-03-18 04:40:26 INFO juju.utils.apt apt.go:143 Running: [apt-get --option=Dpkg::Options::=--force-confold --option=Dpkg::options::=--force-unsafe-io --assume-yes --quiet install --target-release precise-updates/cloud-tools mongodb-server]
2015-03-18 04:40:45 DEBUG juju.mongo mongo.go:315 using mongod: /usr/bin/mongod --version: "db version v2.4.9\nWed Mar 18 04:40:45.072 git version: nogitversion\n"
2015-03-18 04:40:45 DEBUG juju.worker.peergrouper initiate.go:41 Initiating mongo replicaset; dialInfo &mgo.DialInfo{Addrs:[]string{"127.0.0.1:37017"}, Direct:false, Timeout:300000000000, FailFast:false, Database:"", Source:"", Service:"", Mechanism:"", Username:"", Password:"", PoolLimit:0, DialServer:(func(*mgo.ServerAddr) (net.Conn, error))(nil), Dial:(func(net.Addr) (net.Conn, error))(0x625260)}; memberHostport "172.31.4.8:37017"; user ""; password ""
2015-03-18 04:40:45 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:45 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:46 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:46 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:47 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:47 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:48 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:48 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:49 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:41:04 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:41:04 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:04 INFO juju.replicaset replicaset.go:67 Initiating replicaset with config replicaset.Config{Name:"juju", Version:1, Members:[]replicaset.Member{replicaset.Member{Id:1, Address:"172.31.4.8:37017", Arbiter:(*bool)(nil), BuildIndexes:(*bool)(nil), Hidden:(*bool)(nil), Priority:(*float64)(nil), Tags:map[string]string{"juju-machine-id":"0"}, SlaveDelay:(*time.Duration)(nil), Votes:(*int)(nil)}}}
2015-03-18 04:41:09 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:10 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:10 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:11 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:11 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:12 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:12 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:13 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:13 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:14 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:14 INFO juju.worker.peergrouper initiate.go:63 replica set initiated
2015-03-18 04:41:14 INFO juju.worker.peergrouper initiate.go:71 finished MaybeInitiateMongoServer
2015-03-18 04:41:14 INFO juju.cmd.jujud bootstrap.go:174 started mongo
2015-03-18 04:41:14 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:19 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:34 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:39 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:40 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:45 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:50 ERROR juju.cmd supercommand.go:323 failed to initialize mongo admin user: cannot set admin password: Closed explicitly
2015-03-18 04:41:50 ERROR juju.cmd supercommand.go:323 failed to bootstrap environment: subprocess encountered error code 1
Traceback (most recent call last):
File "/mnt/jenkinshome/juju-ci-tools/deploy_job.py", line 4, in <module>
deploy_job()
File "/mnt/jenkinshome/juju-ci-tools/deploy_stack.py", line 415, in deploy_job
args.agent_url)
File "/mnt/jenkinshome/juju-ci-tools/deploy_stack.py", line 477, in _deploy_job
bootstrap_from_env(juju_home, client)
File "/mnt/jenkinshome/juju-ci-tools/jujupy.py", line 478, in bootstrap_from_env
client.bootstrap()
File "/mnt/jenkinshome/juju-ci-tools/jujupy.py", line 211, in bootstrap
juju_home=juju_home)
File "/mnt/jenkinshome/juju-ci-tools/jujupy.py", line 290, in juju
return subprocess.check_call(args, env=env)
File "/usr/lib/python2.7/subprocess.py", line 511, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '('juju', '--show-log', 'bootstrap', '-e', 'aws-upgrade-precise-amd64', '--constraints', 'mem=2G')' returned non-zero exit status 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Description set: gitbranch:1.23:github.com/juju/juju b79fded
[BFA] Scanning build for known causes...
[BFA] Done. 0s
Finished: FAILURE |
This was observed in bootsstrapping 1.21.3-precise-amd64 but may also affect more recent jujus
http://reports.vapour.ws/releases/issue/55bac3a1749a5610506e02a4
Partial log:
125cca7406a4edc1345d5ef7562514adfc097b34bb903a4e6f258369d90a342f /var/lib/juju/tools/1.21.3-precise-amd64/tools.tar.gz
2015-03-18 04:40:24 INFO juju.cmd supercommand.go:37 running jujud [1.21.3-precise-amd64 gc]
2015-03-18 04:40:24 DEBUG juju.agent agent.go:400 read agent config, format "1.18"
2015-03-18 04:40:24 INFO juju.network network.go:110 setting prefer-ipv6 to false
2015-03-18 04:40:24 INFO juju.provider.ec2 ec2.go:211 opening environment "aws-upgrade-precise-amd64"
2015-03-18 04:40:26 INFO juju.agent identity.go:20 writing system identity file
2015-03-18 04:40:26 DEBUG juju.cmd.jujud bootstrap.go:279 starting mongo
2015-03-18 04:40:26 DEBUG juju.cmd.jujud bootstrap.go:304 calling ensureMongoServer
2015-03-18 04:40:26 INFO juju.mongo mongo.go:212 Ensuring mongo server is running; data directory /var/lib/juju; port 37017
2015-03-18 04:40:26 INFO juju.mongo mongo.go:376 installing mongodb-server
2015-03-18 04:40:26 INFO juju.utils.apt apt.go:143 Running: [apt-get --option=Dpkg::Options::=--force-confold --option=Dpkg::options::=--force-unsafe-io --assume-yes --quiet install --target-release precise-updates/cloud-tools mongodb-server]
2015-03-18 04:40:45 DEBUG juju.mongo mongo.go:315 using mongod: /usr/bin/mongod --version: "db version v2.4.9\nWed Mar 18 04:40:45.072 git version: nogitversion\n"
2015-03-18 04:40:45 DEBUG juju.worker.peergrouper initiate.go:41 Initiating mongo replicaset; dialInfo &mgo.DialInfo{Addrs:[]string{"127.0.0.1:37017"}, Direct:false, Timeout:300000000000, FailFast:false, Database:"", Source:"", Service:"", Mechanism:"", Username:"", Password:"", PoolLimit:0, DialServer:(func(*mgo.ServerAddr) (net.Conn, error))(nil), Dial:(func(net.Addr) (net.Conn, error))(0x625260)}; memberHostport "172.31.4.8:37017"; user ""; password ""
2015-03-18 04:40:45 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:45 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:46 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:46 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:47 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:47 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:48 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:48 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:40:49 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:41:04 DEBUG juju.mongo open.go:117 connection failed, will retry: dial tcp 127.0.0.1:37017: connection refused
2015-03-18 04:41:04 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:04 INFO juju.replicaset replicaset.go:67 Initiating replicaset with config replicaset.Config{Name:"juju", Version:1, Members:[]replicaset.Member{replicaset.Member{Id:1, Address:"172.31.4.8:37017", Arbiter:(*bool)(nil), BuildIndexes:(*bool)(nil), Hidden:(*bool)(nil), Priority:(*float64)(nil), Tags:map[string]string{"juju-machine-id":"0"}, SlaveDelay:(*time.Duration)(nil), Votes:(*int)(nil)}}}
2015-03-18 04:41:09 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:10 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:10 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:11 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:11 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:12 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:12 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:13 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:13 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:14 WARNING juju.replicaset replicaset.go:87 Initiate: fetching replication status failed: cannot get replica set status: Received replSetInitiate - should come online shortly.
2015-03-18 04:41:14 INFO juju.worker.peergrouper initiate.go:63 replica set initiated
2015-03-18 04:41:14 INFO juju.worker.peergrouper initiate.go:71 finished MaybeInitiateMongoServer
2015-03-18 04:41:14 INFO juju.cmd.jujud bootstrap.go:174 started mongo
2015-03-18 04:41:14 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:19 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:34 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:39 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:40 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:45 INFO juju.mongo open.go:125 dialled mongo successfully on address "127.0.0.1:37017"
2015-03-18 04:41:50 ERROR juju.cmd supercommand.go:323 failed to initialize mongo admin user: cannot set admin password: Closed explicitly
2015-03-18 04:41:50 ERROR juju.cmd supercommand.go:323 failed to bootstrap environment: subprocess encountered error code 1
Traceback (most recent call last):
File "/mnt/jenkinshome/juju-ci-tools/deploy_job.py", line 4, in <module>
deploy_job()
File "/mnt/jenkinshome/juju-ci-tools/deploy_stack.py", line 415, in deploy_job
args.agent_url)
File "/mnt/jenkinshome/juju-ci-tools/deploy_stack.py", line 477, in _deploy_job
bootstrap_from_env(juju_home, client)
File "/mnt/jenkinshome/juju-ci-tools/jujupy.py", line 478, in bootstrap_from_env
client.bootstrap()
File "/mnt/jenkinshome/juju-ci-tools/jujupy.py", line 211, in bootstrap
juju_home=juju_home)
File "/mnt/jenkinshome/juju-ci-tools/jujupy.py", line 290, in juju
return subprocess.check_call(args, env=env)
File "/usr/lib/python2.7/subprocess.py", line 511, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '('juju', '--show-log', 'bootstrap', '-e', 'aws-upgrade-precise-amd64', '--constraints', 'mem=2G')' returned non-zero exit status 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Description set: gitbranch:1.23:github.com/juju/juju b79fded
[BFA] Scanning build for known causes...
[BFA] Done. 0s
Finished: FAILURE |
|
