break at ansible task - Running Keystone bootstrap container

[Jack]

Run aio deploy with kolla, break at keystone tasks as below:

==================================================

TASK [keystone : Check if Keystone Domain specific settings enabled] ***********
ok: [localhost -> localhost]

TASK [keystone : Ensuring config directories exist] ****************************
changed: [localhost] => (item=keystone)
changed: [localhost] => (item=keystone-fernet)
changed: [localhost] => (item=keystone-ssh)

TASK [keystone : Creating Keystone Domain directory] ***************************
skipping: [localhost] => (item=keystone)

TASK [keystone : Copying over config.json files for services] ******************
changed: [localhost] => (item=keystone)
changed: [localhost] => (item=keystone-fernet)
changed: [localhost] => (item=keystone-ssh)

TASK [keystone : Copying over keystone.conf] ***********************************
changed: [localhost] => (item=keystone)
changed: [localhost] => (item=keystone-fernet)
changed: [localhost] => (item=keystone-ssh)

TASK [keystone : Copying Keystone Domain specific settings] ********************

TASK [keystone : Copying over existing policy.json] ****************************
skipping: [localhost]

TASK [keystone : Copying over wsgi-keystone.conf] ******************************
changed: [localhost] => (item=/home/ubuntu/kolla/ansible/roles/keystone/templates/wsgi-keystone.conf.j2)

TASK [keystone : Generate the required cron jobs for the node] *****************
skipping: [localhost]

TASK [keystone : Save the returned from cron jobs for building the crontab] ****
skipping: [localhost]

TASK [keystone : Copying files for keystone-fernet] ****************************
skipping: [localhost] => (item={u'dest': u'crontab', u'src': u'crontab.j2'})
skipping: [localhost] => (item={u'dest': u'fernet-rotate.sh', u'src': u'fernet-rotate.sh.j2'})
skipping: [localhost] => (item={u'dest': u'fernet-node-sync.sh', u'src': u'fernet-node-sync.sh.j2'})

TASK [keystone : Copying files for keystone-ssh] *******************************
skipping: [localhost] => (item={u'dest': u'sshd_config', u'src': u'sshd_config.j2'})
skipping: [localhost] => (item={u'dest': u'id_rsa', u'src': u'id_rsa'})
skipping: [localhost] => (item={u'dest': u'id_rsa.pub', u'src': u'id_rsa.pub'})
skipping: [localhost] => (item={u'dest': u'ssh_config', u'src': u'ssh_config.j2'})

TASK [keystone : include] ******************************************************
included: /home/ubuntu/kolla/ansible/roles/keystone/tasks/bootstrap.yml for localhost

TASK [keystone : Creating Keystone database] ***********************************
changed: [localhost -> localhost]

TASK [keystone : Reading json from variable] ***********************************
ok: [localhost]

TASK [keystone : Creating Keystone database user and setting permissions] ******
changed: [localhost -> localhost]

TASK [keystone : include] ******************************************************
included: /home/ubuntu/kolla/ansible/roles/keystone/tasks/bootstrap_service.yml for localhost

TASK [keystone : Running Keystone bootstrap container] *************************
fatal: [localhost -> localhost]: FAILED! => {"changed": true, "failed": true, "msg": "Container exited with non-zero return code"}

PLAY RECAP *********************************************************************
localhost : ok=99 changed=16 unreachable=0 failed=1

Command failed ansible-playbook -i ansible/inventory/all-in-one -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla -e action=deploy ansible/site.yml

[Jack (rock-2016)]

And looks like keystone database is created, and the keystone container exits with some information as below:

mysql> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| keystone |
| mysql |
| performance_schema |
| test |
+--------------------+
5 rows in set (0.01 sec)

mysql> exit
Bye
ubuntu@ubuntu16-k:~/kolla$ docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
6a7287f1b90c kolla/centos-binary-rabbitmq:2.0.2 "kolla_start" 4 minutes ago Up 4 minutes rabbitmq
ecfe7417c7b0 kolla/centos-binary-mariadb:2.0.2 "kolla_start" About an hour ago Up About an hour mariadb
d7cd38591585 kolla/centos-binary-memcached:2.0.2 "kolla_start" 22 hours ago Up About an hour memcached
f827a1ba50c1 kolla/centos-binary-keepalived:2.0.2 "kolla_start" 22 hours ago Up About an hour keepalived
11a97e5c3dda kolla/centos-binary-haproxy:2.0.2 "kolla_start" 22 hours ago Up About an hour haproxy
670581f83413 kolla/centos-binary-cron:2.0.2 "kolla_start" 22 hours ago Up About an hour cron
918a72b61911 kolla/centos-binary-kolla-toolbox:2.0.2 "kolla_start" 22 hours ago Up About an hour kolla_toolbox
8fc826d6977f kolla/centos-binary-heka:2.0.2 "kolla_start" 22 hours ago Up About an hour heka
ubuntu@ubuntu16-k:~/kolla$ docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
52b86edfed46 kolla/centos-binary-keystone:2.0.2 "kolla_start" 4 minutes ago Exited (1) 4 minutes ago bootstrap_keystone
6a7287f1b90c kolla/centos-binary-rabbitmq:2.0.2 "kolla_start" 4 minutes ago Up 4 minutes rabbitmq
ecfe7417c7b0 kolla/centos-binary-mariadb:2.0.2 "kolla_start" About an hour ago Up About an hour mariadb
d7cd38591585 kolla/centos-binary-memcached:2.0.2 "kolla_start" 22 hours ago Up About an hour memcached
f827a1ba50c1 kolla/centos-binary-keepalived:2.0.2 "kolla_start" 22 hours ago Up About an hour keepalived
11a97e5c3dda kolla/centos-binary-haproxy:2.0.2 "kolla_start" 22 hours ago Up About an hour haproxy
670581f83413 kolla/centos-binary-cron:2.0.2 "kolla_start" 22 hours ago Up About an hour cron
918a72b61911 kolla/centos-binary-kolla-toolbox:2.0.2 "kolla_start" 22 hours ago Up About an hour...

[Paul Bourke (pauldbourke)]

Please post the output of 'docker logs bootstrap_keystone' and /var/lib/docker/volumes/kolla_logs/_data/keystone/* on the target node

[Launchpad Janitor (janitor)]

[Expired for kolla because there has been no activity for 60 days.]