failed to Bootstraping the mongodb replication set

Bug #1684504 reported by MarginHu
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla
Invalid
Undecided
Unassigned

Bug Description

Hi Guys:
I met the following error when deploy after destroy previous deployment with no clean image.

TASK [mongodb : include] *******************************************************
included: /opt/kolla-openstack/kolla-ansible/ansible/roles/mongodb/tasks/bootstrap.yml for kode0, kode1, kode2

TASK [mongodb : Starting mongodb bootstrap container] **************************
changed: [kode1]
changed: [kode0]
changed: [kode2]

TASK [mongodb : include] *******************************************************
included: /opt/kolla-openstack/kolla-ansible/ansible/roles/mongodb/tasks/start.yml for kode0, kode1, kode2

TASK [mongodb : Starting mongodb container] ************************************
changed: [kode1]
changed: [kode2]
changed: [kode0]

TASK [mongodb : Waiting for the mongodb startup] *******************************
ok: [kode0]
ok: [kode1]
ok: [kode2]

TASK [mongodb : Checking current replication status] ***************************
ok: [kode0 -> kode0]

TASK [mongodb : include] *******************************************************
included: /opt/kolla-openstack/kolla-ansible/ansible/roles/mongodb/tasks/bootstrap_cluster.yml for kode0, kode1, kode2

TASK [mongodb : Copying the mongodb replication set bootstrap script] **********
changed: [kode0 -> localhost]

TASK [mongodb : Bootstraping the mongodb replication set] **********************
fatal: [kode0 -> kode0]: FAILED! => {"changed": true, "cmd": ["docker", "exec", "-t", "mongodb", "mongo", "192.168.102.20", "--quiet", "--eval", "printjson(rs.initiate(\n {\n \"_id\" : \"rs0\",\n \"version\" : 1,\n \"members\" : [\n {\n \"_id\" : 1,\n \"host\" : \"192.168.102.20:27017\"\n }, {\n \"_id\" : 2,\n \"host\" : \"192.168.102.21:27017\"\n }, {\n \"_id\" : 3,\n \"host\" : \"192.168.102.22:27017\"\n } ]\n }\n))"], "delta": "0:00:00.163219", "end": "2017-04-20 16:01:00.166277", "failed": true, "failed_when_result": true, "rc": 0, "start": "2017-04-20 16:01:00.003058", "stderr": "", "stdout": "{\r\n\t\"info\" : \"try querying local.system.replset to see current configuration\",\r\n\t\"ok\" : 0,\r\n\t\"errmsg\" : \"already initialized\"\r\n}", "stdout_lines": ["{", "\t\"info\" : \"try querying local.system.replset to see current configuration\",", "\t\"ok\" : 0,", "\t\"errmsg\" : \"already initialized\"", "}"], "warnings": []}

NO MORE HOSTS LEFT *************************************************************
        to retry, use: --limit @/opt/kolla-openstack/kolla-ansible/ansible/site.retry

PLAY RECAP *********************************************************************
kode0 : ok=181 changed=103 unreachable=0 failed=1
kode1 : ok=201 changed=118 unreachable=0 failed=0
kode2 : ok=154 changed=83 unreachable=0 failed=0
kode3 : ok=66 changed=44 unreachable=0 failed=0
kode4 : ok=85 changed=56 unreachable=0 failed=0
kode5 : ok=57 changed=35 unreachable=0 failed=0

Revision history for this message
MarginHu (margin2017) wrote :

my destroy operation is as following:

[root@kola bgi]# ./07-destroy.sh
Destroy Kolla containers, volumes and host configuration : ansible-playbook -i /etc/kolla/ansible/inventory/openstack -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla /opt/kolla-openstack/kolla-ansible/ansible/destroy.yml

PLAY [Apply role destroy] ******************************************************

TASK [setup] *******************************************************************
ok: [kode0]
ok: [kode4]
ok: [kode5]
ok: [kode3]
ok: [kode2]
ok: [kode1]

TASK [destroy : Creating /kolla-cleanup/tools directory on node] ***************
ok: [kode4]
ok: [kode1]
ok: [kode0]
ok: [kode5]
ok: [kode3]
ok: [kode2]

TASK [destroy : Copying validate-docker-execute.sh file] ***********************
ok: [kode2]
ok: [kode0]
ok: [kode1]
ok: [kode4]
ok: [kode5]
ok: [kode3]

TASK [destroy : Copying cleanup-containers file] *******************************
ok: [kode1]
ok: [kode2]
ok: [kode4]
ok: [kode0]
ok: [kode5]
ok: [kode3]

TASK [destroy : Copying cleanup-host file] *************************************
ok: [kode2]
ok: [kode1]
ok: [kode4]
ok: [kode5]
ok: [kode0]
ok: [kode3]

TASK [destroy : Copying cleanup-images file] ***********************************
skipping: [kode1]
skipping: [kode0]
skipping: [kode2]
skipping: [kode4]
skipping: [kode5]
skipping: [kode3]

TASK [destroy : Destroying all Kolla containers and volumes] *******************
changed: [kode5]
changed: [kode3]
changed: [kode4]
changed: [kode2]
changed: [kode0]
changed: [kode1]

TASK [destroy : Removing Kolla images] *****************************************
skipping: [kode0]
skipping: [kode1]
skipping: [kode2]
skipping: [kode4]
skipping: [kode5]
skipping: [kode3]

TASK [destroy : Destroying Kolla host configuration] ***************************
changed: [kode0]
changed: [kode1]
changed: [kode2]
changed: [kode5]
changed: [kode4]
changed: [kode3]

TASK [destroy : Destroying kolla-cleanup folder] *******************************
changed: [kode2]
changed: [kode0]
changed: [kode4]
changed: [kode1]
changed: [kode5]
changed: [kode3]

PLAY RECAP *********************************************************************
kode0 : ok=8 changed=3 unreachable=0 failed=0
kode1 : ok=8 changed=3 unreachable=0 failed=0
kode2 : ok=8 changed=3 unreachable=0 failed=0
kode3 : ok=8 changed=3 unreachable=0 failed=0
kode4 : ok=8 changed=3 unreachable=0 failed=0
kode5 : ok=8 changed=3 unreachable=0 failed=0

Revision history for this message
MarginHu (margin2017) wrote :

before the comment #1 , I do a failure destroy. I don't know whether it is a clue.

[root@kola bgi]# ./07-destroy.sh
Destroy Kolla containers, volumes and host configuration : ansible-playbook -i /etc/kolla/ansible/inventory/openstack -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla /opt/kolla-openstack/kolla-ansible/ansible/destroy.yml

PLAY [Apply role destroy] ******************************************************

TASK [setup] *******************************************************************
ok: [kode0]
ok: [kode2]
ok: [kode5]
ok: [kode3]
ok: [kode4]
ok: [kode1]

TASK [destroy : Creating /kolla-cleanup/tools directory on node] ***************
changed: [kode1]
changed: [kode4]
changed: [kode5]
changed: [kode2]
changed: [kode0]
changed: [kode3]

TASK [destroy : Copying validate-docker-execute.sh file] ***********************
changed: [kode2]
changed: [kode4]
changed: [kode1]
changed: [kode5]
changed: [kode0]
changed: [kode3]

TASK [destroy : Copying cleanup-containers file] *******************************
changed: [kode0]
changed: [kode1]
changed: [kode2]
changed: [kode4]
changed: [kode5]
changed: [kode3]

TASK [destroy : Copying cleanup-host file] *************************************
changed: [kode4]
changed: [kode2]
changed: [kode0]
changed: [kode1]
changed: [kode5]
changed: [kode3]

TASK [destroy : Copying cleanup-images file] ***********************************
skipping: [kode5]
skipping: [kode1]
skipping: [kode2]
skipping: [kode0]
skipping: [kode4]
skipping: [kode3]

TASK [destroy : Destroying all Kolla containers and volumes] *******************
fatal: [kode5]: FAILED! => {"changed": true, "cmd": ["/tmp/kolla-cleanup/tools/cleanup-containers"], "delta": "0:00:00.092449", "end": "2017-04-20 15:15:10.068378", "failed": true, "rc": 1, "start": "2017-04-20 15:15:09.975929", "stderr": "", "stdout": "Some qemu processes were detected.\nDocker will not be able to stop the nova_libvirt container with those running.\nPlease clean them up before rerunning this script.", "stdout_lines": ["Some qemu processes were detected.", "Docker will not be able to stop the nova_libvirt container with those running.", "Please clean them up before rerunning this script."], "warnings": []}
changed: [kode3]

^CProcess WorkerProcess-40:
Traceback (most recent call last):
  File "/usr/lib64/python2.7/multiprocessing/process.py", line 258, in _bootstrap
Process WorkerProcess-37:
Traceback (most recent call last):
  File "/usr/lib64/python2.7/multiprocessing/process.py", line 258, in _bootstrap
Process WorkerProcess-38:
 [ERROR]: User interrupted execution

Command failed ansible-playbook -i /etc/kolla/ansible/inventory/openstack -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla /opt/kolla-openstack/kolla-ansible/ansible/destroy.yml

Revision history for this message
MarginHu (margin2017) wrote :

Just now , I rerun the "deploy" command and find this time the deployment is successful.

Changed in kolla:
status: New → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.