openvswitch_db container loops in restart

Bug #1623132 reported by prameswar
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla
Invalid
Low
Unassigned

Bug Description

openvswitch_db container restarting continuously that fail to kolla-ansible deploy

TASK [neutron : Starting openvswitch-db container] *****************************
changed: [localhost]

TASK [neutron : Waiting the openvswitch_db service to be ready] ****************
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (29 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (28 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (27 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (26 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (25 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (24 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (23 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (22 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (21 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (20 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (19 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (18 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (17 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (16 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (15 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (14 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (13 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (12 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (11 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (10 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (9 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (8 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (7 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (6 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (5 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (4 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (3 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (2 retries left).
FAILED - RETRYING: TASK: neutron : Waiting the openvswitch_db service to be ready (1 retries left).
fatal: [localhost]: FAILED! => {"attempts": 30, "changed": false, "cmd": ["docker", "exec", "openvswitch_db", "ovs-vsctl", "--no-wait", "show"], "delta": "0:00:00.009785", "end": "2016-09-13 16:50:48.505815", "failed": true, "rc": 1, "start": "2016-09-13 16:50:48.496030", "stderr": "Error response from daemon: Container 689eb126b914df3b0a04281da6a08d1fc2ec7bc73a2247554473c4586701444d is restarting, wait until the container is running", "stdout": "", "stdout_lines": [], "warnings": []}
 to retry, use: --limit @/home/vagrant/kolla/ansible/site.retry

PLAY RECAP *********************************************************************
localhost : ok=175 changed=3 unreachable=0 failed=1

Command failed ansible-playbook -i ../ansible/inventory/all-in-one -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla -e action=deploy /home/vagrant/kolla/ansible/site.yml

See here:
 sudo docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
689eb126b914 kolla/ubuntu-binary-openvswitch-db-server:2.0.2 "kolla_start" 19 minutes ago Restarting (127) 5 minutes ago openvswitch_db

Revision history for this message
prameswar (prameswar) wrote :

Logs

sudo docker logs --tail 50 --follow --timestamps openvswitch_db

2016-09-14T12:40:53.844997340Z /usr/local/bin/kolla_start: line 24: exec: start-ovsdb-server: not found
2016-09-14T12:40:54.298345029Z INFO:__main__:Kolla config strategy set to: COPY_ALWAYS
2016-09-14T12:40:54.298459449Z INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json
2016-09-14T12:40:54.298618327Z INFO:__main__:Validating config file
2016-09-14T12:40:54.298695171Z INFO:__main__:Copying service configuration files
2016-09-14T12:40:54.298758297Z INFO:__main__:Writing out command to execute
2016-09-14T12:40:54.303422329Z Running command: 'start-ovsdb-server 10.0.5.200 '
2016-09-14T12:40:54.303764249Z /usr/local/bin/kolla_start: line 24: exec: start-ovsdb-server: not found
2016-09-14T12:40:55.158024746Z INFO:__main__:Kolla config strategy set to: COPY_ALWAYS
2016-09-14T12:40:55.158136143Z INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json

Changed in kolla:
milestone: none → newton-rc2
status: New → Triaged
Revision history for this message
Steven Dake (sdake) wrote :

I believe you need to rebuild your containers. ovs was recently changed, and I suspect you are using master ansible playbooks with 2.0.2 images. Please reference our documentation as it has recently changed to help explain the workflows for stable vs master work.

http://docs.openstack.org/developer/kolla

Changed in kolla:
status: Triaged → Incomplete
importance: Undecided → Critical
Revision history for this message
zhubingbing (zhubingbing) wrote :

i agree sdake, you can rebuild image in mastar branch.

Revision history for this message
Hui Kang (huikang27) wrote :

Is this bug still valid?

Changed in kolla:
importance: Critical → Low
shake.chen (shake-chen)
Changed in kolla:
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.