Openstack Kilo Nova-Docker:Container will be hung in "powering-on" state.

Bug #1499383 reported by Xiao Li Xu
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
nova-docker
New
Undecided
Unassigned

Bug Description

Bug description:
  [Summary]
  When nova-compute service on compute node is down, issuing "nova start xxx" to start SHUTOFF container, container will be hung in "powering-on" state, even the nova-compute service has been started on compute node.
# Expected behavior:
Cmd "Nova start xx" of start container should not be issued and prompt an error notice to inform that compute node nova-compute service is down;
or
The state of container should be changed to ACTIVE from powering-on after compute node's nova-compute service up.

  [Topo]
  Unbuntu Kilo 14.04 OS , Kilo docker setup , 1 controller ,2 network node,6 computenode

  [Reproduceable or not]
  Can be reproduced,

  [Recreate Steps]
# Steps:
1, Build up a openstack & docker setup based on Ubuntu 14.04 trusty;
2, 1 controller, 2 network node and 7 computer node ;
3, Launch docker containers;

root@quasarucn3:~# nova list
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| 3f62d6c5-a3e4-420d-b6b6-9a719f60c580 | cirros31 | SHUTOFF | - | Shutdown | vmn=12.1.1.27 |
| d65433d0-001b-4e24-9553-42ec5baeb056 | cirros32 | SHUTOFF | - | Shutdown | vmn=12.1.1.28 |
| 28914c07-a0cc-40a0-b743-48136ee997e3 | cirros33 | SHUTOFF | - | Shutdown | vmn=12.1.1.29 |
| 8c1c6f0d-c385-45b3-aef5-eead0dbbd54b | cirros34 | SHUTOFF | - | Shutdown | vmn=12.1.1.30 |
| 40d40e57-7bdb-4a97-8e49-b2b6f7fbb8b5 | cirros35 | SHUTOFF | - | Shutdown | vmn=12.1.1.31 |
| 6dc4c963-124b-4264-adbc-3a32f705318f | cirros36 | SHUTOFF | - | Shutdown | vmn=12.1.1.32 |
| af4ec54b-dc90-410d-87e4-170b8a643bba | d5 | SHUTOFF | - | Shutdown | vmn=12.1.1.14 |
| ae6d1bc5-635a-453d-8cec-143a2b8240f6 | d7 | SHUTOFF | - | Shutdown | vmn=12.1.1.20 |
| 914c2f05-b56a-4689-9c1b-63f5bb36c7db | d8_sdn1 | ACTIVE | - | Running | vmn=12.1.1.22 |
| 925df284-3339-4af7-86e9-f66c41d947ce | d9_220 | ACTIVE | - | Running | vmn=12.1.1.26 |
| 518f7d49-07fb-474b-b18c-647d558562ea | d9_sdnve | ACTIVE | - | Running | vmn=12.1.1.25 |
| 90cc6a5e-e8ce-4a75-a9c5-f0393b68560d | spark_docker | ACTIVE | - | Running | vmn=12.1.1.18 |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
root@quasarucn3:~#

root@quasarucn3:~# nova show d7
+--------------------------------------+----------------------------------------------------------+
| Property | Value |
+--------------------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-SRV-ATTR:host | quasarsdn2 |
| OS-EXT-SRV-ATTR:hypervisor_hostname | quasarsdn2 |
| OS-EXT-SRV-ATTR:instance_name | instance-00000017 |
| OS-EXT-STS:power_state | 1 |
| OS-EXT-STS:task_state | - |
| OS-EXT-STS:vm_state | active |
| OS-SRV-USG:launched_at | 2015-09-19T07:03:41.000000 |
| OS-SRV-USG:terminated_at | - |
| accessIPv4 | |
| accessIPv6 | |
| config_drive | |
| created | 2015-09-19T07:03:39Z |
| flavor | m1.tiny (1) |
| hostId | 95f7fa6ddf5fcdcfc0806bb0e58ab0401a6e5c595ef42560603ebe07 |
| id | ae6d1bc5-635a-453d-8cec-143a2b8240f6 |
| image | cirros (798aa1fd-5c83-4cd9-a450-cbc307eb0e7f) |
| key_name | - |
| metadata | {} |
| name | d7 |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | ACTIVE |
| tenant_id | 066c321d33c24ea4acaf2e1a0451e85c |
| updated | 2015-09-21T06:01:09Z |
| user_id | 7c4dd09b6fe74d10b793a6172d0cce1b |
| vmn network | 12.1.1.20 |
+--------------------------------------+----------------------------------------------------------+
root@quasarucn3:~#

root@quasarucn3:~# nova service-list
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
| 1 | nova-cert | quasarucn3 | internal | enabled | up | 2015-09-21T05:56:22.000000 | - |
| 2 | nova-conductor | quasarucn3 | internal | enabled | up | 2015-09-21T05:56:23.000000 | - |
| 3 | nova-consoleauth | quasarucn3 | internal | enabled | up | 2015-09-21T05:56:23.000000 | - |
| 4 | nova-scheduler | quasarucn3 | internal | enabled | up | 2015-09-21T05:56:25.000000 | - |
| 5 | nova-compute | quasarucn1 | nova | enabled | up | 2015-09-21T05:56:24.000000 | - |
| 6 | nova-compute | quasarsdn2 | nova | enabled | down | 2015-09-21T02:36:08.000000 | - |
| 7 | nova-compute | quasarsdnve1 | nova | enabled | up | 2015-09-21T05:56:28.000000 | - |
| 8 | nova-compute | quasarsdn1 | nova | enabled | up | 2015-09-21T05:56:24.000000 | - |
| 9 | nova-compute | quasarsdnve | nova | enabled | up | 2015-09-21T05:56:26.000000 | - |
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
root@quasarucn3:~#

root@quasarucn3:~#
root@quasarucn3:~# nova start d7
Request to start server d7 has been accepted.
root@quasarucn3:~#
root@quasarucn3:~#
root@quasarucn3:~#
root@quasarucn3:~# nova list
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| 3f62d6c5-a3e4-420d-b6b6-9a719f60c580 | cirros31 | SHUTOFF | - | Shutdown | vmn=12.1.1.27 |
| d65433d0-001b-4e24-9553-42ec5baeb056 | cirros32 | SHUTOFF | - | Shutdown | vmn=12.1.1.28 |
| 28914c07-a0cc-40a0-b743-48136ee997e3 | cirros33 | SHUTOFF | - | Shutdown | vmn=12.1.1.29 |
| 8c1c6f0d-c385-45b3-aef5-eead0dbbd54b | cirros34 | SHUTOFF | - | Shutdown | vmn=12.1.1.30 |
| 40d40e57-7bdb-4a97-8e49-b2b6f7fbb8b5 | cirros35 | SHUTOFF | - | Shutdown | vmn=12.1.1.31 |
| 6dc4c963-124b-4264-adbc-3a32f705318f | cirros36 | SHUTOFF | - | Shutdown | vmn=12.1.1.32 |
| af4ec54b-dc90-410d-87e4-170b8a643bba | d5 | SHUTOFF | - | Shutdown | vmn=12.1.1.14 |
| ae6d1bc5-635a-453d-8cec-143a2b8240f6 | d7 | SHUTOFF | powering-on | Shutdown | vmn=12.1.1.20 |
| 914c2f05-b56a-4689-9c1b-63f5bb36c7db | d8_sdn1 | ACTIVE | - | Running | vmn=12.1.1.22 |
| 925df284-3339-4af7-86e9-f66c41d947ce | d9_220 | ACTIVE | - | Running | vmn=12.1.1.26 |
| 518f7d49-07fb-474b-b18c-647d558562ea | d9_sdnve | ACTIVE | - | Running | vmn=12.1.1.25 |
| 59b3512a-8f6b-443d-ae1a-ca1ff615dba4 | leo_ubuntu | ACTIVE | powering-off | Running | vmn=12.1.1.15 |
| 90cc6a5e-e8ce-4a75-a9c5-f0393b68560d | spark_docker | ACTIVE | - | Running | vmn=12.1.1.18 |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
root@quasarucn3:~#

root@quasarucn3:~# nova service-list
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
| 1 | nova-cert | quasarucn3 | internal | enabled | up | 2015-09-21T09:03:02.000000 | - |
| 2 | nova-conductor | quasarucn3 | internal | enabled | up | 2015-09-21T09:03:03.000000 | - |
| 3 | nova-consoleauth | quasarucn3 | internal | enabled | up | 2015-09-21T09:03:03.000000 | - |
| 4 | nova-scheduler | quasarucn3 | internal | enabled | up | 2015-09-21T09:03:06.000000 | - |
| 5 | nova-compute | quasarucn1 | nova | enabled | up | 2015-09-21T09:03:05.000000 | - |
| 6 | nova-compute | quasarsdn2 | nova | enabled | up | 2015-09-21T09:03:03.000000 | - |
| 7 | nova-compute | quasarsdnve1 | nova | enabled | up | 2015-09-21T09:03:09.000000 | - |
| 8 | nova-compute | quasarsdn1 | nova | enabled | up | 2015-09-21T09:03:04.000000 | - |
| 9 | nova-compute | quasarsdnve | nova | enabled | up | 2015-09-21T09:03:07.000000 | - |
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
root@quasarucn3:~#

root@quasarucn3:~# nova list
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| 3f62d6c5-a3e4-420d-b6b6-9a719f60c580 | cirros31 | SHUTOFF | - | Shutdown | vmn=12.1.1.27 |
| d65433d0-001b-4e24-9553-42ec5baeb056 | cirros32 | SHUTOFF | - | Shutdown | vmn=12.1.1.28 |
| 28914c07-a0cc-40a0-b743-48136ee997e3 | cirros33 | SHUTOFF | - | Shutdown | vmn=12.1.1.29 |
| 8c1c6f0d-c385-45b3-aef5-eead0dbbd54b | cirros34 | SHUTOFF | - | Shutdown | vmn=12.1.1.30 |
| 40d40e57-7bdb-4a97-8e49-b2b6f7fbb8b5 | cirros35 | SHUTOFF | - | Shutdown | vmn=12.1.1.31 |
| 6dc4c963-124b-4264-adbc-3a32f705318f | cirros36 | SHUTOFF | - | Shutdown | vmn=12.1.1.32 |
| af4ec54b-dc90-410d-87e4-170b8a643bba | d5 | SHUTOFF | - | Shutdown | vmn=12.1.1.14 |
| ae6d1bc5-635a-453d-8cec-143a2b8240f6 | d7 | SHUTOFF | powering-on | Shutdown | vmn=12.1.1.20 |
| 914c2f05-b56a-4689-9c1b-63f5bb36c7db | d8_sdn1 | ACTIVE | - | Running | vmn=12.1.1.22 |
| 925df284-3339-4af7-86e9-f66c41d947ce | d9_220 | ACTIVE | - | Running | vmn=12.1.1.26 |
| 518f7d49-07fb-474b-b18c-647d558562ea | d9_sdnve | ACTIVE | - | Running | vmn=12.1.1.25 |
| 59b3512a-8f6b-443d-ae1a-ca1ff615dba4 | leo_ubuntu | ACTIVE | powering-off | Running | vmn=12.1.1.15 |
| 90cc6a5e-e8ce-4a75-a9c5-f0393b68560d | spark_docker | SHUTOFF | - | Shutdown | vmn=12.1.1.18 |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
  [Log]
No error log for this

affects: neutron → nova
Revision history for this message
Xiao Li Xu (xiao-li-xu) wrote :

change it to nova-docker

affects: nova → nova-docker
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.