nova-docker

openstack Kilo Nova-Docker:Container will be hung in "powering-on" state.

Bug #1499397 reported by Xiao Li Xu
14
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Invalid
Undecided
Unassigned
nova-docker
New
Undecided
Unassigned

Bug Description

Bug description:
  [Summary]
When nova-compute service on compute node is down, issuing "nova start xxx" to start SHUTOFF container, container will be hung in "powering-on" state, even the nova-compute service has been started on compute node.

# Expected behavior:
Cmd "Nova start xx" of start container should not be issued and prompt an error notice to inform that compute node nova-compute service is down;
or
The state of container should be changed to ACTIVE from powering-on after compute node's nova-compute service up.

  [Topo]
  Unbuntu Kilo 14.04 OS , Kilo docker setup , 1 controller ,2 network node,6 computenode

  [Reproduceable or not]
  Can be reproduced,

  [Recreate Steps]
1, Build up a openstack & docker setup based on Ubuntu 14.04 trusty;
2, 1 controller, 2 network node and 7 computer node ;
3, Launch docker containers;

root@quasarucn3:~# nova list
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| 3f62d6c5-a3e4-420d-b6b6-9a719f60c580 | cirros31 | SHUTOFF | - | Shutdown | vmn=12.1.1.27 |
| d65433d0-001b-4e24-9553-42ec5baeb056 | cirros32 | SHUTOFF | - | Shutdown | vmn=12.1.1.28 |
| 28914c07-a0cc-40a0-b743-48136ee997e3 | cirros33 | SHUTOFF | - | Shutdown | vmn=12.1.1.29 |
| 8c1c6f0d-c385-45b3-aef5-eead0dbbd54b | cirros34 | SHUTOFF | - | Shutdown | vmn=12.1.1.30 |
| 40d40e57-7bdb-4a97-8e49-b2b6f7fbb8b5 | cirros35 | SHUTOFF | - | Shutdown | vmn=12.1.1.31 |
| 6dc4c963-124b-4264-adbc-3a32f705318f | cirros36 | SHUTOFF | - | Shutdown | vmn=12.1.1.32 |
| af4ec54b-dc90-410d-87e4-170b8a643bba | d5 | SHUTOFF | - | Shutdown | vmn=12.1.1.14 |
| ae6d1bc5-635a-453d-8cec-143a2b8240f6 | d7 | SHUTOFF | - | Shutdown | vmn=12.1.1.20 |
| 914c2f05-b56a-4689-9c1b-63f5bb36c7db | d8_sdn1 | ACTIVE | - | Running | vmn=12.1.1.22 |
| 925df284-3339-4af7-86e9-f66c41d947ce | d9_220 | ACTIVE | - | Running | vmn=12.1.1.26 |
| 518f7d49-07fb-474b-b18c-647d558562ea | d9_sdnve | ACTIVE | - | Running | vmn=12.1.1.25 |
| 90cc6a5e-e8ce-4a75-a9c5-f0393b68560d | spark_docker | ACTIVE | - | Running | vmn=12.1.1.18 |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
root@quasarucn3:~#

root@quasarucn3:~# nova show d7
+--------------------------------------+----------------------------------------------------------+
| Property | Value |
+--------------------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-SRV-ATTR:host | quasarsdn2 |
| OS-EXT-SRV-ATTR:hypervisor_hostname | quasarsdn2 |
| OS-EXT-SRV-ATTR:instance_name | instance-00000017 |
| OS-EXT-STS:power_state | 1 |
| OS-EXT-STS:task_state | - |
| OS-EXT-STS:vm_state | active |
| OS-SRV-USG:launched_at | 2015-09-19T07:03:41.000000 |
| OS-SRV-USG:terminated_at | - |
| accessIPv4 | |
| accessIPv6 | |
| config_drive | |
| created | 2015-09-19T07:03:39Z |
| flavor | m1.tiny (1) |
| hostId | 95f7fa6ddf5fcdcfc0806bb0e58ab0401a6e5c595ef42560603ebe07 |
| id | ae6d1bc5-635a-453d-8cec-143a2b8240f6 |
| image | cirros (798aa1fd-5c83-4cd9-a450-cbc307eb0e7f) |
| key_name | - |
| metadata | {} |
| name | d7 |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | ACTIVE |
| tenant_id | 066c321d33c24ea4acaf2e1a0451e85c |
| updated | 2015-09-21T06:01:09Z |
| user_id | 7c4dd09b6fe74d10b793a6172d0cce1b |
| vmn network | 12.1.1.20 |
+--------------------------------------+----------------------------------------------------------+
root@quasarucn3:~#

root@quasarucn3:~# nova service-list
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
| 1 | nova-cert | quasarucn3 | internal | enabled | up | 2015-09-21T05:56:22.000000 | - |
| 2 | nova-conductor | quasarucn3 | internal | enabled | up | 2015-09-21T05:56:23.000000 | - |
| 3 | nova-consoleauth | quasarucn3 | internal | enabled | up | 2015-09-21T05:56:23.000000 | - |
| 4 | nova-scheduler | quasarucn3 | internal | enabled | up | 2015-09-21T05:56:25.000000 | - |
| 5 | nova-compute | quasarucn1 | nova | enabled | up | 2015-09-21T05:56:24.000000 | - |
| 6 | nova-compute | quasarsdn2 | nova | enabled | down | 2015-09-21T02:36:08.000000 | - |
| 7 | nova-compute | quasarsdnve1 | nova | enabled | up | 2015-09-21T05:56:28.000000 | - |
| 8 | nova-compute | quasarsdn1 | nova | enabled | up | 2015-09-21T05:56:24.000000 | - |
| 9 | nova-compute | quasarsdnve | nova | enabled | up | 2015-09-21T05:56:26.000000 | - |
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
root@quasarucn3:~#

root@quasarucn3:~#
root@quasarucn3:~# nova start d7
Request to start server d7 has been accepted.
root@quasarucn3:~#
root@quasarucn3:~#
root@quasarucn3:~#
root@quasarucn3:~# nova list
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| 3f62d6c5-a3e4-420d-b6b6-9a719f60c580 | cirros31 | SHUTOFF | - | Shutdown | vmn=12.1.1.27 |
| d65433d0-001b-4e24-9553-42ec5baeb056 | cirros32 | SHUTOFF | - | Shutdown | vmn=12.1.1.28 |
| 28914c07-a0cc-40a0-b743-48136ee997e3 | cirros33 | SHUTOFF | - | Shutdown | vmn=12.1.1.29 |
| 8c1c6f0d-c385-45b3-aef5-eead0dbbd54b | cirros34 | SHUTOFF | - | Shutdown | vmn=12.1.1.30 |
| 40d40e57-7bdb-4a97-8e49-b2b6f7fbb8b5 | cirros35 | SHUTOFF | - | Shutdown | vmn=12.1.1.31 |
| 6dc4c963-124b-4264-adbc-3a32f705318f | cirros36 | SHUTOFF | - | Shutdown | vmn=12.1.1.32 |
| af4ec54b-dc90-410d-87e4-170b8a643bba | d5 | SHUTOFF | - | Shutdown | vmn=12.1.1.14 |
| ae6d1bc5-635a-453d-8cec-143a2b8240f6 | d7 | SHUTOFF | powering-on | Shutdown | vmn=12.1.1.20 |
| 914c2f05-b56a-4689-9c1b-63f5bb36c7db | d8_sdn1 | ACTIVE | - | Running | vmn=12.1.1.22 |
| 925df284-3339-4af7-86e9-f66c41d947ce | d9_220 | ACTIVE | - | Running | vmn=12.1.1.26 |
| 518f7d49-07fb-474b-b18c-647d558562ea | d9_sdnve | ACTIVE | - | Running | vmn=12.1.1.25 |
| 59b3512a-8f6b-443d-ae1a-ca1ff615dba4 | leo_ubuntu | ACTIVE | powering-off | Running | vmn=12.1.1.15 |
| 90cc6a5e-e8ce-4a75-a9c5-f0393b68560d | spark_docker | ACTIVE | - | Running | vmn=12.1.1.18 |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
root@quasarucn3:~#

root@quasarucn3:~# nova service-list
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
| 1 | nova-cert | quasarucn3 | internal | enabled | up | 2015-09-21T09:03:02.000000 | - |
| 2 | nova-conductor | quasarucn3 | internal | enabled | up | 2015-09-21T09:03:03.000000 | - |
| 3 | nova-consoleauth | quasarucn3 | internal | enabled | up | 2015-09-21T09:03:03.000000 | - |
| 4 | nova-scheduler | quasarucn3 | internal | enabled | up | 2015-09-21T09:03:06.000000 | - |
| 5 | nova-compute | quasarucn1 | nova | enabled | up | 2015-09-21T09:03:05.000000 | - |
| 6 | nova-compute | quasarsdn2 | nova | enabled | up | 2015-09-21T09:03:03.000000 | - |
| 7 | nova-compute | quasarsdnve1 | nova | enabled | up | 2015-09-21T09:03:09.000000 | - |
| 8 | nova-compute | quasarsdn1 | nova | enabled | up | 2015-09-21T09:03:04.000000 | - |
| 9 | nova-compute | quasarsdnve | nova | enabled | up | 2015-09-21T09:03:07.000000 | - |
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
root@quasarucn3:~#

root@quasarucn3:~# nova list
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| 3f62d6c5-a3e4-420d-b6b6-9a719f60c580 | cirros31 | SHUTOFF | - | Shutdown | vmn=12.1.1.27 |
| d65433d0-001b-4e24-9553-42ec5baeb056 | cirros32 | SHUTOFF | - | Shutdown | vmn=12.1.1.28 |
| 28914c07-a0cc-40a0-b743-48136ee997e3 | cirros33 | SHUTOFF | - | Shutdown | vmn=12.1.1.29 |
| 8c1c6f0d-c385-45b3-aef5-eead0dbbd54b | cirros34 | SHUTOFF | - | Shutdown | vmn=12.1.1.30 |
| 40d40e57-7bdb-4a97-8e49-b2b6f7fbb8b5 | cirros35 | SHUTOFF | - | Shutdown | vmn=12.1.1.31 |
| 6dc4c963-124b-4264-adbc-3a32f705318f | cirros36 | SHUTOFF | - | Shutdown | vmn=12.1.1.32 |
| af4ec54b-dc90-410d-87e4-170b8a643bba | d5 | SHUTOFF | - | Shutdown | vmn=12.1.1.14 |
| ae6d1bc5-635a-453d-8cec-143a2b8240f6 | d7 | SHUTOFF | powering-on | Shutdown | vmn=12.1.1.20 |
| 914c2f05-b56a-4689-9c1b-63f5bb36c7db | d8_sdn1 | ACTIVE | - | Running | vmn=12.1.1.22 |
| 925df284-3339-4af7-86e9-f66c41d947ce | d9_220 | ACTIVE | - | Running | vmn=12.1.1.26 |
| 518f7d49-07fb-474b-b18c-647d558562ea | d9_sdnve | ACTIVE | - | Running | vmn=12.1.1.25 |
| 59b3512a-8f6b-443d-ae1a-ca1ff615dba4 | leo_ubuntu | ACTIVE | powering-off | Running | vmn=12.1.1.15 |
| 90cc6a5e-e8ce-4a75-a9c5-f0393b68560d | spark_docker | SHUTOFF | - | Shutdown | vmn=12.1.1.18 |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+

  [Log]

Eugene Nikanorov (enikanorov)
affects: neutron → nova
Matt Riedemann (mriedem)
Changed in nova:
status: New → Invalid
Revision history for this message
Xiao Li Xu (xiao-li-xu) wrote :

# Expected behavior:
Cmd "Nova start xx" of start container should not be issued and prompt an error notice to inform that compute node nova-compute service is down;

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.