Contrail 2.21 : Neutron failures for an instance

[Deepak Jeyaraman]

The issue below is an extension (?) to https://bugs.launchpad.net/juniperopenstack/+bug/1506739

In this case, the nova instance is up and running even though there are heat stck-show failure for that particular heat stack.

Neutron net-list shows all 3 networks for the instance - but the networks dont show up in the openstack dashboard.

root@nethra-01:~# heat stack-list
+--------------------------------------+------------------------------------------+-----------------+----------------------+
| id | stack_name | stack_status | creation_time |
+--------------------------------------+------------------------------------------+-----------------+----------------------+
| 444cc183-bc31-4045-91f6-5b548ea0c60a | jsm-a22e472b-e94a-4186-87a5-b8747a5bb70f | UPDATE_COMPLETE | 2015-11-05T04:50:43Z |
| 8e2cabf1-b797-4319-b844-e10c2bbc39a3 | jsm-75412bf0-984e-4791-a60b-442bd9f4ed88 | UPDATE_COMPLETE | 2015-11-05T04:50:52Z |
| 1ddbd0f7-002d-42c9-a2ff-8aa7b644059e | jsm-67261710-ddac-43cc-b71e-af21cf83feff | UPDATE_COMPLETE | 2015-11-05T04:50:55Z |
| 6032bc37-f426-4d2c-9679-fcdd4f3e0b2e | jsm-e3cf8409-8b92-4d21-b6db-0c9eb4f2ce11 | UPDATE_COMPLETE | 2015-11-05T04:51:00Z |
| fd497b8a-d939-4be1-9764-853ccabdee67 | jsm-4810437f-c694-4cc5-8cae-7adc95d68344 | UPDATE_COMPLETE | 2015-11-05T04:51:02Z |
| 2fc60ca5-1b1b-4907-b624-35ae6cd9f96f | jsm-664bcbf7-5d28-444e-b569-11c3932e94a3 | UPDATE_COMPLETE | 2015-11-05T04:51:04Z |
| 96a4ce04-c998-4177-a11d-30fb634c2bf8 | jsm-508770ea-d76e-4f3f-9c18-8bf80c67de58 | UPDATE_COMPLETE | 2015-11-05T04:51:07Z |
| e381315f-ab71-40ff-af23-500179d088fa | jsm-01995627-d8cc-4fde-9037-9cb01ed99dd9 | CREATE_COMPLETE | 2015-11-05T04:51:11Z | <<<<<<<<<<<<<<<<<<<<<<<<
| 4d09ab9d-03c0-4e67-a411-4740db9708b4 | jsm-ca3dfcfc-cbd5-42ff-83e2-77d11c139f75 | UPDATE_COMPLETE | 2015-11-05T04:51:13Z |
| 640651cc-502c-4c8f-8734-c97708d998ee | jsm-642c22f8-4e0e-4d02-989c-2b27e6cdf5ef | UPDATE_COMPLETE | 2015-11-05T04:51:16Z |
| 4b90a732-1df9-42a3-acc3-a23b3f2330d1 | jsm-68c45c4f-13fb-4b4e-9c90-052988264a5b | UPDATE_COMPLETE | 2015-11-05T04:51:20Z |
| ba622cda-dc5c-4798-8d32-29f10a5b1cc9 | jsm-44f6e49c-9fb1-4287-89a2-bf2e507541ff | UPDATE_COMPLETE | 2015-11-05T04:51:20Z |
| d7a94d38-78ee-4d81-9015-c43c3926b933 | jsm-f5207647-2d7d-40c4-8738-d1e05408cf78 | UPDATE_COMPLETE | 2015-11-05T04:51:21Z |
| b5406f5c-2a58-476a-aa5c-e3de99c85412 | jsm-921fae95-69c9-4d37-be5f-43242994a47e | UPDATE_COMPLETE | 2015-11-05T04:51:24Z |
| 71af6336-3307-4cf8-8186-d9fb8d6d08a5 | jsm-ee031d60-7f46-417c-a654-6fe03e0390bf | CREATE_COMPLETE | 2015-11-05T04:51:32Z |
| 968c3747-8129-461d-a916-6d0d926af849 | jsm-7a384cb3-f101-445d-8b26-bd82c4a28f5d | UPDATE_COMPLETE | 2015-11-05T04:51:44Z |
+--------------------------------------+------------------------------------------+-----------------+----------------------+

root@nethra-01:~# nova list | grep 01995627-d8cc-4fde-9037-9cb01ed99dd9
| 3f805352-8be6-4fdf-bd08-bbc76ffab162 | default-domain__admin__01995627-d8cc-4fde-9037-9cb01ed99dd9-vFF-0-vnf-instance__1 | ACTIVE | - | Running | right-net=192.168.4.13; 01995627-d8cc-4fde-9037-9cb01ed99dd9-left-net=10.0.5.3; mgmt-net=10.102.57.142 |

nova show for that instance shows as UP and running (ACTIVE) and the networks are fine

root@nethra-01:~# nova show 3f805352-8be6-4fdf-bd08-bbc76ffab162
+-------------------------------------------------------+-----------------------------------------------------------------------------------+
| Property | Value |
+-------------------------------------------------------+-----------------------------------------------------------------------------------+
| 01995627-d8cc-4fde-9037-9cb01ed99dd9-left-net network | 10.0.5.3 |
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-SRV-ATTR:host | nethra-01 |
| OS-EXT-SRV-ATTR:hypervisor_hostname | nethra-01.englab.juniper.net |
| OS-EXT-SRV-ATTR:instance_name | instance-00000042 |
| OS-EXT-STS:power_state | 1 |
| OS-EXT-STS:task_state | - |
| OS-EXT-STS:vm_state | active |
| OS-SRV-USG:launched_at | 2015-11-05T04:53:37.000000 |
| OS-SRV-USG:terminated_at | - |
| accessIPv4 | |
| accessIPv6 | |
| config_drive | |
| created | 2015-11-05T04:53:25Z |
| flavor | m1.medium (3) |
| hostId | bb9c1c0255e4de71e38423ed423e9633fdf82954cf68c446b5e3cd1d |
| id | 3f805352-8be6-4fdf-bd08-bbc76ffab162 |
| image | vsrx2.0-baseline (a8edc88c-8a5d-4e9e-891d-c1554f5a899d) |
| key_name | - |
| metadata | {} |
| mgmt-net network | 10.102.57.142 |
| name | default-domain__admin__01995627-d8cc-4fde-9037-9cb01ed99dd9-vFF-0-vnf-instance__1 |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| right-net network | 192.168.4.13 |
| status | ACTIVE |
| tenant_id | 92947e1fbb484f4899a2f647f8fb5411 |
| updated | 2015-11-05T04:53:37Z |
| user_id | 71bcb027fb654f999a6630e1493f4d12 |
+-------------------------------------------------------+-----------------------------------------------------------------------------------+

root@nethra-01:~# neutron net-show 01995627-d8cc-4fde-9037-9cb01ed99dd9-left-net
+-------------------------+---------------------------------------------------------------------------------------------------------------+
| Field | Value |
+-------------------------+---------------------------------------------------------------------------------------------------------------+
| admin_state_up | True |
| contrail:fq_name | default-domain |
| | admin |
| | 01995627-d8cc-4fde-9037-9cb01ed99dd9-left-net |
| contrail:instance_count | 0 |
| contrail:subnet_ipam | {"subnet_cidr": "10.0.5.0/24", "ipam_fq_name": ["default-domain", "default-project", "default-network-ipam"]} |
| id | 4bf3e737-8b9d-44b4-9e06-546265c04301 |
| name | 01995627-d8cc-4fde-9037-9cb01ed99dd9-left-net |
| router:external | True |
| shared | True |
| status | ACTIVE |
| subnets | f0e56a4c-9584-415e-9e0b-3052b648a551 |
| tenant_id | 92947e1fbb484f4899a2f647f8fb5411 |
+-------------------------+---------------------------------------------------------------------------------------------------------------+

root@nethra-01:~# neutron port-list | grep 10.0.5
| b1a4e7e5-3b71-4833-8800-9f17b14086f6 | default-domain__admin__01995627-d8cc-4fde-9037-9cb01ed99dd9-vFF-0-vnf-instance__1__left__2 | 02:df:47:ba:c3:8c | {"subnet_id": "f0e56a4c-9584-415e-9e0b-3052b648a551", "ip_address": "10.0.5.3"}

root@nethra-01:~# neutron port-show b1a4e7e5-3b71-4833-8800-9f17b14086f6
+---------------------+--------------------------------------------------------------------------------------------+
| Field | Value |
+---------------------+--------------------------------------------------------------------------------------------+
| admin_state_up | True |
| binding:vif_details | {"port_filter": true} |
| binding:vif_type | vrouter |
| device_id | |
| device_owner | |
| fixed_ips | {"subnet_id": "f0e56a4c-9584-415e-9e0b-3052b648a551", "ip_address": "10.0.5.3"} |
| id | b1a4e7e5-3b71-4833-8800-9f17b14086f6 |
| mac_address | 02:df:47:ba:c3:8c |
| name | default-domain__admin__01995627-d8cc-4fde-9037-9cb01ed99dd9-vFF-0-vnf-instance__1__left__2 |
| network_id | 4bf3e737-8b9d-44b4-9e06-546265c04301 |
| security_groups | 2b69ea49-95f1-4728-877d-fee1b2694225 |
| status | DOWN |
| tenant_id | 92947e1fbb484f4899a2f647f8fb5411 |
+---------------------+--------------------------------------------------------------------------------------------+

But look at the attached file (openstack_dash_screenshot.png) you will see there are no networks.