Juniper Openstack

Contrail 3.0: heat stack-delete failures at scale

Bug #1593318 reported by Deepak Jeyaraman
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
New
Undecided
Unassigned

Bug Description

Build 3.0.2.51 (GA), there are heat stack-delete failures. The VMs are deleted, but the stacks are not deleted.

Out of 300 instances, 108 are in this state:

root@ccra-16:~# heat stack-list | wc
    120 1056 14760
root@ccra-16:~# heat stack-list
+--------------------------------------+------------------------------------------+---------------+----------------------+
| id | stack_name | stack_status | creation_time |
+--------------------------------------+------------------------------------------+---------------+----------------------+
| 7f9ea82f-2290-4de2-b959-1b11e55cb50e | jsm-c8669460-37d6-4ad7-8f6f-6186c75866dc | DELETE_FAILED | 2016-06-15T20:39:42Z |
| 9f940645-2967-4369-ad94-593aa53e8625 | jsm-92e56fca-71ff-4961-8b1f-5edeee1e0100 | DELETE_FAILED | 2016-06-15T20:39:44Z |
| 55a49012-8a4b-4d73-bc51-834a9dc6f89d | jsm-e8c1c308-afcb-4ddd-a0e7-d0eb45991c00 | DELETE_FAILED | 2016-06-15T20:39:46Z |
| 14c0156f-9096-45df-9491-d385e8c8050e | jsm-0e46bc39-3dcf-491e-a610-bde618814178 | DELETE_FAILED | 2016-06-15T20:39:47Z |
| 0f9e532f-6f82-459d-907d-2f797faea797 | jsm-dcad5002-1a8b-45ba-a0e0-bac0200f9bf7 | DELETE_FAILED | 2016-06-15T20:39:48Z |
| ab98eaa5-b40d-4228-92b3-ea42eecdf468 | jsm-19cf9271-06df-4a68-9317-def13adb573b | DELETE_FAILED | 2016-06-15T20:39:48Z |
| d69efa53-e262-4562-bcc8-f7b03ae8523e | jsm-ab3c1c83-f7ba-4bac-8201-bded5ab43b3c | DELETE_FAILED | 2016-06-15T20:40:03Z |
| c26d2738-7ae2-4553-9f46-9132106ce99a | jsm-547b4410-d563-465c-b41d-4f96ea0fd678 | DELETE_FAILED | 2016-06-15T20:40:10Z |
| f8d6b4df-4780-440a-b288-05f2d6fef94d | jsm-902df801-abbe-49f5-a95c-2507a93d845e | DELETE_FAILED | 2016-06-15T21:45:06Z |
| 66600109-9157-4caf-9dde-8806867feb72 | jsm-e245b99a-fcdb-426b-9002-bcca02d79a28 | DELETE_FAILED | 2016-06-15T21:45:07Z |
| 45849c98-6fff-4260-b517-ac6881a13e10 | jsm-af80cfc0-7993-4255-bfd7-aec2368aa819 | DELETE_FAILED | 2016-06-15T21:45:12Z |
| 985363e2-48d3-4682-a945-a5d2d064f595 | jsm-498627ac-e9fa-4abc-a91a-8721b0d52be8 | DELETE_FAILED | 2016-06-15T21:45:14Z |
| 8f8912f7-ad6e-4daf-9b19-4fbd3034a761 | jsm-dc871d5d-1339-4953-b9f8-37a2eb3847e0 | DELETE_FAILED | 2016-06-15T21:45:30Z |
| cac97d67-552d-4ae2-8ecd-dead84a313a8 | jsm-6f0f144c-5e7f-42be-91f1-10b751f7f0d0 | DELETE_FAILED | 2016-06-15T21:45:30Z |
| 806728e7-4da7-4025-8438-d9c0b76f49d4 | jsm-382d8196-2c3b-47ad-8535-9d2587b00ba6 | DELETE_FAILED | 2016-06-15T21:45:37Z |
| a7082e3d-21a5-4962-9d6c-4b0eddeb0a68 | jsm-a1a7133e-cf8b-4e7a-8ed6-ea7232b7837d | DELETE_FAILED | 2016-06-15T21:45:37Z |
| e93008d7-361b-4fbc-89d3-2b0199150d64 | jsm-36d3fa36-d8b2-41c9-bc1c-9fbe37723a0d | DELETE_FAILED | 2016-06-15T21:45:38Z |
| 325255f2-d4cd-4db1-b33c-35cc59155b56 | jsm-2cdb0a82-4145-4eab-940f-78455e60e8aa | DELETE_FAILED | 2016-06-15T21:45:39Z |
| b83e7c0b-0af8-411c-9b5a-1f4b1ca18382 | jsm-2627867b-e30a-4a74-8dec-fac3aefb32d5 | DELETE_FAILED | 2016-06-15T21:45:41Z |
| 335db28e-740f-49f4-a3b9-ad97d225157c | jsm-4ee7a21d-5037-4ddb-b965-cea6f72bb20e | DELETE_FAILED | 2016-06-15T21:45:42Z |
| 70694cd9-bea4-4c96-96df-0fa240664f37 | jsm-ae483276-f780-43bf-a18c-b90fd81e7fd1 | DELETE_FAILED | 2016-06-15T21:45:42Z |
| 68d2c0f4-938d-4f6b-afb3-91488a562e7a | jsm-6df3a17e-0427-4ff6-ae6a-1b9b8ceab6f8 | DELETE_FAILED | 2016-06-15T21:45:48Z |
| d864402d-19ce-46b1-939d-d6d5aa304040 | jsm-152c8908-26d9-41a8-813f-f17408decb91 | DELETE_FAILED | 2016-06-15T21:45:48Z |
| 9f278048-f580-4151-b2d1-743b187cbb67 | jsm-21753327-8b09-4718-8c34-a40a5a82d887 | DELETE_FAILED | 2016-06-15T21:45:49Z |
| 176f5f2c-5238-4775-a54b-c32956ab10de | jsm-f8af568e-108b-425b-9d1f-deffd5972ed4 | DELETE_FAILED | 2016-06-15T21:45:50Z |
| e4eb5712-e1cd-489f-9c0c-d1df466f5e32 | jsm-d1393fe4-cfa7-471c-989a-57c269544ce2 | DELETE_FAILED | 2016-06-15T21:55:05Z |
| 6a2cc612-411e-4ae7-b6cc-b6d1f63a0695 | jsm-097b79bc-1ef8-4035-96ef-d64155e19a37 | DELETE_FAILED | 2016-06-15T21:55:13Z |
| 2934e5b1-56ba-4d16-963d-4f30eb42fa3b | jsm-87c14d93-ece2-4a40-af1c-749ae9a592cb | DELETE_FAILED | 2016-06-15T21:55:14Z |
| 746b67a9-e730-47ff-87c5-b1457e77329c | jsm-9cb3b2c1-fa8b-49e2-a232-7713dc5a7b58 | DELETE_FAILED | 2016-06-15T21:55:21Z |
| a3af4812-7d66-4818-88bf-97ec3c96cc32 | jsm-847fea90-1ee9-479b-acdc-d92ede275896 | DELETE_FAILED | 2016-06-15T21:55:34Z |
| c4f53718-b5d5-4bad-a464-09463094d403 | jsm-7a5db087-6986-4e02-8a46-eabf553ab09d | DELETE_FAILED | 2016-06-15T21:55:34Z |
| 23d37847-a12b-45a9-b79a-999396718883 | jsm-2868240b-ca47-4ab7-8c41-7eaa33dbd965 | DELETE_FAILED | 2016-06-15T21:55:37Z |
| 50b28adc-ee56-4c6b-955c-e4aa4b047819 | jsm-884521d9-25a1-4652-a1ac-bcc4713f5da0 | DELETE_FAILED | 2016-06-15T21:55:37Z |
| 83175804-320a-4446-9538-102673b26ac6 | jsm-fcefb2c9-55a7-4131-bf4e-2e15f1306a44 | DELETE_FAILED | 2016-06-15T21:55:37Z |
| eecf9d3e-ed63-4fcb-8337-9f0b91cef799 | jsm-557c6921-3bb0-4548-a2ab-4bde431452e7 | DELETE_FAILED | 2016-06-15T21:55:37Z |
| 0fcd7ef1-742c-4040-914d-5ebff483c968 | jsm-435c94c9-afc6-4249-b328-c12582379cc2 | DELETE_FAILED | 2016-06-15T21:55:39Z |
| cf389fa4-5a6c-47db-a56c-d0921bdb0b72 | jsm-560cabb2-d7b0-4b79-b891-990f5cd6ffe7 | DELETE_FAILED | 2016-06-15T21:55:43Z |
| 292a9b0a-aa05-487d-93ac-60df4ed3324e | jsm-07fd3c0d-782b-4510-bd7d-f8ca793baf23 | DELETE_FAILED | 2016-06-15T21:55:44Z |
| 8b7d6df2-5e4f-42a4-9e6e-35df15f9d712 | jsm-f05a3343-091b-4ee8-9a48-5b41a03c0895 | DELETE_FAILED | 2016-06-15T21:55:44Z |
| d77e3bbd-a23a-48ef-b787-26b4a38d93de | jsm-ae6be4e4-13a4-411f-9c2b-4626097b089a | DELETE_FAILED | 2016-06-15T21:55:44Z |
| 7253f05a-6010-4683-9051-696f80dc0ffa | jsm-5d428da1-0d84-4381-b7ee-f7a560eaadd8 | DELETE_FAILED | 2016-06-15T21:55:47Z |
| 0fdec86d-64de-435b-9a1f-9df3eda75165 | jsm-46f1eee7-6e47-4772-bbc1-6ea97422ea91 | DELETE_FAILED | 2016-06-15T22:05:23Z |
| 17e9a0b3-d1a8-4a94-9aab-29b8a078fd00 | jsm-2ce74cc4-4ac6-438b-ac81-1661a525de6c | DELETE_FAILED | 2016-06-15T22:05:30Z |
| 68e87749-9351-4194-89cf-56354c61d4b5 | jsm-8ba9a7f2-f6c6-42ee-bde7-df113fd88168 | DELETE_FAILED | 2016-06-15T22:05:33Z |
| a53cd437-8954-49ae-84db-12127a323160 | jsm-a8b2a4f9-addf-42f4-85b9-9975f25a1b45 | DELETE_FAILED | 2016-06-15T22:05:33Z |
| 88b4fbde-d7c6-4db1-92f6-bb4035361e9f | jsm-43658cea-bb7e-43f7-8232-e2effac9eee2 | DELETE_FAILED | 2016-06-15T22:05:38Z |
| 210875cb-5867-4946-aaad-45ed7d9b8e71 | jsm-cd35e411-2d2d-4ad7-bd8d-015fd0084a05 | DELETE_FAILED | 2016-06-15T22:05:41Z |
| 347c9085-8de9-4d0e-8e79-1be6af7f1aa3 | jsm-b029919e-5bd9-4505-aa70-94c1a97b7530 | DELETE_FAILED | 2016-06-15T22:05:43Z |
| 75e4b6a4-160f-4919-bcb6-737eabd705b7 | jsm-35860beb-62ee-4057-8df9-a48d29be2b9e | DELETE_FAILED | 2016-06-15T22:05:51Z |
| 9932a206-c04e-4361-97b1-ac28201c17a9 | jsm-3de6586e-5d15-4bca-943c-f8badc27f6c5 | DELETE_FAILED | 2016-06-15T22:05:59Z |
| 20442388-b682-4c48-a024-80cb53a36adf | jsm-be165cdf-e6db-4bab-978d-8a6993bee99d | DELETE_FAILED | 2016-06-15T22:06:00Z |
| 4b070cf1-a12c-4b8c-9cfd-4ef63be68493 | jsm-f097bfb0-a026-4df8-ab0e-1718d4b1a488 | DELETE_FAILED | 2016-06-15T22:06:06Z |
| 59e5a450-772e-49f3-8687-e5252eb33cef | jsm-9aeb1946-fd82-4f2c-ad9b-14d866abcb74 | DELETE_FAILED | 2016-06-15T22:15:24Z |
| 6369896c-9ab7-4ff0-8782-5dd84e0dee9f | jsm-9af4298c-0fdd-40cb-beb6-aed6e6a54bc4 | DELETE_FAILED | 2016-06-15T22:15:27Z |
| f0ed7daa-d86b-40f2-9577-79e8c291098c | jsm-b7f3ed87-d27c-40b0-b7c2-ed4c849bcc42 | DELETE_FAILED | 2016-06-15T22:15:27Z |
| 76328c10-946c-4f97-902d-5b858735da09 | jsm-27f157b5-57c3-438f-9a0b-54ddc1a6b9cf | DELETE_FAILED | 2016-06-15T22:15:28Z |
| 07fc5a58-bcc8-4fc0-9442-407f728f07df | jsm-9c61e3aa-a9fb-4fe4-aea6-f3c93953ca1c | DELETE_FAILED | 2016-06-15T22:15:35Z |
| 6f11af98-124f-4a94-a95d-14d513f42ab3 | jsm-82c6bd5c-af20-4eba-968c-37583ff9199f | DELETE_FAILED | 2016-06-15T22:15:36Z |
| d7d20d35-310c-48b4-9668-3472fa961e85 | jsm-b4383329-318c-4d61-8a9a-6ef7c4a90d66 | DELETE_FAILED | 2016-06-15T22:15:42Z |
| d81940cc-71bc-49de-b2e0-43aab7358cb7 | jsm-5c67f9d4-2715-4d7d-ac2e-8b87b7f76001 | DELETE_FAILED | 2016-06-15T22:15:42Z |
| db82c74a-f406-4cec-a96a-67dfc7be67f0 | jsm-5976af6f-d66a-4528-ad5c-1af80b40a4a2 | DELETE_FAILED | 2016-06-15T22:15:42Z |
| d86b8e0a-fa83-4782-8097-4b30b08bc341 | jsm-24d08256-30de-405e-81d6-6b12736c9d6b | DELETE_FAILED | 2016-06-15T22:15:50Z |
| 0363018a-7b35-4703-9074-686cbdf6f9ad | jsm-1414aa4c-409c-43ce-a02b-b8c96f9622cb | DELETE_FAILED | 2016-06-15T22:15:56Z |
| f9edbd6a-7005-47e9-98dd-b9d1b99da5d1 | jsm-6f01d7ea-bd5b-4f77-9bd7-8dc20ee85ea1 | DELETE_FAILED | 2016-06-15T22:16:01Z |
| c1eda703-249b-40a8-bd85-c6b76358594e | jsm-26bbc487-7b24-4a52-9a8c-439609971272 | DELETE_FAILED | 2016-06-15T22:16:03Z |
| eff7ea01-1159-449f-a8d5-914f95f75c1e | jsm-78ea0e32-a817-46df-8af7-03ae2d160fcd | DELETE_FAILED | 2016-06-15T22:16:03Z |
| 877757da-08ab-4ee0-9dc6-356403fc565d | jsm-d81c2f7c-37d2-4589-8a42-80721a84fe39 | DELETE_FAILED | 2016-06-15T22:16:04Z |
| 872f1e96-1c1d-44a5-af99-a37c622f25da | jsm-27a8bcc2-6aa3-49bb-93d5-e14bafa4557a | DELETE_FAILED | 2016-06-15T22:26:02Z |
| d48c66d8-d715-4ebc-bccd-98940ba18d00 | jsm-1092fdf5-7fa6-40fb-a304-3dae575d2949 | DELETE_FAILED | 2016-06-15T22:26:03Z |
| e33bc44a-b56f-4eaa-86e1-da0ad68aa995 | jsm-6e1d30c1-f000-4ad2-a2a7-3d8602ac9fb9 | DELETE_FAILED | 2016-06-15T22:26:05Z |
| 5e516eab-63cd-40d6-9d72-b6c9435abb3e | jsm-c9fc8c35-6075-43dc-bf16-55f51911939e | DELETE_FAILED | 2016-06-15T22:26:08Z |
| f0d33316-3237-45ca-a81d-18f24a8fa5a3 | jsm-f85669e2-4959-4928-a461-325a6b8dbb45 | DELETE_FAILED | 2016-06-15T22:26:14Z |
| a7663f1a-8cd9-4fd4-88d5-da7a452d2c3e | jsm-1850d458-a20d-4351-a2ac-9f76a8f40fb0 | DELETE_FAILED | 2016-06-15T22:26:23Z |
| 1ccc4324-de33-497f-b666-0b1fe83b35d1 | jsm-3054b0b9-c011-4a1d-a635-42cf7927de3a | DELETE_FAILED | 2016-06-15T22:26:25Z |
| 7db2b8d2-8d92-4ec3-b8fd-b52f41538e82 | jsm-236f2f64-5ec6-4ee7-9115-dcd9e5dccd79 | DELETE_FAILED | 2016-06-15T22:26:28Z |
| 55bda403-c876-4813-a49e-f9f61da9bfee | jsm-e983455c-347d-46a3-88c8-bf8754b2f2c7 | DELETE_FAILED | 2016-06-15T22:36:27Z |
| 77f827e9-f704-44c2-9782-762015270ae9 | jsm-53b1a4dc-2eef-43a9-b872-204f383c5c7a | DELETE_FAILED | 2016-06-15T22:36:27Z |
| 5f8fb90f-cbc8-4b80-9594-45de5a15e72a | jsm-b5ab496b-458a-4a49-a1a2-f523473de466 | DELETE_FAILED | 2016-06-15T22:36:36Z |
| eac1b105-f322-43fb-b21c-a239d126c5cc | jsm-f8f470e3-c666-48cd-80d4-808ad9a23de3 | DELETE_FAILED | 2016-06-15T22:36:36Z |
| 1ee08582-e5e8-4e25-be36-209e0c584c73 | jsm-80eebc7d-b011-4ca2-8836-dbdb9e9d3608 | DELETE_FAILED | 2016-06-15T22:36:43Z |
| 3bddfdc7-6491-46b9-b4ab-d3dffcf4e882 | jsm-04b6c05e-2905-4781-b011-35c2de772325 | DELETE_FAILED | 2016-06-15T22:36:46Z |
| 4573c380-b351-4e69-b94f-30db11ae1766 | jsm-45dee882-3d9c-4b25-86d2-cedd6ca64fd0 | DELETE_FAILED | 2016-06-15T22:36:47Z |
| c6227751-0cc9-49ce-80cd-95b6e1b6589f | jsm-69939643-2ab5-4c53-b3ee-691fc737a66f | DELETE_FAILED | 2016-06-15T22:36:55Z |
| 6455532c-63f6-4b8d-b121-e8a8db52c2c3 | jsm-954594e0-d85b-4628-9a4c-67f555ba940c | DELETE_FAILED | 2016-06-15T22:37:03Z |
| 8a42b9fd-7ffc-4bc3-936b-87d2e2ba169f | jsm-e16601ec-19f5-4e4d-afe5-50147e2227dd | DELETE_FAILED | 2016-06-15T22:37:03Z |
| ce2e3c49-64f7-438e-8e20-505b7b6dbc48 | jsm-6943070d-04e0-4a0d-b838-3a5c7ff549d1 | DELETE_FAILED | 2016-06-15T22:48:10Z |
| 44f9db64-1827-4111-90e2-a7b0e8ce9850 | jsm-51bab785-c8e4-424c-a347-4b76344ead7c | DELETE_FAILED | 2016-06-15T22:48:18Z |
| 5fbe309c-9db0-4872-987f-2a9fe7ce3c6b | jsm-7a5fc8e8-3d96-4ad7-8a81-2f6edea8b972 | DELETE_FAILED | 2016-06-15T22:48:24Z |
| 489976bc-481e-4e99-a26d-7c92d095e557 | jsm-b603af04-39a0-48b3-af68-116d67c7a675 | DELETE_FAILED | 2016-06-15T22:48:25Z |
| b4574d96-ab33-4d5d-b77b-13f7b54fe061 | jsm-834a5425-9179-43d1-8d99-9c9c25b64225 | DELETE_FAILED | 2016-06-15T22:48:27Z |
| 8473c38d-7b52-4a7b-970b-eac34f839f80 | jsm-e36412fe-e70c-41c6-9aa4-356129834abe | DELETE_FAILED | 2016-06-15T22:48:28Z |
| a6638fee-0d53-462c-8774-1f4412cb9499 | jsm-96ab251d-1696-46e3-afe5-d967f19b01fd | DELETE_FAILED | 2016-06-15T22:48:28Z |
| 8822eca8-71d0-4cfb-8f59-18a626c13933 | jsm-ea2f497b-9fb7-4960-8617-2eeb44d7ebaf | DELETE_FAILED | 2016-06-15T22:48:32Z |
| 808d0615-afde-4708-ae66-6f2708e373c7 | jsm-fbccd82c-fe54-4188-b494-a4e2aa706426 | DELETE_FAILED | 2016-06-15T22:48:34Z |
| 091c81d6-f7fb-4139-8bf2-a6a834768f7b | jsm-3a290045-80be-48d7-b19b-ed6779bb9789 | DELETE_FAILED | 2016-06-15T22:48:52Z |
| e96b31f4-d1eb-4702-b4f2-51e126600a61 | jsm-0967bbed-9675-43f8-8b91-664bb0550e8f | DELETE_FAILED | 2016-06-15T22:48:52Z |
| 5a0c1e29-33c8-4dd4-bcdc-a4b6ad52a95f | jsm-f9860d12-6337-4af9-8928-34f1fadda37b | DELETE_FAILED | 2016-06-15T22:48:55Z |
| f49ec0fd-74ac-4a9a-9557-f7f0a2359aab | jsm-1804dc5b-019b-43c5-89f4-9026156a349f | DELETE_FAILED | 2016-06-15T23:00:27Z |
| 2db3fef3-c8f2-40a5-8d43-bb4a9bc2c9c6 | jsm-c31e4507-1beb-4a69-9656-46e830b9af52 | DELETE_FAILED | 2016-06-15T23:00:33Z |
| 09244ff1-f401-4fbe-b16d-2ad8cc3902d5 | jsm-b5516b60-e9bd-4914-812e-0c09e77ef141 | DELETE_FAILED | 2016-06-15T23:00:41Z |
| 3b87cb85-2683-4a60-863d-e5cc2b582079 | jsm-c5176beb-45a8-4503-8cd3-95e06135bb03 | DELETE_FAILED | 2016-06-15T23:00:45Z |
| e48ac8f5-6315-44de-9477-fa444953eac3 | jsm-3862b745-60ed-4f17-a2e3-8a590b7e0091 | DELETE_FAILED | 2016-06-15T23:00:47Z |
| 40d29267-681d-4538-8918-0924d1022bd0 | jsm-637843cc-e9ee-4b60-84a4-e724606646f5 | DELETE_FAILED | 2016-06-15T23:01:03Z |
| 0217b718-4f27-4698-85ae-3cd6206ead5f | jsm-dc875e65-00e0-4888-9bd0-bb24fe273a31 | DELETE_FAILED | 2016-06-15T23:12:25Z |
| db5b4266-4f9d-4ed4-857e-4876a2c57074 | jsm-d7903564-142e-4b3b-8871-f2c255849479 | DELETE_FAILED | 2016-06-15T23:12:27Z |
| c15b8ed9-637e-4a70-855f-6a7e4ba49c45 | jsm-047ea14b-6a51-48d2-bb94-5ca22eb1518a | DELETE_FAILED | 2016-06-15T23:12:28Z |
| 8ccc2235-625b-4abe-9cbf-533b457b50de | jsm-fc530b57-4223-4327-bb24-da5915be8a92 | DELETE_FAILED | 2016-06-15T23:12:43Z |
| 42dbfd8c-9d9b-405d-b9ca-658e2d1bce2a | jsm-7513ec78-db3b-4b9a-a0c7-7721faffe2e7 | DELETE_FAILED | 2016-06-15T23:12:51Z |
| 9c8176c7-cf27-40d1-ba1c-33308486999b | jsm-4506ee31-63f5-4010-98dc-04125e44844b | DELETE_FAILED | 2016-06-15T23:12:56Z |
| 32925597-1e79-45b8-bf70-efe3fff607a1 | jsm-8a7672e3-772c-4e14-835d-497cde801cdb | DELETE_FAILED | 2016-06-15T23:24:48Z |
| 242ca625-bc59-4982-9702-021fc6943ced | jsm-3346be25-f120-4a96-ade3-c25a11a5caf7 | DELETE_FAILED | 2016-06-15T23:25:02Z |
| 890dab73-7897-492b-a2f4-7d61d7624c04 | jsm-7691e663-d6ef-4f16-a074-6747504f0921 | DELETE_FAILED | 2016-06-15T23:25:02Z |
| ea1d20e3-7b74-4a48-8929-d240dc15c3bd | jsm-8dea84f3-ddd7-4ba1-a6c1-3539ed7f87b2 | DELETE_FAILED | 2016-06-15T23:25:04Z |
| a71150b6-c006-4559-9ea8-6f76ae2a3db5 | jsm-1fcd2479-2632-440d-923f-7311212fb30e | DELETE_FAILED | 2016-06-15T23:25:08Z |
| 65ce9505-627c-4311-b955-0025ecb65376 | jsm-c8de1ff4-3dbc-422e-b2f4-5b45858b5fba | DELETE_FAILED | 2016-06-15T23:25:09Z |
| 298a6246-b5be-48cc-a7e1-33d06200134d | jsm-d7c0af74-f5d4-47fc-af8c-97f40bdf89f0 | DELETE_FAILED | 2016-06-15T23:25:13Z |
+--------------------------------------+------------------------------------------+---------------+----------------------+
root@ccra-16:~# heat stack-show 7f9ea82f-2290-4de2-b959-1b11e55cb50e
+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| Property | Value |
+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| capabilities | [] |
| creation_time | 2016-06-15T20:39:42Z |
| description | HOT template to create network service |
| disable_rollback | True |
| id | 7f9ea82f-2290-4de2-b959-1b11e55cb50e |
| links | http://10.102.28.148:8004/v1/5750be4c816642888492384cd51c4866/stacks/jsm-c8669460-37d6-4ad7-8f6f-6186c75866dc/7f9ea82f-2290-4de2-b959-1b11e55cb50e (self) |
| notification_topics | [] |
| parameters | { |
| | "OS::project_id": "5750be4c816642888492384cd51c4866", |
| | "right-net-id": "0a1ab56a-ffcf-4eee-83be-028521af560e", |
| | "OS::stack_name": "jsm-c8669460-37d6-4ad7-8f6f-6186c75866dc", |
| | "nsid": "c8669460-37d6-4ad7-8f6f-6186c75866dc", |
| | "mgmt-net-id": "e1023f42-a149-41ea-8fa4-288355cbc5b3", |
| | "OS::stack_id": "7f9ea82f-2290-4de2-b959-1b11e55cb50e", |
| | "left-net-rt0": "64512:37046", |
| | "left-subnet0-cidr": "57.19.46.0/24" |
| | } |
| parent | None |
| stack_name | jsm-c8669460-37d6-4ad7-8f6f-6186c75866dc |
| stack_owner | None |
| stack_status | DELETE_FAILED |
| stack_status_reason | Resource DELETE failed: BadRequest: resources.left- |
| | subnet0: Bad network request: Cannot Delete IP Block, |
| | Instance IP(s) in use |
| stack_user_project_id | 5750be4c816642888492384cd51c4866 |
| template_description | HOT template to create network service |
| timeout_mins | None |
| updated_time | 2016-06-15T20:45:55Z |
+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+

root@ccra-16:~# heat template-show 7f9ea82f-2290-4de2-b959-1b11e55cb50e
description: 'HOT template to create network service

  '
heat_template_version: '2013-05-23'
outputs:
  left-net_external:
    description: Is virtual network external?
    value:
      get_attr: [left-net, external]
  left-net_fq_name:
    description: FQ name of the virtual network
    value:
      get_attr: [left-net, fq_name]
  left-net_name:
    description: Name of the virtual network
    value:
      get_attr: [left-net, name]
  left-net_network_id:
    description: Network ID to which the subnet belongs to
    value:
      get_attr: [left-subnet0, network_id]
  left-net_route_targets:
    description: Route targets of the virtual network
    value:
      get_attr: [left-net, route_targets]
  left-net_shared:
    description: Is virtual network shared?
    value:
      get_attr: [left-net, shared]
  left-subnet0_allocation_pools:
    description: Subnet allocation pools
    value:
      get_attr: [left-subnet0, allocation_pools]
  left-subnet0_cidr:
    description: Subnet CIDR
    value:
      get_attr: [left-subnet0, cidr]
  left-subnet0_dns_nameservers:
    description: Subnet DNS name servers
    value:
      get_attr: [left-subnet0, dns_nameservers]
  left-subnet0_enable_dhcp:
    description: Subnet DHCP enable
    value:
      get_attr: [left-subnet0, enable_dhcp]
  left-subnet0_gateway_ip:
    description: Subnet Gateway IP
    value:
      get_attr: [left-subnet0, gateway_ip]
  left-subnet0_host_routes:
    description: Subnet host routes
    value:
      get_attr: [left-subnet0, host_routes]
  left-subnet0_ip_version:
    description: Subnet IP version
    value:
      get_attr: [left-subnet0, ip_version]
  left-subnet0_name:
    description: Subnet name
    value:
      get_attr: [left-subnet0, name]
  left-subnet0_tenant_id:
    description: Subnet tenant ID
    value:
      get_attr: [left-subnet0, tenant_id]
  site-access-policy_fq_name:
    description: Policy FQ name
    value:
      get_attr: [site-access-policy, fq_name]
  site-access-policy_name:
    description: Policy name
    value:
      get_attr: [site-access-policy, name]
  vSRX_Firewall-0-vnf-instance_active_service_vms:
    description: Service instance active service vms
    value:
      get_attr: [vSRX_Firewall-0-vnf-instance, active_service_vms]
  vSRX_Firewall-0-vnf-instance_fq_name:
    description: Service instance FQ name
    value:
      get_attr: [vSRX_Firewall-0-vnf-instance, fq_name]
  vSRX_Firewall-0-vnf-instance_name:
    description: Service instance name
    value:
      get_attr: [vSRX_Firewall-0-vnf-instance, name]
  vSRX_Firewall-0-vnf-instance_service_template:
    description: Service instance service template
    value:
      get_attr: [vSRX_Firewall-0-vnf-instance, service_template]
  vSRX_Firewall-0-vnf-instance_status:
    description: Service instance status
    value:
      get_attr: [vSRX_Firewall-0-vnf-instance, status]
  vSRX_Firewall-0-vnf-instance_tenant_id:
    description: Service instance tenant ID
    value:
      get_attr: [vSRX_Firewall-0-vnf-instance, tenant_id]
  vSRX_Firewall-0-vnf-instance_virtual_machines:
    description: Service instance virtual machines
    value:
      get_attr: [vSRX_Firewall-0-vnf-instance, virtual_machines]
  vSRX_Firewall-0-vnf-template_fq_name:
    description: Service template FQ name
    value:
      get_attr: [vSRX_Firewall-0-vnf-template, fq_name]
  vSRX_Firewall-0-vnf-template_name:
    description: Service template name
    value:
      get_attr: [vSRX_Firewall-0-vnf-template, name]
  vSRX_Firewall-0-vnf-template_service_instances:
    description: Service template service instances
    value:
      get_attr: [vSRX_Firewall-0-vnf-template, service_instances]
parameters:
  left-net-rt0: {description: Route Target for the Virtual Network, type: string}
  left-subnet0-cidr: {description: Private network address (CIDR notation), type: string}
  mgmt-net-id: {description: UUID of mgmt network to be used, type: string}
  nsid: {description: Unique identifier for the network service. Not necessarily UUID.
      Format TBD., type: string}
  right-net-id: {description: UUID of mgmt network to be used, type: string}
resources:
  left-net:
    properties:
      allow_transit: 'False'
      external: 'False'
      name:
        Fn::Join:
        - '-'
        - - {get_param: nsid}
          - left-net
      route_targets:
      - {get_param: left-net-rt0}
      shared: 'False'
    type: OS::Contrail::VirtualNetwork
  left-subnet0:
    depends_on: left-net
    properties:
      cidr: {get_param: left-subnet0-cidr}
      network_id: {get_resource: left-net}
    type: OS::Neutron::Subnet
  ns-entry:
    depends_on: [left-net, site-access-policy]
    properties:
      network: {get_resource: left-net}
      policy:
        get_attr: [site-access-policy, fq_name]
    type: OS::Contrail::AttachPolicy
  ns-exit:
    depends_on: [site-access-policy]
    properties:
      network: {get_param: right-net-id}
      policy:
        get_attr: [site-access-policy, fq_name]
    type: OS::Contrail::AttachPolicy
  site-access-policy:
    depends_on: [left-net, vSRX_Firewall-0-vnf-instance]
    properties:
      entries:
        policy_rule:
        - action_list:
            apply_service:
            - {get_resource: vSRX_Firewall-0-vnf-instance}
          direction: <>
          dst_addresses:
          - virtual_network: {get_param: right-net-id}
          dst_ports:
          - {end_port: -1, start_port: -1}
          protocol: any
          src_addresses:
          - virtual_network: {get_resource: left-net}
          src_ports:
          - {end_port: -1, start_port: -1}
      name:
        Fn::Join:
        - '-'
        - - {get_param: nsid}
          - 1d482b2a-3f2e-49f1-96ae-c1080bd916eb-site-access-policy
    type: OS::Contrail::NetworkPolicy
  vSRX_Firewall-0-vnf-flavor:
    properties: {cpus: 2, memory: 4096}
    type: OS::JSM::GetFlavor
  vSRX_Firewall-0-vnf-instance:
    depends_on: [left-subnet0, vSRX_Firewall-0-vnf-template]
    properties:
      availability_zone: SFO-AZ
      interface_list:
      - virtual_network: {get_param: mgmt-net-id}
      - virtual_network: {get_resource: left-net}
      - virtual_network: {get_param: right-net-id}
      name:
        Fn::Join:
        - '-'
        - - {get_param: nsid}
          - vSRX_Firewall-0-vnf-instance
      scale_out: {max_instances: 1}
      service_template:
        get_attr: [vSRX_Firewall-0-vnf-template, fq_name]
    type: OS::Contrail::ServiceInstance
  vSRX_Firewall-0-vnf-template:
    properties:
      availability_zone_enable: 'True'
      flavor:
        get_attr: [vSRX_Firewall-0-vnf-flavor, flavor]
      image_name: vSRX-img
      name:
        Fn::Join:
        - '-'
        - - {get_param: nsid}
          - vSRX_Firewall-0-vnf-template
      ordered_interfaces: 'True'
      service_interface_type_list: [management, left, right]
      service_mode: in-network
      service_type: firewall
      shared_ip_list: ['False', 'False', 'False']
      static_routes_list: ['False', 'False', 'False']
    type: OS::Contrail::ServiceTemplate

Deepak Jeyaraman (jdeepak)
information type: Proprietary → Public
Revision history for this message
Deepak Jeyaraman (jdeepak) wrote :
Download full text (6.0 KiB)

Also seeing gateway timeouts at scale when doing a single heat stack delete

root@ccra-17:~# heat stack-show 35e70095-86e2-460e-83bc-9b76f1447b32
+-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| Property | Value |
 +-----------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+
| capabilities | [] |
| creation_time | 2016-09-16T19:44:28Z |
| description | HOT template to create network service |
| disable_rollback | False |
| id | 35e70095-86e2-460e-83bc-9b76f1447b32 |
| links | http://10.102.28.148:8004/v1/f7f0408b641b470f9e72a25f23c97999/stacks/NSO-86ac4da0-272f-4f95-a097-1730e8fe48dc/35e70095-86e2-460e-83bc-9b76f1447b32 (self) |
| notification_topics | [] |
| parameters | { |
| | "OS::project_id": "f7f0408b641b470f9e72a25f23c97999", |
| | "right-net-id": "91f8629e-aa92-4c95-943e-582118d2534e", |
| | "OS::stack_name": "NSO-86ac4da0-272f-4f95-a097-1730e8fe48dc", |
| | "nsid": "86ac4da0-272f-4f95-a097-1730e8fe48dc", |
| | "mgmt-net-id": "506c7efd-4e7c-4cfc-b8cd-c47c1bf5465d", |
| | "OS::stack_id": "35e70095-86e2-460e-83bc-9b76f1447b32", ...

Read more...

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.