when neutron_tempest_plugin (https://github.com/openstack/neutron-tempest-plugin/commit/cbbb1c5740c3771ab819cabed894001cebc0b269) installed and all tests ran, there were resources left after the last tempest test has finished:
(note to myself: sosreport-testtwosecgroupsneutrontempestplugin.scenario.testsecuritygroups.NetworkSecGroupTest-20180321094446)
nova list:
+----+------+--------+------------+-------------+----------+
| ID | Name | Status | Task State | Power State | Networks |
+----+------+--------+------------+-------------+----------+
+----+------+--------+------------+-------------+----------+
router list:
+--------------------------------------+---------------------------+--------+-------+-------------+-------+----------------------------------+
| ID | Name | Status | State | Distributed | HA | Project |
+--------------------------------------+---------------------------+--------+-------+-------------+-------+----------------------------------+
| 0aa9fd0c-08f6-42ea-8f7d-c87439bed975 | tempest-router-649553975 | ACTIVE | UP | False | True | 1a5f684e3fba4186a1377f7f38c683d1 |
| 2bad4005-0db1-4078-90c9-4e3cb469d36d | tempest-router-14813253 | ACTIVE | DOWN | False | False | 27525fe7302c4486af5e7e70e9deb57d |
| 38a7e94a-9e5c-4aa2-8b23-89d033d0b272 | tempest-router-90797629 | ACTIVE | UP | False | True | 15efd21d6a584bb48abbe7d634bfa210 |
| 3c084a76-c979-4469-aad0-24bb548d66fc | test2 | ACTIVE | DOWN | False | True | 153e19dc012047e8b113dbfcc0d7fc64 |
| 400bd258-35b8-4d2b-9d0a-3aa1dc233953 | test | ACTIVE | DOWN | False | True | e70e438105ca4a588474b3690b576104 |
| 9fb5e728-1ee9-4eae-a7d2-ace2fbb6b72b | tempest-router-1028566458 | ACTIVE | UP | False | True | f9dc9009ca6941f391aeca395fe83962 |
| c7988c56-18de-4db3-932d-5c3bc923007b | tempest-router-225143084 | ACTIVE | DOWN | False | True | e70e438105ca4a588474b3690b576104 |
+--------------------------------------+---------------------------+--------+-------+-------------+-------+----------------------------------+
network list:
+--------------------------------------+----------------------------------------------------+--------------------------------------+
| ID | Name | Subnets |
+--------------------------------------+----------------------------------------------------+--------------------------------------+
| 0d008ea7-94f5-4995-bff0-1a2ecb898822 | nova | 492b7c8d-1f10-46e5-bd31-6d9f66aea3a6 |
| 24e4f0d0-c311-40da-831f-1026fd809bf5 | tempest-test-network--212663196 | 10dadbf2-98db-4603-93de-f6f120c1de93 |
| 29424513-f033-420c-9e98-9ad6c046b6c7 | tempest-test-network--1827538993 | 494d1003-7b12-45ae-a76f-aa7011005a95 |
| 2a4be4eb-69be-4b87-8ec4-b30c48187290 | tempest-network1-1249318944 | 6d76e329-abe9-46cd-a37a-00841b950bcc |
| 4f6389f4-72f5-4b65-ad6c-3525ada9dbd8 | tempest-test-network--1870533714 | 7b590bf4-0c25-40e1-8035-af1c1564a3b7 |
| 537ced78-6867-4d91-871f-29326b6b96e2 | HA network tenant 15efd21d6a584bb48abbe7d634bfa210 | 6c1da996-60f5-42c5-b42d-9b7b3a1f1433 |
| 63830d1b-992e-42df-8483-34c3776f449b | HA network tenant e70e438105ca4a588474b3690b576104 | 4b6772f0-29ea-42f6-ab8c-82f76137bef9 |
| 7189315c-2602-4b47-9734-4753f8f420b4 | tempest-test-network--2004647529 | 2ba3e16a-0055-42db-88c3-ffcbf0eae561 |
| 7f753e70-617a-4978-aa68-88a1288a9f80 | HA network tenant f9dc9009ca6941f391aeca395fe83962 | 570230ce-f1b0-4d58-a147-45ffb6ce5af7 |
| 862736a4-83fa-40c8-af94-001e2ad3f3c3 | tempest-test-network--1660232487 | 9b0e1c78-d0ad-4288-89a3-58f23302d99a |
| 9c10b827-6569-4f03-ab0a-6eafdb48cd2d | newnet | |
| b96dd9c9-e62c-4642-89a0-18f68cb330d8 | HA network tenant 1a5f684e3fba4186a1377f7f38c683d1 | 58667398-25c1-47e7-ac1f-58adc68f864d |
| c8fc1793-535d-47d4-a713-51384d89ea70 | HA network tenant 153e19dc012047e8b113dbfcc0d7fc64 | 74981bca-84d6-4377-829f-2c1b8d3904ce |
| eacbeccc-6cb9-4a2e-9816-c870f7d1a1a2 | tempest-test-network--1401593363 | 10bca35d-ee51-4ea3-9e12-49e524364077 |
| fa1726cf-a6b6-4e91-b31b-248342496120 | tempest-test-network--1833130200 | e1046291-1917-4e75-b31d-8dc08d39123b |
+--------------------------------------+----------------------------------------------------+--------------------------------------+
port list:
+--------------------------------------+------+-------------------+---------------------------------------------------------------------------+--------+
| ID | Name | MAC Address | Fixed IP Addresses | Status |
+--------------------------------------+------+-------------------+---------------------------------------------------------------------------+--------+
| 03c9dfd6-63fb-4c9e-8c45-77bf6134fe8f | | fa:16:3e:7a:a7:44 | ip_address='10.0.0.228', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 073691b7-1ae5-4d28-b4fd-fe07aa520bf2 | | fa:16:3e:54:c4:aa | ip_address='10.0.0.245', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | N/A |
| 08bb37a4-3650-45b5-b158-c45510c5159b | | fa:16:3e:b7:4c:47 | ip_address='10.0.0.237', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | N/A |
| 1c39f17b-4fa2-42cd-ab97-ff96fb9abdf1 | | fa:16:3e:5c:7c:b0 | ip_address='10.0.0.230', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 1ca8f42b-573d-4fd7-9c2e-55f7edfda9d8 | | fa:16:3e:88:45:b8 | ip_address='10.0.0.247', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | N/A |
| 21b67884-5f77-4c23-a7d1-a3e2694da98e | | fa:16:3e:39:e7:c5 | ip_address='10.0.0.210', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | N/A |
| 298e4990-2475-4aa9-bb88-a1f2d2277ca5 | | fa:16:3e:b2:e6:77 | ip_address='10.0.0.246', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | N/A |
| 2c53facf-24ea-40a6-bbc4-af8a5e93e9c3 | | fa:16:3e:64:9f:f1 | ip_address='10.100.0.2', subnet_id='3662fe0d-a2bb-408c-86ad-8a5348ddcb0e' | ACTIVE |
| 2d2b8a4d-82bb-4dba-8f4f-37f88ce2a4e0 | | fa:16:3e:3b:48:e5 | ip_address='10.0.0.212', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 39b16740-ee4b-4a5a-8453-89fe2f1a4030 | | fa:16:3e:cc:b4:bc | ip_address='10.0.0.220', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 473b4993-7c5e-413c-958f-629278f0f579 | | fa:16:3e:69:72:f0 | ip_address='10.0.0.243', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | N/A |
| 4a9a810c-cd6a-496b-bd1f-ee00d66b98de | | fa:16:3e:24:08:85 | ip_address='10.0.0.234', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 4bda802e-889f-4975-a82e-9fc137135bcf | | fa:16:3e:cb:e4:f2 | | DOWN |
| 4e1e0b42-f1a6-4d7c-bb2d-3951273d217b | | fa:16:3e:5d:35:90 | ip_address='10.0.0.244', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | N/A |
| 52fae1cd-5600-48e9-9fa3-9ae6ec8409e6 | | fa:16:3e:e8:02:d0 | ip_address='10.0.0.213', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 544e5ff8-04c3-4859-82ba-a5344ac31edf | | fa:16:3e:e8:a6:e5 | ip_address='10.100.0.9', subnet_id='3662fe0d-a2bb-408c-86ad-8a5348ddcb0e' | DOWN |
| 61c86bfd-704f-46f5-a918-4b764853c849 | | fa:16:3e:7d:fa:5d | ip_address='10.0.0.219', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 7370ac01-2934-4a20-b243-6e5b41b8919c | | fa:16:3e:38:ab:cc | ip_address='10.0.0.224', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 7752195a-5688-43a1-ae91-1453c2eeacb4 | | fa:16:3e:63:fb:42 | ip_address='10.0.0.216', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 77ce88ce-cfd0-4ea8-bf09-44f8afce82de | | fa:16:3e:d0:41:3f | ip_address='10.0.0.227', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 77f0f3af-778d-4f18-9897-e3ecee949182 | | fa:16:3e:d0:37:ea | ip_address='10.0.0.232', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 87a3c8c3-8aed-4e9d-9a36-6d3619039d17 | | fa:16:3e:ec:8e:8b | ip_address='10.0.0.225', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 90fcdfce-af73-496c-ad4a-a046ea76bc2e | | fa:16:3e:b4:8b:0c | ip_address='10.0.0.248', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | N/A |
| 9379f00b-4f10-462c-ac07-6677f5047e38 | | fa:16:3e:c9:40:1d | ip_address='10.0.0.223', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| 9e87cbbb-2105-4494-aed9-0d8c5dbbe9ed | | fa:16:3e:f9:09:1a | ip_address='10.0.0.215', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| b174577f-fa4d-4bc1-b093-4a8144295d17 | | fa:16:3e:bf:0e:52 | ip_address='10.0.0.226', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| b3130f6f-f7bf-4a8a-87cb-c8327ca744cd | | fa:16:3e:0e:61:32 | ip_address='10.0.0.211', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| b7787cea-a607-41a8-b5e6-eebb57931f8b | | fa:16:3e:75:ce:25 | ip_address='10.0.0.221', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| b82f0bea-c689-42dd-9c58-b93b80f9c8a5 | | fa:16:3e:03:80:48 | ip_address='10.100.0.3', subnet_id='3662fe0d-a2bb-408c-86ad-8a5348ddcb0e' | DOWN |
| b965518f-0ba9-4ef0-bd75-5d2ef2492afa | | fa:16:3e:78:07:66 | ip_address='10.0.0.231', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | N/A |
| bc971d1d-c878-4345-b962-a539a943b4f4 | | fa:16:3e:3c:df:2a | ip_address='10.0.0.229', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| bd2127a3-0f75-4792-9b21-63715062b198 | | fa:16:3e:16:f3:e6 | ip_address='10.0.0.218', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| c0881c83-5003-443b-9ffe-57ba78c7c673 | | fa:16:3e:54:5c:37 | ip_address='10.0.0.235', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| c8c4d04c-56d6-48ae-9f39-c5dcf439cf91 | | fa:16:3e:1f:55:bb | ip_address='10.0.0.236', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| cf9e808e-77c0-4d8a-a181-8483632e7fb6 | | fa:16:3e:9b:f7:8f | ip_address='10.0.0.214', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| d5666036-e21d-4c15-93ac-eaad055601c2 | | fa:16:3e:ec:ee:a4 | ip_address='10.0.0.222', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| e0e09d71-5065-4ee7-a9ab-569859a6c1ef | | fa:16:3e:a6:2c:97 | ip_address='10.100.0.1', subnet_id='3662fe0d-a2bb-408c-86ad-8a5348ddcb0e' | DOWN |
| e0eb8405-aba3-4dcd-a684-65e5e66bc129 | | fa:16:3e:3e:64:69 | ip_address='10.0.0.241', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | N/A |
| e476289d-b97e-404e-b4c0-64b18b408242 | | fa:16:3e:7c:0e:57 | ip_address='10.0.0.239', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | N/A |
| eb1e9e4c-a302-4245-acf7-9a5b53946673 | | fa:16:3e:26:4e:b5 | ip_address='10.0.0.217', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
| f18fbe2d-a91e-424d-8179-2fd93e570adb | | fa:16:3e:8f:44:29 | ip_address='10.0.0.238', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | N/A |
| f537326b-7750-4c18-b13f-dbb4eac7cd38 | | fa:16:3e:eb:05:77 | ip_address='10.100.0.5', subnet_id='3662fe0d-a2bb-408c-86ad-8a5348ddcb0e' | ACTIVE |
| f5880601-fd1f-41d0-8fd9-21c8fec66181 | | fa:16:3e:ba:ff:21 | ip_address='10.0.0.233', subnet_id='23014da5-e7ed-4641-9b13-f67ca0ce5153' | DOWN |
+--------------------------------------+------+-------------------+---------------------------------------------------------------------------+--------+
security group list:
+--------------------------------------+------------------------------------------+------------------------+----------------------------------+
| ID | Name | Description | Project |
+--------------------------------------+------------------------------------------+------------------------+----------------------------------+
| 213e4a0c-936a-4027-95e8-b6ff51657ae3 | tempest-ssh_secgrp-1330459539 | | 8269ff1bead141749f0e8369b939010f |
| 25320e85-3eb5-403c-a714-04d9963af771 | tempest-ssh_secgrp-1008443664 | | 8269ff1bead141749f0e8369b939010f |
| 29746e02-289f-4085-a475-98da7d8ffc6e | tempest-icmp_secgrp_with_cidr-811929900 | | 8269ff1bead141749f0e8369b939010f |
| 369ba076-287c-4d3a-b8b9-62c584f1e90e | default | Default security group | b5515c2099f74a4381f5c18afad2b343 |
| 3d345c7e-c188-4b2d-972b-eb4e8b78399e | default | Default security group | 7bab2d2e38c748ef82cd13e5031504d6 |
| 664cd7de-44a1-4e63-ac5c-8d9fa2bf8a59 | default | Default security group | bc4e8db665634b5dbe9e05d0d947f2d5 |
| 6b0c3b8f-7109-4bb4-982a-1a19994265bb | default | Default security group | 8269ff1bead141749f0e8369b939010f |
| 8950a55e-15c2-4b96-b7ac-2f90ca32af9a | default | Default security group | 296cf44325934083a32b1b43c24fc303 |
| a9fa293e-7e33-438c-95cb-6603faa1a443 | tempest-icmp_secgrp_with_cidr-1353478631 | | 8269ff1bead141749f0e8369b939010f |
| abec9d40-c7a8-4833-ab35-bb5d0d5cf190 | tempest-ssh_secgrp-682776431 | | 8269ff1bead141749f0e8369b939010f |
| b27df194-19a2-4cad-bc4f-b16c3bc90cb9 | default | Default security group | e1cba017e945403c938e56a579114406 |
| c17c0452-432d-4971-9371-8f3526604573 | default | Default security group | ee5d84fc239e493ab1988a9ee5af419a |
| c4d14f5d-3e6a-4548-8d4d-66ca00392bfa | tempest-ssh_secgrp-88666983 | | 8269ff1bead141749f0e8369b939010f |
| cb247c04-ded9-4c50-bf0c-4cfec032717f | default | Default security group | b905bece832c4ea4a296c5c8bde93bc0 |
| d79eb751-64df-46f5-95d7-1b7c917b5b8a | tempest-icmp_secgrp-455865266 | | 8269ff1bead141749f0e8369b939010f |
| e08a67ab-590f-4731-a113-fcd4991eb32a | default | Default security group | 7b499c9b41d84f3fa6a54ea6b605fbf6 |
| e38759a8-1779-4976-b17b-2fd371e158b7 | tempest-secgrp-1582154926 | | 8269ff1bead141749f0e8369b939010f |
| e8973e34-4290-4378-8f66-e1da33ce25ad | default | Default security group | 77bd79a2aef64adb8f995dba467366db |
| edc7f057-7fd9-446e-a619-642b954eda53 | default | Default security group | |
+--------------------------------------+------------------------------------------+------------------------+----------------------------------+
neutron version (from RPM: /usr/bin/neutron-server version 12.0.0.0b3.dev187)
ovs-cleanup: 2018-03-20 23:26:01.041 1422 INFO neutron.common.config [-] /usr/bin/neutron-ovs-cleanup version 12.0.0.0b3.dev187
I have plenty of information captured from the time of the tests being run (or even captured between individual tests were ran). It's too much to post it here but I can provide it - just need to know what's required.
In a new devstack environment(with default config), running API tests:
there are routers and security groups left.