neutron net-list throws error "subnet <subnetid> could not be found

[Harish Kumar]

I have run a rally scenario on which it run

- create networks
- create number of subnets (5 per network)
- create a router per network and added interface to all subnets each
- create number of ports in the network - 15 per network or so

- then after the scenario run, it clean up them

Now I see neutron net-list throws error "Subnet fe1c1ce0-24c2-4ff1-92c5-a61897305855 could not be found (HTTP 404) (Request-ID: req-639fbb98-c622-4346-b8cb-2cec2c5e4464)".

On further investigation, I see there is no such entries in useragent table. Once I add an entry to useragent table, things work fine.

I see one bug for this issue (https://bugs.launchpad.net/juniperopenstack/+bug/1511864), but the situation explained in that bug (upgrade scenarios) has not happened here.

It is reproduceable, I will do bit more investigation and will share more info regarding this (I have to rebuild the system before I can go further as the system is down with data discrepancy because of the bug 1521853).

Logs are available here - http://10.204.216.50/Docs/bugs/1521853/ - It is the correct location, because I faced both the issues for these two bugs simultaneously.

- neutron list fail
root@harishku-vm3:/usr/lib/python2.7/dist-packages# neutron net-list
Subnet fe1c1ce0-24c2-4ff1-92c5-a61897305855 could not be found (HTTP 404) (Request-ID: req-639fbb98-c622-4346-b8cb-2cec2c5e4464)
root@harishku-vm3:/usr/lib/python2.7/dist-packages# neutron net-list
Subnet 1f19f7f4-7f02-47bc-917f-0798d0959ee1 could not be found (HTTP 404) (Request-ID: req-789cef30-8d71-471c-a738-cf957b10bc36)
root@harishku-vm3:/usr/lib/python2.7/dist-packages# neutron net-list
Subnet 587ee970-39d5-483a-8a09-c72be5f523bd could not be found (HTTP 404) (Request-ID: req-59060688-f7af-4ed9-a9c9-e1b4bc649035)
root@harishku-vm3:/usr/lib/python2.7/dist-packages# neutron net-list
Subnet ecb62fd1-543b-415a-b7c8-962563329a84 could not be found (HTTP 404) (Request-ID: req-cb869c87-eaaf-453e-8a3d-aa6c455da5c5)
root@harishku-vm3:/usr/lib/python2.7/dist-packages# neutron net-list
Subnet 9ec1367a-091e-4f3c-a903-8f4edec72725 could not be found (HTTP 404) (Request-ID: req-a6d378b7-8de7-449e-a2a6-7bfcd9f2dd03)
root@harishku-vm3:/usr/lib/python2.7/dist-packages# neutron net-list
Subnet b5836368-6c58-4f56-bb3d-a31d61c50d5f could not be found (HTTP 404) (Request-ID: req-f5dcf385-8e63-4f75-99ab-0efc6868e44d)
root@harishku-vm3:/usr/lib/python2.7/dist-packages# neutron net-list
Subnet f6b7c0db-06cb-4481-bdc6-363e1c1e1c59 could not be found (HTTP 404) (Request-ID: req-a5c57055-e2b3-4568-90ca-ad084afa341a)
root@harishku-vm3:/usr/lib/python2.7/dist-packages# neutron net-list

Every time I populate useragent table with an entry.

>>> cf.insert('cf039b89-1a0b-4163-aa7f-da94cf943d45',OrderedDict([('value', u'e636e2ca-ed6a-4c12-a45f-f777fb928988 13.2.2.0/24')]))
1448964830955521
>>> cf.insert('c242df8f-5c68-40ae-94eb-d01e75143509',OrderedDict([('value', u'01e15d63-d7ae-46e9-9c60-c6b0394c2455 13.2.3.0/24')]))
1448964842730396
>>> cf.insert('3675f7ed-c171-4a35-8167-19901a1ab3dd',OrderedDict([('value', u'2f45ee34-04d4-4796-966a-65cce53a1863 13.2.4.0/24')]))
1448964853906522
>>> cf.insert('90d77d3f-573d-4d82-9ac7-0a39781e77c8',OrderedDict([('value', u'3d90b22c-c843-4b35-86f8-f9549feeda2f 13.2.5.0/24')]))
1448964869409919
>>> cf.insert('e12a0e6a-b9e1-48ed-b254-18d4d59ad427',OrderedDict([('value', u'541aaf17-424e-48da-9878-180cda1abd26 13.2.6.0/24')]))
1448964882488414

[Harish Kumar (hkumarmk)]

root@harishku-vm3:/var/log/contrail# contrail-version
Package Version Build-ID | Repo | Package Name
-------------------------------------- ------------------------------ ----------------------------------
contrail-analytics 2.21-105 105
contrail-config 2.21-105 105
contrail-config-openstack 2.21-105 105
contrail-control 2.21-105 105
contrail-dns 2.21-105 105
contrail-f5 2.21-105 105
contrail-fabric-utils 2.21-105 105
contrail-install-packages 2.21-105~juno 105
contrail-lib 2.21-105 105
contrail-nodemgr 2.21-105 105
contrail-openstack-analytics 2.21-105 105
contrail-openstack-config 2.21-105 105
contrail-openstack-control 2.21-105 105
contrail-openstack-database 2.21-105 105
contrail-openstack-webui 2.21-105 105
contrail-setup 2.21-105 105
contrail-utils 2.21-105 105
contrail-web-controller 2.21-105 105
contrail-web-core 2.21-105 105
ifmap-python-client 0.1-2 105
ifmap-server 0.3.2-1contrail1 105
neutron-plugin-contrail 2.21-105 105
python-contrail 2.21-105 105
python-neutronclient 1:2.3.8-0ubuntu1~cloud0.2contrail105