overcloud met a neutron error when creating an instance

[Haiwei Xu]

when running devtest.sh, the script seems to run successfully, and when ssh the controller node, the 'demo' instance has been created, but I found this error in the neutron-server.log

2014-05-26 05:25:14.318 7085 WARNING neutron.api.extensions [-] Extension fwaas not supported by any of loaded plugins
2014-05-26 05:25:14.328 7085 WARNING neutron.api.extensions [-] Extension flavor not supported by any of loaded plugins
2014-05-26 05:25:14.386 7085 WARNING neutron.api.extensions [-] Extension lbaas_agent_scheduler not supported by any of loaded plugins
2014-05-26 05:25:14.404 7085 WARNING neutron.api.extensions [-] Extension lbaas not supported by any of loaded plugins
2014-05-26 05:25:14.409 7085 WARNING neutron.api.extensions [-] Extension metering not supported by any of loaded plugins
2014-05-26 05:25:14.433 7085 WARNING neutron.api.extensions [-] Extension port-security not supported by any of loaded plugins
2014-05-26 05:25:14.458 7085 WARNING neutron.api.extensions [-] Extension routed-service-insertion not supported by any of loaded plugins
2014-05-26 05:25:14.475 7085 WARNING neutron.api.extensions [-] Extension router-service-type not supported by any of loaded plugins
2014-05-26 05:25:14.504 7085 WARNING neutron.api.extensions [-] Extension service-type not supported by any of loaded plugins
2014-05-26 05:25:14.525 7085 WARNING neutron.api.extensions [-] Extension vpnaas not supported by any of loaded plugins
2014-05-26 05:25:14.628 7085 WARNING keystoneclient.middleware.auth_token [-] Configuring admin URI using auth fragments. This is deprecated, use 'identity_uri' instead.
/opt/stack/venvs/openstack/local/lib/python2.7/site-packages/sqlalchemy/sql/default_comparator.py:33: SAWarning: The IN-predicate on "ports.network_id" was invoked with an empty sequence. This results in a contradiction, which nonetheless can be expensive to evaluate. Consider alternative strategies for improved performance.
  return o[0](self, self.expr, op, *(other + o[1:]), **kwargs)
/opt/stack/venvs/openstack/local/lib/python2.7/site-packages/sqlalchemy/sql/default_comparator.py:33: SAWarning: The IN-predicate on "subnets.network_id" was invoked with an empty sequence. This results in a contradiction, which nonetheless can be expensive to evaluate. Consider alternative strategies for improved performance.
  return o[0](self, self.expr, op, *(other + o[1:]), **kwargs)
2014-05-26 05:28:09.441 7085 ERROR neutron.notifiers.nova [-] Failed to notify nova on events: [{'name': 'network-changed', 'server_uuid': u'54c7de9c-7114-4b6a-b965-629afb17e377'}]
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova Traceback (most recent call last):
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova File "/opt/stack/venvs/openstack/local/lib/python2.7/site-packages/neutron/notifiers/nova.py", line 224, in send_events
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova batched_events)
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/v1_1/contrib/server_external_events.py", line 39, in create
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova return_raw=True)
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/base.py", line 152, in _create
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova _resp, body = self.api.client.post(url, body=body)
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 314, in post
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova return self._cs_request(url, 'POST', **kwargs)
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 297, in _cs_request
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova self.authenticate()
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 410, in authenticate
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova auth_url = self._v2_auth(auth_url)
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 501, in _v2_auth
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova return self._authenticate(url, body)
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 514, in _authenticate
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova **kwargs)
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 270, in _time_request
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova resp, body = self.request(url, method, **kwargs)
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 264, in request
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova raise exceptions.from_response(resp, body, url, method)
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova BadRequest: object of type 'NoneType' has no len() (HTTP 400)
2014-05-26 05:28:09.441 7085 TRACE neutron.notifiers.nova
2014-05-26 05:28:35.515 7085 ERROR neutron.notifiers.nova [-] Failed to notify nova on events: [{'status': 'completed', 'tag': u'3b3c9150-62b8-42bb-b18f-04393d9efc84', 'name': 'network-vif-plugged', 'server_uuid': u'54c7de9c-7114-4b6a-b965-629afb17e377'}]
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova Traceback (most recent call last):
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova File "/opt/stack/venvs/openstack/local/lib/python2.7/site-packages/neutron/notifiers/nova.py", line 224, in send_events
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova batched_events)
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/v1_1/contrib/server_external_events.py", line 39, in create
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova return_raw=True)
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/base.py", line 152, in _create
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova _resp, body = self.api.client.post(url, body=body)
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 314, in post
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova return self._cs_request(url, 'POST', **kwargs)
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 297, in _cs_request
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova self.authenticate()
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 410, in authenticate
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova auth_url = self._v2_auth(auth_url)
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 501, in _v2_auth
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova return self._authenticate(url, body)
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 514, in _authenticate
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova **kwargs)
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 270, in _time_request
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova resp, body = self.request(url, method, **kwargs)
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova File "/opt/stack/python-novaclient/novaclient/client.py", line 264, in request
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova raise exceptions.from_response(resp, body, url, method)
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova BadRequest: object of type 'NoneType' has no len() (HTTP 400)
2014-05-26 05:28:35.515 7085 TRACE neutron.notifiers.nova

[James Polley (tchaypo)]

I can confirm that in my overcloud, the demo VM doesn't get built. However, I believe the neutron/nova errors here are a red herring.

The demo VM should be built by this section of the _overcloud script:

    ## #. So that you can deploy a VM.
    ## ::

        nova boot --key-name default --flavor m1.tiny --image user demo

but when I run that by hand, I get an error:

    root@overcloud-controller0-qdbt5hpvyxo5:~# nova boot --key-name default --flavor m1.tiny --image user demo
    ERROR (BadRequest): Multiple possible networks found, use a Network ID to be more specific. (HTTP 400) (Request-ID: req-6d2ec9b6-10fc-4496-b23c-744e0c140f15)

It looks to me as though the error is that our nova boot commandline is incomplete.

[Derek Higgins (derekh)]

The error log pasted is the result of our temperary work around for
https://bugs.launchpad.net/tripleo/+bug/1293782

@James the Multiple networks error is because the nova boot was issued as the admin user (admin sees more then just one network), devtest runs that nova boot as the demo user

So this can be close as a duplicate of bug 1293782