OpenStack Compute (nova)

Failed to publish message to topic 'nova': 'NoneType' object has no attribute '__getitem__'

Bug #1802041 reported by Muhammad Hanif
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Invalid
Undecided
Unassigned

Bug Description

Hello, I am an OpenStack user. I have problem when I launched an instance via horizon, I got a notification:

Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. <class 'oslo_messaging.exceptions.MessageDeliveryFailure'> (HTTP 500) (Request-ID: req-d5a176bf-4d55-4b07-b405-c5eeb8080b77)

Nova API Log:

2018-11-07 10:33:56.795 10976 ERROR oslo.messaging._drivers.impl_rabbit [req-d5a176bf-4d55-4b07-b405-c5eeb8080b77 5fd9267fddb54b638b2129db881353dc b35ae77fe5724f829dd01e0488ca8bc5 - default default] Failed to publish message to topic 'nova': 'NoneType' object has no attribute '__getitem__'
2018-11-07 10:33:56.796 10976 ERROR oslo.messaging._drivers.impl_rabbit [req-d5a176bf-4d55-4b07-b405-c5eeb8080b77 5fd9267fddb54b638b2129db881353dc b35ae77fe5724f829dd01e0488ca8bc5 - default default] Unable to connect to AMQP server on 172.28.0.12:5672 after None tries: 'NoneType' object has no attribute '__getitem__'
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi [req-d5a176bf-4d55-4b07-b405-c5eeb8080b77 5fd9267fddb54b638b2129db881353dc b35ae77fe5724f829dd01e0488ca8bc5 - default default] Unexpected exception in API method: MessageDeliveryFailure: Unable to connect to AMQP server on 172.28.0.12:5672 after None tries: 'NoneType' object has no attribute '__getitem__'
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi Traceback (most recent call last):
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py", line 788, in wrapped
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi return f(*args, **kwargs)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 554, in create
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi **create_kwargs)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi rv = f(*args, **kwargs)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1649, in create
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi tags=tags, supports_multiattach=supports_multiattach)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1180, in _create_instance
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi tags=tags)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/conductor/api.py", line 136, in schedule_and_build_instances
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi block_device_mapping, tags)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/nova/conductor/rpcapi.py", line 400, in schedule_and_build_instances
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi cctxt.cast(context, 'schedule_and_build_instances', **kw)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 152, in cast
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi self.transport._send(self.target, msg_ctxt, msg, retry=self.retry)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 131, in _send
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi timeout=timeout, retry=retry)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in send
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi retry=retry)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 545, in _send
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi msg=msg, timeout=timeout, retry=retry)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1272, in topic_send
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi retry=retry)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1155, in _ensure_publishing
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi self.ensure(method, retry=retry, error_callback=_error_callback)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi raise exceptions.MessageDeliveryFailure(msg)
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi MessageDeliveryFailure: Unable to connect to AMQP server on 172.28.0.12:5672 after None tries: 'NoneType' object has no attribute '__getitem__'
2018-11-07 10:33:56.797 10976 ERROR nova.api.openstack.wsgi
2018-11-07 10:33:56.799 10976 INFO nova.api.openstack.wsgi [req-d5a176bf-4d55-4b07-b405-c5eeb8080b77 5fd9267fddb54b638b2129db881353dc b35ae77fe5724f829dd01e0488ca8bc5 - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_messaging.exceptions.MessageDeliveryFailure'>

Environment:
- CentOS 7
- OpenStack Queens
- Nova 17.0.5

I don't know how to solve it. I am looking forward to being instructed. Thank you.

Tags: nova
Revision history for this message
Muhammad Hanif (muhammadhanif) wrote :
Revision history for this message
Chason Chan (chen-xing) wrote :

Hi Muhammad, thanks for you report. From your log, it said, Unable to connect to AMQP server on 172.28.0.12:5672. Please check your rabbitmq service is running and your firewall accepts the 5672 port.

Revision history for this message
Matt Riedemann (mriedem) wrote :

Hmm, nova-api is failing to RPC cast to the nova-conductor service. What is the value of the [conductor]/topic configuration option in nova.conf? It should be 'conductor'. Do you have it set to 'nova'?

https://docs.openstack.org/nova/queens/configuration/config.html#conductor.topic

Otherwise yeah check the rabbitmq server and configured transport_urls.

https://docs.openstack.org/nova/queens/configuration/config.html#DEFAULT.transport_url

Changed in nova:
status: New → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Bug attachments

Remote bug watches

Bug watches keep track of this bug in other bug trackers.