Install and configure compute node in Neutron

Bug #1938913 reported by Dalton Cézane
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
neutron
Invalid
Undecided
Unassigned

Bug Description

After following the steps to install and configure neutron in the compute node, the nova service is not starting:

sudo service nova-compute status
● nova-compute.service - OpenStack Compute
     Loaded: loaded (/lib/systemd/system/nova-compute.service; enabled; vendor preset: enabled)
     Active: failed (Result: exit-code) since Wed 2021-08-04 12:04:06 -03; 32s ago
    Process: 71167 ExecStart=/etc/init.d/nova-compute systemd-start (code=exited, status=1/FAILURE)
   Main PID: 71167 (code=exited, status=1/FAILURE)

ago 04 12:04:06 openstack-compute systemd[1]: nova-compute.service: Scheduled restart job, restart coun>
ago 04 12:04:06 openstack-compute systemd[1]: Stopped OpenStack Compute.
ago 04 12:04:06 openstack-compute systemd[1]: nova-compute.service: Start request repeated too quickly.
ago 04 12:04:06 openstack-compute systemd[1]: nova-compute.service: Failed with result 'exit-code'.
ago 04 12:04:06 openstack-compute systemd[1]: Failed to start OpenStack Compute.

Here is the log:
2021-08-04 12:04:05.528 71167 INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
2021-08-04 12:04:05.573 71167 CRITICAL nova [req-558c7b67-0fd7-4430-882b-e1a398d4ec4c - - - - -] Unhandled error: TypeError: argument of type 'NoneType' is not iterable
2021-08-04 12:04:05.573 71167 ERROR nova Traceback (most recent call last):
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/bin/nova-compute", line 10, in <module>
2021-08-04 12:04:05.573 71167 ERROR nova sys.exit(main())
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/nova/cmd/compute.py", line 58, in main
2021-08-04 12:04:05.573 71167 ERROR nova server = service.Service.create(binary='nova-compute',
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/nova/service.py", line 252, in create
2021-08-04 12:04:05.573 71167 ERROR nova service_obj = cls(host, binary, topic, manager,
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/nova/service.py", line 115, in __init__
2021-08-04 12:04:05.573 71167 ERROR nova conductor_api.wait_until_ready(context.get_admin_context())
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/nova/conductor/api.py", line 67, in wait_until_ready
2021-08-04 12:04:05.573 71167 ERROR nova self.base_rpcapi.ping(context, '1.21 GigaWatts',
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/nova/baserpc.py", line 58, in ping
2021-08-04 12:04:05.573 71167 ERROR nova return cctxt.call(context, 'ping', arg=arg_p)
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/client.py", line 175, in call
2021-08-04 12:04:05.573 71167 ERROR nova self.transport._send(self.target, msg_ctxt, msg,
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/oslo_messaging/transport.py", line 123, in _send
2021-08-04 12:04:05.573 71167 ERROR nova return self._driver.send(target, ctxt, message,
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 680, in send
2021-08-04 12:04:05.573 71167 ERROR nova return self._send(target, ctxt, message, wait_for_reply, timeout,
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 626, in _send
2021-08-04 12:04:05.573 71167 ERROR nova msg.update({'_reply_q': self._get_reply_q()})
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 607, in _get_reply_q
2021-08-04 12:04:05.573 71167 ERROR nova conn = self._get_connection(rpc_common.PURPOSE_LISTEN)
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 597, in _get_connection
2021-08-04 12:04:05.573 71167 ERROR nova return rpc_common.ConnectionContext(self._connection_pool,
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/common.py", line 425, in __init__
2021-08-04 12:04:05.573 71167 ERROR nova self.connection = connection_pool.create(purpose)
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/pool.py", line 146, in create
2021-08-04 12:04:05.573 71167 ERROR nova return self.connection_cls(self.conf, self.url, purpose)
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 539, in __init__
2021-08-04 12:04:05.573 71167 ERROR nova transformed_urls = [
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 540, in <listcomp>
2021-08-04 12:04:05.573 71167 ERROR nova self._transform_transport_url(url, host)
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 695, in _transform_transport_url
2021-08-04 12:04:05.573 71167 ERROR nova self._parse_url_hostname(host.hostname) or default_hostname,
2021-08-04 12:04:05.573 71167 ERROR nova File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 703, in _parse_url_hostname
2021-08-04 12:04:05.573 71167 ERROR nova return '[%s]' % hostname if ':' in hostname else hostname
2021-08-04 12:04:05.573 71167 ERROR nova TypeError: argument of type 'NoneType' is not iterable
2021-08-04 12:04:05.573 71167 ERROR nova

The neutron-linuxbridge-agent service is not starting too:

sudo service neutron-linuxbridge-agent status
● neutron-linuxbridge-agent.service - Openstack Neutron Linux Bridge Agent
     Loaded: loaded (/lib/systemd/system/neutron-linuxbridge-agent.service; enabled; vendor preset: ena>
     Active: inactive (dead) since Wed 2021-08-04 12:12:10 -03; 1s ago
    Process: 71697 ExecStartPre=/bin/mkdir -p /var/lock/neutron /var/log/neutron /var/lib/neutron (code>
    Process: 71699 ExecStartPre=/bin/chown neutron:neutron /var/lock/neutron /var/log/neutron /var/lib/>
    Process: 71701 ExecStartPre=/sbin/modprobe br_netfilter (code=exited, status=0/SUCCESS)
    Process: 71704 ExecStart=/etc/init.d/neutron-linuxbridge-agent systemd-start (code=exited, status=0>
   Main PID: 71704 (code=exited, status=0/SUCCESS)

ago 04 12:12:08 openstack-compute systemd[1]: Starting Openstack Neutron Linux Bridge Agent...
ago 04 12:12:08 openstack-compute systemd[1]: Started Openstack Neutron Linux Bridge Agent.
ago 04 12:12:09 openstack-compute sudo[71720]: neutron : TTY=unknown ; PWD=/var/lib/neutron ; USER=roo>
ago 04 12:12:09 openstack-compute sudo[71720]: pam_unix(sudo:session): session opened for user root by >
ago 04 12:12:09 openstack-compute sudo[71720]: pam_unix(sudo:session): session closed for user root
ago 04 12:12:10 openstack-compute systemd[1]: neutron-linuxbridge-agent.service: Succeeded.

Can anyone please suggest what is missing to finish the correct installation of neutron/nova?

Tags: doc
description: updated
Revision history for this message
Oleg Bondarev (obondarev) wrote :

From the log it's absolutely impossible to figure out what's wrong. Anyway it's definitely not a Neutron issue

Changed in neutron:
status: New → Invalid
Revision history for this message
Dalton Cézane (daltoncezane) wrote :

So, if it is impossible to figure out what is wrong, maybe there is also a problem with the logs... maybe the services should log helpful messages...

if following all the instructions of the documentation does not help and seeing the log does not help, what should we do to get success in the openstack installation process? Just pray?

Revision history for this message
Oleg Bondarev (obondarev) wrote :

Sorry, I wrote a comment before you updated bug description with nova logs. Please file the bug to the correct project: nova

Revision history for this message
Dalton Cézane (daltoncezane) wrote :
Download full text (14.4 KiB)

No problem, Oleg. I do not know if this is the right place to put these problems, but I am just following the tutorial and clicking in the "bug" button of the pages when I find a problem.
The fact is the neutron installation in the compute node is also with problem.

sudo service neutron-linuxbridge-agent status
● neutron-linuxbridge-agent.service - Openstack Neutron Linux Bridge Agent
     Loaded: loaded (/lib/systemd/system/neutron-linuxbridge-agent.service; enabled; vendor preset: ena>
     Active: inactive (dead) since Wed 2021-08-04 12:12:10 -03; 1s ago
    Process: 71697 ExecStartPre=/bin/mkdir -p /var/lock/neutron /var/log/neutron /var/lib/neutron (code>
    Process: 71699 ExecStartPre=/bin/chown neutron:neutron /var/lock/neutron /var/log/neutron /var/lib/>
    Process: 71701 ExecStartPre=/sbin/modprobe br_netfilter (code=exited, status=0/SUCCESS)
    Process: 71704 ExecStart=/etc/init.d/neutron-linuxbridge-agent systemd-start (code=exited, status=0>
   Main PID: 71704 (code=exited, status=0/SUCCESS)

ago 04 12:12:08 openstack-compute systemd[1]: Starting Openstack Neutron Linux Bridge Agent...
ago 04 12:12:08 openstack-compute systemd[1]: Started Openstack Neutron Linux Bridge Agent.
ago 04 12:12:09 openstack-compute sudo[71720]: neutron : TTY=unknown ; PWD=/var/lib/neutron ; USER=roo>
ago 04 12:12:09 openstack-compute sudo[71720]: pam_unix(sudo:session): session opened for user root by >
ago 04 12:12:09 openstack-compute sudo[71720]: pam_unix(sudo:session): session closed for user root
ago 04 12:12:10 openstack-compute systemd[1]: neutron-linuxbridge-agent.service: Succeeded.

Here is the log:

2021-08-04 12:12:09.262 71704 INFO neutron.common.config [-] Logging enabled!
2021-08-04 12:12:09.263 71704 INFO neutron.common.config [-] /usr/bin/neutron-linuxbridge-agent version 18.0.0
2021-08-04 12:12:09.263 71704 INFO neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent [-] Interface mappings: {'provider': 'enp0s31f6'}
2021-08-04 12:12:09.263 71704 INFO neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent [-] Bridge mappings: {}
2021-08-04 12:12:09.264 71704 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/linuxbridge_agent.ini', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmplov2mv5i/privsep.sock']
2021-08-04 12:12:09.713 71704 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap
2021-08-04 12:12:09.647 71727 INFO oslo.privsep.daemon [-] privsep daemon starting
2021-08-04 12:12:09.650 71727 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
2021-08-04 12:12:09.651 71727 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/none
2021-08-04 12:12:09.651 71727 INFO oslo.privsep.daemon [-] privsep daemon running as pid 71727
2021-08-04 12:12:10.012 71704 INFO neutron...

Revision history for this message
Oleg Bondarev (obondarev) wrote :

"neutron-linuxbridge-agent.service: Succeeded"

From logs there's no issue with LB agent

Revision history for this message
Dalton Cézane (daltoncezane) wrote :

Hello, Oleg. The status is "inactive (dead)".

neutron-linuxbridge-agent.service - Openstack Neutron Linux Bridge Agent
     Loaded: loaded (/lib/systemd/system/neutron-linuxbridge-agent.service; enabled; vendor preset: ena>
     Active: inactive (dead) since Wed 2021-08-04 12:12:10 -03; 1s ago
    Process: 71697 ExecStartPre=/bin/mkdir -p /var/lock/neutron /var/log/neutron /var/lib/neutron (code>

I think the information should be something like:
Active: active (running) since...

As it is listed for other services running with no problems...

Besides, if the service was running ok, I think the log file would not have errors.

Revision history for this message
Oleg Bondarev (obondarev) wrote :

Which linuxbridge agent ERROR logs are you referring to?

Revision history for this message
Dalton Cézane (daltoncezane) wrote :
Download full text (12.9 KiB)

Here is the neutron-linuxbridge-agent.log:

2021-08-04 12:12:09.262 71704 INFO neutron.common.config [-] Logging enabled!
2021-08-04 12:12:09.263 71704 INFO neutron.common.config [-] /usr/bin/neutron-linuxbridge-agent version 18.0.0
2021-08-04 12:12:09.263 71704 INFO neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent [-] Interface mappings: {'provider': 'enp0s31f6'}
2021-08-04 12:12:09.263 71704 INFO neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent [-] Bridge mappings: {}
2021-08-04 12:12:09.264 71704 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/linuxbridge_agent.ini', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmplov2mv5i/privsep.sock']
2021-08-04 12:12:09.713 71704 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap
2021-08-04 12:12:09.647 71727 INFO oslo.privsep.daemon [-] privsep daemon starting
2021-08-04 12:12:09.650 71727 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
2021-08-04 12:12:09.651 71727 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/none
2021-08-04 12:12:09.651 71727 INFO oslo.privsep.daemon [-] privsep daemon running as pid 71727
2021-08-04 12:12:10.012 71704 INFO neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent [-] Agent initialized successfully, now running...
2021-08-04 12:12:10.335 71704 INFO neutron.plugins.ml2.drivers.agent._common_agent [req-1ea44360-a686-461b-a814-e0523c60ed88 - - - - -] RPC agent_id: lbe0d55ef1eb5b
2021-08-04 12:12:10.339 71704 INFO neutron.agent.agent_extensions_manager [req-1ea44360-a686-461b-a814-e0523c60ed88 - - - - -] Loaded agent extensions: []
2021-08-04 12:12:10.340 71704 ERROR neutron_lib.callbacks.manager [req-1ea44360-a686-461b-a814-e0523c60ed88 - - - - -] Error during notification for neutron.services.trunk.drivers.linuxbridge.agent.driver.init_handler-8744244208806 Linux bridge agent, after_init: TypeError: argument of type 'NoneType' is not iterable
2021-08-04 12:12:10.340 71704 ERROR neutron_lib.callbacks.manager Traceback (most recent call last):
2021-08-04 12:12:10.340 71704 ERROR neutron_lib.callbacks.manager File "/usr/lib/python3/dist-packages/neutron_lib/callbacks/manager.py", line 197, in _notify_loop
2021-08-04 12:12:10.340 71704 ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, **kwargs)
2021-08-04 12:12:10.340 71704 ERROR neutron_lib.callbacks.manager File "/usr/lib/python3/dist-packages/neutron/services/trunk/drivers/linuxbridge/agent/driver.py", line 32, in init_handler
2021-08-04 12:12:10.340 71704 ERROR neutron_lib.callbacks.manager LinuxBridgeTrunkDriver()
2021-08-04 12:12:10.340 71704 ERROR neutron_lib.callbacks.manager File "/usr/lib/python3/dist-packages/neutron/services/trunk/drivers/linuxbridge/agent/driver.py",...

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.