instance failed network setup

[ali mirzaei]

I set up open stack on 2 ubuntu vm. when i want to create a new instance its cant connect to neutron and in nova-compute logs show bellow logs:

2021-07-01 02:15:08.398 83631 INFO nova.compute.claims [req-830e0a7f-5a50-448c-a186-f082962c3c86 91704884e43f48fcbd156b8d7429fc3e 5e055db0a5464dc1997ab0f456792271 - default default] [instance: 3316f595-0e20-4914-90a2-c00da68c82ec] Claim successful on node compute
2021-07-01 02:15:12.006 83631 INFO nova.virt.libvirt.driver [req-830e0a7f-5a50-448c-a186-f082962c3c86 91704884e43f48fcbd156b8d7429fc3e 5e055db0a5464dc1997ab0f456792271 - default default] [instance: 3316f595-0e20-4914-90a2-c00da68c82ec] Creating image
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager [req-830e0a7f-5a50-448c-a186-f082962c3c86 91704884e43f48fcbd156b8d7429fc3e 5e055db0a5464dc1997ab0f456792271 - default default] Instance failed network setup after 1 attempt(s): keystoneauth1.exceptions.connection.ConnectFailure: Unable to establish connection to http://localhost:9696/v2.0/networks?id=163f0b54-e337-40ac-81af-958c24ceeb7f: HTTPConnectionPool(host='localhost', port=9696): Max retries exceeded with url: /v2.0/networks?id=163f0b54-e337-40ac-81af-958c24ceeb7f (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f248453c850>: Failed to establish a new connection: [Errno 111] ECONNREFUSED'))
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager Traceback (most recent call last):
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 159, in _new_conn
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager conn = connection.create_connection(
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 84, in create_connection
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager raise err
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 74, in create_connection
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager sock.connect(sa)
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3/dist-packages/eventlet/greenio/base.py", line 253, in connect
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager socket_checkerr(fd)
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3/dist-packages/eventlet/greenio/base.py", line 51, in socket_checkerr
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager raise socket.error(err, errno.errorcode[err])
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager ConnectionRefusedError: [Errno 111] ECONNREFUSED
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager During handling of the above exception, another exception occurred:
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager Traceback (most recent call last):
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager httplib_response = self._make_request(
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 387, in _make_request
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager conn.request(method, url, **httplib_request_kw)
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3.8/http/client.py", line 1255, in request
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager self._send_request(method, url, body, headers, encode_chunked)
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3.8/http/client.py", line 1301, in _send_request
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager self.endheaders(body, encode_chunked=encode_chunked)
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3.8/http/client.py", line 1250, in endheaders
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager self._send_output(message_body, encode_chunked=encode_chunked)
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3.8/http/client.py", line 1010, in _send_output
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager self.send(msg)
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3.8/http/client.py", line 950, in send
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager self.connect()
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 187, in connect
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager conn = self._new_conn()
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 171, in _new_conn
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager raise NewConnectionError(
2021-07-01 02:15:14.264 83631 ERROR nova.compute.manager urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f2484547220>: Failed to establish a new connection: [Errno 111] ECONNREFUSED

[ali mirzaei (alikm)]

Also, when i check neutron-openvswitch status in my compute node, show this:

ovs|00002|db_ctl_base|ERR|multiple rows in Manager match "ptcp:6640:127.0.0.1"

is it related to my main problem?

[ali mirzaei (alikm)]

Also, in my neutron-dhcp status of controller node, show this:

Jul 01 03:04:09 controller dnsmasq-dhcp[133653]: DHCPDISCOVER(tapa8bc8e34-a1) 08:00:27:42:5c:09 no address available

is it related to my main problem?!

[Balazs Gibizer (balazs-gibizer)]

The nova stack trace shows that your nova-compute service cannot connect to neutron on the URL http://localhost:9696/v2.0/networks?id=163f0b54-e337-40ac-81af-958c24ceeb7f . Did you verified that neutron API is available on that URL?

From this limited information I suspect that you have a configuration / deployment issues. I'm setting the nova part of the bug Invalid as it does not seems to be a nova bug itself.

About the neutron related questions I added the neutron project to the bug.

[Bence Romsics (bence-romsics)]

As gibi said above, this is unlikely to be either a nova or a neutron problem, but more likely a deployment problem. I don't believe the various neutron log lines quoted have anything to do with the root cause.

To help with the debugging:

What deployment software did you use?
Are you using devstack - since you said you deployed into vms?
How was the deployment software configured?
Did the deployment complete successfully?
Is neutron-server running?
Is neutron-server actually available at the address nova tries to connect to?
From both hosts?
Since you mentioned that you used 2 vms, did the error message come from the same host where the controller components are running? If not then the http://localhost:9696/... url is definitely wrong.