Cannot create instance in horizon: No valid host was found

[Vladimir]

Fuel 9.0 ISO #157.
Steps to reproduce:

    1. Create new env
    2. Add 1 controller and 1 compute node
    3. Deploy changes.
    4. Login to horizon
    5. Create instance.

Expected result:
    Instance created successfully
Actual result;
    Created instance in Error state:

Message
    No valid host was found. There are not enough hosts available.
Code
    500
Details
    File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 392, in build_instances context, request_spec, filter_properties) File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 436, in _schedule_instances hosts = self.scheduler_client.select_destinations(context, spec_obj) File "/usr/lib/python2.7/dist-packages/nova/scheduler/utils.py", line 372, in wrapped return func(*args, **kwargs) File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/__init__.py", line 51, in select_destinations return self.queryclient.select_destinations(context, spec_obj) File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/__init__.py", line 37, in __run_method return getattr(self.instance, __name)(*args, **kwargs) File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/query.py", line 32, in select_destinations return self.scheduler_rpcapi.select_destinations(context, spec_obj) File "/usr/lib/python2.7/dist-packages/nova/scheduler/rpcapi.py", line 121, in select_destinations return cctxt.call(ctxt, 'select_destinations', **msg_args) File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call retry=self.retry) File "/usr/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send timeout=timeout, retry=retry) File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 470, in send retry=retry) File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 461, in _send raise result

Diagnostic snapshot in attachment.

[Michael Polenchuk (mpolenchuk)]

The reason is compute node hasn't been registered in nova (nova-compute: ERROR oslo.messaging._drivers.impl_rabbit AMQP server on 10.109.1.4:5673 is unreachable: [Errno 113] EHOSTUNREACH)
The same for neutron agent.
Look like temporary network issue: (10.109.1.4) at <incomplete> on br-mgmt

[Peter Zhurba (pzhurba)]

It could't be reproduced. On following configuration:

iso Fuel 9.0 ISO #157 deployed by dos.py

1 controller+cinder + 1 compute cluster. Setting by default.

Provided logs allow to suspect network failure on lab host or misconfiguration of cloud network