Failure of overcloud creation . Seed upstart logs show
nova-compute.log:
2014-04-03 14:03:00.632 4344 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 127.0.0.1:5672
2014-04-03 14:03:00.643 4344 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 127.0.0.1:5672
2014-04-03 14:03:01.342 4344 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 127.0.0.1:5672
2014-04-03 14:13:00.586 4344 WARNING nova.compute.manager [-] Bandwidth usage not supported by hypervisor.
2014-04-03 14:18:34.177 4344 ERROR nova.virt.baremetal.virtual_power_driver [req-9d564cb5-ad3d-4ea3-b5f7-67e0f211df73 fecb961edef04403bff9d49514bccb95 bbb3198854594a15ae94df0c5377c00c] Error running command: /usr/bin/virsh start "baremetalbrbm2_0"
2014-04-03 14:18:34.177 4344 TRACE nova.virt.baremetal.virtual_power_driver Traceback (most recent call last):
2014-04-03 14:18:34.177 4344 TRACE nova.virt.baremetal.virtual_power_driver File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/virtual_power_driver.py", line 228, in _run_command
2014-04-03 14:18:34.177 4344 TRACE nova.virt.baremetal.virtual_power_driver self._connection, cmd, check_exit_code=check_exit_code)
2014-04-03 14:18:34.177 4344 TRACE nova.virt.baremetal.virtual_power_driver File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/processutils.py", line 264, in ssh_execute
2014-04-03 14:18:34.177 4344 TRACE nova.virt.baremetal.virtual_power_driver cmd=cmd)
2014-04-03 14:18:34.177 4344 TRACE nova.virt.baremetal.virtual_power_driver ProcessExecutionError: Unexpected error while running command.
2014-04-03 14:18:34.177 4344 TRACE nova.virt.baremetal.virtual_power_driver Command: /usr/bin/virsh start "baremetalbrbm2_0"
2014-04-03 14:18:34.177 4344 TRACE nova.virt.baremetal.virtual_power_driver Exit code: 1
2014-04-03 14:18:34.177 4344 TRACE nova.virt.baremetal.virtual_power_driver Stdout: u'\n'
2014-04-03 14:18:34.177 4344 TRACE nova.virt.baremetal.virtual_power_driver Stderr: u'Calling /usr/bin/virsh start "baremetalbrbm2_0" \nerror: Failed to start domain baremetalbrbm2_0\nerror: Unable to add port vnet2 to OVS bridge brbm2: Operation not permitted\n'
2014-04-03 14:18:34.177 4344 TRACE nova.virt.baremetal.virtual_power_driver
2014-04-03 14:18:36.689 4344 ERROR nova.virt.baremetal.driver [req-9d564cb5-ad3d-4ea3-b5f7-67e0f211df73 fecb961edef04403bff9d49514bccb95 bbb3198854594a15ae94df0c5377c00c] Error deploying instance e1353c4e-6257-48cb-a0b0-9848ffc3e1e4 on baremetal node f40b0776-db79-432c-ba3f-a1a902131283.
2014-04-03 14:18:45.531 4344 ERROR nova.compute.manager [req-9d564cb5-ad3d-4ea3-b5f7-67e0f211df73 fecb961edef04403bff9d49514bccb95 bbb3198854594a15ae94df0c5377c00c] [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] Instance failed to spawn
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] Traceback (most recent call last):
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1731, in _spawn
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] block_device_info)
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/driver.py", line 245, in spawn
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] block_device_info=block_device_info)
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/driver.py", line 303, in _spawn
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] _update_state(context, node, None, baremetal_states.DELETED)
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] six.reraise(self.type_, self.value, self.tb)
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/driver.py", line 278, in _spawn
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] node)
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] File "/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/baremetal/driver.py", line 424, in power_on
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] "for instance %r") % instance['uuid'])
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] InstancePowerOnFailure: Baremetal power manager failed to start node for instance 'e1353c4e-6257-48cb-a0b0-9848ffc3e1e4'
2014-04-03 14:18:45.531 4344 TRACE nova.compute.manager [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4]
2014-04-03 14:18:45.816 4344 WARNING nova.virt.baremetal.driver [req-9d564cb5-ad3d-4ea3-b5f7-67e0f211df73 fecb961edef04403bff9d49514bccb95 bbb3198854594a15ae94df0c5377c00c] Destroy called on non-existing instance e1353c4e-6257-48cb-a0b0-9848ffc3e1e4
2014-04-03 14:18:47.947 4344 ERROR nova.compute.manager [req-9d564cb5-ad3d-4ea3-b5f7-67e0f211df73 fecb961edef04403bff9d49514bccb95 bbb3198854594a15ae94df0c5377c00c] [instance: e1353c4e-6257-48cb-a0b0-9848ffc3e1e4] Error: Baremetal power manager failed to start node for instance 'e1353c4e-6257-48cb-a0b0-9848ffc3e1e4'
Neutron-server.log shows:
2014-04-03 14:02:46.837 4022 WARNING neutron.openstack.common.db.sqlalchemy.session [-] This application has not enabled MySQL traditional mode, which means silent data corruption may occur. Please encourage the application developers to enable this mode.
2014-04-03 14:02:47.357 4022 WARNING neutron.api.extensions [-] Extension fwaas not supported by any of loaded plugins
2014-04-03 14:02:47.361 4022 WARNING neutron.api.extensions [-] Extension flavor not supported by any of loaded plugins
2014-04-03 14:02:47.379 4022 WARNING neutron.api.extensions [-] Extension lbaas_agent_scheduler not supported by any of loaded plugins
2014-04-03 14:02:47.392 4022 WARNING neutron.api.extensions [-] Extension lbaas not supported by any of loaded plugins
2014-04-03 14:02:47.396 4022 WARNING neutron.api.extensions [-] Extension metering not supported by any of loaded plugins
2014-04-03 14:02:47.403 4022 WARNING neutron.api.extensions [-] Extension port-security not supported by any of loaded plugins
2014-04-03 14:02:47.412 4022 WARNING neutron.api.extensions [-] Extension routed-service-insertion not supported by any of loaded plugins
2014-04-03 14:02:47.415 4022 WARNING neutron.api.extensions [-] Extension router-service-type not supported by any of loaded plugins
2014-04-03 14:02:47.426 4022 WARNING neutron.api.extensions [-] Extension service-type not supported by any of loaded plugins
2014-04-03 14:02:47.434 4022 WARNING neutron.api.extensions [-] Extension vpnaas not supported by any of loaded plugins
/opt/stack/venvs/neutron/local/lib/python2.7/site-packages/sqlalchemy/sql/default_comparator.py:33: SAWarning: The IN-predicate on "ports.network_id" was invoked with an empty sequence. This results in a contradiction, which nonetheless can be expensive to evaluate. Consider alternative strategies for improved performance.
return o[0](self, self.expr, op, *(other + o[1:]), **kwargs)
/opt/stack/venvs/neutron/local/lib/python2.7/site-packages/sqlalchemy/sql/default_comparator.py:33: SAWarning: The IN-predicate on "subnets.network_id" was invoked with an empty sequence. This results in a contradiction, which nonetheless can be expensive to evaluate. Consider alternative strategies for improved performance.
return o[0](self, self.expr, op, *(other + o[1:]), **kwargs)
2014-04-03 14:16:28.277 4022 WARNING neutron.plugins.ml2.managers [req-ed9ae5e3-22a4-472c-a4d5-b96084bdb68b None] Failed to bind port 736e51aa-7142-4c3f-b400-8632dbb973a0 on host seed
neutron-dhcp-agent.log shows:
2014-04-03 14:03:44.384 3863 ERROR neutron.agent.dhcp_agent [req-b6b16665-c722-4554-bbc6-eeea05088ca2 None] Failed reporting state!
2014-04-03 14:03:44.384 3863 TRACE neutron.agent.dhcp_agent Traceback (most recent call last):
2014-04-03 14:03:44.384 3863 TRACE neutron.agent.dhcp_agent File "/opt/stack/venvs/neutron/local/lib/python2.7/site-packages/neutron/agent/dhcp_agent.py", line 563, in _report_state
2014-04-03 14:03:44.384 3863 TRACE neutron.agent.dhcp_agent self.state_rpc.report_state(ctx, self.agent_state, self.use_call)
2014-04-03 14:03:44.384 3863 TRACE neutron.agent.dhcp_agent File "/opt/stack/venvs/neutron/local/lib/python2.7/site-packages/neutron/agent/rpc.py", line 72, in report_state
2014-04-03 14:03:44.384 3863 TRACE neutron.agent.dhcp_agent return self.call(context, msg, topic=self.topic)
2014-04-03 14:03:44.384 3863 TRACE neutron.agent.dhcp_agent File "/opt/stack/venvs/neutron/local/lib/python2.7/site-packages/neutron/openstack/common/rpc/proxy.py", line 129, in call
2014-04-03 14:03:44.384 3863 TRACE neutron.agent.dhcp_agent exc.info, real_topic, msg.get('method'))
2014-04-03 14:03:44.384 3863 TRACE neutron.agent.dhcp_agent Timeout: Timeout while waiting on RPC response - topic: "q-plugin", RPC method: "report_state" info: "<unknown>"
2014-04-03 14:03:44.384 3863 TRACE neutron.agent.dhcp_agent
2014-04-03 14:03:44.388 3863 WARNING neutron.openstack.common.loopingcall [-] task run outlasted interval by 30.106884 sec
Logs are here: http://