Can not create instance - liberty - centos 7

Bug #1550449 reported by Vladislav
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Invalid
Undecided
Unassigned
python-keystoneclient
Invalid
Undecided
Unassigned

Bug Description

 Dear collegues,

I am trying to start instance.

System requirements:
cat /etc/*-release
CentOS Linux release 7.2.1511 (Core)
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"

CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"

CentOS Linux release 7.2.1511 (Core)
CentOS Linux release 7.2.1511 (Core)

nova --version
2.30.1

rpm -qa | grep openstack
openstack-packstack-7.0.0-0.10.dev1682.g42b3426.el7.noarch
python-openstackclient-1.7.2-1.el7.noarch
openstack-selinux-0.6.41-1.el7.noarch
openstack-nova-common-12.0.1-1.el7.noarch
openstack-neutron-7.0.1-1.el7.noarch
openstack-nova-novncproxy-12.0.1-1.el7.noarch
openstack-packstack-puppet-7.0.0-0.10.dev1682.g42b3426.el7.noarch
openstack-nova-compute-12.0.1-1.el7.noarch
openstack-nova-conductor-12.0.1-1.el7.noarch
openstack-nova-console-12.0.1-1.el7.noarch
openstack-neutron-linuxbridge-7.0.1-1.el7.noarch
openstack-puppet-modules-7.0.1-1.el7.noarch
openstack-neutron-ml2-7.0.1-1.el7.noarch
openstack-keystone-8.0.1-1.el7.noarch
openstack-utils-2015.2-1.el7.noarch
openstack-nova-cert-12.0.1-1.el7.noarch
openstack-nova-scheduler-12.0.1-1.el7.noarch
centos-release-openstack-liberty-1-4.el7.noarch
openstack-dashboard-8.0.0-1.el7.noarch
openstack-nova-api-12.0.1-1.el7.noarch
openstack-neutron-common-7.0.1-1.el7.noarch
openstack-glance-11.0.1-2.el7.noarch
python2-django-openstack-auth-2.0.1-1.el7.noarch

When trying to start instance through Horizon it fails with error:
Error: Failed to perform requested operation on instance "test-instance", the instance has an error status: Please try again later [Error: Build of instance baa0ef0e-83a7-442e-90f2-632a803f0e01 aborted: Could not clean up failed build, not rescheduling].

When trying to start via CLI:
nova --debug boot --flavor m1.medium --image cirros --nic net-id=256eea0b-06fe-49a0-880d-6ecc8afeff5a --security-group default --key-name vladf public-instance

In nova-compute.log I get strange errors:
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager [-] Instance failed network setup after 1 attempt(s)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager Traceback (most recent call last):
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1564, in _allocate_network_async
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager dhcp_options=dhcp_options)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 620, in allocate_for_instance
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager get_client(context, admin=True))
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 237, in get_client
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager auth_token = _ADMIN_AUTH.get_token(_SESSION)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 200, in get_token
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager return self.get_access(session).auth_token
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 240, in get_access
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager self.auth_ref = self.get_auth_ref(session)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/generic/base.py", line 184, in get_auth_ref
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager self._plugin = self._do_create_plugin(session)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/generic/base.py", line 139, in _do_create_plugin
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager authenticated=False)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager return func(*args, **kwargs)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 400, in get_discovery
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager authenticated=authenticated)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager return func(*args, **kwargs)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/_discover.py", line 142, in __init__
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager authenticated=authenticated)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager return func(*args, **kwargs)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/_discover.py", line 40, in get_version_data
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager resp = session.get(url, headers=headers, authenticated=authenticated)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 493, in get
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager return func(*args, **kwargs)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 319, in request
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager if url:
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib64/python2.7/urlparse.py", line 142, in urlparse
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager tuple = urlsplit(url, scheme, allow_fragments)
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager File "/usr/lib64/python2.7/urlparse.py", line 181, in urlsplit
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager i = url.find(':')
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager AttributeError: 'NoneType' object has no attribute 'find'
2016-02-26 14:49:04.335 12349 ERROR nova.compute.manager
2016-02-26 14:49:04.617 12349 INFO nova.virt.libvirt.driver [req-b1a25f13-fd91-4f4a-8381-c406580c904b 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] Creating image
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [req-b1a25f13-fd91-4f4a-8381-c406580c904b 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] Instance failed to spawn
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] Traceback (most recent call last):
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2155, in _build_resources
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] yield resources
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2009, in _build_and_run_instance
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] block_device_info=block_device_info)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2512, in spawn
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] write_to_disk=True)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4383, in _get_guest_xml
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] network_info_str = str(network_info)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/network/model.py", line 515, in __str__
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] return self._sync_wrapper(fn, *args, **kwargs)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/network/model.py", line 498, in _sync_wrapper
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] self.wait()
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/network/model.py", line 530, in wait
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] self[:] = self._gt.wait()
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 175, in wait
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] return self._exit_event.wait()
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/eventlet/event.py", line 125, in wait
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] current.throw(*self._exc)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 214, in main
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] result = function(*args, **kwargs)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1581, in _allocate_network_async
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] six.reraise(*exc_info)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1564, in _allocate_network_async
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] dhcp_options=dhcp_options)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 620, in allocate_for_instance
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] get_client(context, admin=True))
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 237, in get_client
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] auth_token = _ADMIN_AUTH.get_token(_SESSION)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 200, in get_token
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] return self.get_access(session).auth_token
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 240, in get_access
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] self.auth_ref = self.get_auth_ref(session)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/generic/base.py", line 184, in get_auth_ref
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] self._plugin = self._do_create_plugin(session)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/generic/base.py", line 139, in _do_create_plugin
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] authenticated=False)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] return func(*args, **kwargs)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 400, in get_discovery
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] authenticated=authenticated)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] return func(*args, **kwargs)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/_discover.py", line 142, in __init__
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] authenticated=authenticated)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] return func(*args, **kwargs)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/_discover.py", line 40, in get_version_data
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] resp = session.get(url, headers=headers, authenticated=authenticated)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 493, in get
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01]
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] return func(*args, **kwargs)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 319, in request
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] if url:
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib64/python2.7/urlparse.py", line 142, in urlparse
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] tuple = urlsplit(url, scheme, allow_fragments)
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib64/python2.7/urlparse.py", line 181, in urlsplit
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] i = url.find(':')
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] AttributeError: 'NoneType' object has no attribute 'find'
2016-02-26 14:49:05.132 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01]
2016-02-26 14:49:05.135 12349 INFO nova.compute.manager [req-b1a25f13-fd91-4f4a-8381-c406580c904b 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] Terminating instance
2016-02-26 14:49:05.139 12349 INFO nova.virt.libvirt.driver [-] [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] During wait destroy, instance disappeared.
2016-02-26 14:49:05.170 12349 INFO nova.virt.libvirt.driver [req-b1a25f13-fd91-4f4a-8381-c406580c904b 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] Deleting instance files /var/lib/nova/instances/baa0ef0e-83a7-442e-90f2-632a803f0e01_del
2016-02-26 14:49:05.171 12349 INFO nova.virt.libvirt.driver [req-b1a25f13-fd91-4f4a-8381-c406580c904b 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] Deletion of /var/lib/nova/instances/baa0ef0e-83a7-442e-90f2-632a803f0e01_del complete
2016-02-26 14:49:05.500 12349 ERROR nova.compute.manager [req-b1a25f13-fd91-4f4a-8381-c406580c904b 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] Failed to deallocate network for instance.
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [req-b1a25f13-fd91-4f4a-8381-c406580c904b 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] Build of instance baa0ef0e-83a7-442e-90f2-632a803f0e01 aborted: Could not clean up failed build, not rescheduling
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] Traceback (most recent call last):
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1905, in _do_build_and_run_instance
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] filter_properties)
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2025, in _build_and_run_instance
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] 'create.error', fault=e)
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 195, in __exit__
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] six.reraise(self.type_, self.value, self.tb)
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2009, in _build_and_run_instance
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] block_device_info=block_device_info)
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib64/python2.7/contextlib.py", line 35, in __exit__
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] self.gen.throw(type, value, traceback)
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2179, in _build_resources
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] instance_uuid=instance.uuid, reason=msg)
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] BuildAbortException: Build of instance baa0ef0e-83a7-442e-90f2-632a803f0e01 aborted: Could not clean up failed build, not rescheduling
2016-02-26 14:49:05.650 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01]
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [req-b1a25f13-fd91-4f4a-8381-c406580c904b 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] Failed to deallocate networks
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] Traceback (most recent call last):
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2184, in _cleanup_allocated_networks
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] self._deallocate_network(context, instance, requested_networks)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1810, in _deallocate_network
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] context, instance, requested_networks=requested_networks)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 835, in deallocate_for_instance
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] self._unbind_ports(context, ports_to_skip, neutron)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 406, in _unbind_ports
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] get_client(context, admin=True))
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 237, in get_client
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] auth_token = _ADMIN_AUTH.get_token(_SESSION)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 200, in get_token
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] return self.get_access(session).auth_token
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 240, in get_access
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] self.auth_ref = self.get_auth_ref(session)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/generic/base.py", line 184, in get_auth_ref
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] self._plugin = self._do_create_plugin(session)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/generic/base.py", line 139, in _do_create_plugin
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] authenticated=False)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] return func(*args, **kwargs)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 400, in get_discovery
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] authenticated=authenticated)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] return func(*args, **kwargs)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/_discover.py", line 142, in __init__
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] authenticated=authenticated)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] return func(*args, **kwargs)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/_discover.py", line 40, in get_version_data
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] resp = session.get(url, headers=headers, authenticated=authenticated)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 493, in get
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01]
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] return func(*args, **kwargs)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 319, in request
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] if url:
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib64/python2.7/urlparse.py", line 142, in urlparse
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] tuple = urlsplit(url, scheme, allow_fragments)
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] File "/usr/lib64/python2.7/urlparse.py", line 181, in urlsplit
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] i = url.find(':')
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01] AttributeError: 'NoneType' object has no attribute 'find'
2016-02-26 14:49:05.683 12349 ERROR nova.compute.manager [instance: baa0ef0e-83a7-442e-90f2-632a803f0e01]

Revision history for this message
zhangjialong (zhangjl) wrote :

It looks like there were errors in the neutron section of your nova.conf. Could you provide your configuration of neutron section in nova.conf ?

Revision history for this message
Vladislav (vladislav-falfushinsky) wrote :

cat /etc/nova/nova.conf
[DEFAULT]
rpc_backend = rabbit
auth_strategy = keystone
my_ip = 192.168.2.50
enabled_apis=osapi_compute,metadata
verbose = True
network_api_class = nova.network.neutronv2.api.API
security_group_api = neutron
linuxnet_interface_driver = nova.network.linux_net.NeutronLinuxBridgeInterfaceDriver
firewall_driver = nova.virt.firewall.NoopFirewallDriver

[database]
connection = mysql://nova:nova@controller/nova

[oslo_messaging_rabbit]
rabbit_host = 192.168.2.50
rabbit_userid = openstack
rabbit_password = openstack

[keystone_authtoken]
auth_uri = http://192.168.2.50:5000
auth_url = http://192.168.2.50:35357
auth_plugin = password
project_domain_id = default
user_domain_id = default
project_name = service
username = nova
password = nova
identity_uri=http://localhost:35357/
auth_version = 3
admin_tenant_name = service
admin_user = nova
admin_password = nova

[vnc]
vncserver_listen = $my_ip
vncserver_proxyclient_address = $my_ip
enabled = True
vncserver_listen = 0.0.0.0
vncserver_proxyclient_address = $my_ip
novncproxy_base_url = http://192.168.2.50:6080/vnc_auto.html

[glance]
host = 192.168.2.50

[oslo_concurrency]
lock_path = /var/lib/nova/tmp

[libvirt]
virt_type = qemu

[neutron]
service_metadata_proxy = True
metadata_proxy_shared_secret = e86ad70cd8b877e56603
url = http://192.168.2.50:9696
auth_url = http://192.168.2.50:35357
auth_plugin = password
project_domain_id = default
user_domain_id = default
region_name = RegionOne
project_name = service
username = neutron
password = neutron

Revision history for this message
Matt Riedemann (mriedem) wrote :

The error from the logs is:

AttributeError: 'NoneType' object has no attribute 'find'

Something failing here:

https://github.com/openstack/nova/blob/stable/liberty/nova/network/neutronv2/api.py#L237

Do you realize you have two auth_uri entries in nova.conf?

auth_uri = http://192.168.2.50:5000
auth_url = http://192.168.2.50:35357

I'm marking this as invalid since it appears to be a request for support rather than an actual bug.

Changed in nova:
status: New → Invalid
Revision history for this message
Vladislav (vladislav-falfushinsky) wrote :

The documentation states about two entries - auth_uri and auth_url . When I specify only one it fails.
Conserning the AttributeError, it seems it occures here:
"/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 319

Changed in nova:
status: Invalid → Incomplete
Revision history for this message
Sean Dague (sdague) wrote :

This is really an issue with the keystone client interaction

Changed in nova:
status: Incomplete → Invalid
Revision history for this message
Steve Martinelli (stevemar) wrote :

I agree with Matt's assessment that this looks like a support request, and based on the line of code that is raising the exception (https://github.com/openstack/python-keystoneclient/blob/stable/liberty/keystoneclient/session.py#L319) it looks like a URL is wrong somewhere in the keystone_authtoken settings.

A sample Liberty configuration can be seen here: http://logs.openstack.org/47/305347/1/check/gate-tempest-dsvm-neutron-full/50be3c3/logs/etc/nova/nova.conf.txt.gz

The identity_uri, auth_version and admin_* options can be removed.

Revision history for this message
Vladislav (vladislav-falfushinsky) wrote :

Thanks for pointing to sample configuration of nova.conf. That clears up many things.
However please look into the my section of keystone_authtoken from my nova.conf.

[keystone_authtoken]
auth_uri = http://192.168.1.1:5000
auth_url = http://192.168.1.1:35357
auth_plugin = password
project_domain_id = default
user_domain_id = default
project_name = service
username = nova
password = nova

Thanks for help!

Revision history for this message
Vladislav (vladislav-falfushinsky) wrote :
Revision history for this message
Steve Martinelli (stevemar) wrote :

That seems like a great example, are you still hitting this error. It's a basic flow that is tested in our CI and unlikely to be a bug in keystoneclient or auth.

Changed in python-keystoneclient:
status: New → Incomplete
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.