2015-02-02 01:20:37.756 6815 CRITICAL cinder [req-7b1344bc-879c-4576-abab-be40294edc2f - - - - -] NoSuchColumnError: "Could not locate column in row for column '%(140070887032400 anon)s.volumes_id'"
2015-02-02 01:20:37.756 6815 TRACE cinder Traceback (most recent call last):
2015-02-02 01:20:37.756 6815 TRACE cinder File "/usr/local/bin/cinder-volume", line 9, in <module>
2015-02-02 01:20:37.756 6815 TRACE cinder load_entry_point('cinder==2015.1.dev310', 'console_scripts', 'cinder-volume')()
2015-02-02 01:20:37.756 6815 TRACE cinder File "/opt/stack/new/cinder/cinder/cmd/volume.py", line 69, in main
2015-02-02 01:20:37.756 6815 TRACE cinder binary='cinder-volume')
2015-02-02 01:20:37.756 6815 TRACE cinder File "/opt/stack/new/cinder/cinder/service.py", line 243, in create
2015-02-02 01:20:37.756 6815 TRACE cinder service_name=service_name)
2015-02-02 01:20:37.756 6815 TRACE cinder File "/opt/stack/new/cinder/cinder/service.py", line 127, in __init__
2015-02-02 01:20:37.756 6815 TRACE cinder *args, **kwargs)
2015-02-02 01:20:37.756 6815 TRACE cinder File "/opt/stack/new/cinder/cinder/volume/manager.py", line 188, in __init__
2015-02-02 01:20:37.756 6815 TRACE cinder context.get_admin_context())
2015-02-02 01:20:37.756 6815 TRACE cinder File "/opt/stack/new/cinder/cinder/volume/manager.py", line 262, in _set_voldb_empty_at_startup_indicator
2015-02-02 01:20:37.756 6815 TRACE cinder None, filters=None)
2015-02-02 01:20:37.756 6815 TRACE cinder File "/opt/stack/new/cinder/cinder/db/api.py", line 199, in volume_get_all
2015-02-02 01:20:37.756 6815 TRACE cinder filters=filters)
2015-02-02 01:20:37.756 6815 TRACE cinder File "/opt/stack/new/cinder/cinder/db/sqlalchemy/api.py", line 156, in wrapper
2015-02-02 01:20:37.756 6815 TRACE cinder return f(*args, **kwargs)
2015-02-02 01:20:37.756 6815 TRACE cinder File "/opt/stack/new/cinder/cinder/db/sqlalchemy/api.py", line 1207, in volume_get_all
2015-02-02 01:20:37.756 6815 TRACE cinder return query.all()
2015-02-02 01:20:37.756 6815 TRACE cinder File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2320, in all
2015-02-02 01:20:37.756 6815 TRACE cinder return list(self)
2015-02-02 01:20:37.756 6815 TRACE cinder File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/loading.py", line 73, in instances
2015-02-02 01:20:37.756 6815 TRACE cinder rows = [process[0](row, None) for row in fetch]
2015-02-02 01:20:37.756 6815 TRACE cinder File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/loading.py", line 363, in _instance
2015-02-02 01:20:37.756 6815 TRACE cinder tuple([row[column] for column in pk_cols])
2015-02-02 01:20:37.756 6815 TRACE cinder File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/result.py", line 331, in _key_fallback
2015-02-02 01:20:37.756 6815 TRACE cinder expression._string_or_unprintable(key))
2015-02-02 01:20:37.756 6815 TRACE cinder NoSuchColumnError: "Could not locate column in row for column '%(140070887032400 anon)s.volumes_id'"
2015-02-02 01:20:37.756 6815 TRACE cinder
detailed log can be found at http://publiclogs.emc.com/vnx_ostack/EMC_VNX_ISCSI/493/logs/screen-c-vol.txt.gz
# pip list|grep -i mysql-python
MySQL-python (1.2.5)
# pip list|grep cinder
cinder (2015.1.dev310, /opt/stack/new/cinder)
can i get any insight as to under what circumstances this occurs, how often, what would be the best way for me to reproduce, and in an ideal world either/or of a SQL log or what specific version this started happening ? thanks.