OperationalError:'SAVEPOINT sa_savepoint_1 does not exist' during Rally boot_and_delete_server_with_secgroups

[Ann Taraday]

Scale environment 45 compute node, 3 controller, Mitaka. During execution of Rally test boot_and_delete_server_with_secgroups error appeared in logs

2016-07-03 08:05:02.314 21792 INFO neutron.plugins.ml2.db [req-0d9d3031-0698-4a24-9ce0-4c886d641c91 ea3ede1f05e348e7853e9f
42c9426830 dc754a03f8de4b468396f8bc3d4a94ee - - -] Added segment af70f885-39df-4c2b-adfc-225d81c8c03c of type vxlan for ne
twork 967af409-e2f4-418a-8919-a7e4a2133996
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource [req-1e786fea-0a7b-4613-9914-bda50be6028e d044072ee7c447bb922d
778565b329e2 715ca0f3f5a74733a49133c4d2202939 - - -] create failed
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource Traceback (most recent call last):
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/resour
ce.py", line 84, in resource
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource result = method(request=request, **args)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p
y", line 410, in create
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return self._create(request, body, **kwargs)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_db/api.py", line
 148, in wrapper
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.p
y", line 220, in __exit__
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.force_reraise()
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.p
y", line 196, in force_reraise
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_db/api.py", line
 138, in wrapper
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return f(*args, **kwargs)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p
y", line 521, in _create
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource obj = do_create(body)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p
y", line 503, in do_create
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource request.context, reservation.reservation_id)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.p
y", line 220, in __exit__
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.force_reraise()
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.p
y", line 196, in force_reraise
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.p
y", line 496, in do_create
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return obj_creator(request.context, **kwargs)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/p
lugin.py", line 696, in create_network
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource result, mech_context = self._create_network_db(context, ne
twork)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/p
lugin.py", line 659, in _create_network_db
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self._ensure_default_security_group(context, tenant_id)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/db/securitygr
oups_db.py", line 709, in _ensure_default_security_group

2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return self._create_default_security_group(context, tenant
_id)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/db/securitygr
oups_db.py", line 720, in _create_default_security_group
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource context, security_group, default_sg=True)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/db/securitygr
oups_db.py", line 189, in create_security_group
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource **kwargs)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/contextlib.py", line 24, in __exit_
_
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.gen.next()
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/neutron/db/api.py", l
ine 89, in autonested_transaction
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource yield tx
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/sessio
n.py", line 490, in __exit__
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.rollback()
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/langh
elpers.py", line 70, in __exit__
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource compat.reraise(type_, value, traceback)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/sessio
n.py", line 490, in __exit__
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.rollback()

e.py", line 1563, in rollback
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self._do_rollback()
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas
e.py", line 1625, in _do_rollback
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self._savepoint, self._parent)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas
e.py", line 717, in _rollback_to_savepoint_impl
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.engine.dialect.do_rollback_to_savepoint(self, name)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/def
ault.py", line 441, in do_rollback_to_savepoint
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource connection.execute(expression.RollbackToSavepointClause(na
me))
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas
e.py", line 914, in execute
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return meth(self, multiparams, params)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elemen
ts.py", line 323, in _execute_on_connection
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource return connection._execute_clauseelement(self, multiparams
, params)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource compiled_sql, distilled_params
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas
e.py", line 1146, in _execute_context
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource context)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas
e.py", line 1337, in _handle_dbapi_exception
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource util.raise_from_cause(newraise, exc_info)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compa
t.py", line 200, in raise_from_cause
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource reraise(type(exception), exception, tb=exc_tb, cause=cause
)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/bas
e.py", line 1139, in _execute_context
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource context)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/def
ault.py", line 450, in do_execute
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource cursor.execute(statement, parameters)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/MySQLdb/cursors.py", line 219, in execute
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource self.errorhandler(self, exc, value)
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 38, in defaulterrorhandler
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource raise errorvalue
2016-07-03 08:05:02.316 21787 ERROR neutron.api.v2.resource OperationalError: (_mysql_exceptions.OperationalError) (1305, 'SAVEPOINT sa_savepoint_1 does not exist') [SQL: u'ROLLBACK TO SAVEPOINT sa_savepoint_1']

[Ihar Hrachyshka (ihar-hrachyshka)]

I see you use MySQLdb. Probably wise to check with pymysql since it's the driver used in gate.