I have not been able to reproduce this with devstack master/queens using the suggestions in comment #3. I've tried both approaches multiple times, but can't find any deadlock errors.
I've been looking in the q-svc log for such errors; should I be looking elsewhere or is there something I'm missing?
What I do find is the following error in q-svc log:
--------
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters [None req-760dc216-6348-4ff7-8d47-fa59b3fba3b5 None None] DBAPIError exception wrapped from (pymysql.err.InternalError) (1305, u'SAVEPOINT sa_savepoint_11 does not exist') [SQL: u'ROLLBACK TO SAVEPOINT sa_savepoint_11'] (Background on this error at: http://sqlalche.me/e/2j85): InternalError: (1305, u'SAVEPOINT sa_savepoint_11 does not exist')
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1193, in _execute_context
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters context)
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 507, in do_execute
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters cursor.execute(statement, parameters)
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters File "/usr/local/lib/python2.7/dist-packages/pymysql/cursors.py", line 165, in execute
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters result = self._query(query)
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters File "/usr/local/lib/python2.7/dist-packages/pymysql/cursors.py", line 321, in _query
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters conn.query(q)
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 860, in query
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 1061, in _read_query_result
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters result.read()
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 1349, in read
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters first_packet = self.connection._read_packet()
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 1018, in _read_packet
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters packet.check_error()
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 384, in check_error
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters err.raise_mysql_exception(self._data)
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters File "/usr/local/lib/python2.7/dist-packages/pymysql/err.py", line 107, in raise_mysql_exception
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters raise errorclass(errno, errval)
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1305, u'SAVEPOINT sa_savepoint_11 does not exist')
Sep 20 10:58:38 udevstack neutron-server[77994]: ERROR oslo_db.sqlalchemy.exc_filters
-----
But I don't see any failures via test or otherwise.
I have not been able to reproduce this with devstack master/queens using the suggestions in comment #3. I've tried both approaches multiple times, but can't find any deadlock errors.
I've been looking in the q-svc log for such errors; should I be looking elsewhere or is there something I'm missing?
What I do find is the following error in q-svc log:
-------- server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters [None req-760dc216- 6348-4ff7- 8d47-fa59b3fba3 b5 None None] DBAPIError exception wrapped from (pymysql. err.InternalErr or) (1305, u'SAVEPOINT sa_savepoint_11 does not exist') [SQL: u'ROLLBACK TO SAVEPOINT sa_savepoint_11'] (Background on this error at: http:// sqlalche. me/e/2j85): InternalError: (1305, u'SAVEPOINT sa_savepoint_11 does not exist') server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters Traceback (most recent call last): server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters File "/usr/local/ lib/python2. 7/dist- packages/ sqlalchemy/ engine/ base.py" , line 1193, in _execute_context server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters context) server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters File "/usr/local/ lib/python2. 7/dist- packages/ sqlalchemy/ engine/ default. py", line 507, in do_execute server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters cursor. execute( statement, parameters) server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters File "/usr/local/ lib/python2. 7/dist- packages/ pymysql/ cursors. py", line 165, in execute server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters result = self._query(query) server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters File "/usr/local/ lib/python2. 7/dist- packages/ pymysql/ cursors. py", line 321, in _query server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters conn.query(q) server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters File "/usr/local/ lib/python2. 7/dist- packages/ pymysql/ connections. py", line 860, in query server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters self._affected_rows = self._read_ query_result( unbuffered= unbuffered) server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters File "/usr/local/ lib/python2. 7/dist- packages/ pymysql/ connections. py", line 1061, in _read_query_result server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters result.read() server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters File "/usr/local/ lib/python2. 7/dist- packages/ pymysql/ connections. py", line 1349, in read server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters first_packet = self.connection ._read_ packet( ) server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters File "/usr/local/ lib/python2. 7/dist- packages/ pymysql/ connections. py", line 1018, in _read_packet server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters packet. check_error( ) server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters File "/usr/local/ lib/python2. 7/dist- packages/ pymysql/ connections. py", line 384, in check_error server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters err.raise_ mysql_exception (self._ data) server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters File "/usr/local/ lib/python2. 7/dist- packages/ pymysql/ err.py" , line 107, in raise_mysql_ exception server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters raise errorclass(errno, errval) server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters InternalError: (1305, u'SAVEPOINT sa_savepoint_11 does not exist') server[ 77994]: ERROR oslo_db. sqlalchemy. exc_filters
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
Sep 20 10:58:38 udevstack neutron-
-----
But I don't see any failures via test or otherwise.