http://logs.openstack.org/80/43580/1/check/gate-nova-python27/ae0cd74/console.html
013-08-26 09:18:25.324 | ======================================================================
2013-08-26 09:18:25.324 | FAIL: nova.tests.db.test_migrations.TestNovaMigrations.test_postgresql_opportunistically
2013-08-26 09:18:25.325 | tags: worker-0
2013-08-26 09:18:25.325 | ----------------------------------------------------------------------
...
2013-08-26 09:18:25.338 | 172 -> 173...
2013-08-26 09:18:25.339 | Deleted duplicated row with id: 2 from table: key_pairs
2013-08-26 09:18:25.339 | Deleted duplicated row with id: 1 from table: key_pairs
2013-08-26 09:18:25.339 | done
2013-08-26 09:18:25.339 | Failed to migrate to version 173 on engine Engine(postgresql+psycopg2://openstack_citest:openstack_citest@localhost/openstack_citest)
2013-08-26 09:18:25.339 | }}}
2013-08-26 09:18:25.339 |
2013-08-26 09:18:25.340 | Traceback (most recent call last):
2013-08-26 09:18:25.340 | File "/home/jenkins/workspace/gate-nova-python27/nova/tests/db/test_migrations.py", line 175, in test_postgresql_opportunistically
2013-08-26 09:18:25.340 | self._test_postgresql_opportunistically()
2013-08-26 09:18:25.340 | File "/home/jenkins/workspace/gate-nova-python27/nova/tests/db/test_migrations.py", line 358, in _test_postgresql_opportunistically
2013-08-26 09:18:25.340 | self._walk_versions(engine, False, False)
2013-08-26 09:18:25.340 | File "/home/jenkins/workspace/gate-nova-python27/nova/tests/db/test_migrations.py", line 379, in _walk_versions
2013-08-26 09:18:25.341 | self._migrate_up(engine, version, with_data=True)
2013-08-26 09:18:25.341 | File "/home/jenkins/workspace/gate-nova-python27/nova/tests/db/test_migrations.py", line 444, in _migrate_up
2013-08-26 09:18:25.341 | check(engine, data)
2013-08-26 09:18:25.341 | File "/home/jenkins/workspace/gate-nova-python27/nova/tests/db/test_migrations.py", line 1233, in _check_173
2013-08-26 09:18:25.341 | insert.execute(duplicate_keypair)
2013-08-26 09:18:25.341 | File "/home/jenkins/workspace/gate-nova-python27/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/sql/expression.py", line 2841, in execute
2013-08-26 09:18:25.341 | return e._execute_clauseelement(self, multiparams, params)
2013-08-26 09:18:25.342 | File "/home/jenkins/workspace/gate-nova-python27/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 2453, in _execute_clauseelement
2013-08-26 09:18:25.342 | return connection._execute_clauseelement(elem, multiparams, params)
2013-08-26 09:23:49.057 | File "/home/jenkins/workspace/gate-nova-python27/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1584, in _execute_clauseelement
2013-08-26 09:23:49.057 | compiled_sql, distilled_params
2013-08-26 09:23:49.057 | File "/home/jenkins/workspace/gate-nova-python27/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1732, in _execute_context
2013-08-26 09:23:49.057 | self._commit_impl()
2013-08-26 09:23:49.057 | File "/home/jenkins/workspace/gate-nova-python27/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1280, in _commit_impl
2013-08-26 09:23:49.057 | self._handle_dbapi_exception(e, None, None, None, None)
2013-08-26 09:23:49.058 | File "/home/jenkins/workspace/gate-nova-python27/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1828, in _handle_dbapi_exception
2013-08-26 09:23:49.058 | self._autorollback()
2013-08-26 09:23:49.058 | File "/home/jenkins/workspace/gate-nova-python27/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1345, in _autorollback
2013-08-26 09:23:49.058 | self._rollback_impl()
2013-08-26 09:23:49.058 | File "/home/jenkins/workspace/gate-nova-python27/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1265, in _rollback_impl
2013-08-26 09:23:49.058 | self._handle_dbapi_exception(e, None, None, None, None)
2013-08-26 09:23:49.058 | File "/home/jenkins/workspace/gate-nova-python27/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1262, in _rollback_impl
2013-08-26 09:23:49.059 | self.engine.dialect.do_rollback(self.connection)
2013-08-26 09:23:49.059 | File "/home/jenkins/workspace/gate-nova-python27/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/engine/default.py", line 300, in do_rollback
2013-08-26 09:23:49.059 | connection.rollback()
2013-08-26 09:23:49.059 | InterfaceError: (InterfaceError) connection already closed None None
Without more info about what this test was trying to accomplish and whether or not the change that caused the failure could be at fault it is hard to debug this further. It looks like during a database migration test the connection to postgres was closed prematurely. Is it possible that one of the migrations was flawed causing this to stop early or is it more likely that there was a network hickup on the test slave? In any case more info necessary. I have also added nova to the bug to hopefully get eyes on this from people that understand the database migration tests.