sqla 0.9.5 breaks the world

[Matt Riedemann]

There are several different tests failing here:

http://logs.openstack.org/79/101579/4/check/gate-nova-python26/990cd05/console.html

Checking on the ec2 failure shows it started on 6/23:

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiRkFJTDogbm92YS50ZXN0cy5hcGkuZWMyLnRlc3RfY2xvdWQuQ2xvdWRUZXN0Q2FzZS50ZXN0X2Fzc29jaWF0ZV9kaXNhc3NvY2lhdGVfYWRkcmVzc1wiIEFORCB0YWdzOlwiY29uc29sZVwiIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiI2MDQ4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxNDAzNTU0ODE0OTQ2fQ==

I'm guessing this is the change that caused the problem:

https://github.com/openstack/nova/commit/077e3c770ebeebd037ce882863a6b5dcefd644cf

[Matt Riedemann (mriedem)]

Revert proposed here: https://review.openstack.org/#/c/102002/

[Matt Riedemann (mriedem)]

elastic-recheck patch: https://review.openstack.org/102005

[Matt Riedemann (mriedem)]

FWIW this looked suspicious too but it merged a few days before the error started showing up:

https://review.openstack.org/#/c/100382/

[Matt Riedemann (mriedem)]

Dan Smith wasn't hitting this locally until he rebuilt his local tox and then started hitting it, so probably a dependency update, and looks like sqlalchemy 0.9.5 was released today:

https://pypi.python.org/pypi/SQLAlchemy/0.9.5

[OpenStack Infra (hudson-openstack)]

Change abandoned by Matt Riedemann (<email address hidden>) on branch: master
Review: https://review.openstack.org/102002
Reason: It's something with sqlalchemy 0.9.5 which was released today.

[Matt Riedemann (mriedem)]

Thinking it's something with this change: https://bitbucket.org/zzzeek/sqlalchemy/issue/3029

Given how the nova sqla.db.api code is doing joins, e.g.:

http://git.openstack.org/cgit/openstack/nova/tree/nova/db/sqlalchemy/api.py#n1023

[Matt Riedemann (mriedem)]

There is a change to global-requirements to ignore 0.9.5:

https://review.openstack.org/#/c/102015/

[Matt Riedemann (mriedem)]

Looks like there is something here that broke sqla:

https://bitbucket.org/zzzeek/sqlalchemy/issue/3060

[Alan Pevec (apevec)]

sqla 0.9.6 was released with #3060 reverted:
http://docs.sqlalchemy.org/en/rel_0_9/changelog/changelog_09.html#change-0.9.6

[Matt Riedemann (mriedem)]

Here is the nova requirements update: https://review.openstack.org/#/c/102130/

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/102130
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=778ff024cc641e3d864e14f0d4494b36c6d745e3
Submitter: Jenkins
Branch: master

commit 778ff024cc641e3d864e14f0d4494b36c6d745e3
Author: OpenStack Proposal Bot <email address hidden>
Date: Tue Jun 24 07:24:01 2014 +0000

    Updated from global requirements

    Closes-Bug: #1333410

    Change-Id: I49d5ee76ef8aed2cbbeec0377c119d3feeea4eca

[Eugene Nikanorov (enikanorov)]

The fix was updated from global requirements