exception translation for pymysql "Lock wait timeout exceeded" broken

[Kevin Benton]

It looks like the classifier for "lock wait timeout exceeded" as a DBDeadlock is not correct for pymysql. Snippet of traceback showing it as the generic DBError:

2016-07-31 00:21:14.938 4145 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
2016-07-31 00:21:14.938 4145 ERROR neutron.api.v2.resource _check_mysql_exception(errinfo)
2016-07-31 00:21:14.938 4145 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
2016-07-31 00:21:14.938 4145 ERROR neutron.api.v2.resource raise InternalError(errno, errorvalue)
2016-07-31 00:21:14.938 4145 ERROR neutron.api.v2.resource DBError: (pymysql.err.InternalError) (1205, u'Lock wait timeout exceeded; try restarting transaction') [SQL: u'SELECT ipavailabilityranges.allocation_pool_id AS ipavailabilityranges_allocation_pool_id, ipavailabilityranges.first_ip AS ipavailabilityranges_first_ip, ipavailabilityranges.last_ip AS ipavailabilityranges_last_ip \nFROM ipavailabilityranges INNER JOIN ipallocationpools ON ipallocationpools.id = ipavailabilityranges.allocation_pool_id \nWHERE ipallocationpools.subnet_id = %(subnet_id_1)s \n LIMIT %(param_1)s FOR UPDATE'] [parameters: {u'param_1': 1, u'subnet_id_1': u'344485c9-e600-40c0-8acf-d9ba98dacf99'}]

[Kevin Benton (kevinbenton)]

Added neutron because this exception was observed in the gate: http://logs.openstack.org/43/298443/4/check/gate-grenade-dsvm-neutron-dvr-multinode/56112e8/logs/old/screen-q-svc.txt.gz?level=TRACE#_2016-07-31_00_21_14_938

[Kevin Benton (kevinbenton)]

Fix for neutron will just be waiting for requirements bump

[Davanum Srinivas (DIMS) (dims-v)]

This issue was fixed in the openstack/oslo.db 4.10.0 release.

[Ihar Hrachyshka (ihar-hrachyshka)]

We'll need to bump requirements in N as well as M where we see it happening (note the job failing is grenade, and the traceback is seen on the 'old' side of grenade).

[Ihar Hrachyshka (ihar-hrachyshka)]

Mitaka release request for oslo.db: https://review.openstack.org/352370

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/353247

[Kevin Benton (kevinbenton)]

Oslo.db fixes are here: https://review.openstack.org/#/q/3277ef33f2a1f6a892f0832e2907acef7b45dc2b,n,z

[Akihiro Motoki (amotoki)]

For reference, the fix in oslo.db master branch is https://review.openstack.org/#/c/349711/
and the backport to mitaka is https://review.openstack.org/350161

[OpenStack Infra (hudson-openstack)]

Change abandoned by Kevin Benton (<email address hidden>) on branch: master
Review: https://review.openstack.org/353247
Reason: merged in bot proposal here: https://review.openstack.org/#/c/354457/4

[Doug Hellmann (doug-hellmann)]

This issue was fixed in the openstack/oslo.db 4.7.1 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/oslo.db 4.7.1 release.