MySQL deadlock creating share networks concurrently

Bug #1483604 reported by Valeriy Ponomaryov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Shared File Systems Service (Manila)
Fix Released
High
Valeriy Ponomaryov

Bug Description

If we create lots of share networks at once we can get "deadlock" using MySQL DB back end.

Here are logs [1] and [2]

[1] http://logs.openstack.org/11/203911/9/check/gate-rally-dsvm-manila-multibackend/9263110/logs/screen-m-api.txt.gz?level=TRACE

[2] http://paste.openstack.org/show/412508/

Tags: api db
tags: added: api db
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to manila (master)

Fix proposed to branch: master
Review: https://review.openstack.org/211484

Changed in manila:
assignee: nobody → Valeriy Ponomaryov (vponomaryov)
status: New → In Progress
Revision history for this message
Valeriy Ponomaryov (vponomaryov) wrote :
Changed in manila:
importance: Undecided → High
milestone: none → liberty-3
Changed in manila:
assignee: Valeriy Ponomaryov (vponomaryov) → Dustin Schoenbrun (dschoenb)
Changed in manila:
assignee: Dustin Schoenbrun (dschoenb) → Valeriy Ponomaryov (vponomaryov)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to manila (master)

Reviewed: https://review.openstack.org/211484
Committed: https://git.openstack.org/cgit/openstack/manila/commit/?id=ab05b5c4651f400b7aaab803be4ace8c6e0bc114
Submitter: Jenkins
Branch: master

commit ab05b5c4651f400b7aaab803be4ace8c6e0bc114
Author: Valeriy Ponomaryov <email address hidden>
Date: Tue Aug 11 12:53:56 2015 +0300

    Add retries for deadlock-vulnerable DB methods

    It is very likely to get 'deadlock' updating common records such as
    quotas, usages, reservations and metadata. All of these things are
    API-dependent. So, add wrappers, that retries request on 'deadlock'
    exceptions.
    Also, set database config opt "max_pool_size" to '40' instead of having
    default value - '5'. It allows to keep upto 40 SQL connection alive at
    once.

    Change-Id: Ia6ec09d4617191c51ad95dd6d9f053141ec1c4c4
    Closes-Bug: #1483604

Changed in manila:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in manila:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in manila:
milestone: liberty-3 → 1.0.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.