type-list does not scale. Makes Horizon unusable for Manila.

Bug #1506240 reported by Mark Sturdevant
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Shared File Systems Service (Manila)
Fix Released
High
Valeriy Ponomaryov

Bug Description

manila type-list is taking over 1 minute to run. This makes the Horizon UI completely fail because it won't wait that long. It cannot even do "create share" because it needs a type list.

This performance problem was found on a system that had created 4000 shares, created an access rule for each one, and deleted the shares. Somehow with 4000 deleted shares, deleted share instances, deleted access rules, etc... the type-list query became slow. I'm not sure if it is doing an unnecessary join or if it just needs better indexes. It seems like maybe both.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to manila (master)

Fix proposed to branch: master
Review: https://review.openstack.org/235364

Changed in manila:
assignee: nobody → Valeriy Ponomaryov (vponomaryov)
status: New → In Progress
Changed in manila:
milestone: none → mitaka-1
importance: Undecided → High
tags: added: api
Revision history for this message
Valeriy Ponomaryov (vponomaryov) wrote :

Please, see testing results before and after fix: https://goo.gl/lyfNaD

tags: added: liberty-backport-potential
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to manila (master)

Reviewed: https://review.openstack.org/235364
Committed: https://git.openstack.org/cgit/openstack/manila/commit/?id=f1ada3fe97942931c181ffe95df6233e3f3c9277
Submitter: Jenkins
Branch: master

commit f1ada3fe97942931c181ffe95df6233e3f3c9277
Author: Valeriy Ponomaryov <email address hidden>
Date: Thu Oct 15 16:51:18 2015 +0300

    Fix share type model scalability for get request

    "share type list" operation greatly depends on amount of records in
    "shares" table. It leads to big slowness of just requesting list
    of several records of share types. That can take dozens of seconds.

    Main reason for it lays in usage of redundant "relationship" of "share
    types" table to "shares" table. It is not used in Manila, so remove it.

    Change-Id: I463b12e2eb7249b42835be063cd953b56ee7376d
    Closes-Bug: #1506240

Changed in manila:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to manila (stable/liberty)

Fix proposed to branch: stable/liberty
Review: https://review.openstack.org/236135

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to manila (stable/liberty)

Reviewed: https://review.openstack.org/236135
Committed: https://git.openstack.org/cgit/openstack/manila/commit/?id=f8d07309dd1cfe95030fc0bc8fa670354bf09b0a
Submitter: Jenkins
Branch: stable/liberty

commit f8d07309dd1cfe95030fc0bc8fa670354bf09b0a
Author: Valeriy Ponomaryov <email address hidden>
Date: Thu Oct 15 16:51:18 2015 +0300

    Fix share type model scalability for get request

    "share type list" operation greatly depends on amount of records in
    "shares" table. It leads to big slowness of just requesting list
    of several records of share types. That can take dozens of seconds.

    Main reason for it lays in usage of redundant "relationship" of "share
    types" table to "shares" table. It is not used in Manila, so remove it.

    Change-Id: I463b12e2eb7249b42835be063cd953b56ee7376d
    Closes-Bug: #1506240
    (cherry picked from commit f1ada3fe97942931c181ffe95df6233e3f3c9277)

tags: added: in-stable-liberty
Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/manila 2.0.0.0b1

This issue was fixed in the openstack/manila 2.0.0.0b1 development milestone.

Changed in manila:
status: Fix Committed → Fix Released
Revision history for this message
Thierry Carrez (ttx) wrote : Fix included in openstack/manila 1.0.1

This issue was fixed in the openstack/manila 1.0.1 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

This issue was fixed in the openstack/manila 1.0.1 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.