heat-manage script fails when encrypting large database

Bug #1470652 reported by Pratik Mallya
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Heat
Fix Released
High
Pratik Mallya

Bug Description

The heat-manage script loads all table entries at once during the process of encrypting parameters. This causes the process to run out of memory on production databases used for heat. We need to fix this so that it does the encryption in batches.

Changed in heat:
status: New → Triaged
importance: Undecided → High
Changed in heat:
assignee: nobody → Kairat Kushaev (kkushaev)
Changed in heat:
status: Triaged → In Progress
Changed in heat:
assignee: Kairat Kushaev (kkushaev) → Pratik Mallya (pratik-mallya)
Changed in heat:
assignee: Pratik Mallya (pratik-mallya) → Kairat Kushaev (kkushaev)
Changed in heat:
assignee: Kairat Kushaev (kkushaev) → Pratik Mallya (pratik-mallya)
Changed in heat:
assignee: Pratik Mallya (pratik-mallya) → Kairat Kushaev (kkushaev)
Changed in heat:
assignee: Kairat Kushaev (kkushaev) → Pratik Mallya (pratik-mallya)
Changed in heat:
milestone: none → liberty-3
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to heat (master)

Reviewed: https://review.openstack.org/197988
Committed: https://git.openstack.org/cgit/openstack/heat/commit/?id=7c90690accd68c9d9da440eea007345dc3c912c1
Submitter: Jenkins
Branch: master

commit 7c90690accd68c9d9da440eea007345dc3c912c1
Author: kairat_kushaev <email address hidden>
Date: Thu Jul 2 16:23:08 2015 +0300

    Add batching for heat-manage encrypt/decrypt

    When heat-manage executed encrypt/descrypt previously it
    requested all templates in db. It lead to some issues with memory.
    So the patch add batching for encrypt/descrypt operations:
    it allows to request only predefined number of templates,
    encrypt/decrypt them and request next batch of templates.
    It allows to reduce memory overhead when doing encrypt/decrypt
    operations.

    Co-Authored-By: Pratik Mallya <email address hidden>
    Change-Id: I6312235ca7de93a95672755c906156034647b177
    Closes-bug: #1470652

Changed in heat:
status: In Progress → Fix Committed
Changed in heat:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in heat:
milestone: liberty-3 → 5.0.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.