Cinder openstack-upgrade does not migrate the db correctly

Bug #1674457 reported by David Ames
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Cinder Charm
Fix Released
Critical
David Ames

Bug Description

After running the action openstack-upgrade (mitaka -> newton) the db has not been fully migrated and cinder applications show the following in their logs.

Note: Juju status may or may not show "Services not running"
systemctl may show the service as up or down but the error is shown.

2017-03-20 18:57:26.039 5933 ERROR cinder DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'services.cluster_name' in 'field list'") [SQL: u'SELECT services.created_at AS services_created_at, services.deleted_at AS services_deleted_at, services.deleted AS services_deleted, services.id AS services_id, services.cluster_name AS services_cluster_name, services.host AS services_host, services.`binary` AS services_binary, services.updated_at AS services_updated_at, services.topic AS services_topic, services.report_count AS services_report_count, services.disabled AS services_disabled, services.availability_zone AS services_availability_zone, services.disabled_reason AS services_disabled_reason, services.modified_at AS services_modified_at, services.rpc_current_version AS services_rpc_current_version, services.object_current_version AS services_object_current_version, services.replication_status AS services_replication_status, services.active_backend_id AS services_active_backend_id, services.frozen AS services_frozen \nFROM services \nWHERE services.deleted = false AND services.`binary` = %(binary_1)s'] [parameters: {u'binary_1': 'cinder-scheduler'}]

Subsequent hook runs may or may not "fix" the problem.

Revision history for this message
David Ames (thedac) wrote :

Logs

Changed in charm-cinder:
status: New → Triaged
importance: Undecided → Critical
milestone: none → 17.05
David Ames (thedac)
Changed in charm-cinder:
assignee: nobody → David Ames (thedac)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to charm-cinder (master)

Fix proposed to branch: master
Review: https://review.openstack.org/447674

Changed in charm-cinder:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to charm-cinder (master)

Reviewed: https://review.openstack.org/447674
Committed: https://git.openstack.org/cgit/openstack/charm-cinder/commit/?id=0ccc67afcacad386940c88a2e58795c0b068ea7c
Submitter: Jenkins
Branch: master

commit 0ccc67afcacad386940c88a2e58795c0b068ea7c
Author: David Ames <email address hidden>
Date: Mon Mar 20 13:20:26 2017 -0700

    Force DB Migrate on openstack-upgrade

    The is_db_initialised function was stopping migrate_database from
    performing the migration when running an openstack-upgrade. Add
    upgrade kwarg to guarantee the migration runs.

    Change-Id: I4f71f34f752f49992774e3d44e9105d35ca32d80
    Closes-bug: #1674457

Changed in charm-cinder:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to charm-cinder (stable/17.02)

Fix proposed to branch: stable/17.02
Review: https://review.openstack.org/448128

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to charm-cinder (stable/17.02)

Reviewed: https://review.openstack.org/448128
Committed: https://git.openstack.org/cgit/openstack/charm-cinder/commit/?id=a9a713f1eecaaa6555f30ef32ba5fd90195e4186
Submitter: Jenkins
Branch: stable/17.02

commit a9a713f1eecaaa6555f30ef32ba5fd90195e4186
Author: David Ames <email address hidden>
Date: Mon Mar 20 13:20:26 2017 -0700

    Force DB Migrate on openstack-upgrade

    The is_db_initialised function was stopping migrate_database from
    performing the migration when running an openstack-upgrade. Add
    upgrade kwarg to guarantee the migration runs.

    Resync tox.ini to stable branch to fix issues with addressing
    the Juju charmstore via the v5 API.

    Change-Id: I4f71f34f752f49992774e3d44e9105d35ca32d80
    Closes-bug: #1674457
    (cherry picked from commit 0ccc67afcacad386940c88a2e58795c0b068ea7c)

James Page (james-page)
Changed in charm-cinder:
milestone: 17.05 → 17.08
James Page (james-page)
Changed in charm-cinder:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.