Unsequenced alembic migration files block the gate.

Bug #1288427 reported by Allison Randal
22
This bug affects 3 people
Affects Status Importance Assigned to Milestone
neutron
Fix Released
Critical
Mark McClain

Bug Description

The gate was substantially delayed today by a handful of alembic db migration changes that hit the gate at the same time, and failed with the following error in logs/devstacklog.txt:

Only a single head is supported. The script directory has multiple heads (due to branching), which must be resolved by manually editing the revision files to form a linear sequence. Run `alembic branches` to see the divergence(s).

The current blockage was cleared by sequencing the db migrations to resolve alembic's branching conflict. This bug is linked to an elastic-recheck fingerprint, to track any future recurrence of the problem.

Revision history for this message
Allison Randal (allison) wrote :
Revision history for this message
Octavian Ciuhandu (ociuhandu) wrote :

We seem to be hitting the same problem on the Hyper-V CI quite often in the last day. Here is a sample devstack log output:

http://64.119.130.115/78575/3/console.log.gz

Revision history for this message
Allison Randal (allison) wrote :

The fingerprint was merged into elastic-recheck in https://review.openstack.org/#/c/78435/

We're currently clear of these failures in the gate, but have a very high hit rate in check.

Changed in neutron:
status: New → Confirmed
Changed in neutron:
assignee: nobody → Mark McClain (markmcclain)
importance: Undecided → Critical
milestone: none → icehouse-rc1
status: Confirmed → Triaged
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to neutron (master)

Fix proposed to branch: master
Review: https://review.openstack.org/79377

Changed in neutron:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to neutron (master)

Reviewed: https://review.openstack.org/79377
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=36d85f831ae8eb21383806261bfc4c3d53dd1929
Submitter: Jenkins
Branch: master

commit 36d85f831ae8eb21383806261bfc4c3d53dd1929
Author: Mark McClain <email address hidden>
Date: Fri Mar 7 15:07:43 2014 -0500

    add HEAD sentinel file that contains migration revision

    This change wraps the command to generate a migration with code to
    update a file called HEAD. The HEAD file will contain the revision ID
    of the head of the migraton timeline. Additionally, check migrations has
    been altered to verify the contents of this file against the timeline
    head.

    This file helps the OpenStack gate detect potential migration branches
    without running alembic via git merge conflicts.

    Closes-Bug:1288427
    Change-Id: If382c57baea061753d3f4fcd6faec1a31fbfb7ed

Changed in neutron:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in neutron:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in neutron:
milestone: icehouse-rc1 → 2014.1
Revision history for this message
Sean Dague (sdague) wrote :

Dropped from ER tracking.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.