Neuton failed to start on non-primary controllers: Table 'neutron.ml2_vlan_allocations' doesn't exist

[Vladimir Khlyunev]

Snapshot 582

Scenario:
  1. Revert the snapshot
  2. Create a cluster
  3. Add 3 nodes with controller role
  4. Add 1 node with compute role
  5. Set custom hostnames for all cluster nodes << can be important
  6. Deploy the cluster
  7. Verify network configuration on controller
  8. Run OSTF

Result:

root@controller-31367:~# haproxy-status.sh | grep -A1 -B2 DOWN
neutron FRONTEND Status: OPEN Sessions: 0 Rate: 0
neutron node-1 Status: UP/L7OK Sessions: 0 Rate: 0
neutron node-4 Status: DOWN/L4CON Sessions: 0 Rate: 0
neutron node-5 Status: DOWN/L4CON Sessions: 0 Rate: 0
neutron BACKEND Status: UP Sessions: 0 Rate: 0

2016-12-02 04:59:43.326 21071 ERROR neutron ProgrammingError: (_mysql_exceptions.ProgrammingError) (1146, "Table 'neutron.ml2_vlan_allocations' doesn't exist") [SQL: u'SELECT ml2_vlan_allocations.physical_network AS ml2_vlan_allocations_physical_network, ml2_vlan_allocations.vlan_id AS ml2_vlan_allocations_vlan_id, ml2_vlan_allocations.allocated AS ml2_vlan_allocations_allocated \nFROM ml2_vlan_allocations FOR UPDATE']

Diag snapshot https://product-ci.infra.mirantis.net/job/9.x.system_test.ubuntu.custom_hostname/142/artifact/logs/fail_error_set_custom_hostname-fuel-snapshot-2016-12-02_05-11-53.tar

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/408180

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/408618

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/408619

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/408618
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=1828eade796d74419b65a3845033a29eafe3fa19
Submitter: Jenkins
Branch: master

commit 1828eade796d74419b65a3845033a29eafe3fa19
Author: Mikhail <email address hidden>
Date: Wed Dec 7 19:24:59 2016 +0400

    Add primary task for network-server-config

    Sometimes task network-server-config on non-primary-controller
    executes before primary-controller. We should specify the start order

    Change-Id: I0288d84b64c061a079c471fe47b2bc312a3f5659
    Closes-Bug: #1646799
    Closes-Bug: #1648028

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/408619
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=2f89958be73733a63f0833b8ccfdad36f8742cf7
Submitter: Jenkins
Branch: stable/newton

commit 2f89958be73733a63f0833b8ccfdad36f8742cf7
Author: Mikhail <email address hidden>
Date: Wed Dec 7 19:24:59 2016 +0400

    Add primary task for network-server-config

    Sometimes task network-server-config on non-primary-controller
    executes before primary-controller. We should specify the start order

    Change-Id: I0288d84b64c061a079c471fe47b2bc312a3f5659
    Closes-Bug: #1646799
    Closes-Bug: #1648028

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/408180
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=6eb0ef859edd651e638e0394f77aa083ecb6e3c8
Submitter: Jenkins
Branch: stable/mitaka

commit 6eb0ef859edd651e638e0394f77aa083ecb6e3c8
Author: Mikhail <email address hidden>
Date: Wed Dec 7 19:24:59 2016 +0400

    Add primary task for network-server-config

    Sometimes task network-server-config on non-primary-controller
    executes before primary-controller. We should specify the start order

    Change-Id: I0288d84b64c061a079c471fe47b2bc312a3f5659
    Closes-Bug: #1646799
    Closes-Bug: #1648028

[TatyanaGladysheva (tgladysheva)]

Verified on 9.2 snapshot #630.

Test is passed now:
https://product-ci.infra.mirantis.net/job/9.x.system_test.ubuntu.custom_hostname/151/testReport/(root)/set_custom_hostname/set_custom_hostname/

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/fuel-library 11.0.0.0rc1 release candidate.