[DVSPlugin]Missing table nsxv_subnet_ext_attributes

[Kevin Tibi]

Hi,

After fresh install on mitaka, I have issue when I start neutron-server :

2016-04-25 13:30:48.945 6276 ERROR neutron.agent.dhcp.agent
2016-04-25 13:31:18.946 6276 INFO neutron.agent.dhcp.agent [-] Synchronizing state
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent [-] Unable to sync network state.
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent Traceback (most recent call last):
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/neutron/agent/dhcp/agent.py", line 154, in sync_state
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent active_networks = self.plugin_rpc.get_active_networks_info()
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/neutron/agent/dhcp/agent.py", line 439, in get_active_networks_info
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent host=self.host)
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 158, in call
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent retry=self.retry)
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 90, in _send
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent timeout=timeout, retry=retry)
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 470, in send
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent retry=retry)
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 461, in _send
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent raise result
2016-04-25 13:31:19.005 6276 ERROR neutron.agent.dhcp.agent RemoteError: Remote error: ProgrammingError (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.nsxv_subnet_ext_attributes' doesn't exist") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS sub
[..............]

My tables in neutron DB :

[.....]
| networks |
| networksecuritybindings |
| neutron_nsx_network_mappings |
| neutron_nsx_port_mappings |
| neutron_nsx_router_mappings |
| neutron_nsx_security_group_mappings |
| nexthops |
| nsxv_edge_dhcp_static_bindings |
| nsxv_edge_vnic_bindings |
| nsxv_firewall_rule_bindings |
| nsxv_internal_edges |
| nsxv_internal_networks |
| nsxv_port_index_mappings |
| nsxv_port_vnic_mappings |
| nsxv_router_bindings |
| nsxv_router_ext_attributes |
| nsxv_rule_mappings |
| nsxv_security_group_section_mappings |
| nsxv_spoofguard_policy_network_mappings |
| nsxv_tz_network_bindings |
| nsxv_vdr_dhcp_bindings |
| nuage_net_partition_router_mapping
[.....]

I use stable/mitaka and DVS plugin

[Gary Kotton (garyk)]

The NSX|V does not work witht he DHCP agents. The plugin has built in DHCP aupport

[Kevin Tibi (ktibi)]

I update, I use DVS plugin.

[Kevin Tibi (ktibi)]

I solved issue :

I copy file from github vmware_nsx/db/migration/alembic_migrations/* to my /usr/lib/python2.7/site-packages/vmware_nsx/db/migration/alembic_migrations/

==> neutron-db-manage upgrade heads

And all tables are added

[James Page (james-page)]

This is a problem with the git based workflow used in Debian - it does *not* use the sdist created release tarball, it just installs direct from a raw git commit which does not have any egg-info.

As a result, we end up with missing files from the deb package install, such as in this bug.

I'd rather move away from this approach, but I'm unable to convince the Debian maintainer of OpenStack that is good idea.

Ho-hum.

Anyway I'll get this fixed up next week!

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.

[James Page (james-page)]

The missing alembic migrations is a bit of a side effect for installing directly from the git source tree; using an sdist generated release tarball *does* include the alembic migrations, so I've switched over the Ubuntu packages to use that method instead.

This did reveal that the 8.0.0 release is not actually published to either pypi or tarballs.openstack.org - it would be really helpful if the vmware-nsx team could resume publication of released versions of the NSX driver.

[James Page (james-page)]

I've uploaded to xenial for SRU team review; however I'm blocked in yakkety as the 8.0.0 + patches I prepared a while back fails to build from source.

[James Page (james-page)]

[Impact]
python-vmware-nsx lacks the required alembic db migrations; installations will lack any vmware nsx specific db tables.

[Test Case]
sudo apt-get install python-vmware-nsx neutron-server
<configure nsx driver in neutron configuration>
neutron-db-manage upgrade head
<succeeds>
sudo service neutron-server restart
<fails with log messages inline with the original bug report>

[Regression Potential]
Minimal; the fix is to actually use an sdist generated tarball; the current orig.tar.xz is a snapshot generated by the pkg-openstack git based workflow of merging upstream tags, rather than using upstream generated release tarballs.

[James Page (james-page)]

https://review.openstack.org/#/c/376384/

[James Page (james-page)]

[Impact]
python-vmware-nsx lacks the required alembic db migrations; installations will lack any vmware nsx specific db tables.

[Test Case]
sudo apt-get install python-vmware-nsx neutron-server
<configure nsx driver in neutron configuration>
neutron-db-manage upgrade head
<succeeds>
sudo service neutron-server restart
<fails with log messages inline with the original bug report>

[Regression Potential]
Minimal; cherry picked fix for master branch to ensure that alembic migrations are installed even when not using a sdist generated tarball.

[Launchpad Janitor (janitor)]

This bug was fixed in the package vmware-nsx - 9.0.0~git20160927.64c87d2-0ubuntu1

---------------
vmware-nsx (9.0.0~git20160927.64c87d2-0ubuntu1) yakkety; urgency=medium

  * New upstream snapshot for OpenStack Newton.
  * d/p/0001-Include-alembic-migrations-in-module.patch: Cherry pick fix
    to ensure that alembic migrations are installed with module
    (LP: #1574610).

 -- James Page <email address hidden> Wed, 28 Sep 2016 14:34:21 +0100

[Brian Murray (brian-murray)]

Hello Kevin, or anyone else affected,

Accepted vmware-nsx into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/vmware-nsx/8.0.0-0ubuntu0.16.04.3 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/376384
Committed: https://git.openstack.org/cgit/openstack/vmware-nsx/commit/?id=32b96a25b2b0d8419ae925e4616905a90b68fe56
Submitter: Jenkins
Branch: master

commit 32b96a25b2b0d8419ae925e4616905a90b68fe56
Author: James Page <email address hidden>
Date: Mon Sep 26 11:47:45 2016 +0100

    Include alembic migrations in module

    Explicitly include all alembic data in installed python module,
    ensuring that installations direct from git repositories are
    fully functional when compared to use of sdist generated tarballs
    from tarballs.openstack.org or pypi.

    Closes-Bug: 1574610

    Change-Id: I7aac86987658b9b914b45fbb64f9c1cbc9c43151

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/384104

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/384104
Committed: https://git.openstack.org/cgit/openstack/vmware-nsx/commit/?id=f53b2a71b3116d8e2a10ebc8ac111551605312bf
Submitter: Jenkins
Branch: stable/newton

commit f53b2a71b3116d8e2a10ebc8ac111551605312bf
Author: James Page <email address hidden>
Date: Mon Sep 26 11:47:45 2016 +0100

    Include alembic migrations in module

    Explicitly include all alembic data in installed python module,
    ensuring that installations direct from git repositories are
    fully functional when compared to use of sdist generated tarballs
    from tarballs.openstack.org or pypi.

    Closes-Bug: 1574610

    Change-Id: I7aac86987658b9b914b45fbb64f9c1cbc9c43151
    (cherry picked from commit 32b96a25b2b0d8419ae925e4616905a90b68fe56)

[Brian Murray (brian-murray)]

Hello Kevin, or anyone else affected,

Accepted vmware-nsx into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/vmware-nsx/8.0.0-0ubuntu0.16.04.4 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Ubuntu Foundations Team Bug Bot (crichton)]

The fix for this bug has been awaiting testing feedback in the -proposed repository for xenial for more than 90 days. Please test this fix and update the bug appropriately with the results. In the event that the fix for this bug is still not verified 15 days from now, the package will be removed from the -proposed repository.

[Andy Whitcroft (apw)]

The version of vmware-nsx in the proposed pocket of Xenial that was purported to fix this bug report has been removed because the bugs that were to be fixed by the upload were not verified in a timely (105 days) fashion.