Fuel+NSX can not complete deploy CentOS-based cloud because of problems with neutron

[okosse]

I used simple mode with CentOS, 1 node as controller, 2 nodes as compute+glance(default)+cinder(default) and NSX network. Fuel could not complete deploy controller node with error: "Could not prefetch neutron_router_interface provider 'neutron': Can't prefetch subnet-list Neutron or Keystone API is not avalaible."

---------------------fuel-version---------------------------------
api: '1.0'
astute_sha: 3c374c9f7bfbdbcd7ce2f716cd704e3044e6fb41
auth_required: true
build_id: 2014-11-11_20-43-34
build_number: '92'
feature_groups:
- mirantis
fuellib_sha: 0b1c4ab522009681f27053a267dcc9dd4010b7ea
fuelmain_sha: f09f3624e55da3b58bf9ef6e2614c4a96cb5b072
nailgun_sha: e1e58a78f07d33ef5467eb2e7ac8c18b86783caa
ostf_sha: 720cc1308c3a7081736edd167e7928ca61914aaa
production: docker
release: '6.0'
release_versions:
  2014.2-6.0:
    VERSION:
      api: '1.0'
      astute_sha: 3c374c9f7bfbdbcd7ce2f716cd704e3044e6fb41
      build_id: 2014-11-11_20-43-34
      build_number: '92'
      feature_groups:
      - mirantis
      fuellib_sha: 0b1c4ab522009681f27053a267dcc9dd4010b7ea
      fuelmain_sha: f09f3624e55da3b58bf9ef6e2614c4a96cb5b072
      nailgun_sha: e1e58a78f07d33ef5467eb2e7ac8c18b86783caa
      ostf_sha: 720cc1308c3a7081736edd167e7928ca61914aaa
      production: docker
      release: '6.0'

[Igor Zinovik (izinovik)]

It seems that neutron server did not started:
fuel-snapshot-2014-11-13_09-27-42/node-4.test.domain.local/commands)% grep -c neutron ps.txt
0

[Igor Zinovik (izinovik)]

I think that this bug can be fixed by this fix:
https://review.openstack.org/#/c/133563

'gateway' field for neutron_subnet type was changed to
'gateway_ip' in commit 247ea68f2. But the NSX module is using this filed
by an old name.

[Igor Zinovik (izinovik)]

fuellib_sha: "0b1c4ab522009681f27053a267dcc9dd4010b7ea"

I checkouted 0b1c4ab fuel-library git repository and verified that neutron_subnet uses 'gateway_ip' attribute,
while plugin_neutronnsx::alter_neutron_server calls `neutron_subnet' with 'gateway' attribute.

[Andrey Danin (gcon-monolake)]

Igor,

The patch, you are talking about, was applied to this environment manually.

The problem with Neutron is in configuration.
Here is an error in file fuel-snapshot-2014-11-13_09-27-42/10.108.0.2/var/log/docker-logs/remote/node-4.test.domain.local/**NO MATCH**.log
http://paste.openstack.org/show/133277/
"Unable to load neutron from configuration file /usr/share/neutron/api-paste.ini. ImportError: No module named ml2"

It seems some part of config files assume that there is ML2 enabled but it should be Neutron NSX plugin.

[Igor Zinovik (izinovik)]

File /etc/neutron/api-paste.ini does not contain needed configuration directives.

It contains:
[filter:authtoken]
admin_user=neutron
auth_port=35357
admin_password=9d3WcntS
auth_protocol=http
auth_uri=http://172.16.1.2:35357/v2.0
admin_tenant_name=services
auth_host=172.16.1.2

While it should contain more:
[composite:neutron]
use = egg:Paste#urlmap
/: neutronversions
/v2.0: neutronapi_v2_0

[composite:neutronapi_v2_0]
use = call:neutron.auth:pipeline_factory
noauth = request_id catch_errors extensions neutronapiapp_v2_0
keystone = request_id catch_errors authtoken keystonecontext extensions neutronapiapp_v2_0

[filter:request_id]
paste.filter_factory = neutron.openstack.common.middleware.request_id:RequestIdMiddleware.factory

[filter:catch_errors]
paste.filter_factory = neutron.openstack.common.middleware.catch_errors:CatchErrorsMiddleware.factory

[filter:keystonecontext]
paste.filter_factory = neutron.auth:NeutronKeystoneContext.factory

[filter:authtoken]
paste.filter_factory = keystonemiddleware.auth_token:filter_factory
admin_user=neutron
auth_port=35357
admin_password=v7tVpouA
auth_protocol=http
auth_uri=http://172.16.1.2:35357/v2.0
admin_tenant_name=services
auth_host=172.16.1.2

[filter:extensions]
paste.filter_factory = neutron.api.extensions:plugin_aware_extension_middleware_factory

[app:neutronversions]
paste.app_factory = neutron.api.versions:Versions.factory

[app:neutronapiapp_v2_0]
paste.app_factory = neutron.api.v2.router:APIRouter.factory

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/137075

[Stepan Rogov (srogov)]

This bug consist 2 parts:
1. neutron-ml2 package is non-obvious neutron dependency neutron start fail without it
2. Not performed "neutron-db-manage upgrade", because the package is installed as someone dependence and it does not notify corresponding resource("neutron-db-sync").

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/137075
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=7b3c1d76959fe46db80b4f94f0af8298479a6d60
Submitter: Jenkins
Branch: master

commit 7b3c1d76959fe46db80b4f94f0af8298479a6d60
Author: Stepan Rogov <email address hidden>
Date: Tue Nov 25 17:07:53 2014 +0300

    Fix nsx plugin deploy on Centos

    Add neutron-ml2 package for non-obvious neutron dependency (neutron
    start fail without it)
    Add notify "neutron-db-sync" resource, because neutron-server package
    in our module installed as a dependency

    Change-Id: I1ae8c05c54ddf2d6b175eb1a13ecfa70a569a0e3
    closes-bug: #1392244

[Tatyana Dubyk (tdubyk)]

Verified on 6.0-48.iso by autotest 'deploy_simple_nsx_stt'