SM: Fab Gap - Use Externally Provisioned/Managed AMQP Cluster

[Nitish Krishna Kaveri]

Fab supports the following scenarios:

1. Contrail(Config) and Openstack nodes are provisioned with separate RabbitMQ clusters which only Contrail/Openstack uses respectively. (manage_amqp = True & no contrail_amqp_server_list in hieradata)
2. Externally provisioned AMQP cluster is configured for both Contrail and Openstack nodes to use. (contrail_amqp_server_list and openstack_amqp_server_list in hieradata)
3. Externally provisioned AMQP cluster is configured only for Contrail to use. Openstack uses self provisioned local RabbitMQ cluster (manage_amqp = True & contrail_amqp_server_list in hieradata)
4. Externally provisioned AMQP cluster is configured only for Openstack to use. Contrail uses self provisioned local RabbitMQ cluster (manage_amqp = False & openstack_amqp_server_list in hieradata)

Use below configs in testbed.py
# In environments where openstack services are deployed independently
# from contrail, you can use the below options
# service_token : Common service token for for all services like nova,
# neutron, glance, cinder etc
# amqp_host : IP of AMQP Server to be used in openstack
# manage_amqp : Default = 'no', if set to 'yes' provision's amqp in openstack nodes and
# openstack services uses the amqp in openstack nodes instead of config nodes.
# amqp_host is neglected if manage_amqp is set
# service_dbpass: Default = 'c0ntrail123'; DB password of all openstack service users
#
#env.openstack = {
# 'service_token' : '33c57636fbc2c5552fd2', #Common service token for for all openstack services
# 'amqp_host' : '10.204.217.19', #IP of AMQP Server to be used in openstack
# 'manage_amqp' : 'yes', #Default no, Manage seperate AMQP for openstack services in openstack nodes.
# 'osapi_compute_workers' : 40, #Default 40, For low memory system reduce the osapi compute workers thread.
# 'conductor_workers' : 40, #Default 40, For low memory system reduce the conductor workers thread.
# 'service_dbpass' : 'c0ntrail123', #DB password of all openstack service users
#}

#Config node related config knobs
#amqp_hosts : List of customer deployed AMQP servers to be used by config services.
#amqp_port : Port of the customer deployed AMQP servers.
#env.cfgm = {
# 'amqp_hosts' : ['10.10.10.1', '10.10.10.2']
# 'amqp_port' : '5672'
#}

[Nitish Krishna Kaveri (nitishk)]

External Openstack implementation means manage_amqp = True will be default.
Also On the CFGM nodes on the contrail cluster, new external_rabbit_hosts parameter should point to this openstack amqp for NOVA COMPUTE ONLY

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/19341
Submitter: Nitish Krishna Kaveri (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/19342
Submitter: Nitish Krishna Kaveri (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/19341
Submitter: Nitish Krishna Kaveri (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/19342
Committed: http://github.org/Juniper/contrail-puppet/commit/5edfd9dcc7cf23fd1aa1f11e426580b6cbe8e195
Submitter: Zuul
Branch: R3.0

commit 5edfd9dcc7cf23fd1aa1f11e426580b6cbe8e195
Author: nitishkrishna <email address hidden>
Date: Fri Apr 15 16:43:00 2016 -0700

Closes-Bug: #1570541 - Separating RabbitMQ provision from Config

This will allow Openstack to Provision its own rabbitmq cluster.

To provision rabbitmq on openstack nodes:

In new params, add parameter as below:
"parameters": {
"provision": {
"openstack": {
"openstack_manage_amqp": true,
}
}
}

This will now allow SM to provision Openstack role independently in a cluster
Related-Bug: #1566558 - Use External Openstack
Related-Bug: #1566585 - Use External Rabbitmq

Change-Id: I9da4e922572630d5142804343faa3722cfa48068

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/19341
Submitter: Nitish Krishna Kaveri (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/19341
Committed: http://github.org/Juniper/contrail-puppet/commit/beda2ce3428588e4fc84cdb89eba835eed5aaf0d
Submitter: Zuul
Branch: master

commit beda2ce3428588e4fc84cdb89eba835eed5aaf0d
Author: nitishkrishna <email address hidden>
Date: Fri Apr 15 16:43:00 2016 -0700

Closes-Bug: #1570541 - Separating RabbitMQ provision from Config

This will allow Openstack to Provision its own rabbitmq cluster.

To provision rabbitmq on openstack nodes:

In new params, add parameter as below:
"parameters": {
"provision": {
"openstack": {
"openstack_manage_amqp": true,
}
}
}

This will now allow SM to provision Openstack role independently in a cluster
Related-Bug: #1566558 - Use External Openstack
Related-Bug: #1566585 - Use External Rabbitmq

Change-Id: I9da4e922572630d5142804343faa3722cfa48068