R4.0:4:: openstack provision fails on 16.04.2 on single node SMLite setup.

[Vivek krishnappa]

Provisioning of openstack fails on a single node SMLite setup for ubunut:16-04, & build R4.0:4 (newton).
The issue persists even after applying the patch listed in "https://review.opencontrail.org/#/c/31519/1/contrail_provisioning/compute/scripts/compute-server-setup.sh" and changing “auth_type=v3password” to password in file file /etc/nova/nova.conf.

Sys logs points to “ERROR oslo_service.service err.raise_mysql_exception(self._data)
May 15 19:44:04 nodea10 nova-conductor[2497]: 2017-05-15 19:44:04.603 18860 ERROR oslo_service.service File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception.

Logs::
=====================
root@nodea10:~# server-manager status server

+---------+---------------------+---------------+-------------------+
| id | status | ip_address | mac_address |
+---------+---------------------+---------------+-------------------+
| nodea10 | openstack_completed | 10.204.216.48 | 00:25:90:A5:3B:1A |
+---------+---------------------+---------------+-------------------+
root@nodea10:~#
root@nodea10:~# server-manager display cluster -d
{
    "cluster": [
        {
            "base_image_id": "",
            "email": "",
            "id": "cluster1",
            "package_image_id": "",
            "parameters": {
                "domain": "englab.juniper.net",
                "gateway": "10.204.216.254",
                "provision": {
                    "contrail": {
                        "config": {
                            "config_ip_list": [
                                "10.204.216.48"
                            ]
                        },
                        "storage": {
                            "last_osd_num": 0,
                            "osd_bootstrap_key": "AQA/WhlZOkZ6FRAAgauhod7N7wx0+iTSYWi74g==",
                            "pool_keys": {
                                "images": "AQC7WhlZ7DF7DBAAk576CTksbdda3YEZuHg6fQ==",
                                "volumes": "AQC7WhlZ3RqhCxAANF02IiMvfzZAy53vJegfhg=="
                            },
                            "pool_secret": {
                                "images": "68b8330c-82bc-41cd-a540-5e640820be4d",
                                "volumes": "6ab41568-56cd-4421-bb3c-11f7e2b6b339"
                            },
                            "storage_admin_key": "AQA/WhlZ0uISFhAAlchCo73mvXc581uYQPEFXg==",
                            "storage_enabled": 0,
                            "storage_fsid": "3b99c6f7-2abc-4de5-9b06-934c9f9bb58f",
                            "storage_monitor_secret": "AQA/WhlZhszhFBAADthB5iU9EBMaSN+/YTanuQ==",
                            "storage_virsh_uuid": "3bd83fde-500d-400f-ac31-36774cd5d830"
                        }
                    },
                    "contrail_4": {
                        "contrail_analytics_log_volumes": [
                            "/var/log/contrail/analytics:/var/log/contrail"
                        ],
                        "contrail_analyticsdb_log_volumes": [
                            "/var/log/contrail/analyticsdb:/var/log/contrail"
                        ],
                        "contrail_controller_log_volumes": [
                            "/var/log/contrail/controller:/var/log/contrail",
                            "/var/log/zookeeper:/var/log/zookeeper"
                        ],
                        "controller_config": {
                            "bgp_asn": "64512",
                            "encap_priority": "VXLAN,MPLSoUDP,MPLSoGRE",
                            "external_routers_list": {
                                "blr-xm1": "10.204.216.253"
                            }
                        }
                    },
                    "openstack": {
                        "ceilometer": {
                            "mongo": "*****",
                            "password": "*****"
                        },
                        "cinder": {
                            "password": "*****"
                        },
                        "glance": {
                            "password": "*****"
                        },
                        "heat": {
                            "encryption_key": "*****",
                            "password": "*****"
                        },
                        "horizon": {
                            "password": "*****"
                        },
                        "keystone": {
                            "admin_password": "*****",
                            "admin_token": "*****"
                        },
                        "mysql": {
                            "root_password": "*****",
                            "service_password": "*****"
                        },
                        "neutron": {
                            "password": "*****"
                        },
                        "nova": {
                            "password": "*****"
                        },
                        "openstack_manage_amqp": true,
                        "swift": {
                            "password": "*****"
                        }
                    }
                },
                "storage_fsid": "38f1b385-ae6d-4bb3-9e44-11c9a1988276",
                "storage_virsh_uuid": "c3eaa0a7-e512-448d-a80f-f910994bb14c",
                "subnet_mask": "255.255.255.0",
                "uuid": "50ff2e3d-9d0d-48dd-acc8-0b168082b3b6"
            },
            "provision_role_sequence": "{'completed': [(u'nodea10', 'openstack', '2017_05_16__04_20_36')], 'steps': [[(u'nodea10', 'post_provision')]]}",
            "provisioned_id": null
        }
    ]
}
====================================================

Dev_comments::
=====================
On newton, keystone is managed by apache, during provisioning of keystone we inadvertently removed all the other services managed by apache.

Info: Computing checksum on file /etc/apache2/sites-available/puppetmaster.conf
Info: /Stage[openstack]/Apache/File[/etc/apache2/sites-available/puppetmaster.conf]: Filebucketed /etc/apache2/sites-available/puppetmaster.conf to puppet with sum f32918b82860016169c6dad8c10513a4
Notice: /Stage[openstack]/Apache/File[/etc/apache2/sites-available/puppetmaster.conf]/ensure: removed
Info: Computing checksum on file /etc/apache2/sites-available/smgr.conf
Info: /Stage[openstack]/Apache/File[/etc/apache2/sites-available/smgr.conf]: Filebucketed /etc/apache2/sites-available/smgr.conf to puppet with sum 7c58aeb7b808757479392389e7267145
Notice: /Stage[openstack]/Apache/File[/etc/apache2/sites-available/smgr.conf]/ensure: removed
Info: /etc/apache2/sites-available: Scheduling refresh of Class[Apache::Service]
Notice: /Stage[openstack]/Apache/File[/etc/apache2/sites-enabled/puppetmaster.conf]/ensure: removed
Notice: /Stage[openstack]/Apache/File[/etc/apache2/sites-enabled/smgr.conf]/ensure: removed
Info: /etc/apache2/sites-enabled: Scheduling refresh of Class[Apache::Service]
Notice: executed verify-rabbitmq
Notice: /Stage[openstack]/Contrail::Verify_rabbitmq/Notify[executed verify-rabbitmq]/message: defined 'message' as 'executed verify-rabbitmq'
Notice: /Stage[openstack]/Apache/File[/etc/apache2/mods-enabled/headers.load]/ensure: removed
Notice: /Stage[openstack]/Apache/File[/etc/apache2/mods-enabled/mpm_worker.conf]/ensure: removed
Notice: /Stage[openstack]/Apache/File[/etc/apache2/mods-enabled/mpm_worker.load]/ensure: removed
Notice: /Stage[openstack]/Apache/File[/etc/apache2/mods-enabled/passenger.conf]/ensure: removed
Notice: /Stage[openstack]/Apache/File[/etc/apache2/mods-enabled/passenger.load]/ensure: removed
Notice: /Stage[openstack]/Apache/File[/etc/apache2/mods-enabled/socache_shmcb.load]/ensure: removed
Notice: /Stage[openstack]/Apache/File[/etc/apache2/mods-enabled/ssl.conf]/ensure: removed
Notice: /Stage[openstack]/Apache/File[/etc/apache2/mods-enabled/ssl.load]/ensure: removed
Info: /etc/apache2/mods-enabled: Scheduling refresh of Class[Apache::Service]

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/31930
Submitter: Dheeraj Gautam (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/31931
Submitter: Dheeraj Gautam (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/31930
Submitter: Dheeraj Gautam (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/31931
Submitter: Dheeraj Gautam (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/31939
Submitter: kamlesh parmar (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/31930
Committed: http://github.com/Juniper/contrail-puppet/commit/60e64b3813f3206f7328f2bfaee24a465190d0e4
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit 60e64b3813f3206f7328f2bfaee24a465190d0e4
Author: Dheeraj Gautam <email address hidden>
Date: Sat May 20 11:46:15 2017 -0700

fix newton /horizon 404

Closes-Bug: #1692245
Partial-Bug: #1690991

1. remove using keystone::wsgi::apache
2. add keystone and its related files in templates and use them

testing:
1. provisioned all-in-one via SM, and check keystone came up and responding
2. verified /horizon and logged into the system

Change-Id: I63a4c819b6022faefdb9a004324430f0dd8a3162

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/31931
Committed: http://github.com/Juniper/contrail-puppet/commit/1fb2795650e10a2177fd6e5d2f2efcd377ad80e5
Submitter: Zuul (<email address hidden>)
Branch: master

commit 1fb2795650e10a2177fd6e5d2f2efcd377ad80e5
Author: Dheeraj Gautam <email address hidden>
Date: Sat May 20 11:46:15 2017 -0700

fix newton /horizon 404

Closes-Bug: #1692245
Partial-Bug: #1690991

1. remove using keystone::wsgi::apache
2. add keystone and its related files in templates and use them

testing:
1. provisioned all-in-one via SM, and check keystone came up and responding
2. verified /horizon and logged into the system

Change-Id: I63a4c819b6022faefdb9a004324430f0dd8a3162

[Abhay Joshi (abhayj)]

Fix committed with Dheeraj's fix. Kamlesh's fix (different approach has been abandoned).