ServerManager :: Provisioning Fails on R2.2 build 48

[Ritam Gangopadhyay]

Provisioning fails at collector role for R2.2 build 48. Till now failure seen in:

1. R2.2 build 48 ubuntu 14.04 Juno

Will updated rest based on sanity that is running now.

I see request for provisioning of collector role in the debug.log but after that there is no update of the Server status Data.

******************
******************

"2015-06-11 14:55:05,189-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'control_started', 'id': 'nodeg37'}"
"2015-06-11 14:55:13,985-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'control_completed', 'id': 'nodeg37'}"
"2015-06-11 14:55:14,012-DEBUG-server_mgr_puppet.py:2191-modify_server_hiera_data(): role-tuple: nodeg37 = control"
"2015-06-11 14:55:14,013-DEBUG-server_mgr_puppet.py:2195-modify_server_hiera_data(): role-key: contrail::params::enable_control"
"2015-06-11 14:55:14,027-DEBUG-server_mgr_puppet.py:2191-modify_server_hiera_data(): role-tuple: nodeg37 = collector"
"2015-06-11 14:55:14,028-DEBUG-server_mgr_puppet.py:2195-modify_server_hiera_data(): role-key: contrail::params::enable_collector" <<<<<< COLLECTOR ROLE PROVISIONING ISSUED >>>>>>

"2015-06-11 14:55:40,582-DEBUG-server_mgr_mon_base_plugin.py:669-create_server_dict(): Created server dictionary."
"2015-06-11 14:56:08,194-DEBUG-server_mgr_main.py:1054-get_server_status(): get_server_status"
"2015-06-11 14:56:08,195-DEBUG-server_mgr_main.py:957-validate_smgr_request(): validate_smgr_request"
"2015-06-11 14:56:08,195-DEBUG-server_mgr_main.py:590-validate_smgr_get(): match key returned: {'cluster_id': ['clusterg37']}"
"2015-06-11 14:56:08,196-DEBUG-server_mgr_main.py:592-validate_smgr_get(): select keys: None"
"2015-06-11 14:56:08,196-DEBUG-server_mgr_main.py:982-validate_smgr_request(): ret_val_data returned: {'status': 0, 'match_key': 'cluster_id', 'match_value': 'clusterg37', 'select': None, 'detail': False}"
"2015-06-11 14:56:08,197-DEBUG-server_mgr_main.py:1088-get_server_status(): JSON response:[
    {
        "id": "nodeg37",
        "ip_address": "10.204.217.77",
        "mac_address": "00:25:90:C5:60:E0",
        "status": "control_completed"
    }
]"

******************
******************

Provisioning status as shown in the debug.log :-

root@nodeg19:~# cat /var/log/contrail-server-manager/debug.log | grep "Server status Data" | grep "nodeg37" | grep "2015-06-11 14"
"2015-06-11 14:38:38,141-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'reimage_started', 'id': 'nodeg37'}"
"2015-06-11 14:41:10,785-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'reimage_completed', 'id': 'nodeg37'}"
"2015-06-11 14:44:51,686-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'provision_started', 'id': 'nodeg37'}"
"2015-06-11 14:47:31,333-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'haproxy_started', 'id': 'nodeg37'}"
"2015-06-11 14:47:32,464-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'haproxy_completed', 'id': 'nodeg37'}"
"2015-06-11 14:47:49,518-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'database_started', 'id': 'nodeg37'}"
"2015-06-11 14:48:20,193-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'database_completed', 'id': 'nodeg37'}"
"2015-06-11 14:51:26,084-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'openstack_started', 'id': 'nodeg37'}"
"2015-06-11 14:52:27,066-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'openstack_completed', 'id': 'nodeg37'}"
"2015-06-11 14:53:28,494-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'config_started', 'id': 'nodeg37'}"
"2015-06-11 14:54:30,876-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'config_completed', 'id': 'nodeg37'}"
"2015-06-11 14:55:05,189-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'control_started', 'id': 'nodeg37'}"
"2015-06-11 14:55:13,985-DEBUG-server_mgr_status.py:104-put_server_status(): Server status Data {'status': 'control_completed', 'id': 'nodeg37'}"
root@nodeg19:~#

[Ritam Gangopadhyay (ritam)]

failure is seen in:

1. R2.2 build 48 ubuntu 14.04 Juno
2. R2.2 build 48 ubuntu 12.04.3 Icehouse
3. R2.2 build 48 ubuntu 14.04 Icehouse

[Thilak Raj (tsurendra)]

Below diff needs to be added,
Also a tempate file for ini was missing in the commit.
https://github.com/Juniper/contrail-puppet/commit/6a998496b453814031a554861d6be55f63eb5143

 diff -r collector.pp collector.pp.1
< if $multi_tenancy == true {
< $memcached_opt = "memcache_servers=127.0.0.1:11211"
< }
< else {
< $memcached_opt = ""
< }
<
<
136,137c128,129
< require => Package["contrail-openstack-analytics"],
< notify => Service["supervisor-analytics"],
---
> require => Package["contrail-openstack-config"],
> notify => Service["supervisor-config"],