provison failed on computes with error "/etc/contrail/contrail-config-nodemgr.conf does not exist"

Bug #1693329 reported by wenqing liang
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.0
Fix Committed
Critical
Megh Bhatt
Trunk
Fix Committed
Critical
Megh Bhatt

Bug Description

R4.0-12 mitaka provision of 14.04.5 openstack-/contrail-ha cluster failed on provision failing to reach API server. This is not seen in 16.04.2 contrail-ha cluster provisioning of the same build.

Compute failed because API server was not reachable:

"2017-05-24 18:07:13,845-INFO-sm_ansible_callback.py:43-append(): fatal: [10.0.0.11]: FAILED! => {"attempts": 180, "cache_control": "no-cache", "changed": false, "connection": "close", "content": "<html><body><h1>503 Service Unavailable</h1>\nNo server is available to handle this request.\n</body></html>\n\n", "content_type": "text/html", "failed": true, "msg": "Status code was not [200]: HTTP Error 503: Service Unavailable", "redirected": false, "status": 503, "url": "http://10.10.0.10:8082"}"
"2017-05-24 18:07:14,046-INFO-sm_ansible_callback.py:43-append(): fatal: [10.0.0.12]: FAILED! => {"attempts": 180, "cache_control": "no-cache", "changed": false, "connection": "close", "content": "<html><body><h1>503 Service Unavailable</h1>\nNo server is available to handle this request.\n</body></html>\n\n", "content_type": "text/html", "failed": true, "msg": "Status code was not [200]: HTTP Error 503: Service Unavailable", "redirected": false, "status": 503, "url": "http://10.10.0.10:8082”}"

On controller container:

TASK [contrail/config : configure config nodemanager] **************************
failed: [localhost] (item={'section': u'COLLECTOR', 'option': u'server_list', 'value': u'10.10.0.9:8086 10.10.0.8:8086 10.10.0.7:8086'}) => {"failed": true, "item": {"option": "server_list", "sect
ion": "COLLECTOR", "value": "10.10.0.9:8086 10.10.0.8:8086 10.10.0.7:8086"}, "msg": "Destination /etc/contrail/contrail-config-nodemgr.conf does not exist !", "rc": 257}
failed: [localhost] (item={'section': u'SANDESH', 'option': u'sandesh_keyfile', 'value': u'/etc/contrail/ssl/private/server-privkey.pem'}) => {"failed": true, "item": {"option": "sandesh_keyfile",
 "section": "SANDESH", "value": "/etc/contrail/ssl/private/server-privkey.pem"}, "msg": "Destination /etc/contrail/contrail-config-nodemgr.conf does not exist !", "rc": 257}
failed: [localhost] (item={'section': u'SANDESH', 'option': u'sandesh_ssl_enable', 'value': False}) => {"failed": true, "item": {"option": "sandesh_ssl_enable", "section": "SANDESH", "value": fals
e}, "msg": "Destination /etc/contrail/contrail-config-nodemgr.conf does not exist !", "rc": 257}
failed: [localhost] (item={'section': u'SANDESH', 'option': u'introspect_ssl_enable', 'value': False}) => {"failed": true, "item": {"option": "introspect_ssl_enable", "section": "SANDESH", "value"
: false}, "msg": "Destination /etc/contrail/contrail-config-nodemgr.conf does not exist !", "rc": 257}
failed: [localhost] (item={'section': u'SANDESH', 'option': u'sandesh_ca_cert', 'value': u'/etc/contrail/ssl/certs/ca-cert.pem'}) => {"failed": true, "item": {"option": "sandesh_ca_cert", "section
": "SANDESH", "value": "/etc/contrail/ssl/certs/ca-cert.pem"}, "msg": "Destination /etc/contrail/contrail-config-nodemgr.conf does not exist !", "rc": 257}
failed: [localhost] (item={'section': u'SANDESH', 'option': u'sandesh_certfile', 'value': u'/etc/contrail/ssl/certs/server.pem'}) => {"failed": true, "item": {"option": "sandesh_certfile", "sectio
n": "SANDESH", "value": "/etc/contrail/ssl/certs/server.pem"}, "msg": "Destination /etc/contrail/contrail-config-nodemgr.conf does not exist !", "rc": 257}

+---------+---------------------+------------+-------------------+
| id | status | ip_address | mac_address |
+---------+---------------------+------------+-------------------+
| server7 | provision_completed | 10.0.0.10 | 02:A2:6B:1D:8F:A7 |
| server6 | provision_completed | 10.0.0.9 | 02:3B:42:5C:AE:20 |
| server5 | provision_completed | 10.0.0.8 | 02:7D:B5:1D:17:24 |
| server3 | provision_completed | 10.0.0.6 | 02:B1:72:6F:02:67 |
| server1 | provision_completed | 10.0.0.4 | 02:15:CF:57:2E:07 |
| server9 | provision_failed | 10.0.0.12 | 02:74:91:A9:50:7D |
| server2 | provision_completed | 10.0.0.5 | 02:CA:F3:89:3F:D1 |
| server8 | provision_failed | 10.0.0.11 | 02:A6:1E:C9:CA:CC |
| server4 | provision_completed | 10.0.0.7 | 02:D0:08:2E:F1:41 |
+---------+---------------------+------------+-------------------+
root@servermanager:~#

+---------+--------------------------------------------------------------------------+
| id | roles |
+---------+--------------------------------------------------------------------------+
| server7 | [u'contrail-lb'] |
| server6 | [u'contrail-controller', u'contrail-analytics', u'contrail-analyticsdb'] |
| server5 | [u'contrail-controller', u'contrail-analytics', u'contrail-analyticsdb'] |
| server3 | [u'openstack'] |
| server1 | [u'openstack'] |
| server9 | [u'contrail-compute'] |
| server2 | [u'openstack'] |
| server8 | [u'contrail-compute'] |
| server4 | [u'contrail-controller', u'contrail-analytics', u'contrail-analyticsdb'] |
+---------+--------------------------------------------------------------------------+

wenqing liang (wliang)
information type: Proprietary → Public
description: updated
Revision history for this message
Megh Bhatt (meghb) wrote :
Revision history for this message
Megh Bhatt (meghb) wrote :
Jeba Paulaiyan (jebap)
tags: added: sanity
Revision history for this message
Megh Bhatt (meghb) wrote :
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.