[9.2] [contrail] The prov_encap_type puppet task has failed on contrail-controller

[Ruslan Khozinov]

Detailed bug description:

Deploy has failed during contrail-controller installation on the "prov_encap_type" puppet task
with the next puppet error:

/Stage[main]/Contrail::Provision::Config/Exec[prov_encap_type]/returns (err): change from notrun to 0 failed: python /opt/contrail/utils/provision_encap.py --api_server_ip 10.109.4.11 --api_server_port 8082 --oper add --encap_priority MPLSoUDP,MPLSoGRE,VXLAN --admin_user admin --admin_password 'admin' && touch /opt/contrail/prov_encap_type-DONE returned 1 instead of one of [0]

And the next python trace:

Traceback (most recent call last):
  File "/opt/contrail/utils/provision_encap.py", line 139, in <module>
    main()
  File "/opt/contrail/utils/provision_encap.py", line 135, in main
    EncapsulationProvision(args_str)
  File "/opt/contrail/utils/provision_encap.py", line 25, in __init__
    api_server_use_ssl=self._args.api_server_use_ssl)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 322, in __init__
    retry_on_error=False)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 716, in _request
    query_params=data)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 589, in _http_get
    params=query_params)
  File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 480, in get
    return self.request('GET', url, **kwargs)
  File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 468, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 608, in send
    r.content
  File "/usr/lib/python2.7/dist-packages/requests/models.py", line 737, in content
    self._content = bytes().join(self.iter_content(CONTENT_CHUNK_SIZE)) or bytes()
  File "/usr/lib/python2.7/dist-packages/requests/models.py", line 663, in generate
    raise ChunkedEncodingError(e)
requests.exceptions.ChunkedEncodingError: ("Connection broken: error(104, 'Connection reset by peer')", error(104, 'Connection reset by peer'))

Steps to reproduce:

Deploy cluster with 1 controller, 1 compute,
 3 contrail-config, contrail-control, contrail-db roles
 and install contrail plugin

 Scenario:
   1. Create an environment with "Neutron with tunneling
      segmentation" as a network configuration
   2. Enable Contrail plugin
   3. Add 2 nodes with contrail-controller role
   4. Add 2 nodes with contrail-analytics-db role.
   5. Add a node with contrail-analytics + contrail-analytics-db roles
   6. Add a node with contrail-analytics + contrail-controller roles
   7. Add a node with contrail-analytics role
   8. Add a node with with controller role
   9. Add a node with compute + cinder role
   10. Deploy cluster with plugin
   11. Run contrail health check tests
   12. Run OSTF tests

Additional information:
There's the full puppet.log from the failed contrail-controller http://paste.ubuntu.com/23528379/

[Ruslan Khozinov (rkhozinov)]

contrail-config-provision-primary

{
  "puppet_modules": "puppet/modules:/etc/puppet/modules",
  "puppet_manifest": "puppet/manifests/contrail-config-provision.pp",
  "timeout": 1440,
  "cwd": "/etc/fuel/plugins/contrail-5.0/"
}

[Ruslan Khozinov (rkhozinov)]

trace from contrail-api-0-stdout.log

ERROR:stevedore.extension:No option 'admin_password' in section: 'KEYSTONE'
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 163, in _load_plugins
    verify_requirements,
  File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 188, in _load_one_plugin
    obj = plugin(*invoke_args, **invoke_kwds)
  File "/usr/lib/python2.7/dist-packages/vnc_openstack/__init__.py", line 951, in __init__
    conf_sections, sandesh)
  File "/usr/lib/python2.7/dist-packages/vnc_openstack/neutron_plugin_interface.py", line 41, in __init__
    self._auth_passwd = conf_sections.get('KEYSTONE', 'admin_password')
  File "/usr/lib/python2.7/ConfigParser.py", line 618, in get
    raise NoOptionError(option, section)
NoOptionError: No option 'admin_password' in section: 'KEYSTONE'

http://paste.ubuntu.com/23528476/

[Alexey Shtokolov (ashtokolov)]

Waiting for RCA from Illia. Move to Incomplete for Fuel project

[Yevgeniy (yshapovalov)]

BVT test passed