Vcenter-as-compute: SM provisioning fails @ preconfig of esxi/contrailvm

Bug #1718318 reported by Sarath
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.0
Fix Committed
High
kamlesh parmar
R4.1
Fix Committed
High
kamlesh parmar
Trunk
Fix Committed
High
kamlesh parmar

Bug Description

Version: 4.0.1.0-31-newton(regular)
Topology: 3node HA with multiple computes (multi-cluster Esxi) & Kvm

This is regression and worked good on CB build #57

Development Kamlesh already root-caused the issue and knows the problem and also patched the fix on setup.

Please find below the details,

root@5a10s26:~# /opt/contrail/contrail_server_manager/provision_containers.sh -j vc.json -cid cluster-vcenter-compute
----> Install server manager without cobbler option This install is
----> being logged at:
----> /var/log/contrail/install_logs/install_2017_09_19__13_01_21.log
    ----> Cleaning up existing sources.list and Server Manager sources file
    ----> Allow Install of Unauthenticated APT packages
    ----> Installing dependent packages for Setting up Smgr repos
dpkg-scanpackages: warning: package ansible (filename ./ansible_2.3.1.0-1ppa~xenial_all.deb) is repeat but newer version; used that one and ignored data from ./ansible_2.2.0.0-1ppa~xenial_all.deb!
dpkg-scanpackages: warning: package libnss3-1d (filename ./libnss3-1d_2%3a3.26.2-0ubuntu0.16.04.2_amd64.deb) is repeat but newer version; used that one and ignored data from ./libnss3-1d_2%3a3.23-0ubuntu0.16.04.1_amd64.deb!
dpkg-scanpackages: warning: package python-bottle (filename ./python-bottle_0.12.7-1_all.deb) is repeat; ignored that one and using data from ./python-bottle_0.12.7-1+deb8u1build0.16.04.1_all.deb!
dpkg-scanpackages: warning: package python-xmltodict (filename ./python-xmltodict_0.9.2-3_all.deb) is repeat but newer version; used that one and ignored data from ./python-xmltodict_0.9.0-1contrail1_all.deb!
dpkg-scanpackages: warning: package libstdc++6 (filename ./libstdc++6_5.4.0-6ubuntu1~16.04.4_amd64.deb) is repeat but newer version; used that one and ignored data from ./libstdc++6_5.4.0-6ubuntu1~16.04.2_amd64.deb!
dpkg-scanpackages: warning: package python-pbr (filename ./python-pbr_1.10.0-0ubuntu3~cloud0_all.deb) is repeat but newer version; used that one and ignored data from ./python-pbr_1.8.0-4ubuntu1_all.deb!
dpkg-scanpackages: warning: package python-pkg-resources (filename ./python-pkg-resources_26.1.1-1~cloud0_all.deb) is repeat but newer version; used that one and ignored data from ./python-pkg-resources_20.7.0-1_all.deb!
dpkg-scanpackages: warning: package python-stevedore (filename ./python-stevedore_1.17.1-1~cloud0_all.deb) is repeat but newer version; used that one and ignored data from ./python-stevedore_1.12.0-1_all.deb!
dpkg-scanpackages: info: Wrote 433 entries to output Packages file.
----> Server Manager
    ----> Using default puppet certificate name 5a10s26.contrail.juniper.net
Notice: Signed certificate request for ca
    ----> Installing package Puppetmaster Passenger
    ----> Installing package Server Manager Lite Configuring Ansible Starting docker if required Setting DOCKER_OPTS in systemd service file Restarting Docker Starting docker registry with --security-opt apparmor:unconfined -d -e REGISTRY_HTTP_ADDR=0.0.0.0:5100 --restart=always --net=host Loaded image: registry:2 554312d73ce8d63d1191d29a297944351510a7de2262e91afd37e5fb5d01c44c
----> Completed Installing Server Manager Server Manager Cliff Client
    ----> Installing package Server Manager Cliff Client
----> Completed Installing Server Manager Cliff Client Web Server
----> Manager
    ----> Installing package Contrail Web Core
    ----> Installing package Contrail Web Server Manager
----> Completed Installing Web Server Manager
        ----> Starting Server Manager Lite Service
----> Reverting Repos to old state
SM installation took 6 minutes and 39 seconds.
----> Pre provision checks to make sure setup is ready for contrail
----> provisioning
Configuring => 5a10s31
Configuring => 5a10s30
Configuring => 5a10s29
Configuring => 5a10s01b
Configuring => 5a10s23
Configuring => contrailvm-5a10s27
[2017-09-19 13:22:45,151: connect] ERROR: [Errno None] Unable to connect to port 22 on 10.87.36.19
[2017-09-19 13:22:45,151: connect] ERROR: Unable to connect Host (10.87.36.19) with username(root) and password(c0ntrail123)
[2017-09-19 13:22:45,151: preconfig] ERROR_IGNORED: Unable to connect Host (10.87.36.19) but ignoring it since it is on ESXI host Traceback (most recent call last):
  File "/opt/contrail/server_manager/client/preconfig.py", line 608, in <module>
    Utils.preconfig(args)
  File "/opt/contrail/server_manager/client/preconfig.py", line 108, in preconfig
    hostobj.preconfig(sku=cliargs.sku)
  File "/opt/contrail/server_manager/client/preconfig.py", line 271, in preconfig
    self.set_os_version()
  File "/opt/contrail/server_manager/client/preconfig.py", line 268, in set_os_version
    self.os_version = self.get_os_version()
  File "/opt/contrail/server_manager/client/preconfig.py", line 259, in get_os_version
    status, output = self.exec_cmd(cmd)
  File "/opt/contrail/server_manager/client/preconfig.py", line 233, in exec_cmd
    stdin, stdout, stderr = self.connection.exec_command(cmd)
  File "/usr/lib/python2.7/dist-packages/paramiko/client.py", line 414, in exec_command
    chan = self._transport.open_session(timeout=timeout)
AttributeError: 'NoneType' object has no attribute 'open_session'
root@5a10s26:~#

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/35751
Submitter: kamlesh parmar (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/35751
Committed: http://github.com/Juniper/contrail-server-manager/commit/092e79df7ba5a020de72a34c675f0132379b46e0
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit 092e79df7ba5a020de72a34c675f0132379b46e0
Author: Kamlesh Parmar <email address hidden>
Date: Tue Sep 19 16:55:36 2017 -0700

move preconfig in try clause as that also does remote command execution.
Do not perform remote command exec for compute on esxi host.

Change-Id: I4a5c0f98b53f18439948176c9661830bb77631be
Closes-Bug: #1718318

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/36055
Submitter: kamlesh parmar (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.1

Review in progress for https://review.opencontrail.org/36056
Submitter: kamlesh parmar (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/36056
Committed: http://github.com/Juniper/contrail-server-manager/commit/335e354a5d6aab0b49658170871baba11e4ba194
Submitter: Zuul (<email address hidden>)
Branch: R4.1

commit 335e354a5d6aab0b49658170871baba11e4ba194
Author: Kamlesh Parmar <email address hidden>
Date: Tue Sep 19 16:55:36 2017 -0700

move preconfig in try clause as that also does remote command execution.
Do not perform remote command exec for compute on esxi host.

Change-Id: I4a5c0f98b53f18439948176c9661830bb77631be
Closes-Bug: #1718318
(cherry picked from commit 092e79df7ba5a020de72a34c675f0132379b46e0)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/36055
Committed: http://github.com/Juniper/contrail-server-manager/commit/63e3573c60551955f8c329b3820e078bbadf1f52
Submitter: Zuul (<email address hidden>)
Branch: master

commit 63e3573c60551955f8c329b3820e078bbadf1f52
Author: Kamlesh Parmar <email address hidden>
Date: Tue Sep 19 16:55:36 2017 -0700

move preconfig in try clause as that also does remote command execution.
Do not perform remote command exec for compute on esxi host.

Change-Id: I4a5c0f98b53f18439948176c9661830bb77631be
Closes-Bug: #1718318
(cherry picked from commit 092e79df7ba5a020de72a34c675f0132379b46e0)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.