SM:R3.1 build 29 centos- reprovision leads to database_started state
1) Installed SM liberty build 29
2) Reimaged the target with centos 72; Reimage succeeds
3) Upload contrail pakcage using
server-manager-client upload-image --id centos71liberty29 --version 29 --category package --type contrail-centos-package --file_name /cs-shared/github-build/R3.1/29/centos71/liberty/contrail-install-packages-3.1.1.0-29~liberty.el7.centos.noarch.rpm
4) issue provision. it hits webui_started state (bug https://review.opencontrail.org/#/c/23601/2)
5) Issue provision again . This time, provision gets stuck at database_started
ug 29 12:08:06 nodeg37 puppet-agent[19212]: (/Stage[database]/Contrail::Database/Contrail::Lib::Report_status[database_started]/Exec[contrail-status-database_started]/returns) executed successfully
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: (/Stage[database]/Contrail::Database::Install/Exec[Upgrade Cassandra to version 2.1 through intermediate version]/returns) executed successfully
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: executed contrail Upgrade Cassandra Command : /bin/bash /etc/contrail/contrail_setup_utils/upgrade_cassandra.sh 10.204.217.77 /var/lib/cassandra centos71liberty29
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: (/Stage[database]/Contrail::Database::Install/Notify[executed contrail Upgrade Cassandra Command : /bin/bash /etc/contrail/contrail_setup_utils/upgrade_cassandra.sh 10.204.217.77 /var/lib/cassandra centos71liberty29]/message) defined 'message' as 'executed contrail Upgrade Cassandra Command : /bin/bash /etc/contrail/contrail_setup_utils/upgrade_cassandra.sh 10.204.217.77 /var/lib/cassandra centos71liberty29'
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: Could not update: Execution of '/usr/bin/yum -d 0 -e 0 -y list cassandra' returned 1: Error: No matching Packages to list
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: Wrapped exception:
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: Execution of '/usr/bin/yum -d 0 -e 0 -y list cassandra' returned 1: Error: No matching Packages to list
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: (/Stage[database]/Contrail::Database::Install/Package[cassandra]/ensure) change from absent to latest failed: Could not update: Execution of '/usr/bin/yum -d 0 -e 0 -y list cassandra' returned 1: Error: No matching Packages to list
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: (/Stage[database]/Contrail::Database::Install/Package[contrail-openstack-database]) Dependency Package[cassandra] has failures: true
Aug 29 12:08:07 nodeg37
upload contrail- install- packge in tgz format has server manager exception
server- manager- client upload-image --id centos71kilo30 --version 30 --category package --type contrail- centos- package --file_name /cs-shared/ github- build/R3. 1/30/centos71/ kilo/contrail- install- packages_ 3.1.1.0- 30-kilo. tgz
"2016-09-01 09:29:13, 646-ERROR- server_ mgr_main. py:3361- log_trace( ): *****TRACEBACK- START** ***" 647-ERROR- server_ mgr_main. py:3365- log_trace( ): Traceback (most recent call last): 647-ERROR- server_ mgr_main. py:3365- log_trace( ): File "/opt/contrail/ server_ manager/ server_ mgr_main. py", line 2625, in delete_image log_and_ raise_exception (msg) 648-ERROR- server_ mgr_main. py:3365- log_trace( ): File "/opt/contrail/ server_ manager/ server_ mgr_main. py", line 2758, in log_and_ raise_exception ion(msg, err_code) 649-ERROR- server_ mgr_main. py:3365- log_trace( ): ServerMgrException: "Image {'id': 'centos71kilo30'} doesn't exist" 650-ERROR- server_ mgr_main. py:3366- log_trace( ): *****TRACEBACK- END**** **" 650-DEBUG- server_ mgr_main. py:1862- form_operartion _data() : function_start" 809-DEBUG- server_ mgr_main. py:1888- upload_ image() : upload_image" 461-ERROR- server_ mgr_main. py:2198- _create_ yum_repo( ): create_yum_repo: error 2 when executing"tar xvzf $(ls contrail-install*) > /dev/null"" 462-ERROR- server_ mgr_main. py:3361- log_trace( ): *****TRACEBACK- START** ***" 462-ERROR- server_ mgr_main. py:3365- log_trace( ): Traceback (most recent call last): 462-ERROR- server_ mgr_main. py:3365- log_trace( ): File "/opt/contrail/ server_ manager/ server_ mgr_main. py", line 1937, in upload_image 463-ERROR- server_ mgr_main. py:3365- log_trace( ): File "/opt/contrail/ server_ manager/ server_ mgr_main. py", line 2419, in _create_repo 463-ERROR- server_ mgr_main. py:3365- log_trace( ): ServerMgrException: 'create_yum_repo: error 2 when executing"tar xvzf $(ls contrail-install*) > /dev/null"' 464-ERROR- server_ mgr_main. py:3366- log_trace( ): *****TRACEBACK- END**** **"
"2016-09-01 09:29:13,
"
"2016-09-01 09:29:13,
self.
"
"2016-09-01 09:29:13,
raise ServerMgrExcept
"
"2016-09-01 09:29:13,
"
"2016-09-01 09:29:13,
"2016-09-01 09:29:13,
"2016-09-01 09:29:13,
"2016-09-01 09:29:26,
"2016-09-01 09:29:26,
"2016-09-01 09:29:26,
"
"2016-09-01 09:29:26,
image_id, image_type, image_version, dest)
"
"2016-09-01 09:29:26,
raise(e)
"
"2016-09-01 09:29:26,
"
"2016-09-01 09:29:26,
"2016-09-01 09:29:26,464-