Juniper Openstack

SM:R3.1 build 29 centos - reprovision leads to database_started state

Bug #1618200 reported by sundarkh
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R3.1
Fix Committed
High
Siva Gurumurthy
Juniper Openstack r3.1.1.0
Trunk
Fix Committed
High
Siva Gurumurthy
Juniper Openstack r3.2.0.0-fcs "r3.2.0.0"

Bug Description

SM:R3.1 build 29 centos- reprovision leads to database_started state

1) Installed SM liberty build 29
2) Reimaged the target with centos 72; Reimage succeeds
3) Upload contrail pakcage using
server-manager-client upload-image --id centos71liberty29 --version 29 --category package --type contrail-centos-package --file_name /cs-shared/github-build/R3.1/29/centos71/liberty/contrail-install-packages-3.1.1.0-29~liberty.el7.centos.noarch.rpm

4) issue provision. it hits webui_started state (bug https://review.opencontrail.org/#/c/23601/2)

5) Issue provision again . This time, provision gets stuck at database_started

ug 29 12:08:06 nodeg37 puppet-agent[19212]: (/Stage[database]/Contrail::Database/Contrail::Lib::Report_status[database_started]/Exec[contrail-status-database_started]/returns) executed successfully
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: (/Stage[database]/Contrail::Database::Install/Exec[Upgrade Cassandra to version 2.1 through intermediate version]/returns) executed successfully
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: executed contrail Upgrade Cassandra Command : /bin/bash /etc/contrail/contrail_setup_utils/upgrade_cassandra.sh 10.204.217.77 /var/lib/cassandra centos71liberty29
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: (/Stage[database]/Contrail::Database::Install/Notify[executed contrail Upgrade Cassandra Command : /bin/bash /etc/contrail/contrail_setup_utils/upgrade_cassandra.sh 10.204.217.77 /var/lib/cassandra centos71liberty29]/message) defined 'message' as 'executed contrail Upgrade Cassandra Command : /bin/bash /etc/contrail/contrail_setup_utils/upgrade_cassandra.sh 10.204.217.77 /var/lib/cassandra centos71liberty29'
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: Could not update: Execution of '/usr/bin/yum -d 0 -e 0 -y list cassandra' returned 1: Error: No matching Packages to list
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: Wrapped exception:
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: Execution of '/usr/bin/yum -d 0 -e 0 -y list cassandra' returned 1: Error: No matching Packages to list
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: (/Stage[database]/Contrail::Database::Install/Package[cassandra]/ensure) change from absent to latest failed: Could not update: Execution of '/usr/bin/yum -d 0 -e 0 -y list cassandra' returned 1: Error: No matching Packages to list
Aug 29 12:08:07 nodeg37 puppet-agent[19212]: (/Stage[database]/Contrail::Database::Install/Package[contrail-openstack-database]) Dependency Package[cassandra] has failures: true
Aug 29 12:08:07 nodeg37

Revision history for this message
sundarkh (sundar-kh) wrote :

upload contrail-install-packge in tgz format has server manager exception

server-manager-client upload-image --id centos71kilo30 --version 30 --category package --type contrail-centos-package --file_name /cs-shared/github-build/R3.1/30/centos71/kilo/contrail-install-packages_3.1.1.0-30-kilo.tgz

"2016-09-01 09:29:13,646-ERROR-server_mgr_main.py:3361-log_trace(): *****TRACEBACK-START*****"
"2016-09-01 09:29:13,647-ERROR-server_mgr_main.py:3365-log_trace(): Traceback (most recent call last):
"
"2016-09-01 09:29:13,647-ERROR-server_mgr_main.py:3365-log_trace(): File "/opt/contrail/server_manager/server_mgr_main.py", line 2625, in delete_image
    self.log_and_raise_exception(msg)
"
"2016-09-01 09:29:13,648-ERROR-server_mgr_main.py:3365-log_trace(): File "/opt/contrail/server_manager/server_mgr_main.py", line 2758, in log_and_raise_exception
    raise ServerMgrException(msg, err_code)
"
"2016-09-01 09:29:13,649-ERROR-server_mgr_main.py:3365-log_trace(): ServerMgrException: "Image {'id': 'centos71kilo30'} doesn't exist"
"
"2016-09-01 09:29:13,650-ERROR-server_mgr_main.py:3366-log_trace(): *****TRACEBACK-END******"
"2016-09-01 09:29:13,650-DEBUG-server_mgr_main.py:1862-form_operartion_data(): function_start"
"2016-09-01 09:29:13,809-DEBUG-server_mgr_main.py:1888-upload_image(): upload_image"
"2016-09-01 09:29:26,461-ERROR-server_mgr_main.py:2198-_create_yum_repo(): create_yum_repo: error 2 when executing"tar xvzf $(ls contrail-install*) > /dev/null""
"2016-09-01 09:29:26,462-ERROR-server_mgr_main.py:3361-log_trace(): *****TRACEBACK-START*****"
"2016-09-01 09:29:26,462-ERROR-server_mgr_main.py:3365-log_trace(): Traceback (most recent call last):
"
"2016-09-01 09:29:26,462-ERROR-server_mgr_main.py:3365-log_trace(): File "/opt/contrail/server_manager/server_mgr_main.py", line 1937, in upload_image
    image_id, image_type, image_version, dest)
"
"2016-09-01 09:29:26,463-ERROR-server_mgr_main.py:3365-log_trace(): File "/opt/contrail/server_manager/server_mgr_main.py", line 2419, in _create_repo
    raise(e)
"
"2016-09-01 09:29:26,463-ERROR-server_mgr_main.py:3365-log_trace(): ServerMgrException: 'create_yum_repo: error 2 when executing"tar xvzf $(ls contrail-install*) > /dev/null"'
"
"2016-09-01 09:29:26,464-ERROR-server_mgr_main.py:3366-log_trace(): *****TRACEBACK-END******"
"2016-09-01 09:29:26,464-

Siva Gurumurthy (sgurumurthy)
Changed in juniperopenstack:
status: New → Fix Committed
status: Fix Committed → New
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/24329
Submitter: sgurumurthy (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/24329
Committed: http://github.org/Juniper/contrail-server-manager/commit/44245b8d3a4d1d20b9f597e3ee3695c7e22fe13d
Submitter: Zuul
Branch: master

commit 44245b8d3a4d1d20b9f597e3ee3695c7e22fe13d
Author: sgurumurthy <email address hidden>
Date: Tue Sep 20 16:55:58 2016 -0700

Closes-Bug: #1618200
Fix the way the version is retrieved for a contrail debian, rpm and tgz packages
Fix the way the version is retrieved for the storage package
One common fucntion will handle all the 3 cases

Change-Id: I76444cb66f6ae2a3939b1753c82eb406f610ad29

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.1

Review in progress for https://review.opencontrail.org/24356
Submitter: sgurumurthy (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/24356
Committed: http://github.org/Juniper/contrail-server-manager/commit/20234e252de1600da1821ea2bdfec32aedeb4c0f
Submitter: Zuul
Branch: R3.1

commit 20234e252de1600da1821ea2bdfec32aedeb4c0f
Author: sgurumurthy <email address hidden>
Date: Tue Sep 20 16:55:58 2016 -0700

Closes-Bug: #1618200
Fix the way the version is retrieved for a contrail debian, rpm and tgz packages
Fix the way the version is retrieved for the storage package
One common fucntion will handle all the 3 cases

Change-Id: I76444cb66f6ae2a3939b1753c82eb406f610ad29

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.