Upgrade fails for SM upgrade of Contrail 2.23 to 3.0

[Nitish Krishna Kaveri]

SM Upgrade of 2.23 Contrail to 3.0 contrail fails

Bugs seen:
1. Repo pinning
2. kafka-python packaging issue

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/16989
Submitter: Nitish Krishna Kaveri (<email address hidden>)

[Thilak Raj (tsurendra)]

Feb 8 12:21:41 nodeg21 puppet-agent[17166]: (/Stage[main]/Openstack::Common::Keystone/Notify[SYNC_DB = false]/message) defined 'message' as 'SYNC_DB = false'
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: (/Stage[main]/Contrail::Config/Contrail::Lib::Report_status[config_started]/Exec[contrail-status-config_started]/returns) executed successfully
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: Could not update: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install contrail-openstack-config' returned 100: Reading package lists...
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: Building dependency tree...
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: Reading state information...
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: contrail-openstack-config is already the newest version.
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: You might want to run 'apt-get -f install' to correct these:
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: The following packages have unmet dependencies:
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: contrail-analytics : Depends: python-kafka (>= 0.9.3) but it is not going to be installed
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: contrail-config-openstack : Depends: contrail-config (>= 3.0-2711) but 2.21-103 is to be installed
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: contrail-openstack-config : Depends: contrail-config (>= 3.0-2711) but 2.21-103 is to be installed
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: E: Unmet dependencies. Try 'apt-get -f install' with no packages (or specify a solution).
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: Wrapped exception:
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install contrail-openstack-config' returned 100: Reading package lists...
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: Building dependency tree...
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: Reading state information...
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: contrail-openstack-config is already the newest version.
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: You might want to run 'apt-get -f install' to correct these:
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: The following packages have unmet dependencies:
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: contrail-analytics : Depends: python-kafka (>= 0.9.3) but it is not going to be installed
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: contrail-config-openstack : Depends: contrail-config (>= 3.0-2711) but 2.21-103 is to be installed
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: contrail-openstack-config : Depends: contrail-config (>= 3.0-2711) but 2.21-103 is to be installed
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: E: Unmet dependencies. Try 'apt-get -f install' with no packages (or specify a solution).
Feb 8 12:21:42 nodeg21 puppet-agent[17166]: (/Stage[main]/Contrail::Config::Install/Package[contrail-openstack-config]/ensure) change from absent to latest failed: Could not update: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install contrail-openstack-config' returned 100: Reading package lists...

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/17056
Submitter: Nitish Krishna Kaveri (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/16989
Committed: http://github.org/Juniper/contrail-puppet/commit/babbc2b1181901413f7a5f3f8b277f38270b9bc0
Submitter: Zuul
Branch: master

commit babbc2b1181901413f7a5f3f8b277f38270b9bc0
Author: nitishkrishna <email address hidden>
Date: Mon Feb 8 14:50:10 2016 -0800

Partial-Bug: #1543333 - Changing dpdk and new contrail repo pinning priorities

This is to allow upgrade of 3.0 contrail packages, as well as dpdk packages
Note: old repo is at 999, new repo at 999, dpdk at 1000

Change-Id: Ib898a30de07564f2dfb404aa7fd371cc40dab2b7

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/17056
Committed: http://github.org/Juniper/contrail-puppet/commit/81c64c81364a81ccc8f43bda1f3aba559c375573
Submitter: Zuul
Branch: master

commit 81c64c81364a81ccc8f43bda1f3aba559c375573
Author: nitishkrishna <email address hidden>
Date: Tue Feb 9 16:58:26 2016 -0800

Partial-Bug: #1543333 - Fix for Upgrade of 3.0 2709 kilo -> 3.0 2711 kilo

Failure was in config of 2711 kilo.
The failure was because the rabbitmq server was not getting restarted properly.
Previously supervisor-support-service service was not being controlled by puppet.
It was in script form_rqm_cluster.
Now have introduced that service as puppet resource, it is being notified when verify_rabbitmq runs.

Rabbit-server restarts correctly during upgrade and provision completed.

Change-Id: I3a844694f71d5f139dd3cd8bc4c3665b29f5c763

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/17697
Submitter: Nitish Krishna Kaveri (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/17706
Submitter: Nitish Krishna Kaveri (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/17670
Submitter: Nitish Krishna Kaveri (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/17671
Submitter: Nitish Krishna Kaveri (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/17706
Committed: http://github.org/Juniper/contrail-server-manager/commit/734f705cc0f3d8d3080bb91ab851e6cc8c7826ec
Submitter: Zuul
Branch: R3.0

commit 734f705cc0f3d8d3080bb91ab851e6cc8c7826ec
Author: nitishkrishna <email address hidden>
Date: Tue Feb 23 15:14:00 2016 -0800

Closes-Bug: #1545618 - Removing unused openstack hiera param

In latest 3.0 server manager the shared secret is hard coded in openstack.yaml if not set via SM cluster params.
An additional parameter in openstack yaml has been deleted as in interfered with the upgrade

Change-Id: Ieeeb415fc20ec2314cd44b5acb25bd64ce3a9fc4
Closes-Bug: #1543333

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/17671
Committed: http://github.org/Juniper/contrail-puppet/commit/54f691e724bfdc4f0306a074eff8adb755bab844
Submitter: Zuul
Branch: R3.0

commit 54f691e724bfdc4f0306a074eff8adb755bab844
Author: nitishkrishna <email address hidden>
Date: Tue Feb 23 11:29:21 2016 -0800

Closes-Bug: #1545618 : Upgrade of contrail from R2.23 to R3.0 fixed

Changes:
I. Cassandra upgrade thru intermediate 2.0 version
Cassandra configured using file_line (not templates)
Cassandra templates removed

II. Python-kafka-python package replaced by python-kafka package

III. Contrail-config package brings new configs, causes dependency issues - fixed

IV. Removed secret key from nova api (metadata services bug)

Closes-Bug: #1543333

Change-Id: I1a655b129c9878f499aef58cb1b9057c7769d53c

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/17670
Submitter: Nitish Krishna Kaveri (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/17697
Committed: http://github.org/Juniper/contrail-server-manager/commit/a3922b43c7a3448c4d65f1d5e3f3046bcd5ee814
Submitter: Zuul
Branch: master

commit a3922b43c7a3448c4d65f1d5e3f3046bcd5ee814
Author: nitishkrishna <email address hidden>
Date: Tue Feb 23 15:14:00 2016 -0800

Closes-Bug: #1545618 - Removing unused openstack hiera param

In latest 3.0 server manager the shared secret is hard coded in openstack.yaml if not set via SM cluster params.
An additional parameter in openstack yaml has been deleted as in interfered with the upgrade

Change-Id: Ieeeb415fc20ec2314cd44b5acb25bd64ce3a9fc4
Closes-Bug: #1543333

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/17670
Submitter: Nitish Krishna Kaveri (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/17670
Committed: http://github.org/Juniper/contrail-puppet/commit/33316fb86f958531dff5eb361249b9a7dc6cfbb1
Submitter: Zuul
Branch: master

commit 33316fb86f958531dff5eb361249b9a7dc6cfbb1
Author: nitishkrishna <email address hidden>
Date: Tue Feb 23 11:29:21 2016 -0800

Closes-Bug: #1545618 : Upgrade of contrail from R2.23 to mainline fixed

Changes:
I. Cassandra upgrade thru intermediate 2.0 version
Cassandra configured using file_line (not templates)
Cassandra templates removed

II. Python-kafka-python package replaced by python-kafka package

III. Contrail-config package brings new configs, causes dependency issues - fixed

IV. Removed secret key from nova api (metadata services bug)

Closes-Bug: #1543333

Patch 2:
Closes-Bug: #1550650 - Error in Cassandra Seeds
Closed-Bug: #1550665 - Error in wget of upgrade_cassandra script

Patch 4:
Changes to config_cassandra (to remove extra cofigs which cause error in multinode)
Changes to database/install.pp (use contrail::params::contrail_repo_name - smlite CI failure)

Closes-Bug: #1550650 - Previous Upgrade cassandra script has bugs

1. The previous shell script did not loop properly to check for connect status
It was succeeding in cases where cassandra comes up within five seconds only

2. Config cassandra had bug in one particular file_line

3. Added dependency for upgrade such that contrail-database package gets upgraded only if cassandra upgrade succeeds

Note:
upgrade_cassandra.sh can be run independently to upgrade cassandra before provision
Usage is:
./upgrade_cassandra.sh <host_ip> <cassandra_home_dir> <image_id of added 3.0 image>

Change-Id: I1a655b129c9878f499aef58cb1b9057c7769d53c