Server Manager HA, configuration for mysql , nova , haproxy were different from fab provisioning

Bug #1413364 reported by venu kolli
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Fix Committed
Critical
Thilak Raj
R2.1
Fix Committed
Critical
Thilak Raj

Bug Description

There were some changes in configuration of a HA system through fab provisioning and server manager provisioning.

Need to look into the differences and make sure that system provisioned by both of them should be similar in functionality.

Checked this on R2.1 build 7

Revision history for this message
venu kolli (vkolli) wrote :

added ha tag as well

venu kolli (vkolli)
Changed in juniperopenstack:
importance: Undecided → Critical
Abhay Joshi (abhayj)
Changed in juniperopenstack:
assignee: nobody → Thilak Raj (tsurendra)
venu kolli (vkolli)
tags: added: blocker ha
information type: Proprietary → Public
Revision history for this message
Thilak Raj (tsurendra) wrote :

Addressed Haproxy config in below commit.

https://review.opencontrail.org/#/c/6622/

summary: - server manager HA , configuration for mysql , nova , haproxy were
- different from fab provisioning.
+ ServerManager HA, configuration for mysql , nova , haproxy were
+ different from fab provisioning
summary: - ServerManager HA, configuration for mysql , nova , haproxy were
+ Server Manager HA, configuration for mysql , nova , haproxy were
different from fab provisioning
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/6994
Committed: http://github.org/Juniper/contrail-puppet/commit/1d4eb99f3bd04bb0a28cfc67ae8a50ed9a4f6234
Submitter: Zuul
Branch: R2.1

commit 1d4eb99f3bd04bb0a28cfc67ae8a50ed9a4f6234
Author: tsurendra <email address hidden>
Date: Tue Feb 3 15:38:27 2015 -0800

Closes-Bug: #1413364
Server Manager HA, configuration for mysql , nova , haproxy were different from fab provisioning

Mysql gets into error state due to locks.

Deviced a recover logic for that.

Change-Id: Ibb7463356ed0683ef05c2dc57e51c9a8fe0c82d9

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/7107
Committed: http://github.org/Juniper/contrail-server-manager/commit/393e2bf215e990ffa8187117963cded97f6dbdd7
Submitter: Zuul
Branch: R2.1

commit 393e2bf215e990ffa8187117963cded97f6dbdd7
Author: tsurendra <email address hidden>
Date: Thu Feb 5 13:19:01 2015 -0800

Partial-Bug: #1413364

Server Manager HA, configuration for mysql , nova , haproxy were
different from fab provisioning

1) Wrote a script to cluster gallera.

Change-Id: I4290d88b164fecec51cee950bffee115371956a8

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/7108
Committed: http://github.org/Juniper/contrail-puppet/commit/89ee946c0cb057761e4a164d600eb20b34ff6840
Submitter: Zuul
Branch: R2.1

commit 89ee946c0cb057761e4a164d600eb20b34ff6840
Author: tsurendra <email address hidden>
Date: Thu Feb 5 14:17:48 2015 -0800

Partial-Bug: #1413364

1)Generate config for mysql and nova similar to fab.
2)Run DB sync only on one node.
3)Handle db sync for cinder.
4)Make check-wsrep-status to re-cluster when galera enters a bad state.
5)Mysql was connecting to 3306 instead of 33306.

Change-Id: I1231ef121b846fb7b35202ab548bdc37b861a1cd

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/7375
Committed: http://github.org/Juniper/contrail-server-manager/commit/98397807cacf5c710a3d452e0c2965823dd1ab08
Submitter: Zuul
Branch: R2.1

commit 98397807cacf5c710a3d452e0c2965823dd1ab08
Author: tsurendra <email address hidden>
Date: Thu Feb 12 11:26:56 2015 -0800

Partial-Bug: #1413364

On multi-interface,
Allowed hosts should have contraol_data ip list.

Change-Id: Id529ef6220ee919a8435b1b9824b67db254ef165

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/7376
Committed: http://github.org/Juniper/contrail-puppet/commit/e900952291f72ec126461e9fcdb8f4efd01a85b5
Submitter: Zuul
Branch: R2.1

commit e900952291f72ec126461e9fcdb8f4efd01a85b5
Author: tsurendra <email address hidden>
Date: Thu Feb 12 11:33:59 2015 -0800

Partial-Bug: #1413364

Use openstack data interface ip list instead of mgmt ip.

Change-Id: I31d031e8f0246f0bd54922c036e48afaa165a1e5

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/7460
Committed: http://github.org/Juniper/contrail-server-manager/commit/0b3e1e4c9de7ccd7754fc20ba0a437b7f0514a01
Submitter: Zuul
Branch: R2.1

commit 0b3e1e4c9de7ccd7754fc20ba0a437b7f0514a01
Author: tsurendra <email address hidden>
Date: Sun Feb 15 09:14:01 2015 -0800

Partial-Bug: #1413364

On multi-interface,
Allowed hosts should have mgmt ip list in addtion to control data ip
list, as in non-ha setup ,some of the service seems to connect with mgmt
IP and there is no mysql grant.

Change-Id: I17c2e2ef79890e032bb9a9b3372d2aa9d988d6bf

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/7527
Committed: http://github.org/Juniper/contrail-puppet/commit/336516092314955dd67715f857f9a01188aba023
Submitter: Zuul
Branch: R2.1

commit 336516092314955dd67715f857f9a01188aba023
Author: tsurendra <email address hidden>
Date: Tue Feb 17 13:09:34 2015 -0800

Partial-Bug: #1413364
Server Manager HA, configuration for mysql , nova , haproxy were
different from fab provisioning

Ha-mon was being started only on openstack[0],
Have done changes to make it start on openstack nodes after provision is
complete.

Testing:
Provisoned and tested that ha-mon is started on all nodes.

Change-Id: I70f3f0d5cefc6c84190eb0b8296bb87df88677bc

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/7858
Committed: http://github.org/Juniper/contrail-server-manager/commit/87b1598478c232e0a814c01d1afbfda7785d2823
Submitter: Zuul
Branch: master

commit 87b1598478c232e0a814c01d1afbfda7785d2823
Author: tsurendra <email address hidden>
Date: Thu Feb 5 13:19:01 2015 -0800

Partial-Bug: #1413364

Server Manager HA, configuration for mysql , nova , haproxy were
different from fab provisioning

1) Wrote a script to cluster gallera.

Change-Id: I4290d88b164fecec51cee950bffee115371956a8

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/7859
Committed: http://github.org/Juniper/contrail-server-manager/commit/6e735cf77f286f0133b5e7606c5bbbb81b567936
Submitter: Zuul
Branch: master

commit 6e735cf77f286f0133b5e7606c5bbbb81b567936
Author: tsurendra <email address hidden>
Date: Thu Feb 12 11:26:56 2015 -0800

Partial-Bug: #1413364

On multi-interface,
Allowed hosts should have contraol_data ip list.

Change-Id: Id529ef6220ee919a8435b1b9824b67db254ef165

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/7860
Committed: http://github.org/Juniper/contrail-server-manager/commit/93d7021dba4b3d6fb4f0a53e51f2743252d47fae
Submitter: Zuul
Branch: master

commit 93d7021dba4b3d6fb4f0a53e51f2743252d47fae
Author: tsurendra <email address hidden>
Date: Sun Feb 15 09:14:01 2015 -0800

Partial-Bug: #1413364

On multi-interface,
Allowed hosts should have mgmt ip list in addtion to control data ip
list, as in non-ha setup ,some of the service seems to connect with mgmt
IP and there is no mysql grant.

Change-Id: I17c2e2ef79890e032bb9a9b3372d2aa9d988d6bf

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/7883
Committed: http://github.org/Juniper/contrail-puppet/commit/2e3b091c396aa72f0bfcf119c2200d561c3f6b30
Submitter: Zuul
Branch: master

commit 2e3b091c396aa72f0bfcf119c2200d561c3f6b30
Author: tsurendra <email address hidden>
Date: Thu Feb 26 11:30:30 2015 -0800

Merging below commits from R2.1

4648977 (HEAD, merge_5) Server Manager: provision complete status is lost when compute role is present Closes-Bug: #1424870
2f9356b Server Manager: provision complete status is lost when compute role is present Closes-Bug: #1424870
74c49e8 Server Manager: external_vip Partial-Bug: #1423179
b23de15 Partial-Bug: #1413364 Server Manager HA, configuration for mysql, nova , haproxy were different from fab provisioning
b28a286 Closes-Bug: #1413364
7f67138 Partial-Bug: #1413364
6ce4a85 Partial-Bug: #1413364
681e420 Closes-Bug: #1416585 Fixing multi interface related code changes for 1415585.
c7e800c Closes-Bug: #1413364 Server Manager HA, configuration for mysql, nova , haproxy were different from fab provisioning
c3278ea Closes-Bug: #1417411 Server Manager: Remove keystone-auth.conf for config server, untill multi-tenancy is enabled
5b179d3 Closes-Bug: #1413365 server manager HA , rabbitmq clustering should happen on control interface
0d3522f Partial-Bug: #1416585 Changes to clean up parameter list passed to puppet modules and document." into R2.1
847e258 Closes-Bug: #1416354 Provisioning External router is not happening through server-manager
d4a9b95 Closes-Bug: #1412757 Not able to login to WebUI
c191800 Partial-Bug: #1397496 Server Manager changes to make use of new structure puppet modules for contrail and openstack (from puppet-labs)."
 into R2.1"
8bc7246 Closes-Bug: #1415787 Nova is not able to connect to AMQP server
5290115 Partial-Bug: #1397496 Server Manager changes to make use of new structure puppet modules for contrail and openstack (from puppet-labs)."
 into R2.1
ae53bf4 Closes-bug: #1413361 server manager HA , supervisor is not starting contrail-api service when it is down.
60d20eb Partial: #1413364 server manager HA , configuration for mysql ,nova , haproxy were different from fab provisioning.
7478e72 Partial-Bug: #1397496 Server Manager changes to make use of new structure puppet modules for contrail and openstack (from puppet-labs)."
 into R2.1
95f4b05 Partial-Bug: #1397496 Server Manager changes to make use of new structure puppet modules for contrail and openstack (from
 puppet-labs)." into R2.1
700dd4c Partial-Bug: #1397496 Server Manager changes to make use of new structure puppet modules for contrail and openstack (from
 puppet-labs)." into R2.1
292b0ba Partial-Bug: #1397496 Server Manager changes to make use of new structure puppet modules for contrail and openstack (from
 puppet-labs)." into R2.1
b797518 Partial-Bug: #1397496 Server Manager changes to make use of new structure puppet modules for contrail and openstack (from
 puppet-labs).

Change-Id: If3f4512e9fb2aa4cc7ad99239d4011ee9838db6d

Changed in juniperopenstack:
status: New → Fix Committed
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.