SM provision of openstack-/contrail-ha cluster hangs on openstack start

Bug #1692048 reported by wenqing liang
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.0
Fix Committed
Critical
Ranjeet R
Trunk
Fix Committed
Critical
Ranjeet R

Bug Description

R4.0-7 newton provision of 16.04.2 openstack-/contrail-ha cluster via r4.0-7 mitaka 14.04.5 SM hangs:

SM: 10.87.118.139

+---------+---------------------+------------+-------------------+
| id | status | ip_address | mac_address |
+---------+---------------------+------------+-------------------+
| server3 | openstack_started | 10.0.0.6 | 02:35:9D:71:11:A2 |
| server9 | provision_issued | 10.0.0.12 | 02:4D:7F:A1:2C:E1 |
| server6 | provision_issued | 10.0.0.9 | 02:50:00:BF:EE:90 |
| server8 | provision_issued | 10.0.0.11 | 02:41:D9:71:B9:6E |
| server1 | openstack_completed | 10.0.0.4 | 02:EA:AC:62:EC:8F |
| server4 | provision_issued | 10.0.0.7 | 02:20:64:4E:FC:81 |
| server5 | provision_issued | 10.0.0.8 | 02:16:31:80:E7:A3 |
| server2 | openstack_completed | 10.0.0.5 | 02:1B:24:A5:C0:4C |
| server7 | provision_issued | 10.0.0.10 | 02:E7:BF:11:BD:33 |
+---------+---------------------+------------+-------------------+

+---------+--------------------------------------------------------------------------+
| id | roles |
+---------+--------------------------------------------------------------------------+
| server3 | [u'openstack'] |
| server9 | [u'contrail-compute'] |
| server6 | [u'contrail-controller', u'contrail-analytics', u'contrail-analyticsdb'] |
| server8 | [u'contrail-compute'] |
| server1 | [u'openstack'] |
| server4 | [u'contrail-controller', u'contrail-analytics', u'contrail-analyticsdb'] |
| server5 | [u'contrail-controller', u'contrail-analytics', u'contrail-analyticsdb'] |
| server2 | [u'openstack'] |
| server7 | [u'contrail-lb'] |

/etc/mysql/conf.d/wsrep.cnf is missing on two nodes (i.e. server2 and server1) though SM says provision is completed on those openstack nodes …

Galera clustering is triggered only on 10.0.0.6 and not on 10.0.0.5 and 10.0.0.4.

wenqing liang (wliang)
information type: Proprietary → Public
Jeba Paulaiyan (jebap)
tags: added: blocker sanity
Revision history for this message
Ranjeet R (rranjeet-n) wrote :

Update - Galera bootstrapping has changed a bit in Ubuntu 16.04. The bringup script should be modified for 16.04 to bootstrap the cluster.

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/31945
Submitter: Ranjeet R (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/31945
Committed: http://github.com/Juniper/contrail-provisioning/commit/bc1cf844d1fd46ac604b776d22cf26d16d4c829f
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit bc1cf844d1fd46ac604b776d22cf26d16d4c829f
Author: Ranjeet R <email address hidden>
Date: Sun May 21 19:22:54 2017 -0700

Fixes: SM provision of openstack-/contrail-ha cluster hangs on openstack start

In 16.04, the boot strap of galera does not take wsrep cluster address
as a parameter. When bootstrapping the donor, modifying the conf file
to empty gcomm string when the donor is bootstrapped and modifying it back.

Change-Id: I9136821f3094a4bb8e68484cf584d26ce1609929
Closes-Bug: 1692048

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/32319
Submitter: Ranjeet R (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/32319
Committed: http://github.com/Juniper/contrail-provisioning/commit/53dab85f62bcc463cb0f7f7e550ad0532bd9b8bb
Submitter: Zuul (<email address hidden>)
Branch: master

commit 53dab85f62bcc463cb0f7f7e550ad0532bd9b8bb
Author: Ranjeet R <email address hidden>
Date: Sun May 21 19:22:54 2017 -0700

Fixes: SM provision of openstack-/contrail-ha cluster hangs on openstack start

In 16.04, the boot strap of galera does not take wsrep cluster address
as a parameter. When bootstrapping the donor, modifying the conf file
to empty gcomm string when the donor is bootstrapped and modifying it back.

Change-Id: I9136821f3094a4bb8e68484cf584d26ce1609929
Closes-Bug: 1692048
(cherry picked from commit bc1cf844d1fd46ac604b776d22cf26d16d4c829f)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.