Vcenter-as-compute: ha_proxy not restart aborting setup_all provisioning

Bug #1694858 reported by Sarath
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.0
Fix Committed
Critical
amudhar
Trunk
Fix Committed
Critical
amudhar

Bug Description

This seen during fresh install Vcenter-compute sanity with latest #16 ( newton )

::
::
2017-05-31 14:06:12:126830: [root@10.87.36.10] Executing task 'setup_openstack_keepalived'
2017-05-31 14:06:12:127025: [root@10.87.36.10] sudo: python -c 'from platform import linux_distribution; print linux_distribution()'
2017-05-31 14:06:12:127185: [root@10.87.36.10] out: ('Ubuntu', '16.04', 'xenial')
2017-05-31 14:06:12:162753: [root@10.87.36.10] out:
2017-05-31 14:06:12:162940:
2017-05-31 14:06:12:163646: [root@10.87.36.10] sudo: sudo sed -i 's/ENABLED=.*/ENABLED=1/g' /etc/default/haproxy
2017-05-31 14:06:12:163877: [root@10.87.36.10] sudo: /etc/init.d/haproxy stop
2017-05-31 14:06:12:251275: [root@10.87.36.10] out: Stopping haproxy (via systemctl): haproxy.service.
2017-05-31 14:06:12:316152: [root@10.87.36.10] out:
2017-05-31 14:06:12:316290:
2017-05-31 14:06:12:316628: [root@10.87.36.10] sudo: service haproxy restart
2017-05-31 14:06:12:316750: [root@10.87.36.10] out: Job for haproxy.service failed because the control process exited with error code. See "systemctl status haproxy.service" and "journalctl -xe" for details.
2017-05-31 14:06:12:413774: [root@10.87.36.10] out:
2017-05-31 14:06:12:414026:
2017-05-31 14:06:12:414137: Disconnecting from 10.87.36.20... done.
2017-05-31 14:06:12:528156: Disconnecting from 10.87.36.15... done.
2017-05-31 14:06:12:591781: Disconnecting from 10.87.36.19... done.
2017-05-31 14:06:12:705530: Disconnecting from 10.87.36.18... done.
2017-05-31 14:06:12:769186: Disconnecting from 10.87.36.12... done.
2017-05-31 14:06:12:800767: Disconnecting from 10.87.36.21... done.
2017-05-31 14:06:12:808130: Disconnecting from 10.87.36.11... done.
2017-05-31 14:06:12:921832: Disconnecting from 10.87.36.10... done.
2017-05-31 14:06:13:035665:
2017-05-31 14:06:12:414222: Fatal error: sudo() received nonzero return code 1 while executing!
2017-05-31 14:06:12:414222:
2017-05-31 14:06:12:414222: Requested: service haproxy restart
2017-05-31 14:06:12:414222: Executed: sudo -S -p 'sudo password:' /bin/bash -l -c "service haproxy restart"
2017-05-31 14:06:12:414222:
2017-05-31 14:06:12:414246: Aborting.

Revision history for this message
Sarath (nsarath) wrote :

nsarath@ubuntu-build04:/auto/cores/1694858$ ls -ltrd *
-rwxrwxrwx 1 nsarath test 10240 May 31 16:46 Ctrl-A-Utils.tar
-rwxrwxrwx 1 nsarath test 553963520 May 31 16:47 Ctrl-A-log.tar

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/32336
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/32339
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/32336
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/32339
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/32339
Committed: http://github.com/Juniper/contrail-fabric-utils/commit/88be990f4bbfa8249acee12d097f4286eba23eb7
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit 88be990f4bbfa8249acee12d097f4286eba23eb7
Author: Amudha <email address hidden>
Date: Wed May 31 20:37:15 2017 -0700

Fix haproxy syntax change in collector_haproxy.py

Change-Id: Ic96635eeb3f8b924a902a5cbec49bff25333af8a
Closes-Bug: #1694858

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/32445
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/32446
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Review in progress for https://review.opencontrail.org/32447
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/32446
Committed: http://github.com/Juniper/contrail-fabric-utils/commit/0e1abdc8cee3705427674b20a9e10b917bf44df2
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit 0e1abdc8cee3705427674b20a9e10b917bf44df2
Author: Amudha <email address hidden>
Date: Fri Jun 2 20:52:09 2017 -0700

HA provisioning in 16.04

-> Fix haproxy syntax changes
-> Disable CMON on 16.04

Change-Id: Ief7c09d7b0b2fbe3b6953a32cc0bafd8a18382c5
Partial-Bug: #1694858

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/32447
Committed: http://github.com/Juniper/contrail-provisioning/commit/ed35ddfc8928685c48e521942465b4c55dbd517c
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit ed35ddfc8928685c48e521942465b4c55dbd517c
Author: Amudha <email address hidden>
Date: Fri Jun 2 21:00:19 2017 -0700

HA provisioning in 16.04

-> Fix setup-vnc-galera, do not call mysql_install_db for 16.04

Change-Id: I333110adddcc4b0efba713073a81609513f4a247
Partial-Bug: #1694858

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/32451
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/32452
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Review in progress for https://review.opencontrail.org/32453
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/32451
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/32453
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Review in progress for https://review.opencontrail.org/32452
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Review in progress for https://review.opencontrail.org/32453
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/32451
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/32452
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/32453
Committed: http://github.com/Juniper/contrail-fabric-utils/commit/573d970b9d2f1a62606566f0a4f7cb69f1b259fe
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit 573d970b9d2f1a62606566f0a4f7cb69f1b259fe
Author: Amudha <email address hidden>
Date: Sat Jun 3 13:10:56 2017 -0700

HA provisioning in 16.04 - fab changes

-> https://github.com/Juniper/contrail-fabric-utils/commit/0e1abdc8cee3705427674b20a9e10b917bf44df2
removed the haproxy.cfg entries in non-HA case, adding it back.
-> Stop collector services before starting haproxy.
-> In haproxy version running on 16.04, tcp-check isn's needed,
remove conditionallay for 16.04.

Change-Id: I30aa3b6ad789a2ea8bda0c65e562cb9cef1b858d
Partial-Bug: #1694858

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/32451
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/32452
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Review in progress for https://review.opencontrail.org/32462
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/32452
Committed: http://github.com/Juniper/contrail-provisioning/commit/434af440fb7d685a1785621be9cb054ace4a9a15
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit 434af440fb7d685a1785621be9cb054ace4a9a15
Author: Amudha <email address hidden>
Date: Sat Jun 3 09:08:17 2017 -0700

HA provisioning in 16.04 - provisioning changes

-> Set keystone ports for HA and non-HA scenario.
-> In newton, keystone runs behind apache2, update Listen
ports in /etc/apache2/keystone.conf

Change-Id: Ieb7c70bcf5ef58beeda79bcbfe0a19bb5752b66d
Partial-Bug: #1694858

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/32462
Committed: http://github.com/Juniper/contrail-fabric-utils/commit/51c1318e914d52aa87d2ce8c46c97b12d02daf9c
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit 51c1318e914d52aa87d2ce8c46c97b12d02daf9c
Author: Amudha <email address hidden>
Date: Sun Jun 4 06:27:54 2017 -0700

HA provisioning in 16.04 - disable hamon

-> Disable contrail-hamon in 16.04

Change-Id: Ibde9094520aef6594bbc9212c7b60f46f608c9da
Closes-Bug: #1694858

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/32451
Committed: http://github.com/Juniper/contrail-provisioning/commit/55d5a3f2e31366484d1256bb22e42be2a6132fc7
Submitter: Zuul (<email address hidden>)
Branch: master

commit 55d5a3f2e31366484d1256bb22e42be2a6132fc7
Author: Amudha <email address hidden>
Date: Sat Jun 3 09:08:17 2017 -0700

HA provisioning in 16.04 - provisioning changes

-> Set keystone ports for HA and non-HA scenario.
-> In newton, keystone runs behind apache2, update Listen
ports in /etc/apache2/keystone.conf

Change-Id: Ieb7c70bcf5ef58beeda79bcbfe0a19bb5752b66d
Partial-Bug: #1694858

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/32445
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/32445
Committed: http://github.com/Juniper/contrail-fabric-utils/commit/bb8a2f6a48f4722aed3e441abb8a81900808dfa4
Submitter: Zuul (<email address hidden>)
Branch: master

commit bb8a2f6a48f4722aed3e441abb8a81900808dfa4
Author: Amudha <email address hidden>
Date: Thu Jun 8 09:28:11 2017 -0700

HA provisioning in 16.04 - fab changes

Commit missing fixes from R4.0 to master
-> Fix haproxy syntax changes
-> Disable CMON on 16.04

Change-Id: Ief7c09d7b0b2fbe3b6953a32cc0bafd8a18382c5
Partial-Bug: #1694858

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.