Juniper Openstack

SM:R3.1.1 build 38: creation of lbaas fails

Bug #1639442 reported by sundarkh
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R3.0.2.x
Invalid
Undecided
kamlesh parmar
Juniper Openstack r3.0.2.1
R3.1
Fix Committed
High
Nitish Krishna Kaveri
Juniper Openstack r3.1.3.0
R3.1.1.x
Fix Committed
High
Nitish Krishna Kaveri
Juniper Openstack r3.1.1.1
R3.2
Fix Committed
High
Nitish Krishna Kaveri
Juniper Openstack r3.2.0.0-fcs "r3.2.0.0"
Trunk
Fix Committed
High
Nitish Krishna Kaveri
Juniper Openstack r4.0.0.0-fcs "r4.0.0.0"

Bug Description

SM:R3.1.1 build 38: lbaas not able to connect to VIP ip

HA setup 3.1.1 build 38 Kilo with 2 computes

root@nodeg21:~# neutron lb-vip-list
+--------------------------------------+-------+----------+----------+----------------+--------+
| id | name | address | protocol | admin_state_up | status |
+--------------------------------------+-------+----------+----------+----------------+--------+
| 625fd269-a039-48f8-b7c3-7f66a2f92125 | myvip | 10.1.1.7 | HTTP | True | ACTIVE |
+--------------------------------------+-------+----------+----------+----------------+--------+
root@nodeg21:~# neutron lb-vip-show myvip
+---------------------+--------------------------------------+
| Field | Value |
+---------------------+--------------------------------------+
| address | 10.1.1.7 |
| admin_state_up | True |
| connection_limit | -1 |
| description | |
| id | 625fd269-a039-48f8-b7c3-7f66a2f92125 |
| name | myvip |
| pool_id | 987a49b2-74e5-4c2c-b599-2e1b014aa1d7 |
| port_id | fb037c55-34bf-413c-854a-ff38b74992b3 |
| protocol | HTTP |
| protocol_port | 80 |
| session_persistence | |
| status | ACTIVE |
| subnet_id | 7a12be4c-fbaf-4bb2-b9df-08c2ec64172f |
| tenant_id | 17d16de3b1ad4c6892491963bd982e65 |
+---------------------+--------------------------------------+
root@nodeg21:~# neutron lb-pool-show mypool
+------------------------+--------------------------------------+
| Field | Value |
+------------------------+--------------------------------------+
| admin_state_up | True |
| custom_attributes | [] |
| description | |
| health_monitors | a310157a-2457-4317-a819-54ba044a2970 |
| health_monitors_status | |
| id | 987a49b2-74e5-4c2c-b599-2e1b014aa1d7 |
| lb_method | ROUND_ROBIN |
| members | 27e8f53c-2d5b-4e52-8076-d808f79d9afa |
| | 2767a76b-77f2-4b04-8ccc-4a17d8f0c9a3 |
| | 19c8a2d9-01b3-4af5-9ca8-fcb5c87f565f |
| name | mypool |
| protocol | HTTP |
| provider | opencontrail |
| status | ACTIVE |
| subnet_id | 7a12be4c-fbaf-4bb2-b9df-08c2ec64172f |
| tenant_id | 17d16de3b1ad4c6892491963bd982e65 |
| vip_id | 625fd269-a039-48f8-b7c3-7f66a2f92125 |
+------------------------+--------------------------------------+
root@nodeg21:~# nova list
+----+------+--------+------------+-------------+----------+
| ID | Name | Status | Task State | Power State | Networks |
+----+------+--------+------------+-------------+----------+
+----+------+--------+------------+-------------+----------+

/var/log/contrail/contrail-lbaas-haproxy-stdout.log >> On nodea4 the compute node

11/05/2016 05:53:21 MSG Starting haproxy for Loadbalancer-ID 7ffb405d-6bda-4e18-82b7-34bc8e1ba350
11/05/2016 05:53:21 MSG exec of "haproxy" failed: No such file or directory

Seen with Multi interface setup also

See original description
sundarkh (sundar-kh)
summary: - SM:HA:R3.1.1 build 38: lbaas not able to connect to VIP ip
+ SM:R3.1.1 build 38: lbaas not able to connect to VIP ip
description: updated
Jeba Paulaiyan (jebap)
tags: added: sanity
Revision history for this message
kamlesh parmar (kparmar) wrote : Re: SM:R3.1.1 build 38: lbaas not able to connect to VIP ip

Seems like connectivity losss to VIP from compute node.
Please provision the cluster with required config and let me know. Need to debug on setup.

Revision history for this message
sundarkh (sundar-kh) wrote :

In 3.0.2.x , 2016-11-16 06:17:51,510 - INFO - pool ref created successfully for VIP with id fe0ffa8e-1b1c-40ce-a131-63df072b5876
[ubuntu@169.254.0.3] run: cd <function cd at 0x7fd1272659b0>; hostname > index.html
[ubuntu@169.254.0.3] out: /bin/bash: -c: line 0: syntax error near unexpected token `;'
[ubuntu@169.254.0.3] out: /bin/bash: -c: line 0: `cd <function cd at 0x7fd1272659b0>; hostname > index.html'
[ubuntu@169.254.0.3] out:

Warning: run() received nonzero return code 1 while executing 'cd <function cd at 0x7fd1272659b0>; hostname > index.html'!

[ubuntu@169.254.0.3] sudo: cd <function cd at 0x7fd1272659b0>; python -m SimpleHTTPServer 80 &> /tmp/http.log
[ubuntu@169.254.0.3] out: sudo: unable to resolve host ctest-server1-52875118
[ubuntu@169.254.0.3] out: /bin/bash: -c: line 0: syntax error near unexpected token `;'
[ubuntu@169.254.0.3] out: /bin/bash: -c: line 0: `cd <function cd at 0x7fd1272659b0>; python -m SimpleHTTPServer 80 &> /tmp/http.log'
[ubuntu@169.254.0.3] out:

connection to vip 20.1.1.4 failed

Revision history for this message
sundarkh (sundar-kh) wrote :

And is not a software issue

Needed test code fix
https://review.opencontrail.org/#/c/26153

Revision history for this message
sundarkh (sundar-kh) wrote :

With Build 43, observing that creation of LBAAS fails

Neutron-server.log

2016-11-17 21:21:49.724 12260 ERROR neutron.manager File "/usr/lib/python2.7/dist-packages/neutron/manager.py", line 150, in load_class_for_provider
2016-11-17 21:21:49.724 12260 ERROR neutron.manager plugin_class = importutils.import_class(plugin_provider)
2016-11-17 21:21:49.724 12260 ERROR neutron.manager File "/usr/lib/python2.7/dist-packages/oslo_utils/importutils.py", line 27, in import_class
2016-11-17 21:21:49.724 12260 ERROR neutron.manager __import__(mod_str)
2016-11-17 21:21:49.724 12260 ERROR neutron.manager File "/usr/lib/python2.7/dist-packages/neutron_plugin_contrail/plugins/opencontrail/loadbalancer/plugin.py", line 4, in <module>
2016-11-17 21:21:49.724 12260 ERROR neutron.manager from loadbalancer_db import LoadBalancerPluginDb
2016-11-17 21:21:49.724 12260 ERROR neutron.manager File "/usr/lib/python2.7/dist-packages/neutron_plugin_contrail/plugins/opencontrail/loadbalancer/loadbalancer_db.py", line 24, in <module>
2016-11-17 21:21:49.724 12260 ERROR neutron.manager from neutron_lbaas.extensions import loadbalancer
2016-11-17 21:21:49.724 12260 ERROR neutron.manager ImportError: No module named neutron_lbaas.extensions
2016-11-17 21:21:49.724 12260 ERROR neutron.manager
2016-11-17 2

Neutron.conf

api_extensions_path = extensions:/path/to/more/extensions:/even/more/extensions
api_extensions_path = extensions:/usr/lib/python2.7/dist-packages/neutron_plugin_contrail/extensions:/usr/lib/python2.7/dist-packages/neutron_lbaas/extensions
# The __path__ of neutron.extensions is appended to this, so if your

summary: - SM:R3.1.1 build 38: lbaas not able to connect to VIP ip
+ SM:R3.1.1 build 38: creation of lbaas fails
Revision history for this message
Abhay Joshi (abhayj) wrote :

Talking to Sundar and Kamlesh, reopening 3.1 onwards instances of bug. Still invalid for 3.0. Bug is not critical. Nitish has provided patch to Sundar to proceed. Some 2-3 test cases are failing. Change was done in contrail, but corresponding change was not done in SM.

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/26402
Submitter: Nitish Krishna Kaveri (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.2

Review in progress for https://review.opencontrail.org/26403
Submitter: Nitish Krishna Kaveri (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.1

Review in progress for https://review.opencontrail.org/26404
Submitter: Nitish Krishna Kaveri (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/26402
Committed: http://github.org/Juniper/contrail-puppet/commit/7b71a8d314dcb5d2d9934f13aab1732d8bc34732
Submitter: Zuul
Branch: master

commit 7b71a8d314dcb5d2d9934f13aab1732d8bc34732
Author: nitishkrishna <email address hidden>
Date: Tue Nov 22 16:09:10 2016 -0800

Closes-Bug: #1639442 - Lbaas plugin set incorrectly in liberty,mitaka

The service plugin in neutron.conf for liberty, mitaka for 3.1 upwards will now be set as:
neutron_plugin_contrail.plugins.opencontrail.loadbalancer.v2.plugin.LoadBalancerPluginV2

for kilo it will remain:
neutron_plugin_contrail.plugins.opencontrail.loadbalancer.plugin.LoadBalancerPlugin

Change-Id: I4c8072f9a5ab48583ee9a3abf8e613ca6221d6bd

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/26404
Committed: http://github.org/Juniper/contrail-puppet/commit/bdd5b50b2e894ecf3f81761637e2e43a678446ff
Submitter: Zuul (<email address hidden>)
Branch: R3.1

commit bdd5b50b2e894ecf3f81761637e2e43a678446ff
Author: nitishkrishna <email address hidden>
Date: Tue Nov 22 16:09:10 2016 -0800

Closes-Bug: #1639442 - Lbaas plugin set incorrectly in liberty,mitaka

The service plugin in neutron.conf for liberty, mitaka for 3.1 upwards will now be set as:
neutron_plugin_contrail.plugins.opencontrail.loadbalancer.v2.plugin.LoadBalancerPluginV2

for kilo it will remain:
neutron_plugin_contrail.plugins.opencontrail.loadbalancer.plugin.LoadBalancerPlugin

Change-Id: I4c8072f9a5ab48583ee9a3abf8e613ca6221d6bd

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/26403
Committed: http://github.org/Juniper/contrail-puppet/commit/b0dc297859f06fff3dce43e10de8600a6019d053
Submitter: Zuul (<email address hidden>)
Branch: R3.2

commit b0dc297859f06fff3dce43e10de8600a6019d053
Author: nitishkrishna <email address hidden>
Date: Tue Nov 22 16:09:10 2016 -0800

Closes-Bug: #1639442 - Lbaas plugin set incorrectly in liberty,mitaka

The service plugin in neutron.conf for liberty, mitaka for 3.1 upwards will now be set as:
neutron_plugin_contrail.plugins.opencontrail.loadbalancer.v2.plugin.LoadBalancerPluginV2

for kilo it will remain:
neutron_plugin_contrail.plugins.opencontrail.loadbalancer.plugin.LoadBalancerPlugin

Change-Id: I4c8072f9a5ab48583ee9a3abf8e613ca6221d6bd

Revision history for this message
sundarkh (sundar-kh) wrote :

Issue seen with 3.1.1.x build 1 mitaka, creation of lbaasv2 fails

Neutron Error Log
-------------------

2017-01-04 13:21:16.333 20673 ERROR neutron.common.utils [-] Error loading class by class name
2017-01-04 13:21:16.333 20673 ERROR neutron.common.utils Traceback (most recent call last):
2017-01-04 13:21:16.333 20673 ERROR neutron.common.utils File "/usr/lib/python2.7/dist-packages/neutron/common/utils.py", line 562, in load_class_by_alias_or_classname
2017-01-04 13:21:16.333 20673 ERROR neutron.common.utils class_to_load = importutils.import_class(name)
2017-01-04 13:21:16.333 20673 ERROR neutron.common.utils File "/usr/lib/python2.7/dist-packages/oslo_utils/importutils.py", line 30, in import_class
2017-01-04 13:21:16.333 20673 ERROR neutron.common.utils __import__(mod_str)
2017-01-04 13:21:16.333 20673 ERROR neutron.common.utils File "/usr/lib/python2.7/dist-packages/neutron_plugin_contrail/plugins/opencontrail/loadbalancer/plugin.py", line 4, in <module>
2017-01-04 13:21:16.333 20673 ERROR neutron.common.utils from loadbalancer_db import LoadBalancerPluginDb
2017-01-04 13:21:16.333 20673 ERROR neutron.common.utils File "/usr/lib/python2.7/dist-packages/neutron_plugin_contrail/plugins/opencontrail/loadbalancer/loadbalancer_db.py", line 24, in <module>
2017-01-04 13:21:16.333 20673 ERROR neutron.common.utils from neutron_lbaas.extensions import loadbalancer
2017-01-04 13:21:16.333 20673 ERROR neutron.common.utils ImportError: No module named neutron_lbaas.extensions
2017-01-04 13:21:16.333 20673 ERROR neutron.common.utils

neutron.conf
-------------

api_extensions_path =extensions:/usr/lib/python2.7/dist-packages/neutron_plugin_contrail/extensions:/usr/lib/python2.7/dist-packages/neutron_lbaas/extensions

Opening scope for R3.1.1.x

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.1.1.x

Review in progress for https://review.opencontrail.org/27677
Submitter: Nitish Krishna Kaveri (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/27677
Committed: http://github.org/Juniper/contrail-puppet/commit/29756f6a07fdc768f00821a1875b443b69dade4c
Submitter: Zuul (<email address hidden>)
Branch: R3.1.1.x

commit 29756f6a07fdc768f00821a1875b443b69dade4c
Author: nitishkrishna <email address hidden>
Date: Tue Nov 22 16:09:10 2016 -0800

Closes-Bug: #1639442 - Lbaas plugin set incorrectly in liberty,mitaka

The service plugin in neutron.conf for liberty, mitaka for 3.1 upwards will now be set as:
neutron_plugin_contrail.plugins.opencontrail.loadbalancer.v2.plugin.LoadBalancerPluginV2

for kilo it will remain:
neutron_plugin_contrail.plugins.opencontrail.loadbalancer.plugin.LoadBalancerPlugin

Change-Id: I4c8072f9a5ab48583ee9a3abf8e613ca6221d6bd
(cherry picked from commit bdd5b50b2e894ecf3f81761637e2e43a678446ff)

Revision history for this message
sundarkh (sundar-kh) wrote :

Seen with 3.1.2.0
3.1 build 61 - Mitaka

Revision history for this message
Nitish Krishna Kaveri (nitishk) wrote :

This was merged into 3.1 with:
https://review.opencontrail.org/#/c/26404/1
Please check if this commit is there in Latest 3.1 code

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.