kolla-ansible

lbaas can not connect openvswitch db

Bug #1713594 reported by Jeffrey Zhang on 2017-08-29

This bug affects 3 people

Affects		Status	Importance	Assigned to	Milestone
	kolla-ansible	Fix Released	Undecided	Jeffrey Zhang
	Ocata	Fix Released	Undecided	Unassigned

Bug Description

when creating lb, following error is reased.

2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager [req-738d7396-b8dc-49c1-9f69-3e4697467ce4 e7606d4d78d749779f9f951107bca7f2 40844d061473409daebe3f4cad2880a6 - - -] Create healthmonitor fe008261-7022-4ae5-9df3-7816e200cf59 failed on device driver haproxy_ns
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager Traceback (most recent call last):
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lbaas/agent/agent_manager.py", line 387, in create_healthmonitor
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager driver.healthmonitor.create(healthmonitor)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 520, in create
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager self.driver.loadbalancer.refresh(hm.pool.loadbalancer)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 426, in refresh
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager if (not self.driver.deploy_instance(loadbalancer) and
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 271, in inner
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager return f(*args, **kwargs)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 205, in deploy_instance
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager self.create(loadbalancer)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 232, in create
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager self._plug(namespace, loadbalancer.vip_port, loadbalancer.vip_address)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 327, in _plug
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager mtu=port.network.mtu
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 261, in plug
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager bridge, namespace, prefix, mtu)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 363, in plug_new
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager internal=internal)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 338, in _ovs_add_port
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager ovs = ovs_lib.OVSBridge(bridge)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/common/ovs_lib.py", line 188, in __init__
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager super(OVSBridge, self).__init__()
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/common/ovs_lib.py", line 106, in __init__
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager self.ovsdb = ovsdb.API.get(self)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/ovsdb/api.py", line 92, in get
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager return iface(context)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_idl.py", line 300, in __init__
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager super(NeutronOvsdbIdl, self).__init__(context)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_idl.py", line 199, in __init__
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager OvsdbIdl.ovsdb_connection.start()
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/debtcollector/removals.py", line 261, in wrapper
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager return f(*args, **kwargs)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/ovsdb/native/connection.py", line 116, in start
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager self.idl = self.idl_factory()
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/debtcollector/removals.py", line 242, in wrapper
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager return f(*args, **kwargs)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/ovsdb/native/connection.py", line 98, in _idl_factory
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager helper = self.get_schema_helper()
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/debtcollector/removals.py", line 242, in wrapper
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager return f(*args, **kwargs)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/ovsdb/native/connection.py", line 129, in get_schema_helper
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager retry=True)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/ovsdb/native/idlutils.py", line 138, in get_schema_helper
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager return do_get_schema_helper()
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/tenacity/__init__.py", line 87, in wrapped_f
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager return r.call(f, *args, **kw)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/tenacity/__init__.py", line 235, in call
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager do = self.iter(result=result, exc_info=exc_info)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/tenacity/__init__.py", line 205, in iter
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager raise RetryError(fut).reraise()
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/tenacity/__init__.py", line 282, in reraise
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager raise self.last_attempt.result()
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/concurrent/futures/_base.py", line 398, in result
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager return self.__get_result()
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/tenacity/__init__.py", line 238, in call
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager result = fn(*args, **kwargs)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/ovsdb/native/idlutils.py", line 136, in do_get_schema_helper
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager return _get_schema_helper(connection, schema_name)
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/agent/ovsdb/native/idlutils.py", line 115, in _get_schema_helper
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager 'err': os.strerror(err)})
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager Exception: Could not retrieve schema from tcp:127.0.0.1:6640: Connection refused
2017-08-28 16:00:56.269 6 ERROR neutron_lbaas.agent.agent_manager

Jeffrey Zhang (jeffrey4l) on 2017-08-29

Changed in kolla-ansible:
assignee:	nobody → Jeffrey Zhang (jeffrey4l)

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-08-29: Fix proposed to kolla-ansible (master)

Fix proposed to branch: master
Review: https://review.openstack.org/498632

Changed in kolla-ansible:
status:	New → In Progress

Revision history for this message

Arminder Singh Girgla (arminder) wrote on 2017-08-30:

Thanks @jeffrey4l, I had the same issue and the change to ansible/roles/neutron/templates/lbaas_agent.ini.j2 as proposed, fixed the issue for me.

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-09-20: Change abandoned on kolla-ansible (master)

Change abandoned by Jeffrey Zhang (jeffrey.zhang@99cloud.net) on branch: master
Review: https://review.openstack.org/498632
Reason: master is fixed by listening only on 127.0.0.1

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-10-09: Fix merged to kolla-ansible (stable/ocata)

Reviewed: https://review.openstack.org/505571
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=b45d6dea6f706fc2761e8b1c3e71cda8997f3bf0
Submitter: Jenkins
Branch: stable/ocata

commit b45d6dea6f706fc2761e8b1c3e71cda8997f3bf0
Author: Jeffrey Zhang <email address hidden>
Date: Tue Aug 29 08:33:01 2017 +0800

Add ovs section in neutron lbaas configuration

neutron lbaas need access ovs db, which is listen on api interface.

    Change-Id: I699a7d2f54460854ecee01440e8156e7c269c17b
    Closes-Bug: #1713594
    (cherry picked from commit c603716ca370be2be1dc1ae8ade930ce749b46e7)

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-12-15: Fix included in openstack/kolla-ansible 4.0.3

This issue was fixed in the openstack/kolla-ansible 4.0.3 release.

Eduardo Gonzalez (egonzalez90) on 2018-09-28

Changed in kolla-ansible:
status:	In Progress → Fix Released

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.