Barbican

[pike] neutron-lbaasv2 with barbican error: LookupError: Container XXXXX could not be found

Bug #1818649 reported by miaoyuliang
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Barbican
Won't Fix
Undecided
Unassigned
neutron
Invalid
Undecided
Unassigned

Bug Description

Is there any configuration method about neutron_lbaasv2?. this problem troubled me a long time, the doc is not very well. my lbaas'es config file has been changed many times, but it didn't work.

my openstack version is pike.

It was relate to https://bugs.launchpad.net/barbican/+bug/1689846, but my environment is lbaasv2, not octavia.

I tried create tls listener throuth through lbaasv2, there will be a right response on CLI. And neutron-server.log was all right, but there will be an ERROR in lbaas-agent.log, the log is bellow.

----------------------------------------------------------------------------------------------------------------------------------------------------
2019-03-05 18:47:52.427 14045 INFO neutron_lbaas.common.cert_manager.barbican_cert_manager [req-6e0b798e-b10c-4132-8665-dfe1122133bb cdb0fbe60ff84eaf932ba6a90dd030b2 502990c9fd4d442693e8d818b01051b5 - - -] Loading certificate container http://192.168.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a from Barbican.
2019-03-05 18:47:52.428 14045 DEBUG barbicanclient.v1.containers [req-6e0b798e-b10c-4132-8665-dfe1122133bb cdb0fbe60ff84eaf932ba6a90dd030b2 502990c9fd4d442693e8d818b01051b5 - - -] Getting container - Container href: http://192.168.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a get /usr/lib/python2.7/site-packages/barbicanclient/v1/containers.py:537
2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager [req-6e0b798e-b10c-4132-8665-dfe1122133bb cdb0fbe60ff84eaf932ba6a90dd030b2 502990c9fd4d442693e8d818b01051b5 - - -] Error getting http://192.168.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a: LookupError: Container http://192.168.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a could not be found.
2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager Traceback (most recent call last):
2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/common/cert_manager/barbican_cert_manager.py", line 174, in get_cert
2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager container_ref=cert_ref
2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager File "/usr/lib/python2.7/site-packages/barbicanclient/v1/containers.py", line 543, in get
2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager .format(container_ref))
2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager LookupError: Container http://192.168.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a could not be found.
2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager
2019-03-05 18:47:52.430 14045 DEBUG oslo_concurrency.lockutils [req-6e0b798e-b10c-4132-8665-dfe1122133bb cdb0fbe60ff84eaf932ba6a90dd030b2 502990c9fd4d442693e8d818b01051b5 - - -] Lock "haproxy-driver" released by "neutron_lbaas.drivers.haproxy.namespace_driver.deploy_instance" :: held 2.682s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:282
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager [req-6e0b798e-b10c-4132-8665-dfe1122133bb cdb0fbe60ff84eaf932ba6a90dd030b2 502990c9fd4d442693e8d818b01051b5 - - -] Create listener 73a3aacc-3e81-4cee-aec9-1f0fa9cb61ca failed on device driver haproxy_ns: LookupError: Container http://192.168.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a could not be found.
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager Traceback (most recent call last):
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/agent/agent_manager.py", line 303, in create_listener
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager driver.listener.create(listener)
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 480, in create
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager self.driver.loadbalancer.refresh(listener.loadbalancer)
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 444, in refresh
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager if (not self.driver.deploy_instance(loadbalancer) and
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 271, in inner
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager return f(*args, **kwargs)
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 214, in deploy_instance
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager self.create(loadbalancer)
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 242, in create
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager self._spawn(loadbalancer)
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 399, in _spawn
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager haproxy_base_dir)
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/jinja_cfg.py", line 90, in save_config
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager haproxy_base_dir)
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/jinja_cfg.py", line 234, in render_loadbalancer_obj
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager loadbalancer = _transform_loadbalancer(loadbalancer, haproxy_base_dir)
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/jinja_cfg.py", line 249, in _transform_loadbalancer
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager for x in loadbalancer.listeners if x.admin_state_up]
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/jinja_cfg.py", line 290, in _transform_listener
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager certs = _process_tls_certificates(listener)
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/jinja_cfg.py", line 162, in _process_tls_certificates
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager check_only=True
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/common/cert_manager/barbican_cert_manager.py", line 185, in get_cert
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager LOG.exception("Error getting {0}".format(cert_ref))
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager self.force_reraise()
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager six.reraise(self.type_, self.value, self.tb)
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/neutron_lbaas/common/cert_manager/barbican_cert_manager.py", line 174, in get_cert
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager container_ref=cert_ref
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager File "/usr/lib/python2.7/site-packages/barbicanclient/v1/containers.py", line 543, in get
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager .format(container_ref))
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager LookupError: Container http://192.179.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a could not be found.
2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager
2019-03-05 18:47:55.026 14045 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats run_periodic_tasks /usr/lib/python2.7/site-packages/oslo_service/periodic_task.py:215

________________________________________________________________________________________________________________________________________
my config file is :
neutron_lbaas.conf

[DEFAULT]
[certificates]
cert_manager_type = barbican
barbican_auth = barbican_acl_auth
storage_path = /var/lib/neutron-lbaas/certificates/
[quotas]
quota_loadbalancer = -1
quota_listener = -1
quota_pool = -1
quota_member = -1
quota_healthmonitor = -1
[service_auth]
auth_url = http://keystone-ha-vip:5000/v2.0
admin_user = admin
admin_tenant_name = admin
admin_password = XXX
admin_user_domain = default
admin_project_domain = default
region = RegionOne
auth_version = 2
endpoint_type = public
[service_providers]
service_provider = LOADBALANCERV2:Haproxy:neutron_lbaas.drivers.haproxy.plugin_driver.HaproxyOnHostPluginDriver:default

_____________________________________________________________________________________________________________________________________
cat /etc/neutron/lbaas_agent.ini | grep ^[^#]
[DEFAULT]
interface_driver = neutron.agent.linux.interface.OVSInterfaceDriver
ovs_use_veth = True
verbose = true
device_driver = neutron_lbaas.drivers.haproxy.namespace_driver.HaproxyNSDriver
ovs_integration_bridge = br-int
[haproxy]
user_group = haproxy

Revision history for this message
miaoyuliang (mylaliang) wrote :

Is this feature not supported by neutron-lbaasv2-agent and haproxy

Revision history for this message
miaoyuliang (mylaliang) wrote :

resolve this problem by adding these configurations to lbaas_agent.ini

[service_auth]
auth_url = http://keystone-ha-vip:5000/v2.0
admin_user = admin
admin_tenant_name = admin
admin_password = XXX
admin_user_domain = default
admin_project_domain = default
region = RegionOne
auth_version = 2
endpoint_type = public

I have to say that there are too few documents about barbican in the community， especially with other components.

Revision history for this message
Bernard Cafarelli (bcafarel) wrote :

Marking invalid for neutron, neutron-lbaas bugs are on storyboard now: https://storyboard.openstack.org/#!/project/openstack/neutron-lbaas

If you still have an issue (it looks like it was a configuration problem), feel free to report it there

Changed in neutron:
status: New → Invalid
Revision history for this message
Grzegorz Grasza (xek) wrote :

Closing out bugs created before migration to StoryBoard. Please re-open if you are of the opinion it is still current.

Changed in barbican:
status: New → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.