manila has three Zuul jobs [1][2] that set up a bgp speaker to do route advertisements to dynamically created tempest test tenant networks. This bug is observed on all three of those jobs:
Steps to reproduce:
1) public_gateway_ipv6=$(openstack subnet show ipv6-public-subnet -c gateway_ip -f value) 2) neutron --debug bgp-speaker-create --ip-version 6 --local-as 100 bgpspeaker neutron --debug bgp-speaker-network-add bgpspeaker $PUBLIC_NETWORK_NAME neutron --debug bgp-peer-create --peer-ip $public_gateway_ipv6 --remote-as 200 bgppeer neutron --debug bgp-speaker-peer-add bgpspeaker bgppeer
Log trace in neutron server log:
Nov 08 23:20:56.266635 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: DEBUG neutron.api.v2.base [None req-8e095d65-0b34-48b0-bb63-1e067f0c4969 admin admin] Request body: {'bgp_speaker': {'local_as': '100', 'ip_version': 6, 'name': 'bgpspeaker'}} {{(pid=14476) prepare_request_body /opt/stack/new/neutron/neutron/api/v2/base.py:719}} Nov 08 23:20:56.267073 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: DEBUG neutron.api.v2.base [None req-8e095d65-0b34-48b0-bb63-1e067f0c4969 admin admin] Unknown quota resources ['bgp_speaker']. {{(pid=14476) _create /opt/stack/new/neutron/neutron/api/v2/base.py:490}} Nov 08 23:20:56.286015 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: DEBUG neutron_lib.callbacks.manager [None req-8e095d65-0b34-48b0-bb63-1e067f0c4969 admin admin] Notify callbacks ['neutron_dynamic_routing.services.bgp.scheduler.bgp_dragent_scheduler.BgpDrAgentSchedulerBase.schedule_bgp_speaker_callback--9223372036854306101'] for bgp_speaker, after_create {{(pid=14476) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}} Nov 08 23:20:56.297311 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: ERROR neutron_lib.callbacks.manager [None req-8e095d65-0b34-48b0-bb63-1e067f0c4969 admin admin] Error during notification for neutron_dynamic_routing.services.bgp.scheduler.bgp_dragent_scheduler.BgpDrAgentSchedulerBase.schedule_bgp_speaker_callback--9223372036854306101 bgp_speaker, after_create: TypeError: bind() takes 4 positional arguments but 5 were given Nov 08 23:20:56.297311 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Nov 08 23:20:56.297311 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py", line 197, in _notify_loop Nov 08 23:20:56.297311 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, **kwargs) Nov 08 23:20:56.297311 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: ERROR neutron_lib.callbacks.manager File "/opt/stack/new/neutron-dynamic-routing/neutron_dynamic_routing/services/bgp/scheduler/bgp_dragent_scheduler.py", line 202, in schedule_bgp_speaker_callback Nov 08 23:20:56.297311 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: ERROR neutron_lib.callbacks.manager plugin.schedule_bgp_speaker(ctx, payload['bgp_speaker']) Nov 08 23:20:56.297311 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: ERROR neutron_lib.callbacks.manager File "/opt/stack/new/neutron-dynamic-routing/neutron_dynamic_routing/db/bgp_dragentscheduler_db.py", line 100, in schedule_bgp_speaker Nov 08 23:20:56.297311 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: ERROR neutron_lib.callbacks.manager created_bgp_speaker) Nov 08 23:20:56.297311 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: ERROR neutron_lib.callbacks.manager File "/opt/stack/new/neutron/neutron/scheduler/base_scheduler.py", line 55, in schedule Nov 08 23:20:56.297311 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: ERROR neutron_lib.callbacks.manager context, chosen_agents, resource['id'], force_scheduling) Nov 08 23:20:56.297311 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: ERROR neutron_lib.callbacks.manager TypeError: bind() takes 4 positional arguments but 5 were given Nov 08 23:20:56.297311 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: ERROR neutron_lib.callbacks.manager Nov 08 23:20:56.298175 ubuntu-bionic-inap-mtl01-0012732936 neutron-server[14101]: DEBUG neutron_lib.callbacks.manager [None req-8e095d65-0b34-48b0-bb63-1e067f0c4969 admin admin] Notify callbacks [] for bgp_speaker, before_response {{(pid=14476) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}}
[1] manila-tempest-minimal-dsvm-lvm, manila-tempest-minimal-lvm-ipv6-only and manila-tempest-minimal-dsvm-cephfs-nfs - https://opendev.org/openstack/manila/src/commit/24337fe73959f11a824540b5dc8b38e93843e2e4/.zuul.yaml#L37-L38 [2] https://opendev.org/openstack/manila/src/commit/24337fe73959f11a824540b5dc8b38e93843e2e4/contrib/ci/post_test_hook.sh#L368-L372
manila has three Zuul jobs [1][2] that set up a bgp speaker to do route advertisements to dynamically created tempest test tenant networks. This bug is observed on all three of those jobs:
Steps to reproduce:
1) public_ gateway_ ipv6=$( openstack subnet show ipv6-public-subnet -c gateway_ip -f value) network- add bgpspeaker $PUBLIC_ NETWORK_ NAME gateway_ ipv6 --remote-as 200 bgppeer peer-add bgpspeaker bgppeer
2) neutron --debug bgp-speaker-create --ip-version 6 --local-as 100 bgpspeaker
neutron --debug bgp-speaker-
neutron --debug bgp-peer-create --peer-ip $public_
neutron --debug bgp-speaker-
Log trace in neutron server log:
Nov 08 23:20:56.266635 ubuntu- bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: DEBUG neutron.api.v2.base [None req-8e095d65- 0b34-48b0- bb63-1e067f0c49 69 admin admin] Request body: {'bgp_speaker': {'local_as': '100', 'ip_version': 6, 'name': 'bgpspeaker'}} {{(pid=14476) prepare_ request_ body /opt/stack/ new/neutron/ neutron/ api/v2/ base.py: 719}} bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: DEBUG neutron.api.v2.base [None req-8e095d65- 0b34-48b0- bb63-1e067f0c49 69 admin admin] Unknown quota resources ['bgp_speaker']. {{(pid=14476) _create /opt/stack/ new/neutron/ neutron/ api/v2/ base.py: 490}} bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: DEBUG neutron_ lib.callbacks. manager [None req-8e095d65- 0b34-48b0- bb63-1e067f0c49 69 admin admin] Notify callbacks ['neutron_ dynamic_ routing. services. bgp.scheduler. bgp_dragent_ scheduler. BgpDrAgentSched ulerBase. schedule_ bgp_speaker_ callback- -92233720368543 06101'] for bgp_speaker, after_create {{(pid=14476) _notify_loop /usr/local/ lib/python3. 6/dist- packages/ neutron_ lib/callbacks/ manager. py:193} } bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: ERROR neutron_ lib.callbacks. manager [None req-8e095d65- 0b34-48b0- bb63-1e067f0c49 69 admin admin] Error during notification for neutron_ dynamic_ routing. services. bgp.scheduler. bgp_dragent_ scheduler. BgpDrAgentSched ulerBase. schedule_ bgp_speaker_ callback- -92233720368543 06101 bgp_speaker, after_create: TypeError: bind() takes 4 positional arguments but 5 were given bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: ERROR neutron_ lib.callbacks. manager Traceback (most recent call last): bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: ERROR neutron_ lib.callbacks. manager File "/usr/local/ lib/python3. 6/dist- packages/ neutron_ lib/callbacks/ manager. py", line 197, in _notify_loop bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: ERROR neutron_ lib.callbacks. manager callback(resource, event, trigger, **kwargs) bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: ERROR neutron_ lib.callbacks. manager File "/opt/stack/ new/neutron- dynamic- routing/ neutron_ dynamic_ routing/ services/ bgp/scheduler/ bgp_dragent_ scheduler. py", line 202, in schedule_ bgp_speaker_ callback bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: ERROR neutron_ lib.callbacks. manager plugin. schedule_ bgp_speaker( ctx, payload[ 'bgp_speaker' ]) bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: ERROR neutron_ lib.callbacks. manager File "/opt/stack/ new/neutron- dynamic- routing/ neutron_ dynamic_ routing/ db/bgp_ dragentschedule r_db.py" , line 100, in schedule_ bgp_speaker bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: ERROR neutron_ lib.callbacks. manager created_ bgp_speaker) bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: ERROR neutron_ lib.callbacks. manager File "/opt/stack/ new/neutron/ neutron/ scheduler/ base_scheduler. py", line 55, in schedule bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: ERROR neutron_ lib.callbacks. manager context, chosen_agents, resource['id'], force_scheduling) bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: ERROR neutron_ lib.callbacks. manager TypeError: bind() takes 4 positional arguments but 5 were given bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: ERROR neutron_ lib.callbacks. manager bionic- inap-mtl01- 0012732936 neutron- server[ 14101]: DEBUG neutron_ lib.callbacks. manager [None req-8e095d65- 0b34-48b0- bb63-1e067f0c49 69 admin admin] Notify callbacks [] for bgp_speaker, before_response {{(pid=14476) _notify_loop /usr/local/ lib/python3. 6/dist- packages/ neutron_ lib/callbacks/ manager. py:193} }
Nov 08 23:20:56.267073 ubuntu-
Nov 08 23:20:56.286015 ubuntu-
Nov 08 23:20:56.297311 ubuntu-
Nov 08 23:20:56.297311 ubuntu-
Nov 08 23:20:56.297311 ubuntu-
Nov 08 23:20:56.297311 ubuntu-
Nov 08 23:20:56.297311 ubuntu-
Nov 08 23:20:56.297311 ubuntu-
Nov 08 23:20:56.297311 ubuntu-
Nov 08 23:20:56.297311 ubuntu-
Nov 08 23:20:56.297311 ubuntu-
Nov 08 23:20:56.297311 ubuntu-
Nov 08 23:20:56.297311 ubuntu-
Nov 08 23:20:56.297311 ubuntu-
Nov 08 23:20:56.298175 ubuntu-
[1] manila- tempest- minimal- dsvm-lvm, manila- tempest- minimal- lvm-ipv6- only and manila- tempest- minimal- dsvm-cephfs- nfs - https:/ /opendev. org/openstack/ manila/ src/commit/ 24337fe73959f11 a824540b5dc8b38 e93843e2e4/ .zuul.yaml# L37-L38 /opendev. org/openstack/ manila/ src/commit/ 24337fe73959f11 a824540b5dc8b38 e93843e2e4/ contrib/ ci/post_ test_hook. sh#L368- L372
[2] https:/