Activity log for bug #1899772

Date Who What changed Old value New value Message
2020-10-14 11:34:03 Onong Tayeng bug added bug
2020-10-14 11:34:11 Onong Tayeng networking-vpp: assignee Onong Tayeng (onong)
2020-10-14 11:34:25 Onong Tayeng networking-vpp: importance Undecided High
2020-10-14 17:16:45 OpenStack Infra networking-vpp: status New In Progress
2020-10-14 17:20:20 Onong Tayeng description With patch https://review.opendev.org/#/c/751935, PAPI throws an unexpected error: TypeError: argument of type 'IPv4Interface' is not iterable for the next hop address param to ip_route_add_del api call. Passing the binary IP address makes the error disappear but then it begs the question as to what is the correct format that PAPI expects. Needs further investigation and hence creating the bug report to keep track. Here's the complete backtrace: 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils [-] router_watcher: etcd threw exception: TypeError: argument of type 'IPv4Interface' is not iterable 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils Traceback (most recent call last): 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/etcdutils.py", line 574, in watch_forever 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils self.do_watch() 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/etcdutils.py", line 630, in do_watch 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils self.do_work(rv.action, rv.key, rv.value) 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/etcdutils.py", line 717, in do_work 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils self.key_change(action, key, value) 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/etcdutils.py", line 744, in key_change 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils self.added(short_key, value) 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/agent/server.py", line 3310, in added 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils port_id, router_data) 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/agent/server.py", line 1799, in ensure_router_interface_on_ht 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils is_local=True) 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/agent/vpp.py", line 962, in add_ip_route 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils route=route) 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/agent/vpp.py", line 244, in call_vpp 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils t = func_call(*args, **kwargs) 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_papi.py", line 113, in __call__ 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils return self._func(**kwargs) 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_papi.py", line 452, in f 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils return self._call_vpp(i, msg, multipart, **kwargs) 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_papi.py", line 679, in _call_vpp 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils b = msgdef.pack(kwargs) 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_serializer.py", line 628, in pack 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils b += self.packers[i].pack(arg, kwarg) 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_serializer.py", line 628, in pack 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils b += self.packers[i].pack(arg, kwarg) 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_serializer.py", line 615, in pack 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils if data and type(data) is not dict and a not in data: 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils TypeError: argument of type 'IPv4Interface' is not iterable 2020-10-01 15:21:49.949 24240 ERROR networking_vpp.etcdutils Running tempest_smoke on the latest master causes PAPI to produce the following error: 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils TypeError: object of type ‘IPv4Address’ has no len() Passing the next_hop_address in binary format to ip_route_add_del api makes the error disappear but then it begs the question as to what is the correct format that PAPI expects. Needs further investigation and hence creating the bug report to keep track. Here's the complete backtrace: 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils [-] router_watcher: etcd threw exception: TypeError: object of type 'IPv4Address' has no len() 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils Traceback (most recent call last): 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/etcdutils.py", line 574, in watch_forever 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils self.do_watch() 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/etcdutils.py", line 630, in do_watch 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils self.do_work(rv.action, rv.key, rv.value) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/etcdutils.py", line 717, in do_work 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils self.key_change(action, key, value) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/etcdutils.py", line 744, in key_change 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils self.added(short_key, value) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/agent/server.py", line 3351, in added 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils port_id, router_data) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/agent/server.py", line 1830, in ensure_router_interface_on_t 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils source_vrf=router_dict['vrf_id']) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/agent/server.py", line 1970, in export_routes_from_tenant_vs 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils is_ipv6=is_ipv6) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/agent/vpp.py", line 951, in add_ip_route 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils route=route) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/local/lib/python3.6/dist-packages/networking_vpp/agent/vpp.py", line 243, in call_vpp 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils t = func_call(*args, **kwargs) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_papi.py", line 113, in call 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils return self._func(**kwargs) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_papi.py", line 452, in f 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils return self._call_vpp(i, msg, multipart, **kwargs) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_papi.py", line 679, in _call_vpp 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils b = msgdef.pack(kwargs) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_serializer.py", line 628, in pack 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils b += self.packers[i].pack(arg, kwarg) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_serializer.py", line 630, in pack 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils b += self.packers[i].pack(arg, kwargs) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_serializer.py", line 304, in pack 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils b += self.packer.pack(e) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_serializer.py", line 628, in pack 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils b += self.packers[i].pack(arg, kwarg) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_serializer.py", line 630, in pack 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils b += self.packers[i].pack(arg, kwargs) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_serializer.py", line 457, in pack 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils b = self.packers[k].pack(v, kwargs) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_serializer.py", line 514, in pack 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils return self.packer.pack(data, kwargs) 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils File "/usr/lib/python3/dist-packages/vpp_papi/vpp_serializer.py", line 218, in pack 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils if len(data) > self.num: 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils TypeError: object of type 'IPv4Address' has no len() 2020-10-06 11:17:14.641 41022 ERROR networking_vpp.etcdutils 2020-10-06 11:17:16.648 41022 CRITICAL networking_vpp.agent.server [-] Failed VPP call to sw_interface_set_table(, {'sw_if_index': 18, 'vrf_id': 4, 'is_ipv6': True}): retval is -114
2020-10-14 17:24:52 Onong Tayeng networking-vpp: milestone 20.09
2020-10-21 17:04:57 OpenStack Infra networking-vpp: status In Progress Fix Released