2019-10-10 23:37:14.599 1458 ERROR neutron.agent.linux.utils [-] Rootwrap error running command: ['kill', '-15', '14677']: RemoteError: 
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent [-] Error while deleting router d8bf191c-2728-4d32-8956-b54e02813c7b: RemoteError: 
---------------------------------------------------------------------------
Unserializable message: Traceback (most recent call last):
  File "/usr/lib/python2.7/multiprocessing/managers.py", line 288, in serve_client
    send(msg)
  File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/oslo_rootwrap/jsonrpc.py", line 128, in send
    s = self.dumps(obj)
  File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/oslo_rootwrap/jsonrpc.py", line 170, in dumps
    return json.dumps(obj, cls=RpcJSONEncoder).encode('utf-8')
  File "/usr/lib/python2.7/json/__init__.py", line 251, in dumps
    sort_keys=sort_keys, **kw).encode(obj)
  File "/usr/lib/python2.7/json/encoder.py", line 207, in encode
    chunks = self.iterencode(o, _one_shot=True)
  File "/usr/lib/python2.7/json/encoder.py", line 270, in iterencode
    return _iterencode(o, 0)
  File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/oslo_rootwrap/jsonrpc.py", line 43, in default
    return super(RpcJSONEncoder, self).default(o)
  File "/usr/lib/python2.7/json/encoder.py", line 184, in default
    raise TypeError(repr(o) + " is not JSON serializable")
TypeError: ValueError('I/O operation on closed file',) is not JSON serializable

---------------------------------------------------------------------------
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent Traceback (most recent call last):
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 458, in _safe_router_removed
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     self._router_removed(ri, router_id)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 480, in _router_removed
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     ri.delete()
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 460, in delete
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     self.destroy_state_change_monitor(self.process_monitor)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 399, in destroy_state_change_monitor
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     pm.disable(sig=str(int(signal.SIGTERM)))
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/neutron/agent/linux/external_process.py", line 110, in disable
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     utils.execute(cmd, run_as_root=self.run_as_root)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 122, in execute
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     execute_rootwrap_daemon(cmd, process_input, addl_env))
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 109, in execute_rootwrap_daemon
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     LOG.error("Rootwrap error running command: %s", cmd)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     self.force_reraise()
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     six.reraise(self.type_, self.value, self.tb)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 106, in execute_rootwrap_daemon
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     return client.execute(cmd, process_input)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/oslo_rootwrap/client.py", line 154, in execute
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     res = self._run_one_command(proxy, cmd, stdin)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/oslo_rootwrap/client.py", line 139, in _run_one_command
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     res = proxy.run_one_command(cmd, stdin)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "<string>", line 2, in run_one_command
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/multiprocessing/managers.py", line 774, in _callmethod
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     raise convert_to_error(kind, result)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent RemoteError: 
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent ---------------------------------------------------------------------------
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent Unserializable message: Traceback (most recent call last):
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/multiprocessing/managers.py", line 288, in serve_client
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     send(msg)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/oslo_rootwrap/jsonrpc.py", line 128, in send
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     s = self.dumps(obj)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/oslo_rootwrap/jsonrpc.py", line 170, in dumps
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     return json.dumps(obj, cls=RpcJSONEncoder).encode('utf-8')
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/json/__init__.py", line 251, in dumps
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     sort_keys=sort_keys, **kw).encode(obj)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/json/encoder.py", line 207, in encode
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     chunks = self.iterencode(o, _one_shot=True)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/json/encoder.py", line 270, in iterencode
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     return _iterencode(o, 0)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/openstack/venvs/neutron-19.0.2/lib/python2.7/site-packages/oslo_rootwrap/jsonrpc.py", line 43, in default
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     return super(RpcJSONEncoder, self).default(o)
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/json/encoder.py", line 184, in default
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent     raise TypeError(repr(o) + " is not JSON serializable")
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent TypeError: ValueError('I/O operation on closed file',) is not JSON serializable
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent 
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent ---------------------------------------------------------------------------
2019-10-10 23:37:14.600 1458 ERROR neutron.agent.l3.agent 
2019-10-10 23:37:14.618 1458 INFO neutron.agent.l3.agent [-] Finished a router update for d8bf191c-2728-4d32-8956-b54e02813c7b, update_id c736a217-a6a4-4c82-81bf-671ece571004. Time elapsed: 0.031