[RPC] digging RPC timeout for client and server

[LIU Yulong]

RPC timeout can be found frequently, but we have no statistical data for it. A simple log can help. Since all the projects are using oslo.messaging as midlware between services and message queue, we can add a log in it, something like this, a local test:

2019-10-11 19:23:05.703 40774 INFO oslo_messaging.rpc.server [-] Receive incoming message with id cf4ab75b89e64458bc989c709add43cf and method: sync_routers.
2019-10-11 19:29:19.781 40774 INFO oslo_messaging.rpc.server:188 [None req-e33a11a2-64cd-4aea-b801-7689996a8ace - - - - -] Replied message with id cf4ab75b89e64458bc989c709add43cf and method: sync_routers. Time elapsed: 374.078

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/688147

[LIU Yulong (dragon889)]

The example log:
http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Replied%20success%20message%20with%20id%5C%22%20or%20message%3A%5C%22Replied%20failure%20message%20with%20id%5C%22

and
https://de0c46c43aa3408cb704-ea8eedd91454e7f5ed51aea65091aac2.ssl.cf2.rackcdn.com/688147/1/check/oslo.messaging-src-dsvm-full-rabbit/ca32d07/controller/logs/screen-q-svc.txt.gz

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/688147
Committed: https://git.openstack.org/cgit/openstack/oslo.messaging/commit/?id=b104f254ab43d5e2589e845eff84b1bd096cb42d
Submitter: Zuul
Branch: master

commit b104f254ab43d5e2589e845eff84b1bd096cb42d
Author: LIU Yulong <email address hidden>
Date: Fri Oct 11 23:22:23 2019 +0800

    Add RPC incoming and reply log

    Typically a simple log will not narrow down the
    performance, but give us more information about
    the service status.

    Change-Id: I51c8f2743dd39cccd3d1d021d3c50dc09f70cd97
    Closes-Bug: #1847747

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/oslo.messaging 10.4.0 release.

[Brian Haley (brian-haley)]

Hi Liu - is there a neutron bug here? Or should this be closed? Thanks