Hi Ken, >Which version of oslo.messaging are you using? oslo.messaging-5.12.0 >Any chance you can get a traceback of the hung process? Like via pstack? The py traceback is obtained (manually) as below: ---- #012Traceback (most recent call last):#012 File "/usr/lib/python2.6/osd-packages/oslo_messaging/notify/messaging.py", line 70, in notify#012 retry=retry)#012 File "/usr/lib/python2.6/osd-packages/oslo_messaging/transport.py", line 104, in _send_notification#012 retry=retry)#012 File "/usr/lib/python2.6/osd-packages/oslo_messaging/_drivers/amqpdriver.py", line 471, in send_notification#012 envelope=(version == 2.0), notify=True, retry=retry)#012 File "/usr/lib/python2.6/osd-packages/oslo_messaging/_drivers/amqpdriver.py", line 428, in _send#012 with self._get_connection(rpc_common.PURPOSE_SEND) as conn:#012 File "/usr/lib/python2.6/osd-packages/oslo_messaging/_drivers/amqpdriver.py", line 374, in _get_connection#012 purpose=purpose)#012 File "/usr/lib/python2.6/osd-packages/oslo_messaging/_drivers/common.py", line 399, in __init__#012 self.connection = connection_pool.get()#012 File "/usr/lib/python2.6/osd-packages/oslo_messaging/_drivers/pool.py", line 103, in get#012 wait_condition(self._cond)#012 File "/usr/lib/python2.6/osd-packages/oslo_messaging/_drivers/pool.py", line 33, in wait_condition#012 cond.wait(timeout=1)#012 File "/opt/rh/python27/root/usr/lib64/python2.7/threading.py", line 361, in wait#012 _sleep(delay)#012 File "/opt/objectStorage/osd/proxyService/timeout.py", line 18, in _handle_timeout#012 raise TimeoutError(error_message)#012TimeoutError: Timer expired (txn: txf02c301ee4fd40bdbfb29-00593ebf05) ---- Apart from above, pstack is below: ==== [root@HN0101 ~]# pstack 29016 Thread 3 (Thread 0x7f234f41a700 (LWP 30639)): #0 0x00000034c04e8ef3 in epoll_wait () from /lib64/libc.so.6 #1 0x00007f2352d173f2 in boost::asio::detail::epoll_reactor::run(bool) () from /opt/objectStorage/lib/release_prod_64/libcommunication.so #2 0x00007f2352d190ce in boost::asio::detail::task_io_service >::run(boost::system::error_code&) () from /opt/objectStorage/lib/release_prod_64/libcommunication.so #3 0x00007f2352d14024 in CommunicationHelper::invoke() () from /opt/objectStorage/lib/release_prod_64/libcommunication.so #4 0x00007f235775bd10 in thread_proxy () from /usr/lib64/libboost_thread-mt.so.1.41.0 #5 0x00000034c0c079d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00000034c04e88fd in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f234e0ae700 (LWP 20244)): #0 0x00000034c0c0d930 in sem_wait () from /lib64/libpthread.so.0 #1 0x00007f235e835788 in PyThread_acquire_lock () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #2 0x00007f235e8398f4 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #3 0x00007f235e808c5f in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #4 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #5 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #6 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #7 0x00007f235e789c5c in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #8 0x00007f235e7c3e05 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #9 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #10 0x00007f235e807ae0 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #11 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #12 0x00007f235e794ad1 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #13 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #14 0x00007f235e77f1bf in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #15 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #16 0x00007f235e76c4b8 in PyObject_CallFunctionObjArgs () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #17 0x00007f235e804951 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #18 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #19 0x00007f235e794bd8 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #20 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #21 0x00007f235e807351 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #22 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #23 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #24 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #25 0x00007f235e794ad1 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #26 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #27 0x00007f235e77f1bf in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #28 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #29 0x00007f235e802763 in PyEval_CallObjectWithKeywords () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #30 0x00007f235e839de2 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #31 0x00000034c0c079d1 in start_thread () from /lib64/libpthread.so.0 #32 0x00000034c04e88fd in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f235e710700 (LWP 29016)): #0 0x00000034c04e1373 in select () from /lib64/libc.so.6 #1 0x00007f235d6ee379 in ?? () from /opt/rh/python27/root/usr/lib64/python2.7/lib-dynload/timemodule.so #2 0x00007f235e808c5f in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #3 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #4 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #5 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #6 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #7 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #8 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #9 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #10 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #11 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #12 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #13 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #14 0x00007f235e794ad1 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #15 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #16 0x00007f235e77f1bf in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #17 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #18 0x00007f235e7c41be in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #19 0x00007f235e7c2e48 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #20 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #21 0x00007f235e807ae0 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #22 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #23 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #24 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #25 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #26 0x00007f235e794bd8 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #27 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #28 0x00007f235e77f1bf in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #29 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #30 0x00007f235e7c41be in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #31 0x00007f235e7c2e48 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #32 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #33 0x00007f235e807ae0 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #34 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #35 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #36 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #37 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #38 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #39 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #40 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #41 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #42 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #43 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #44 0x00007f235e794bd8 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #45 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #46 0x00007f235e807351 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #47 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #48 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #49 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #50 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #51 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #52 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #53 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #54 0x00007f235e794bd8 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #55 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #56 0x00007f235e807351 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #57 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #58 0x00007f235e794bd8 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #59 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #60 0x00007f235e807351 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #61 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #62 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #63 0x00007f235e789c5c in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #64 0x00007f235e7fe81f in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #65 0x00007f235e808c5f in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #66 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #67 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #68 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #69 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #70 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #71 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #72 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #73 0x00007f235e794ad1 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #74 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #75 0x00007f235e77f1bf in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #76 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #77 0x00007f235e7c4584 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #78 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #79 0x00007f235e807ae0 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #80 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #81 0x00007f235e794bd8 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #82 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #83 0x00007f235e807351 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #84 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #85 0x00007f235e794ad1 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #86 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #87 0x00007f235e77f1bf in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #88 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #89 0x00007f235e7c4584 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #90 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #91 0x00007f235e807ae0 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #92 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #93 0x00007f235e794ad1 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #94 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #95 0x00007f235e77f1bf in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #96 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #97 0x00007f235e7c4584 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #98 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #99 0x00007f235e807ae0 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #100 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #101 0x00007f235e794ad1 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #102 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #103 0x00007f235e77f1bf in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #104 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #105 0x00007f235e7c4584 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #106 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #107 0x00007f235e807ae0 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #108 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #109 0x00007f235e794bd8 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #110 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #111 0x00007f235e807351 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #112 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #113 0x00007f235e794ad1 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #114 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #115 0x00007f235e77f1bf in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #116 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #117 0x00007f235e7c4584 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #118 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #119 0x00007f235e807ae0 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #120 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #121 0x00007f235e794bd8 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #122 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #123 0x00007f235e807351 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #124 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #125 0x00007f235e794ad1 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #126 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #127 0x00007f235e77f1bf in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #128 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #129 0x00007f235e7c4584 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #130 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #131 0x00007f235e807ae0 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #132 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #133 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #134 0x00007f235e794bd8 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #135 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #136 0x00007f235e807351 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #137 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #138 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #139 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #140 0x00007f235e794ad1 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #141 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #142 0x00007f235e77f1bf in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #143 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #144 0x00007f235e7c4584 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #145 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #146 0x00007f235e807ae0 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #147 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #148 0x00007f235e808cdb in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #149 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #150 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #151 0x00007f235e809b2b in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #152 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #153 0x00007f235e794bd8 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #154 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #155 0x00007f235e807351 in PyEval_EvalFrameEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #156 0x00007f235e80a64e in PyEval_EvalCodeEx () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #157 0x00007f235e794bd8 in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #158 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #159 0x00007f235e77f1bf in ?? () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #160 0x00007f235e76c1e3 in PyObject_Call () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #161 0x00007f235e802763 in PyEval_CallObjectWithKeywords () from /opt/rh/python27/root/usr/lib64/libpython2.7.so.1.0 #162 0x00007f235a76c9ed in ?? () from /usr/lib64/python2.6/site-packages/greenlet.so #163 0x00007f235a76c0e3 in ?? () from /usr/lib64/python2.6/site-packages/greenlet.so #164 0x0000000002cc0720 in ?? () #165 0x0000000002cc08c0 in ?? () #166 0x0000000000000000 in ?? () ==== > $ sudo rabbitmqctl list_queues [root@localhost ~]# rabbitmqctl list_queues Listing queues ... notifications.info 0 notifications.sample 0 metering.sample 0 > $ sudo rabbitmqctl list_queues messages_unacknowledged [root@localhost ~]# rabbitmqctl list_queues messages_unacknowledged Listing queues ... 0 0 0