https://review.openstack.org/#/c/67564/ has logs with libvirt 1.1.1 from UCA
Here is the specific run
http://logs.openstack.org/64/67564/4/check/check-tempest-dsvm-full/b076c4f/logs/
Here is the hang in screen-n-cpu.log
2014-01-21 04:15:07.082+0000: 27080: debug : virDomainFree:2406 : dom=0x7f31a4001760, (VM: name=instance-00000049, uuid=1a6453d4-edfc-4884-8d8d-c66d6f36a004) 2014-01-21 04:15:07.082+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31a4001760 2014-01-21 04:15:07.082+0000: 27080: debug : virObjectUnref:258 : OBJECT_DISPOSE: obj=0x7f31a4001760 2014-01-21 04:15:07.082+0000: 27080: debug : virDomainDispose:262 : release domain 0x7f31a4001760 instance-00000049 1a6453d4-edfc-4884-8d8d-c66d6f36a004 2014-01-21 04:15:07.082+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31f4001f00 2014-01-21 04:15:07.102+0000: 27080: debug : virDomainFree:2406 : dom=0x7f31a80015f0, (VM: name=instance-00000050, uuid=2c093d29-ad6e-4486-a470-a2fa09a94388) 2014-01-21 04:15:07.102+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31a80015f0 2014-01-21 04:15:07.102+0000: 27080: debug : virObjectUnref:258 : OBJECT_DISPOSE: obj=0x7f31a80015f0 2014-01-21 04:15:07.102+0000: 27080: debug : virDomainDispose:262 : release domain 0x7f31a80015f0 instance-00000050 2c093d29-ad6e-4486-a470-a2fa09a94388 2014-01-21 04:15:07.102+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31f4001f00 2014-01-21 04:15:07.112+0000: 27080: debug : virDomainFree:2406 : dom=0x7f31bc001850, (VM: name=instance-00000053, uuid=9199131f-7ae8-4e9e-9065-0b47787180c1) 2014-01-21 04:15:07.112+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31bc001850 2014-01-21 04:15:07.112+0000: 27080: debug : virObjectUnref:258 : OBJECT_DISPOSE: obj=0x7f31bc001850 2014-01-21 04:15:07.112+0000: 27080: debug : virDomainDispose:262 : release domain 0x7f31bc001850 instance-00000053 9199131f-7ae8-4e9e-9065-0b47787180c1 2014-01-21 04:15:07.112+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31f4001f00 2014-01-21 04:15:07.112+0000: 27080: debug : virDomainFree:2406 : dom=0x7f31ec001840, (VM: name=instance-00000053, uuid=9199131f-7ae8-4e9e-9065-0b47787180c1) 2014-01-21 04:15:07.112+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31ec001840 2014-01-21 04:15:07.112+0000: 27080: debug : virObjectUnref:258 : OBJECT_DISPOSE: obj=0x7f31ec001840 2014-01-21 04:15:07.112+0000: 27080: debug : virDomainDispose:262 : release domain 0x7f31ec001840 instance-00000053 9199131f-7ae8-4e9e-9065-0b47787180c1 2014-01-21 04:15:07.112+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31f4001f00 2014-01-21 04:15:07.566+0000: 27080: debug : virNWFilterUndefine:18265 : nwfilter=0x7f31e0001650 2014-01-21 04:15:07.566+0000: 27080: debug : virNetMessageNew:44 : msg=0x40150c0 tracked=0 2014-01-21 04:15:07.566+0000: 27080: debug : virNetMessageEncodePayload:373 : Encode length as 92 2014-01-21 04:15:07.566+0000: 27080: debug : virNetClientSendInternal:1952 : RPC_CLIENT_MSG_TX_QUEUE: client=0x7f31f40049d0 len=92 prog=536903814 vers=1 proc=181 type=0 status=0 serial=5238 2014-01-21 04:15:07.566+0000: 27080: debug : virNetClientCallNew:1905 : New call 0x3ec8050: msg=0x40150c0, expectReply=1, nonBlock=0 2014-01-21 04:15:07.566+0000: 27080: debug : virNetClientIO:1714 : Outgoing message prog=536903814 version=1 serial=5238 proc=181 type=0 length=92 dispatch=0x7f31d4001810 2014-01-21 04:15:07.566+0000: 27080: debug : virNetClientIO:1740 : Going to sleep head=0x7f31d4001810 call=0x3ec8050
There is no sign of any activity on thread 27080 after that last line
https:/ /review. openstack. org/#/c/ 67564/ has logs with libvirt 1.1.1 from UCA
Here is the specific run
http:// logs.openstack. org/64/ 67564/4/ check/check- tempest- dsvm-full/ b076c4f/ logs/
Here is the hang in screen-n-cpu.log
2014-01-21 04:15:07.082+0000: 27080: debug : virDomainFree:2406 : dom=0x7f31a4001760, (VM: name=instance- 00000049, uuid=1a6453d4- edfc-4884- 8d8d-c66d6f36a0 04) e:262 : release domain 0x7f31a4001760 instance-00000049 1a6453d4- edfc-4884- 8d8d-c66d6f36a0 04 00000050, uuid=2c093d29- ad6e-4486- a470-a2fa09a943 88) e:262 : release domain 0x7f31a80015f0 instance-00000050 2c093d29- ad6e-4486- a470-a2fa09a943 88 00000053, uuid=9199131f- 7ae8-4e9e- 9065-0b47787180 c1) e:262 : release domain 0x7f31bc001850 instance-00000053 9199131f- 7ae8-4e9e- 9065-0b47787180 c1 00000053, uuid=9199131f- 7ae8-4e9e- 9065-0b47787180 c1) e:262 : release domain 0x7f31ec001840 instance-00000053 9199131f- 7ae8-4e9e- 9065-0b47787180 c1 fine:18265 : nwfilter= 0x7f31e0001650 codePayload: 373 : Encode length as 92 dInternal: 1952 : RPC_CLIENT_ MSG_TX_ QUEUE: client= 0x7f31f40049d0 len=92 prog=536903814 vers=1 proc=181 type=0 status=0 serial=5238 lNew:1905 : New call 0x3ec8050: msg=0x40150c0, expectReply=1, nonBlock=0 0x7f31d4001810
2014-01-21 04:15:07.082+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31a4001760
2014-01-21 04:15:07.082+0000: 27080: debug : virObjectUnref:258 : OBJECT_DISPOSE: obj=0x7f31a4001760
2014-01-21 04:15:07.082+0000: 27080: debug : virDomainDispos
2014-01-21 04:15:07.082+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31f4001f00
2014-01-21 04:15:07.102+0000: 27080: debug : virDomainFree:2406 : dom=0x7f31a80015f0, (VM: name=instance-
2014-01-21 04:15:07.102+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31a80015f0
2014-01-21 04:15:07.102+0000: 27080: debug : virObjectUnref:258 : OBJECT_DISPOSE: obj=0x7f31a80015f0
2014-01-21 04:15:07.102+0000: 27080: debug : virDomainDispos
2014-01-21 04:15:07.102+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31f4001f00
2014-01-21 04:15:07.112+0000: 27080: debug : virDomainFree:2406 : dom=0x7f31bc001850, (VM: name=instance-
2014-01-21 04:15:07.112+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31bc001850
2014-01-21 04:15:07.112+0000: 27080: debug : virObjectUnref:258 : OBJECT_DISPOSE: obj=0x7f31bc001850
2014-01-21 04:15:07.112+0000: 27080: debug : virDomainDispos
2014-01-21 04:15:07.112+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31f4001f00
2014-01-21 04:15:07.112+0000: 27080: debug : virDomainFree:2406 : dom=0x7f31ec001840, (VM: name=instance-
2014-01-21 04:15:07.112+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31ec001840
2014-01-21 04:15:07.112+0000: 27080: debug : virObjectUnref:258 : OBJECT_DISPOSE: obj=0x7f31ec001840
2014-01-21 04:15:07.112+0000: 27080: debug : virDomainDispos
2014-01-21 04:15:07.112+0000: 27080: debug : virObjectUnref:256 : OBJECT_UNREF: obj=0x7f31f4001f00
2014-01-21 04:15:07.566+0000: 27080: debug : virNWFilterUnde
2014-01-21 04:15:07.566+0000: 27080: debug : virNetMessageNew:44 : msg=0x40150c0 tracked=0
2014-01-21 04:15:07.566+0000: 27080: debug : virNetMessageEn
2014-01-21 04:15:07.566+0000: 27080: debug : virNetClientSen
2014-01-21 04:15:07.566+0000: 27080: debug : virNetClientCal
2014-01-21 04:15:07.566+0000: 27080: debug : virNetClientIO:1714 : Outgoing message prog=536903814 version=1 serial=5238 proc=181 type=0 length=92 dispatch=
2014-01-21 04:15:07.566+0000: 27080: debug : virNetClientIO:1740 : Going to sleep head=0x7f31d4001810 call=0x3ec8050
There is no sign of any activity on thread 27080 after that last line