Some notes from a failed delete in
http://logs.openstack.org/48/219448/1/check/gate-tempest-dsvm-full/bc0fc2a/logs/screen-n-cpu.txt.gz
Mounted /dev/nbd13 here:
2015-09-01 22:10:36.697 DEBUG oslo_concurrency.processutils [req-5a3718b5-5042-4bd3-b82f-6868097f6f47 tempest-
AggregatesAdminTestJSON-1589136606 tempest-AggregatesAdminTestJSON-1584222786] CMD "sudo nova-rootwrap
/etc/nova/rootwrap.conf mount /dev/nbd13 /opt/stack/data/nova/instances/87a8fc91-5d8b-474c-aedf-36bf8300282e/rootfs"
returned: 0 in 0.066s execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260
Unmounted /dev/nbd13 here (should be from clean_lxc_namespace):
2015-09-01 22:10:42.569 DEBUG oslo_concurrency.processutils [req-5a3718b5-5042-4bd3-b82f-6868097f6f47 tempest-
/etc/nova/rootwrap.conf umount /dev/nbd13" returned: 0 in 0.555s execute /usr/local/lib/python2.7/dist-
packages/oslo_concurrency/processutils.py:260
Released the /dev/nbd13 device here (should be from _teardown_container):
2015-09-01 22:10:49.043 DEBUG oslo_concurrency.processutils [req-811e7df5-a137-41cb-8c3a-918712f61e46 tempest-
/etc/nova/rootwrap.conf qemu-nbd -d /dev/nbd13" returned: 0 in 0.103s execute /usr/local/lib/python2.7/dist-
Deleting the instance files fails here, is it still mounted?
2015-09-01 22:10:49.449 ERROR nova.virt.libvirt.driver [req-811e7df5-a137-41cb-8c3a-918712f61e46 tempest-
AggregatesAdminTestJSON-1589136606 tempest-AggregatesAdminTestJSON-1584222786] [instance: 87a8fc91-5d8b-474c-aedf-
36bf8300282e] Failed to cleanup directory /opt/stack/data/nova/instances/87a8fc91-5d8b-474c-aedf-36bf8300282e_del: [Errno
16] Device or resource busy: '/opt/stack/data/nova/instances/87a8fc91-5d8b-474c-aedf-36bf8300282e_del/rootfs'
destroy calls: _destroy calls: _teardown_container executes: qemu-nbd -d cleanup calls: delete_instance_files: This is what fails saying
Some notes from a failed delete in
http:// logs.openstack. org/48/ 219448/ 1/check/ gate-tempest- dsvm-full/ bc0fc2a/ logs/screen- n-cpu.txt. gz
Mounted /dev/nbd13 here:
2015-09-01 22:10:36.697 DEBUG oslo_concurrenc y.processutils [req-5a3718b5- 5042-4bd3- b82f-6868097f6f 47 tempest-
AggregatesAdmin TestJSON- 1589136606 tempest- AggregatesAdmin TestJSON- 1584222786] CMD "sudo nova-rootwrap
/etc/nova/ rootwrap. conf mount /dev/nbd13 /opt/stack/ data/nova/ instances/ 87a8fc91- 5d8b-474c- aedf-36bf830028 2e/rootfs"
returned: 0 in 0.066s execute /usr/local/ lib/python2. 7/dist- packages/ oslo_concurrenc y/processutils. py:260
Unmounted /dev/nbd13 here (should be from clean_lxc_ namespace) :
2015-09-01 22:10:42.569 DEBUG oslo_concurrenc y.processutils [req-5a3718b5- 5042-4bd3- b82f-6868097f6f 47 tempest-
AggregatesAdmin TestJSON- 1589136606 tempest- AggregatesAdmin TestJSON- 1584222786] CMD "sudo nova-rootwrap
/etc/nova/ rootwrap. conf umount /dev/nbd13" returned: 0 in 0.555s execute /usr/local/ lib/python2. 7/dist-
packages/ oslo_concurrenc y/processutils. py:260
Released the /dev/nbd13 device here (should be from _teardown_ container) :
2015-09-01 22:10:49.043 DEBUG oslo_concurrenc y.processutils [req-811e7df5- a137-41cb- 8c3a-918712f61e 46 tempest-
AggregatesAdmin TestJSON- 1589136606 tempest- AggregatesAdmin TestJSON- 1584222786] CMD "sudo nova-rootwrap
/etc/nova/ rootwrap. conf qemu-nbd -d /dev/nbd13" returned: 0 in 0.103s execute /usr/local/ lib/python2. 7/dist-
packages/ oslo_concurrenc y/processutils. py:260
Deleting the instance files fails here, is it still mounted?
2015-09-01 22:10:49.449 ERROR nova.virt. libvirt. driver [req-811e7df5- a137-41cb- 8c3a-918712f61e 46 tempest-
AggregatesAdmin TestJSON- 1589136606 tempest- AggregatesAdmin TestJSON- 1584222786] [instance: 87a8fc91- 5d8b-474c- aedf-
36bf8300282e] Failed to cleanup directory /opt/stack/ data/nova/ instances/ 87a8fc91- 5d8b-474c- aedf-36bf830028 2e_del: [Errno
16] Device or resource busy: '/opt/stack/ data/nova/ instances/ 87a8fc91- 5d8b-474c- aedf-36bf830028 2e_del/ rootfs'
destroy calls: container executes: instance_ files:
_destroy calls:
_teardown_
qemu-nbd -d
cleanup calls:
delete_
This is what fails saying