Comment 2 for bug 1491563

Revision history for this message
Matt Riedemann (mriedem) wrote :

Some notes from a failed delete in

http://logs.openstack.org/48/219448/1/check/gate-tempest-dsvm-full/bc0fc2a/logs/screen-n-cpu.txt.gz

Mounted /dev/nbd13 here:

2015-09-01 22:10:36.697 DEBUG oslo_concurrency.processutils [req-5a3718b5-5042-4bd3-b82f-6868097f6f47 tempest-

AggregatesAdminTestJSON-1589136606 tempest-AggregatesAdminTestJSON-1584222786] CMD "sudo nova-rootwrap

/etc/nova/rootwrap.conf mount /dev/nbd13 /opt/stack/data/nova/instances/87a8fc91-5d8b-474c-aedf-36bf8300282e/rootfs"

returned: 0 in 0.066s execute /usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:260

Unmounted /dev/nbd13 here (should be from clean_lxc_namespace):

2015-09-01 22:10:42.569 DEBUG oslo_concurrency.processutils [req-5a3718b5-5042-4bd3-b82f-6868097f6f47 tempest-

AggregatesAdminTestJSON-1589136606 tempest-AggregatesAdminTestJSON-1584222786] CMD "sudo nova-rootwrap

/etc/nova/rootwrap.conf umount /dev/nbd13" returned: 0 in 0.555s execute /usr/local/lib/python2.7/dist-

packages/oslo_concurrency/processutils.py:260

Released the /dev/nbd13 device here (should be from _teardown_container):

2015-09-01 22:10:49.043 DEBUG oslo_concurrency.processutils [req-811e7df5-a137-41cb-8c3a-918712f61e46 tempest-

AggregatesAdminTestJSON-1589136606 tempest-AggregatesAdminTestJSON-1584222786] CMD "sudo nova-rootwrap

/etc/nova/rootwrap.conf qemu-nbd -d /dev/nbd13" returned: 0 in 0.103s execute /usr/local/lib/python2.7/dist-

packages/oslo_concurrency/processutils.py:260

Deleting the instance files fails here, is it still mounted?

2015-09-01 22:10:49.449 ERROR nova.virt.libvirt.driver [req-811e7df5-a137-41cb-8c3a-918712f61e46 tempest-

AggregatesAdminTestJSON-1589136606 tempest-AggregatesAdminTestJSON-1584222786] [instance: 87a8fc91-5d8b-474c-aedf-

36bf8300282e] Failed to cleanup directory /opt/stack/data/nova/instances/87a8fc91-5d8b-474c-aedf-36bf8300282e_del: [Errno

16] Device or resource busy: '/opt/stack/data/nova/instances/87a8fc91-5d8b-474c-aedf-36bf8300282e_del/rootfs'

destroy calls:
 _destroy calls:
  _teardown_container executes:
   qemu-nbd -d
 cleanup calls:
  delete_instance_files:
   This is what fails saying