flaky "Getting disk size" ERROR in n-cpu log after successful tempest run
Bug #1243849 reported by
David Kranz
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Compute (nova) |
Fix Released
|
Medium
|
jichenjc |
Bug Description
This happened in 14 out of 156 runs. Here is a sample:
https:/
http://
2013-10-22 20:48:20.036 | 2013-10-22 20:41:24.129 21399 ERROR nova.virt.
tags: | added: compute |
Changed in nova: | |
importance: | Undecided → Medium |
status: | New → Confirmed |
Changed in nova: | |
assignee: | nobody → jichencom (jichenjc) |
Changed in nova: | |
milestone: | none → icehouse-2 |
status: | Fix Committed → Fix Released |
Changed in nova: | |
milestone: | icehouse-2 → 2014.1 |
To post a comment you must log in.
I would think it's an expected situation, but from http:// en.wikipedia. org/wiki/ Syslog# Severity_ levels
I will modify the ERROR to WARNING because it might lead to some wrong info later
The root cause of this ERROR is the periodic task will update the resource by getting all active instances and calculate their size
however, during the calculation, the instance is resized, so the disk file can't be found
if someone suggest to permanently resolve the problem, we might need to make the resource stat update and nova operations such as resize/delete etc mutual access(use lock), it might block the operations if thousands of instances exist, so catch the error and defer the process which is used currently might be a better solution
see following logs for more detail
</span><span class='DEBUG _2013-10- 22_20_41_ 24_102' ><a name='_ 2013-10- 22_20_41_ 24_102' class='date' href='# _2013-10- 22_20_41_ 24_102' >2013-10- 22 20:41:24.102</a> DEBUG nova.openstack. common. processutils [req-2a121325- 5913-4add- 95a4-350c3d7975 10 tempest. scenario. manager- tempest- 1560801136- user tempest. scenario. manager- tempest- 1560801136- tenant] Running cmd (subprocess): qemu-img convert -f qcow2 -O qcow2 /opt/stack/ data/nova/ instances/ cd1428aa- fa8a-43d9- 8180-888e832c35 c2_resize/ disk /opt/stack/ data/nova/ instances/ cd1428aa- fa8a-43d9- 8180-888e832c35 c2_resize/ disk_rbase execute /opt/stack/ new/nova/ nova/openstack/ common/ processutils. py:147 22_20_41_ 24_129' ><a name='_ 2013-10- 22_20_41_ 24_129' class='date' href='# _2013-10- 22_20_41_ 24_129' >2013-10- 22 20:41:24.129</a> 21399 ERROR nova.virt. libvirt. driver [-] Getting disk size of instance-00000069: [Errno 2] No such file or directory: '/opt/stack/ data/nova/ instances/ cd1428aa- fa8a-43d9- 8180-888e832c35 c2/disk' 22_20_41_ 24_140' ><a name='_ 2013-10- 22_20_41_ 24_140' class='date' href='# _2013-10- 22_20_41_ 24_140' >2013-10- 22 20:41:24.140</a> DEBUG nova.openstack. common. processutils [req-2a121325- 5913-4add- 95a4-350c3d7975 10 tempest. scenario. manager- tempest- 1560801136- user tempest. scenario. manager- tempest- 1560801136- tenant] Running cmd (subprocess): mv /opt/stack/ data/nova/ instances/ cd1428aa- fa8a-43d9- 8180-888e832c35 c2_resize/ disk_rbase /opt/stack/ data/nova/ instances/ cd1428aa- fa8a-43d9- 8180-888e832c35 c2/disk execute /opt/stack/ new/nova/ nova/openstack/ common/ processutils. py:147
.......
</span><span class='ERROR _2013-10-
</span><span class='DEBUG _2013-10-