| 2016-11-21 16:17:30 |
Roman Podoliaka |
bug |
|
|
added bug |
| 2016-11-21 16:18:02 |
Roman Podoliaka |
description |
A few recent builds of 9.0-community.main.ubuntu.bvt_2 (MOS 9.2 as of now)
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/606/
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/614/
failed on launching of an instance with the following error:
2016-11-19 04:34:55.805 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] CMD "/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part" returned: -9 in 5.177s execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:374
2016-11-19 04:34:55.806 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] u'/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part' failed. Not Retrying. execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:422
2016-11-19 04:34:56.866 23824 DEBUG nova.compute.utils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
2016-11-19 04:34:56.867 23824 ERROR nova.compute.manager [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Build of instance 83ae7e3b-377b-4091-8a33-74487bf21a9b aborted: Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
Note, that it took `qemu-img info` 5.177s to return -9. We intentionally run the command with resource constraints:
/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2
to prevent possible DoS attacks with corrupted images, but in this case the image is correct - VMs are booted successfully in other OSTF test cases.
My current understanding is that sometimes a CI node the env is run on can be "slow" (disk? cpu?) and cause such errors.
(max 1G of memory and 2 seconds of CPU time) |
A few recent builds of 9.0-community.main.ubuntu.bvt_2 (MOS 9.2 as of now)
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/606/
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/614/
failed on launching of an instance with the following error:
2016-11-19 04:34:55.805 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] CMD "/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part" returned: -9 in 5.177s execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:374
2016-11-19 04:34:55.806 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] u'/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part' failed. Not Retrying. execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:422
2016-11-19 04:34:56.866 23824 DEBUG nova.compute.utils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
2016-11-19 04:34:56.867 23824 ERROR nova.compute.manager [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Build of instance 83ae7e3b-377b-4091-8a33-74487bf21a9b aborted: Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
Note, that it took `qemu-img info` 5.177s to return -9. We intentionally run this command with resource constraints set:
/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2
to prevent possible DoS attacks with corrupted images, but in this case the image is correct - VMs are booted successfully in other OSTF test cases.
My current understanding is that sometimes a CI node the env is run on can be "slow" (disk? cpu?) and cause such errors.
(max 1G of memory and 2 seconds of CPU time) |
|
| 2016-11-21 16:18:15 |
Roman Podoliaka |
description |
A few recent builds of 9.0-community.main.ubuntu.bvt_2 (MOS 9.2 as of now)
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/606/
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/614/
failed on launching of an instance with the following error:
2016-11-19 04:34:55.805 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] CMD "/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part" returned: -9 in 5.177s execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:374
2016-11-19 04:34:55.806 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] u'/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part' failed. Not Retrying. execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:422
2016-11-19 04:34:56.866 23824 DEBUG nova.compute.utils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
2016-11-19 04:34:56.867 23824 ERROR nova.compute.manager [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Build of instance 83ae7e3b-377b-4091-8a33-74487bf21a9b aborted: Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
Note, that it took `qemu-img info` 5.177s to return -9. We intentionally run this command with resource constraints set:
/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2
to prevent possible DoS attacks with corrupted images, but in this case the image is correct - VMs are booted successfully in other OSTF test cases.
My current understanding is that sometimes a CI node the env is run on can be "slow" (disk? cpu?) and cause such errors.
(max 1G of memory and 2 seconds of CPU time) |
A few recent builds of 9.0-community.main.ubuntu.bvt_2 (MOS 9.2 as of now)
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/606/
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/614/
failed on launching of an instance with the following error:
2016-11-19 04:34:55.805 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] CMD "/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part" returned: -9 in 5.177s execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:374
2016-11-19 04:34:55.806 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] u'/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part' failed. Not Retrying. execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:422
2016-11-19 04:34:56.866 23824 DEBUG nova.compute.utils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
2016-11-19 04:34:56.867 23824 ERROR nova.compute.manager [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Build of instance 83ae7e3b-377b-4091-8a33-74487bf21a9b aborted: Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
Note, that it took `qemu-img info` 5.177s to return -9. We intentionally run this command with resource constraints set:
/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2
to prevent possible DoS attacks with malicious images, but in this case the image is correct - VMs are booted successfully in other OSTF test cases.
My current understanding is that sometimes a CI node the env is run on can be "slow" (disk? cpu?) and cause such errors.
(max 1G of memory and 2 seconds of CPU time) |
|
| 2016-11-21 16:19:16 |
Roman Podoliaka |
description |
A few recent builds of 9.0-community.main.ubuntu.bvt_2 (MOS 9.2 as of now)
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/606/
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/614/
failed on launching of an instance with the following error:
2016-11-19 04:34:55.805 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] CMD "/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part" returned: -9 in 5.177s execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:374
2016-11-19 04:34:55.806 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] u'/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part' failed. Not Retrying. execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:422
2016-11-19 04:34:56.866 23824 DEBUG nova.compute.utils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
2016-11-19 04:34:56.867 23824 ERROR nova.compute.manager [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Build of instance 83ae7e3b-377b-4091-8a33-74487bf21a9b aborted: Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
Note, that it took `qemu-img info` 5.177s to return -9. We intentionally run this command with resource constraints set:
/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2
to prevent possible DoS attacks with malicious images, but in this case the image is correct - VMs are booted successfully in other OSTF test cases.
My current understanding is that sometimes a CI node the env is run on can be "slow" (disk? cpu?) and cause such errors.
(max 1G of memory and 2 seconds of CPU time) |
A few recent builds of 9.0-community.main.ubuntu.bvt_2 (MOS 9.2 as of now)
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/606/
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/614/
failed on launching of an instance with the following error:
2016-11-19 04:34:55.805 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] CMD "/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part" returned: -9 in 5.177s execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:374
2016-11-19 04:34:55.806 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] u'/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part' failed. Not Retrying. execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:422
2016-11-19 04:34:56.866 23824 DEBUG nova.compute.utils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
2016-11-19 04:34:56.867 23824 ERROR nova.compute.manager [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Build of instance 83ae7e3b-377b-4091-8a33-74487bf21a9b aborted: Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
Note, that it took `qemu-img info` 5.177s to return -9. We intentionally run this command with resource constraints set:
/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2
(max 1G of memory and 2 seconds of CPU time)
to prevent possible DoS attacks with malicious images, but in this case the image is correct - VMs are booted successfully in other OSTF test cases.
My current understanding is that sometimes a CI node a test environment is run on can be "slow" (disk? cpu?) and cause such errors. |
|
| 2016-11-21 16:20:14 |
Roman Podoliaka |
attachment added |
|
fail_error_ceph_rados_gw-fuel-snapshot-2016-11-19_04-35-48.tar https://bugs.launchpad.net/mos/+bug/1643609/+attachment/4781095/+files/fail_error_ceph_rados_gw-fuel-snapshot-2016-11-19_04-35-48.tar |
|
| 2016-11-21 16:21:19 |
Roman Podoliaka |
attachment added |
|
fail_error_ceph_rados_gw-fuel-snapshot-2016-11-21_04-26-29.tar https://bugs.launchpad.net/mos/+bug/1643609/+attachment/4781096/+files/fail_error_ceph_rados_gw-fuel-snapshot-2016-11-21_04-26-29.tar |
|
| 2016-11-21 16:22:48 |
Roman Podoliaka |
description |
A few recent builds of 9.0-community.main.ubuntu.bvt_2 (MOS 9.2 as of now)
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/606/
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/614/
failed on launching of an instance with the following error:
2016-11-19 04:34:55.805 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] CMD "/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part" returned: -9 in 5.177s execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:374
2016-11-19 04:34:55.806 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] u'/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part' failed. Not Retrying. execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:422
2016-11-19 04:34:56.866 23824 DEBUG nova.compute.utils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
2016-11-19 04:34:56.867 23824 ERROR nova.compute.manager [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Build of instance 83ae7e3b-377b-4091-8a33-74487bf21a9b aborted: Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
Note, that it took `qemu-img info` 5.177s to return -9. We intentionally run this command with resource constraints set:
/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2
(max 1G of memory and 2 seconds of CPU time)
to prevent possible DoS attacks with malicious images, but in this case the image is correct - VMs are booted successfully in other OSTF test cases.
My current understanding is that sometimes a CI node a test environment is run on can be "slow" (disk? cpu?) and cause such errors. |
A few recent builds of 9.0-community.main.ubuntu.bvt_2 (MOS 9.2 as of now)
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/606/
https://ci.fuel-infra.org/view/BVT/job/9.0-community.main.ubuntu.bvt_2/614/
failed on launching of an instance with the following error:
2016-11-19 04:34:55.805 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] CMD "/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part" returned: -9 in 5.177s execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:374
2016-11-19 04:34:55.806 23824 DEBUG oslo_concurrency.processutils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] u'/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- env LC_ALL=C LANG=C qemu-img info /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part' failed. Not Retrying. execute /usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:422
2016-11-19 04:34:56.866 23824 DEBUG nova.compute.utils [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
2016-11-19 04:34:56.867 23824 ERROR nova.compute.manager [req-b823b3fc-6435-40f7-87af-2ecfbadc78af d071d93fd9524714b1b1bbb49ed765e9 69393ef97a314fb1a2c41b98283f063c - - -] [instance: 83ae7e3b-377b-4091-8a33-74487bf21a9b] Build of instance 83ae7e3b-377b-4091-8a33-74487bf21a9b aborted: Disk info file is invalid: qemu-img failed to execute on /var/lib/nova/instances/_base/3d5a408550fdf3a23c50da67bb61a63e723e7f2d.part : Unexpected error while running command.
Note, that it took `qemu-img info` 5.177s to return -9. We intentionally run this command with resource constraints set (see https://review.openstack.org/#/c/327624/ for details):
/usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2
(max 1G of memory and 2 seconds of CPU time)
to prevent possible DoS attacks with malicious images, but in this case the image is correct - VMs are booted successfully in other OSTF test cases.
My current understanding is that sometimes a CI node a test environment is run on can be "slow" (disk? cpu?) and cause such errors. |
|
| 2016-11-23 13:07:35 |
Vitaly Sedelnik |
mos: status |
New |
Confirmed |
|
| 2016-11-23 13:07:37 |
Vitaly Sedelnik |
mos: importance |
Undecided |
Medium |
|
| 2016-11-23 13:07:43 |
Vitaly Sedelnik |
mos: assignee |
|
MOS Nova (mos-nova) |
|
| 2016-11-23 13:07:46 |
Vitaly Sedelnik |
mos: milestone |
|
9.2 |
|
| 2016-11-23 13:07:53 |
Vitaly Sedelnik |
tags |
|
area-nova |
|
| 2016-12-07 13:42:51 |
Elena Ezhova |
attachment added |
|
fail_error_ceph_rados_gw-fuel-snapshot-2016-12-06_19-59-08.tar https://bugs.launchpad.net/mos/+bug/1643609/+attachment/4788561/+files/fail_error_ceph_rados_gw-fuel-snapshot-2016-12-06_19-59-08.tar |
|
| 2016-12-13 18:17:06 |
Fuel Devops McRobotson |
mos: status |
Confirmed |
Fix Committed |
|
| 2016-12-14 05:32:50 |
TatyanaGladysheva |
tags |
area-nova |
area-nova on-verification |
|
| 2016-12-20 06:27:49 |
TatyanaGladysheva |
tags |
area-nova on-verification |
area-nova |
|
| 2016-12-20 06:27:52 |
TatyanaGladysheva |
mos: status |
Fix Committed |
Fix Released |
|
| 2017-01-03 15:36:16 |
Roman Podoliaka |
nominated for series |
|
mos/10.0.x |
|
| 2017-01-03 15:36:16 |
Roman Podoliaka |
bug task added |
|
mos/10.0.x |
|
| 2017-01-03 15:36:23 |
Roman Podoliaka |
mos/10.0.x: status |
New |
Confirmed |
|
| 2017-01-03 15:36:25 |
Roman Podoliaka |
mos/10.0.x: importance |
Undecided |
Medium |
|
| 2017-01-03 15:36:30 |
Roman Podoliaka |
mos/10.0.x: assignee |
|
MOS Nova (mos-nova) |
|
| 2017-01-03 15:36:31 |
Roman Podoliaka |
mos/10.0.x: milestone |
|
10.0 |
|
| 2017-01-31 10:00:58 |
Roman Podoliaka |
mos/10.0.x: status |
Confirmed |
Fix Committed |
|
| 2020-01-22 12:08:56 |
Hu Zhou |
bug |
|
|
added subscriber Hu Zhou |
