nova-compute can't perform any actions during waiting response from Ceph

Bug #1484167 reported by Leontii Istomin
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Invalid
Medium
MOS Nova
7.0.x
Won't Fix
Medium
MOS Nova
8.0.x
Invalid
Medium
MOS Nova

Bug Description

In case when Ceph performance is slow, nova-compute can't even poll status to nova-api.

Here we can see that nova-compute tried to resize disk and hanged on connection to Ceph backend. During the time nova-compute didn't report about its status:
http://paste.openstack.org/show/412683/

api: '1.0'
astute_sha: 34e0493afa22999c4a07d3198ceb945116ab7932
auth_required: true
build_id: 2015-07-27_09-24-22
build_number: '98'
feature_groups:
- mirantis
fuel-agent_sha: 2a65f11c10b0aeb5184247635a19740fc3edde21
fuel-library_sha: 39c3162ee2e2ff6e3af82f703998f95ff4cc2b7a
fuel-ostf_sha: 94a483c8aba639be3b96616c1396ef290dcc00cd
fuelmain_sha: 921918a3bd3d278431f35ad917989e46b0c24100
nailgun_sha: d5c19f6afc66b5efe3c61ecb49025c1002ccbdc6
openstack_version: 2015.1.0-7.0
production: docker
python-fuelclient_sha: 58c411d87a7eaf0fd6892eae2b5cb1eff4190c98
release: '7.0'

Revision history for this message
Leontii Istomin (listomin) wrote :

Way to solve the issue from Roman Podoliaka: http://paste.openstack.org/show/412686/

Changed in mos:
importance: Low → Medium
Dina Belova (dbelova)
description: updated
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/nova (openstack-ci/fuel-7.0/2015.1.0)

Fix proposed to branch: openstack-ci/fuel-7.0/2015.1.0
Change author: Roman Podoliaka <email address hidden>
Review: https://review.fuel-infra.org/10379

Revision history for this message
Dina Belova (dbelova) wrote :

Roman, if the fix will be included to 7.0, please update the bug status for 7.0.x

Revision history for this message
Roman Podoliaka (rpodolyaka) wrote :

We no longer fixing medium bugs in 7.0, moving to 8.0

Changed in mos:
status: Confirmed → Won't Fix
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/nova (openstack-ci/fuel-7.0/2015.1.0)

Change abandoned by Roman Podoliaka <email address hidden> on branch: openstack-ci/fuel-7.0/2015.1.0
Review: https://review.fuel-infra.org/10379

Revision history for this message
Roman Podoliaka (rpodolyaka) wrote :

All calls to rados lib are done in threads - https://github.com/ceph/ceph/blob/master/src/pybind/rados.py#L202-L235 - and *should not* block a python eventlet process.

Marking this as Incomplete. Let's see if we can reproduce this ever again (I believe, we haven't seen this in 8.0).

tags: added: area-nova
Revision history for this message
Roman Podoliaka (rpodolyaka) wrote :

No new repros and #6 summaries why this must not be a problem anymore.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.