Status is still 'creating' after the volume shapshot is created

Bug #1005805 reported by Vincent Hou
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Dashboard (Horizon)
Fix Released
Low
Gabriel Hurley

Bug Description

When the volume snapshot is successfully created, the status is still sticking to 'creating'. After the page is refreshed, the status turns to 'available'.

The log of nova-volume is:
2012-05-29 16:21:01 DEBUG nova.manager [-] Running periodic task VolumeManager._publish_service_capabilities from (pid=6050) periodic_tasks /opt/stack/n
ova/nova/manager.py:164
2012-05-29 16:21:01 DEBUG nova.manager [-] Running periodic task VolumeManager._report_driver_status from (pid=6050) periodic_tasks /opt/stack/nova/nova
/manager.py:164
2012-05-29 16:21:11 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'KeystoneServiceAdmin', u'admin', u'KeystoneAdmin'], u'_context_request_id':
u'req-1d62a647-240c-4f51-9838-f216233c7c4b', u'_context_quota_class': None, u'args': {u'snapshot_id': u'df122f34-dc3b-487d-b145-cc02a3dd4946', u'volume_
id': u'b9ea2a7a-6a0c-49b2-b0ef-21c0f04644f6'}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': u'e274002b917a
413783827982ffa52ab4', u'_context_timestamp': u'2012-05-29T08:21:11.568122', u'_context_read_deleted': u'no', u'_context_user_id': u'f981308eeed741e1b55
fc17afe9f7d6f', u'method': u'create_snapshot', u'_context_remote_address': u'9.119.148.14'} from (pid=6050) _safe_log /opt/stack/nova/nova/rpc/common.py
:199
2012-05-29 16:21:11 DEBUG nova.rpc.amqp [req-1d62a647-240c-4f51-9838-f216233c7c4b f981308eeed741e1b55fc17afe9f7d6f e274002b917a413783827982ffa52ab4] unp
acked context: {'user_id': u'f981308eeed741e1b55fc17afe9f7d6f', 'roles': [u'KeystoneServiceAdmin', u'admin', u'KeystoneAdmin'], 'timestamp': '2012-05-29
T08:21:11.568122', 'auth_token': '<SANITIZED>', 'remote_address': u'9.119.148.14', 'quota_class': None, 'is_admin': True, 'request_id': u'req-1d62a647-2
40c-4f51-9838-f216233c7c4b', 'project_id': u'e274002b917a413783827982ffa52ab4', 'read_deleted': u'no'} from (pid=6050) _safe_log /opt/stack/nova/nova/rp
c/common.py:199
2012-05-29 16:21:11 INFO nova.volume.manager [req-1d62a647-240c-4f51-9838-f216233c7c4b f981308eeed741e1b55fc17afe9f7d6f e274002b917a413783827982ffa52ab4
] snapshot snapshot-df122f34-dc3b-487d-b145-cc02a3dd4946: creating
2012-05-29 16:21:11 DEBUG nova.volume.manager [req-1d62a647-240c-4f51-9838-f216233c7c4b f981308eeed741e1b55fc17afe9f7d6f e274002b917a413783827982ffa52ab4] snapshot snapshot-df122f34-dc3b-487d-b145-cc02a3dd4946: creating from (pid=6050) create_snapshot /opt/stack/nova/nova/volume/manager.py:218
2012-05-29 16:21:11 DEBUG nova.utils [req-1d62a647-240c-4f51-9838-f216233c7c4b f981308eeed741e1b55fc17afe9f7d6f e274002b917a413783827982ffa52ab4] Running cmd (subprocess): sudo /usr/local/bin/nova-rootwrap lvcreate -L 1G --name _snapshot-df122f34-dc3b-487d-b145-cc02a3dd4946 --snapshot nova-volumes/volume-b9ea2a7a-6a0c-49b2-b0ef-21c0f04644f6 from (pid=6050) execute /opt/stack/nova/nova/utils.py:176
Exception AssertionError: AssertionError() in <module 'threading' from '/usr/lib/python2.7/threading.pyc'> ignored
2012-05-29 16:21:12 DEBUG nova.volume.manager [req-1d62a647-240c-4f51-9838-f216233c7c4b f981308eeed741e1b55fc17afe9f7d6f e274002b917a413783827982ffa52ab4] snapshot snapshot-df122f34-dc3b-487d-b145-cc02a3dd4946: created successfully from (pid=6050) create_snapshot /opt/stack/nova/nova/volume/manager.py:233
2012-05-29 16:22:01 DEBUG nova.manager [-] Running periodic task VolumeManager._publish_service_capabilities from (pid=6050) periodic_tasks /opt/stack/nova/nova/manager.py:164
2012-05-29 16:22:01 DEBUG nova.manager [-] Running periodic task VolumeManager._report_driver_status from (pid=6050) periodic_tasks /opt/stack/nova/nova/manager.py:164

The log of horizon is:

[Tue May 29 16:23:21 2012] [error] DEBUG:horizon.api.nova:cinderclient connection created using token "0285f8b5b6bc450bbfa95fb034d8c120" and url "http:/
/9.119.148.14:8776/v1/e274002b917a413783827982ffa52ab4"
[Tue May 29 16:23:21 2012] [error] DEBUG:novaclient.client:REQ: curl -i http://9.119.148.14:8776/v1/e274002b917a413783827982ffa52ab4/snapshots/detail -X
 GET -H "X-Auth-Project-Id: e274002b917a413783827982ffa52ab4" -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: 0285f8b
5b6bc450bbfa95fb034d8c120"
[Tue May 29 16:23:21 2012] [error]
[Tue May 29 16:23:21 2012] [error] DEBUG:novaclient.client:RESP:{'status': '200', 'content-length': '247', 'content-location': u'http://9.119.148.14:877
6/v1/e274002b917a413783827982ffa52ab4/snapshots/detail', 'x-compute-request-id': 'req-9a69b23f-eee5-4e58-b128-a49805d76d34', 'date': 'Tue, 29 May 2012 0
8:23:21 GMT', 'content-type': 'application/json'} {"snapshots": [{"status": "available", "display_name": "Vol1_snapshot", "created_at": "2012-05-29 08:21:11", "display_description": "", "volume_id": "b9ea2a7a-6a0c-49b2-b0ef-21c0f04644f6", "id": "df122f34-dc3b-487d-b145-cc02a3dd4946", "size": 1}]}
[Tue May 29 16:23:21 2012] [error]
[Tue May 29 16:23:21 2012] [error] DEBUG:horizon.api.keystone:Creating a new keystoneclient connection to http://9.119.148.14:5000/v2.0.
[Tue May 29 16:23:21 2012] [error] DEBUG:keystoneclient.client:REQ: curl -i http://9.119.148.14:5000/v2.0/tenants -X GET -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: 87629683c9f94aba8b93b0393fe0463f"
[Tue May 29 16:23:21 2012] [error]
[Tue May 29 16:23:21 2012] [error] DEBUG:keystoneclient.client:RESP: {'status': '200', 'content-length': '231', 'content-location': u'http://9.119.148.14:5000/v2.0/tenants', 'vary': 'X-Auth-Token', 'date': 'Tue, 29 May 2012 08:23:21 GMT', 'content-type': 'application/json'}
[Tue May 29 16:23:21 2012] [error] RESP BODY: {"tenants_links": [], "tenants": [{"enabled": true, "description": null, "name": "demo", "id": "2973b305a5c249b5bf52485c4e781d3b"}, {"enabled": true, "description": null, "name": "admin", "id": "e274002b917a413783827982ffa52ab4"}]}
[Tue May 29 16:23:21 2012] [error]
[Tue May 29 16:23:42 2012] [error] DEBUG:django.db.backends:(0.001) SELECT "django_session"."session_key", "django_session"."session_data", "django_session"."expire_date" FROM "django_session" WHERE ("django_session"."session_key" = 7dcd935a74588f2ed776e1e87af06265 AND "django_session"."expire_date" > 2012-05-29 16:23:42.760917 ); args=('7dcd935a74588f2ed776e1e87af06265', u'2012-05-29 16:23:42.760917')
[Tue May 29 16:23:42 2012] [error] DEBUG:horizon.api.nova:novaclient connection created using token "0285f8b5b6bc450bbfa95fb034d8c120" and url "http://9.119.148.14:8774/v2/e274002b917a413783827982ffa52ab4"
[Tue May 29 16:23:42 2012] [error] DEBUG:novaclient.client:REQ: curl -i http://9.119.148.14:8774/v2/e274002b917a413783827982ffa52ab4/servers/detail?project_id=e274002b917a413783827982ffa52ab4 -X GET -H "X-Auth-Project-Id: e274002b917a413783827982ffa52ab4" -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: 0285f8b5b6bc450bbfa95fb034d8c120"
[Tue May 29 16:23:42 2012] [error]
[Tue May 29 16:23:42 2012] [error] DEBUG:novaclient.client:RESP:{'status': '200', 'content-length': '15', 'content-location': u'http://9.119.148.14:8774/v2/e274002b917a413783827982ffa52ab4/servers/detail?project_id=e274002b917a413783827982ffa52ab4', 'x-compute-request-id': 'req-3ac1ad19-d518-405c-aa96-786b5468c46a', 'date': 'Tue, 29 May 2012 08:23:42 GMT', 'content-type': 'application/json'} {"servers": []}
[Tue May 29 16:23:42 2012] [error]
[Tue May 29 16:23:42 2012] [error] DEBUG:horizon.api.nova:cinderclient connection created using token "0285f8b5b6bc450bbfa95fb034d8c120" and url "http://9.119.148.14:8776/v1/e274002b917a413783827982ffa52ab4"
[Tue May 29 16:23:42 2012] [error] DEBUG:novaclient.client:REQ: curl -i http://9.119.148.14:8776/v1/e274002b917a413783827982ffa52ab4/volumes/detail -X GET -H "X-Auth-Project-Id: e274002b917a413783827982ffa52ab4" -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: 0285f8b5b6bc450bbfa95fb034d8c120"
[Tue May 29 16:23:42 2012] [error]
[Tue May 29 16:23:42 2012] [error] DEBUG:novaclient.client:RESP:{'status': '200', 'content-length': '291', 'content-location': u'http://9.119.148.14:8776/v1/e274002b917a413783827982ffa52ab4/volumes/detail', 'x-compute-request-id': 'req-4703cf0e-37ed-4d27-a638-37e093981346', 'date': 'Tue, 29 May 2012 08:23:42 GMT', 'content-type': 'application/json'} {"volumes": [{"status": "available", "display_name": "Vol1", "attachments": [], "availability_zone": "nova", "created_at": "2012-05-29 08:19:55", "display_description": "", "volume_type": "None", "snapshot_id": null, "metadata": {}, "id": "b9ea2a7a-6a0c-49b2-b0ef-21c0f04644f6", "size": 1}]}
[Tue May 29 16:23:42 2012] [error]
[Tue May 29 16:23:42 2012] [error] DEBUG:horizon.api.keystone:Creating a new keystoneclient connection to http://9.119.148.14:5000/v2.0.
[Tue May 29 16:23:42 2012] [error] DEBUG:keystoneclient.client:REQ: curl -i http://9.119.148.14:5000/v2.0/tenants -X GET -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: 87629683c9f94aba8b93b0393fe0463f"
[Tue May 29 16:23:42 2012] [error]
[Tue May 29 16:23:42 2012] [error] DEBUG:keystoneclient.client:RESP: {'status': '200', 'content-length': '231', 'content-location': u'http://9.119.148.14:5000/v2.0/tenants', 'vary': 'X-Auth-Token', 'date': 'Tue, 29 May 2012 08:23:42 GMT', 'content-type': 'application/json'}
[Tue May 29 16:23:42 2012] [error] RESP BODY: {"tenants_links": [], "tenants": [{"enabled": true, "description": null, "name": "demo", "id": "2973b305a5c249b5bf52485c4e781d3b"}, {"enabled": true, "description": null, "name": "admin", "id": "e274002b917a413783827982ffa52ab4"}]}
[Tue May 29 16:23:42 2012] [error]

It seems no problem with nova.

Revision history for this message
Vincent Hou (houshengbo) wrote :
Revision history for this message
Gabriel Hurley (gabriel-hurley) wrote :

The screenshot doesn't have the "updating" spinner icon in it, which means that for whatever reason the updating either stopped or never started. However, from those logs there's no indiciation of what happened.

It seems like you've been having a lot of problems with nova volume lately. Could you tell us exactly what version of the code you're running, and how you installed it? (devstack essex, devstack master, ubuntu repos, etc.)

Changed in horizon:
assignee: nobody → Gabriel Hurley (gabriel-hurley)
status: New → Incomplete
Revision history for this message
Vincent Hou (houshengbo) wrote :

I install OpenStack via devstack on Ubuntu 12.04, 64 bit. I checked out the code from the master.

Revision history for this message
Vincent Hou (houshengbo) wrote :

This scenario can be recreated by creating the snapshot from a volume from horizon webpage interface.

Revision history for this message
Gabriel Hurley (gabriel-hurley) wrote :

Turns out this table just wasn't set to poll.

Changed in horizon:
status: Incomplete → In Progress
importance: Undecided → Low
milestone: none → folsom-2
milestone: folsom-2 → none
milestone: none → folsom-2
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to horizon (master)

Fix proposed to branch: master
Review: https://review.openstack.org/8432

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to horizon (master)

Reviewed: https://review.openstack.org/8432
Committed: http://github.com/openstack/horizon/commit/155bfb72c1b5f866236928f4ffd0c2567dc556f3
Submitter: Jenkins
Branch: master

commit 155bfb72c1b5f866236928f4ffd0c2567dc556f3
Author: Gabriel Hurley <email address hidden>
Date: Mon Jun 11 18:27:00 2012 -0700

    Rollup of volume fixes.

      * Standardizes volume attachment wording.
      * Defensive coding for missing values in attachment dict.
        Fixes bug 1004412 and bug 1004337.
      * Adds polling to Snapshots and Volume Snapshots tables.
        Fixes bug 1005805.
      * Removes an erroneous link on the Volume Snapshots table.
        Fixes bug 1005806.
      * Correts the "type" property on the Images and Snapshots tables.
        Fixes bug 1011910.

    This seems to restore all supported functionality related to volumes using
    devstack master.

    Change-Id: Ie9b7aec06fa1bb7628cd854fb49c02aab14451ea

Changed in horizon:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in horizon:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in horizon:
milestone: folsom-2 → 2012.2
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.