(1)openstack version info
openstack --version
openstack 2.2.0
cinder --version
1.6.0
(2)environmental information
Linux system is centos7.2.
3 control nodes, to achieve the control node of the HA
The back-end storage of cinder is CEPH distributed storage system.
The configuration of cinder is as follows:
[DEFAULT]
logdir = /var/log/cinder
state_path = /var/lib/cinder
volumes_dir = /etc/cinder/volumes
iscsi_helper = lioadm
rootwrap_config = /etc/cinder/rootwrap.conf
auth_strategy = keystone
my_ip = 10.0.1.11
osapi_volume_listen = 10.0.1.11
enabled_backends = ceph
[ceph]
volume_driver = cinder.volume.drivers.rbd.RBDDriver
rbd_pool = volumes
rbd_ceph_conf = /etc/ceph/ceph.conf
rbd_flatten_volume_from_snapshot = false
rbd_max_clone_depth = 5
rbd_store_chunk_size = 4
rados_connect_timeout = -1
glance_api_version = 2
rbd_user = cinder
rbd_secret_uuid = 7289b252-f19d-4a86-ae99-34900a535a3c
[database]
connection = mysql://cinder:Changeme_123@10.0.1.11/cinder
[keystone_authtoken]
auth_uri = http://controller:5000
auth_url = http://controller:35357
memcached_servers = controller:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = cinder
password = Changeme_123
[oslo_concurrency]
lock_path = /var/lib/cinder/tmp
[oslo_messaging_rabbit]
rabbit_hosts = 10.0.1.11:5672,10.0.1.12:5672,10.0.1.13:5672
rabbit_userid = openstack
rabbit_password = 123
(3)The operation steps of problem reproduction
3.1 Open dashboard
3.2 Menu path:
Project - Calculation - mirror image
Select a mirror, click on the button to hide the drop-down menu to create volume"
3.3 click save
3.4 The volume state displayed on the interface is error
I expect the state of the Available to be volume,but it is error.
(4) The detail log
2016-10-18 10:58:36.110 29009 INFO cinder.image.image_utils [req-50e04037-b79c-4421-9c99-9c66e9316c7f 3fa132a654cb40cf913f1a0d42396451 e7b6391717f145b38552c4ce83555860 - - -] Image download 358.00 MB at 142.01 MB/s
2016-10-18 10:58:36.321 29009 WARNING cinder.volume.manager [req-50e04037-b79c-4421-9c99-9c66e9316c7f 3fa132a654cb40cf913f1a0d42396451 e7b6391717f145b38552c4ce83555860 - - -] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802ff3c4-f554-4fa4-a8c8-fbb19525952e) transitioned into state 'FAILURE' from state 'RUNNING'
5 predecessors (most recent first):
Atom 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'volume_ref': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,consistencygroup=<?>,consistencygroup_id=None,created_at=2016-10-18T02:58:25Z,deleted=False,deleted_at=None,display_description='',display_name='testOS',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,host='sd-controller2@ceph#RBD',id=aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id=e7b6391717f145b38552c4ce83555860,provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status='disabled',scheduled_at=2016-10-18T02:58:33Z,size=100,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2016-10-18T02:58:33Z,user_id=3fa132a654cb40cf913f1a0d42396451,volume_attachment=<?>,volume_type=<?>,volume_type_id=None), 'context': <cinder.context.RequestContext object at 0x58b3310>}, 'provides': None}
|__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'volume_ref': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,consistencygroup=<?>,consistencygroup_id=None,created_at=2016-10-18T02:58:25Z,deleted=False,deleted_at=None,display_description='',display_name='testOS',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,host='sd-controller2@ceph#RBD',id=aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id=e7b6391717f145b38552c4ce83555860,provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status='disabled',scheduled_at=2016-10-18T02:58:33Z,size=100,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2016-10-18T02:58:33Z,user_id=3fa132a654cb40cf913f1a0d42396451,volume_attachment=<?>,volume_type=<?>,volume_type_id=None), 'request_spec': {u'source_replicaid': None, u'volume_properties': {u'status': u'creating', u'volume_type_id': None, u'display_name': u'testOS', u'multiattach': False, u'reservations': [u'5220a0bf-967e-4121-ad9c-87fb50ae6b8f', u'62a320ee-4e33-44ba-b37e-dd572e1b6646'], u'availability_zone': u'nova', u'attach_status': u'detached', u'display_description': u'', u'cgsnapshot_id': None, u'source_replicaid': None, u'qos_specs': None, u'encryption_key_id': None, u'replication_status': u'disabled', u'snapshot_id': None, u'source_volid': None, u'user_id': u'3fa132a654cb40cf913f1a0d42396451', u'project_id': u'e7b6391717f145b38552c4ce83555860', u'consistencygroup_id': None, u'size': 100, u'metadata': {}}, u'source_volid': None, u'cgsnapshot_id': None, u'volume': {u'migration_status': None, u'provider_id': None, u'availability_zone': u'nova', u'terminated_at': None, u'updated_at': None, u'provider_geometry': None, u'ec2_id': None, u'replication_status': u'disabled', u'snapshot_id': None, u'replication_extended_status': None, u'deleted_at': None, u'id': u'aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', u'size': 100, u'display_name': u'testOS', u'display_description': u'', u'name_id': u'aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', u'volume_admin_metadata': [], u'project_id': u'e7b6391717f145b38552c4ce83555860', u'launched_at': None, u'metadata': {}, u'status': u'creating', u'volume_type_id': None, u'multiattach': False, u'deleted': False, u'provider_location': None, u'volume_glance_metadata': [], u'host': None, u'consistencygroup_id': None, u'source_volid': None, u'provider_auth': None, u'previous_status': None, u'name': u'volume-aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', u'user_id': u'3fa132a654cb40cf913f1a0d42396451', u'bootable': False, u'created_at': u'2016-10-18T02:58:25.954084', u'attach_status': u'detached', u'volume_metadata': [], u'_name_id': None, u'encryption_key_id': None, u'replication_driver_data': None, u'scheduled_at': None}, u'image_id': u'4d2bec68-a8e3-44f4-b04a-79c114a8d740', u'snapshot_id': None, u'consistencygroup_id': None, u'volume_type': {}, u'volume_id': u'aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', u'resource_properties': {u'status': u'creating', u'volume_type_id': None, u'snapshot_id': None, u'user_id': u'3fa132a654cb40cf913f1a0d42396451', u'multiattach': False, u'reservations': [u'5220a0bf-967e-4121-ad9c-87fb50ae6b8f', u'62a320ee-4e33-44ba-b37e-dd572e1b6646'], u'availability_zone': u'nova', u'attach_status': u'detached', u'display_description': u'', u'cgsnapshot_id': None, u'qos_specs': None, u'encryption_key_id': None, u'replication_status': u'disabled', u'source_replicaid': None, u'source_volid': None, u'display_name': u'testOS', u'project_id': u'e7b6391717f145b38552c4ce83555860', u'consistencygroup_id': None, u'size': 100, u'metadata': {}}}, 'context': <cinder.context.RequestContext object at 0x58b3310>}, 'provides': {'status': u'creating', 'image_location': (None, None), 'image_id': u'4d2bec68-a8e3-44f4-b04a-79c114a8d740', 'volume_id': 'aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', 'volume_size': 100, 'image_service': <cinder.image.glance.GlanceImageService object at 0x5ddd150>, 'image_meta': {'status': u'active', 'name': u'centos70x64', 'deleted': False, 'container_format': u'bare', 'created_at': datetime.datetime(2016, 10, 15, 10, 19, 47, tzinfo=<iso8601.Utc>), 'disk_format': u'qcow2', 'updated_at': datetime.datetime(2016, 10, 15, 10, 19, 54, tzinfo=<iso8601.Utc>), 'id': u'4d2bec68-a8e3-44f4-b04a-79c114a8d740', 'owner': u'e7b6391717f145b38552c4ce83555860', 'min_ram': 0, 'checksum': u'bee7e856460140a77921304ec52d46a9', 'min_disk': 0, 'is_public': False, 'deleted_at': None, 'properties': {}, 'size': 375926784}, 'volume_name': 'volume-aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', 'type': 'image'}}
|__Atom 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'volume_ref': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,consistencygroup=<?>,consistencygroup_id=None,created_at=2016-10-18T02:58:25Z,deleted=False,deleted_at=None,display_description='',display_name='testOS',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,host='sd-controller2@ceph#RBD',id=aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id=e7b6391717f145b38552c4ce83555860,provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status='disabled',scheduled_at=2016-10-18T02:58:33Z,size=100,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2016-10-18T02:58:33Z,user_id=3fa132a654cb40cf913f1a0d42396451,volume_attachment=<?>,volume_type=<?>,volume_type_id=None), 'filter_properties': {u'config_options': {}, u'request_spec': {u'volume_id': u'aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', u'source_replicaid': None, u'volume_properties': {u'status': u'creating', u'volume_type_id': None, u'display_name': u'testOS', u'availability_zone': u'nova', u'reservations': [u'5220a0bf-967e-4121-ad9c-87fb50ae6b8f', u'62a320ee-4e33-44ba-b37e-dd572e1b6646'], u'multiattach': False, u'user_id': u'3fa132a654cb40cf913f1a0d42396451', u'attach_status': u'detached', u'display_description': u'', u'cgsnapshot_id': None, u'metadata': {}, u'qos_specs': None, u'encryption_key_id': None, u'replication_status': u'disabled', u'snapshot_id': None, u'source_volid': None, u'source_replicaid': None, u'project_id': u'e7b6391717f145b38552c4ce83555860', u'consistencygroup_id': None, u'size': 100}, u'source_volid': None, u'cgsnapshot_id': None, u'volume': {u'migration_status': None, u'provider_id': None, u'availability_zone': u'nova', u'terminated_at': None, u'updated_at': None, u'provider_geometry': None, u'ec2_id': None, u'replication_status': u'disabled', u'snapshot_id': None, u'replication_extended_status': None, u'deleted_at': None, u'id': u'aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', u'size': 100, u'display_name': u'testOS', u'display_description': u'', u'name_id': u'aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', u'volume_admin_metadata': [], u'encryption_key_id': None, u'project_id': u'e7b6391717f145b38552c4ce83555860', u'launched_at': None, u'metadata': {}, u'status': u'creating', u'volume_type_id': None, u'multiattach': False, u'deleted': False, u'provider_location': None, u'volume_glance_metadata': [], u'host': None, u'consistencygroup_id': None, u'source_volid': None, u'provider_auth': None, u'previous_status': None, u'name': u'volume-aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', u'user_id': u'3fa132a654cb40cf913f1a0d42396451', u'bootable': False, u'created_at': u'2016-10-18T02:58:25.954084', u'attach_status': u'detached', u'_name_id': None, u'volume_metadata': [], u'replication_driver_data': None, u'scheduled_at': None}, u'image_id': u'4d2bec68-a8e3-44f4-b04a-79c114a8d740', u'consistencygroup_id': None, u'volume_type': {}, u'snapshot_id': None, u'resource_properties': {u'status': u'creating', u'volume_type_id': None, u'user_id': u'3fa132a654cb40cf913f1a0d42396451', u'availability_zone': u'nova', u'reservations': [u'5220a0bf-967e-4121-ad9c-87fb50ae6b8f', u'62a320ee-4e33-44ba-b37e-dd572e1b6646'], u'multiattach': False, u'attach_status': u'detached', u'display_description': u'', u'cgsnapshot_id': None, u'source_replicaid': None, u'metadata': {}, u'qos_specs': None, u'encryption_key_id': None, u'replication_status': u'disabled', u'snapshot_id': None, u'source_volid': None, u'display_name': u'testOS', u'project_id': u'e7b6391717f145b38552c4ce83555860', u'consistencygroup_id': None, u'size': 100}}, u'user_id': u'3fa132a654cb40cf913f1a0d42396451', u'availability_zone': u'nova', u'volume_type': {}, u'qos_specs': None, u'retry': {u'num_attempts': 3, u'hosts': [u'sd-controller2@ceph#RBD', u'sd-controller2@ceph#RBD', u'sd-controller2@ceph#RBD']}, u'metadata': {}, u'resource_type': {}, u'size': 100}, 'context': <cinder.context.RequestContext object at 0x58b3310>, 'request_spec': {u'source_replicaid': None, u'volume_properties': {u'status': u'creating', u'volume_type_id': None, u'display_name': u'testOS', u'multiattach': False, u'reservations': [u'5220a0bf-967e-4121-ad9c-87fb50ae6b8f', u'62a320ee-4e33-44ba-b37e-dd572e1b6646'], u'availability_zone': u'nova', u'attach_status': u'detached', u'display_description': u'', u'cgsnapshot_id': None, u'source_replicaid': None, u'qos_specs': None, u'encryption_key_id': None, u'replication_status': u'disabled', u'snapshot_id': None, u'source_volid': None, u'user_id': u'3fa132a654cb40cf913f1a0d42396451', u'project_id': u'e7b6391717f145b38552c4ce83555860', u'consistencygroup_id': None, u'size': 100, u'metadata': {}}, u'source_volid': None, u'cgsnapshot_id': None, u'volume': {u'migration_status': None, u'provider_id': None, u'availability_zone': u'nova', u'terminated_at': None, u'updated_at': None, u'provider_geometry': None, u'ec2_id': None, u'replication_status': u'disabled', u'snapshot_id': None, u'replication_extended_status': None, u'deleted_at': None, u'id': u'aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', u'size': 100, u'display_name': u'testOS', u'display_description': u'', u'name_id': u'aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', u'volume_admin_metadata': [], u'project_id': u'e7b6391717f145b38552c4ce83555860', u'launched_at': None, u'metadata': {}, u'status': u'creating', u'volume_type_id': None, u'multiattach': False, u'deleted': False, u'provider_location': None, u'volume_glance_metadata': [], u'host': None, u'consistencygroup_id': None, u'source_volid': None, u'provider_auth': None, u'previous_status': None, u'name': u'volume-aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', u'user_id': u'3fa132a654cb40cf913f1a0d42396451', u'bootable': False, u'created_at': u'2016-10-18T02:58:25.954084', u'attach_status': u'detached', u'volume_metadata': [], u'_name_id': None, u'encryption_key_id': None, u'replication_driver_data': None, u'scheduled_at': None}, u'image_id': u'4d2bec68-a8e3-44f4-b04a-79c114a8d740', u'snapshot_id': None, u'consistencygroup_id': None, u'volume_type': {}, u'volume_id': u'aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9', u'resource_properties': {u'status': u'creating', u'volume_type_id': None, u'snapshot_id': None, u'user_id': u'3fa132a654cb40cf913f1a0d42396451', u'multiattach': False, u'reservations': [u'5220a0bf-967e-4121-ad9c-87fb50ae6b8f', u'62a320ee-4e33-44ba-b37e-dd572e1b6646'], u'availability_zone': u'nova', u'attach_status': u'detached', u'display_description': u'', u'cgsnapshot_id': None, u'qos_specs': None, u'encryption_key_id': None, u'replication_status': u'disabled', u'source_replicaid': None, u'source_volid': None, u'display_name': u'testOS', u'project_id': u'e7b6391717f145b38552c4ce83555860', u'consistencygroup_id': None, u'size': 100, u'metadata': {}}}}, 'provides': None}
|__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x58b3310>, 'volume_id': 'aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9'}, 'provides': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,consistencygroup=<?>,consistencygroup_id=None,created_at=2016-10-18T02:58:25Z,deleted=False,deleted_at=None,display_description='',display_name='testOS',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,host='sd-controller2@ceph#RBD',id=aa1d80c0-f990-43ce-8eb4-b9808f5a6ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id=e7b6391717f145b38552c4ce83555860,provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status='disabled',scheduled_at=2016-10-18T02:58:33Z,size=100,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2016-10-18T02:58:33Z,user_id=3fa132a654cb40cf913f1a0d42396451,volume_attachment=<?>,volume_type=<?>,volume_type_id=None)}
|__Flow 'volume_create_manager'
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager Traceback (most recent call last):
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 82, in _execute_task
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager result = task.execute(**arguments)
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 833, in execute
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager **volume_spec)
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 741, in _create_from_image
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager image_service, context, image_id) as tmp_image:
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager return self.gen.next()
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 533, in fetch
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager fetch_verify_image(context, image_service, image_id, tmp)
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 200, in fetch_verify_image
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager data = qemu_img_info(dest, run_as_root=run_as_root)
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 63, in qemu_img_info
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager out, _err = utils.execute(*cmd, run_as_root=run_as_root)
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/utils.py", line 148, in execute
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager return processutils.execute(*cmd, **kwargs)
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py", line 371, in execute
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager cmd=sanitized_cmd)
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager ProcessExecutionError: Unexpected error while running command.
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /var/lib/cinder/conversion/tmpa77d19
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager Exit code: 1
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager Stdout: u''
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager Stderr: u'Traceback (most recent call last):\n File "/usr/bin/cinder-rootwrap", line 10, in <module>\n sys.exit(main())\n File "/usr/lib/python2.7/site-packages/oslo_rootwrap/cmd.py", line 91, in main\n filters = wrapper.load_filters(config.filters_path)\n File "/usr/lib/python2.7/site-packages/oslo_rootwrap/wrapper.py", line 121, in load_filters\n for (name, value) in filterconfig.items("Filters"):\n File "/usr/lib64/python2.7/ConfigParser.py", line 347, in items\n raise NoSectionError(section)\nConfigParser.NoSectionError: No section: \'Filters\'\n'
2016-10-18 10:58:36.321 29009 ERROR cinder.volume.manager
2016-10-18 10:58:36.332 29009 WARNING cinder.volume.manager [req-50e04037-b79c-4421-9c99-9c66e9316c7f 3fa132a654cb40cf913f1a0d42396451 e7b6391717f145b38552c4ce83555860 - - -] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802ff3c4-f554-4fa4-a8c8-fbb19525952e) transitioned into state 'REVERTED' from state 'REVERTING'
2016-10-18 10:58:36.337 29009 WARNING cinder.volume.manager [req-50e04037-b79c-4421-9c99-9c66e9316c7f 3fa132a654cb40cf913f1a0d42396451 e7b6391717f145b38552c4ce83555860 - - -] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c5ac89-4fe2-49e2-97a4-637f2e42ea6f) transitioned into state 'REVERTED' from state 'REVERTING'
2016-10-18 10:58:36.341 29009 WARNING cinder.volume.manager [req-50e04037-b79c-4421-9c99-9c66e9316c7f 3fa132a654cb40cf913f1a0d42396451 e7b6391717f145b38552c4ce83555860 - - -] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97bcd08-5f60-45b0-9017-b583df52f300) transitioned into state 'REVERTED' from state 'REVERTING'
2016-10-18 10:58:36.423 29009 WARNING cinder.volume.manager [req-50e04037-b79c-4421-9c99-9c66e9316c7f 3fa132a654cb40cf913f1a0d42396451 e7b6391717f145b38552c4ce83555860 - - -] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5c9d0e-c170-4f2e-be26-41a6e4882f0f) transitioned into state 'REVERTED' from state 'REVERTING'
2016-10-18 10:58:36.428 29009 WARNING cinder.volume.manager [req-50e04037-b79c-4421-9c99-9c66e9316c7f 3fa132a654cb40cf913f1a0d42396451 e7b6391717f145b38552c4ce83555860 - - -] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79b502f-55ce-498b-b7e3-12e0f5ecc3b5) transitioned into state 'REVERTED' from state 'REVERTING'
2016-10-18 10:58:36.431 29009 WARNING cinder.volume.manager [req-50e04037-b79c-4421-9c99-9c66e9316c7f 3fa132a654cb40cf913f1a0d42396451 e7b6391717f145b38552c4ce83555860 - - -] Flow 'volume_create_manager' (4d3db89e-ed76-4cc1-bc08-dad9e68f0620) transitioned into state 'REVERTED' from state 'RUNNING'
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher [req-50e04037-b79c-4421-9c99-9c66e9316c7f 3fa132a654cb40cf913f1a0d42396451 e7b6391717f145b38552c4ce83555860 - - -] Exception during message handling: Unexpected error while running command.
Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /var/lib/cinder/conversion/tmpa77d19
Exit code: 1
Stdout: u''
Stderr: u'Traceback (most recent call last):\n File "/usr/bin/cinder-rootwrap", line 10, in <module>\n sys.exit(main())\n File "/usr/lib/python2.7/site-packages/oslo_rootwrap/cmd.py", line 91, in main\n filters = wrapper.load_filters(config.filters_path)\n File "/usr/lib/python2.7/site-packages/oslo_rootwrap/wrapper.py", line 121, in load_filters\n for (name, value) in filterconfig.items("Filters"):\n File "/usr/lib64/python2.7/ConfigParser.py", line 347, in items\n raise NoSectionError(section)\nConfigParser.NoSectionError: No section: \'Filters\'\n'
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher incoming.message))
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args)
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 631, in create_volume
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher _run_flow()
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 618, in _run_flow
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher flow_engine.run()
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 230, in run
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher for _state in self.run_iter(timeout=timeout):
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 308, in run_iter
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher failure.Failure.reraise_if_any(fails)
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher failures[0].reraise()
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher six.reraise(*self._exc_info)
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 82, in _execute_task
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher result = task.execute(**arguments)
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 833, in execute
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher **volume_spec)
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py", line 741, in _create_from_image
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher image_service, context, image_id) as tmp_image:
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher return self.gen.next()
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 533, in fetch
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher fetch_verify_image(context, image_service, image_id, tmp)
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 200, in fetch_verify_image
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher data = qemu_img_info(dest, run_as_root=run_as_root)
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 63, in qemu_img_info
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher out, _err = utils.execute(*cmd, run_as_root=run_as_root)
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/cinder/utils.py", line 148, in execute
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher return processutils.execute(*cmd, **kwargs)
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py", line 371, in execute
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher cmd=sanitized_cmd)
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher ProcessExecutionError: Unexpected error while running command.
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /var/lib/cinder/conversion/tmpa77d19
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher Exit code: 1
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher Stdout: u''
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher Stderr: u'Traceback (most recent call last):\n File "/usr/bin/cinder-rootwrap", line 10, in <module>\n sys.exit(main())\n File "/usr/lib/python2.7/site-packages/oslo_rootwrap/cmd.py", line 91, in main\n filters = wrapper.load_filters(config.filters_path)\n File "/usr/lib/python2.7/site-packages/oslo_rootwrap/wrapper.py", line 121, in load_filters\n for (name, value) in filterconfig.items("Filters"):\n File "/usr/lib64/python2.7/ConfigParser.py", line 347, in items\n raise NoSectionError(section)\nConfigParser.NoSectionError: No section: \'Filters\'\n'
2016-10-18 10:58:36.433 29009 ERROR oslo_messaging.rpc.dispatcher
