Cinder

Cinder fc_zone_manger with Cisco configured

Bug #1424852 reported by Carl Bader on 2015-02-23

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Cinder	Fix Released	High	Walt Boring	Cinder 2015.1.0 "kilo"

Bug Description

With Cisco switch configured in zone manger section of cinder.conf on attach of volume it fails thinking it is configured to Brocade.

/opt/stack/cinder/cinder/zonemanger/fc_zone_manger.py has failure to recognize that Cisco zone configuration is returned from lookup_services and defaults to Brocade.

cinder.conf
[fc-zone-manager]
cisco_sb_connector=cinder.zonemanager.drivers.cisco.cisco_fc_zone_client_cli.CiscoFCZoneClientCLI
fc_san_lookup_service= cinder.zonemanager.drivers.cisco.cisco_fc_san_lookup_service.CiscoFCSanLookupService
zone_driver = cinder.zonemanager.drivers.cisco.cisco_fc_zone_driver.CiscoFCZoneDriver
fc_fabric_names=CISCO_FAB_A
zoning_mode = fabric

[CISCO_FAB_A]
cisco_fc_fabric_address= 10.50.1.5
cisco_fc_fabric_password= hpinvent
cisco_fc_fabric_port= 22
cisco_fc_fabric_user= admin
cisco_zone_activate= True
cisco_zone_name_prefix= Carl_STACK_2_
cisco_zone_policy= initiator-target
cisco_zoning_vsan= 1

Failure from c-vol.log

cal/lib/python2.7/dist-packages/oslo_concurrency/processutils.py:321
2015-02-23 14:15:18.131 DEBUG cinder.zonemanager.drivers.cisco.cisco_fc_san_lookup_service [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] CLI output from ss
h - output:
VSAN 1:
--------------------------------------------------------------------------
FCID TYPE PWWN (VENDOR) FC4-TYPE:FEATURE
--------------------------------------------------------------------------
0x9d0000 N 23:11:00:02:ac:00:2b:a0 scsi-fcp:target
0x9d0100 N 22:11:00:02:ac:00:2b:a0 scsi-fcp:target
0x9d0200 N 20:00:00:11:0a:02:95:f7
0x9d0201 N 10:00:38:ea:a7:62:f2:f1 scsi-fcp:init
0x9d0300 N 20:00:00:11:0a:02:94:53
0x9d0301 N 10:00:38:ea:a7:62:f2:f5 scsi-fcp:init
0x9d0400 N 20:01:00:11:0a:02:f2:de
0x9d0401 N 10:00:d8:9d:67:f2:38:89 scsi-fcp:init
0x9d0500 N 20:01:00:11:0a:02:f2:ac
0x9d0501 N 10:00:d8:9d:67:f2:38:8d scsi-fcp:init

Total number of entries = 10
from (pid=41048) _get_switch_info /opt/stack/cinder/cinder/zonemanager/drivers/cisco/cisco_fc_san_lookup_service.py:196
2015-02-23 14:15:18.132 DEBUG cinder.zonemanager.drivers.cisco.cisco_fc_san_lookup_service [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Connector returnin
g fcns info-[u'23:11:00:02:ac:00:2b:a0', u'22:11:00:02:ac:00:2b:a0', u'20:00:00:11:0a:02:95:f7', u'10:00:38:ea:a7:62:f2:f1', u'20:00:00:11:0a:02:94:53', u'10:00:38:ea:a7:62:f2:f5', u'20:01:00:11:0a:02:f2:de', u'10:00:d
8:9d:67:f2:38:89', u'20:01:00:11:0a:02:f2:ac', u'10:00:d8:9d:67:f2:38:8d'] from (pid=41048) get_nameserver_info /opt/stack/cinder/cinder/zonemanager/drivers/cisco/cisco_fc_san_lookup_service.py:189
2015-02-23 14:15:18.133 DEBUG cinder.zonemanager.drivers.cisco.cisco_fc_san_lookup_service [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Lookup service:fcn
sdatabase-[u'23:11:00:02:ac:00:2b:a0', u'22:11:00:02:ac:00:2b:a0', u'20:00:00:11:0a:02:95:f7', u'10:00:38:ea:a7:62:f2:f1', u'20:00:00:11:0a:02:94:53', u'10:00:38:ea:a7:62:f2:f5', u'20:01:00:11:0a:02:f2:de', u'10:00:d8:
9d:67:f2:38:89', u'20:01:00:11:0a:02:f2:ac', u'10:00:d8:9d:67:f2:38:8d'] from (pid=41048) get_device_mapping_from_network /opt/stack/cinder/cinder/zonemanager/drivers/cisco/cisco_fc_san_lookup_service.py:135
2015-02-23 14:15:18.133 DEBUG cinder.zonemanager.drivers.cisco.cisco_fc_san_lookup_service [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Lookup service:ini
tiator list from caller-[u'10:00:d8:9d:67:f2:38:89', u'10:00:d8:9d:67:f2:38:8d'] from (pid=41048) get_device_mapping_from_network /opt/stack/cinder/cinder/zonemanager/drivers/cisco/cisco_fc_san_lookup_service.py:137
2015-02-23 14:15:18.134 DEBUG cinder.zonemanager.drivers.cisco.cisco_fc_san_lookup_service [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Lookup service:tar
get list from caller-[u'20:11:00:02:ac:00:2b:a0', u'20:12:00:02:ac:00:2b:a0', u'21:11:00:02:ac:00:2b:a0', u'21:12:00:02:ac:00:2b:a0', u'22:11:00:02:ac:00:2b:a0', u'22:12:00:02:ac:00:2b:a0', u'23:11:00:02:ac:00:2b:a0',
u'23:12:00:02:ac:00:2b:a0'] from (pid=41048) get_device_mapping_from_network /opt/stack/cinder/cinder/zonemanager/drivers/cisco/cisco_fc_san_lookup_service.py:139
2015-02-23 14:15:18.134 DEBUG cinder.zonemanager.drivers.cisco.cisco_fc_san_lookup_service [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Filtered targets is: [u'23:11:00:02:ac:00:2b:a0', u'22:11:00:02:ac:00:2b:a0'] from (pid=41048) get_device_mapping_from_network /opt/stack/cinder/cinder/zonemanager/drivers/cisco/cisco_fc_san_lookup_service.py:146
2015-02-23 14:15:18.135 DEBUG cinder.zonemanager.drivers.cisco.cisco_fc_san_lookup_service [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Device map for SAN context: {'1': {'target_port_wwn_list': ['23110002ac002ba0', '22110002ac002ba0'], 'initiator_port_wwn_list': ['1000d89d67f23889', '1000d89d67f2388d']}} from (pid=41048) get_device_mapping_from_network /opt/stack/cinder/cinder/zonemanager/drivers/cisco/cisco_fc_san_lookup_service.py:168
2015-02-23 14:15:18.215 INFO cinder.volume.drivers.san.hp.hp_3par_common [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Disconnect from 3PAR REST and SSH 7781f670-a0ec-4f37-88c0-f09f31cd161f
2015-02-23 14:15:18.242 INFO cinder.volume.drivers.san.hp.hp_3par_common [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] logout Done 7781f670-a0ec-4f37-88c0-f09f31cd161f
2015-02-23 14:15:18.243 DEBUG cinder.zonemanager.utils [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Zoning mode: fabric from (pid=41048) create_zone_manager /opt/stack/cinder/cinder/zonemanager/utils.py:36
2015-02-23 14:15:18.244 DEBUG cinder.zonemanager.utils [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Zoning driver: cinder.zonemanager.drivers.brocade.brcd_fc_zone_driver.BrcdFCZoneDriver from (pid=41048) create_zone_manager /opt/stack/cinder/cinder/zonemanager/utils.py:37
2015-02-23 14:15:18.244 DEBUG cinder.zonemanager.utils [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] FC Zone Manager enabled. from (pid=41048) create_zone_manager /opt/stack/cinder/cinder/zonemanager/utils.py:39
2015-02-23 14:15:18.245 DEBUG cinder.zonemanager.fc_zone_manager [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Zone Driver from config: {cinder.zonemanager.drivers.brocade.brcd_fc_zone_driver.BrcdFCZoneDriver} from (pid=41048) _build_driver /opt/stack/cinder/cinder/zonemanager/fc_zone_manager.py:99
2015-02-23 14:15:18.246 DEBUG cinder.zonemanager.drivers.fc_zone_driver [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Initializing FCZoneDriver from (pid=41048) __init__ /opt/stack/cinder/cinder/zonemanager/drivers/fc_zone_driver.py:44
2015-02-23 14:15:18.247 DEBUG cinder.zonemanager.drivers.brocade.brcd_fabric_opts [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Loaded FC fabric config CISCO_FAB_A from (pid=41048) load_fabric_configurations /opt/stack/cinder/cinder/zonemanager/drivers/brocade/brcd_fabric_opts.py:60
2015-02-23 14:15:18.248 INFO cinder.zonemanager.utils [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Using FC Zone Manager 1.0.1, Driver BrcdFCZoneDriver 1.1.
2015-02-23 14:15:18.249 DEBUG cinder.zonemanager.utils [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Add FC Zone for mapping '{'1000d89d67f23889': ['23110002ac002ba0', '22110002ac002ba0'], '1000d89d67f2388d': ['23110002ac002ba0', '22110002ac002ba0']}'. from (pid=41048) decorator /opt/stack/cinder/cinder/zonemanager/utils.py:91
2015-02-23 14:15:18.249 DEBUG cinder.zonemanager.fc_zone_manager [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Target List: ['23110002ac002ba0', '22110002ac002ba0'] from (pid=41048) add_connection /opt/stack/cinder/cinder/zonemanager/fc_zone_manager.py:133
2015-02-23 14:15:18.250 DEBUG cinder.zonemanager.drivers.brocade.brcd_fc_zone_driver [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Fabric List: ['CISCO_FAB_A'] from (pid=41048) get_san_context /opt/stack/cinder/cinder/zonemanager/drivers/brocade/brcd_fc_zone_driver.py:338
2015-02-23 14:15:18.250 DEBUG cinder.zonemanager.drivers.brocade.brcd_fc_zone_driver [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Target wwn List: ['23110002ac002ba0', '22110002ac002ba0'] from (pid=41048) get_san_context /opt/stack/cinder/cinder/zonemanager/drivers/brocade/brcd_fc_zone_driver.py:339
2015-02-23 14:15:18.251 DEBUG cinder.zonemanager.drivers.brocade.brcd_fc_zone_driver [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Formatted Target wwn List: ['23:11:00:02:ac:00:2b:a0', '22:11:00:02:ac:00:2b:a0'] from (pid=41048) get_san_context /opt/stack/cinder/cinder/zonemanager/drivers/brocade/brcd_fc_zone_driver.py:344
2015-02-23 14:15:18.251 DEBUG cinder.zonemanager.drivers.brocade.brcd_fc_zone_driver [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] CLI client not found, creating for from (pid=41048) _get_cli_client /opt/stack/cinder/cinder/zonemanager/drivers/brocade/brcd_fc_zone_driver.py:414
2015-02-23 14:15:18.253 DEBUG cinder.ssh_utils [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Setting strict_ssh_host_key_policy to 'False' using ssh_hosts_key_file '/opt/stack/data/cinder/ssh_known_hosts'. from (pid=41048) __init__ /opt/stack/cinder/cinder/ssh_utils.py:90
2015-02-23 14:15:18.254 ERROR cinder.ssh_utils [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Error connecting via ssh: Specify a password or private_key
2015-02-23 14:15:18.255 ERROR cinder.zonemanager.drivers.brocade.brcd_fc_zone_driver [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Failed to get name server info:Error connecting via ssh: Specify a password or private_key
2015-02-23 14:15:18.256 ERROR cinder.zonemanager.fc_zone_manager [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Failed adding connection for fabric=None: Error: Failed to get name server info:Error connecting via ssh: Specify a password or private_key
2015-02-23 14:15:18.259 ERROR cinder.volume.manager [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Unable to fetch connection information from backend: Fibre Channel connection control failure: Failed adding connection for fabric=None: Error: Failed to get name server info:Error connecting via ssh: Specify a password or private_key
2015-02-23 14:15:18.262 ERROR oslo_messaging.rpc.dispatcher [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Exception during message handling: Bad or unexpected response from the storage volume backend API: Unable to fetch connection information from backend: Fibre Channel connection control failure: Failed adding connection for fabric=None: Error: Failed to get name server info:Error connecting via ssh: Specify a password or private_key
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher executor_callback))
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher executor_callback)
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/osprofiler/profiler.py", line 105, in wrapper
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher return f(*args, **kwargs)
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/cinder/cinder/volume/manager.py", line 938, in initialize_connection
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher raise exception.VolumeBackendAPIException(data=err_msg)
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Unable to fetch connection information from backend: Fibre Channel connection control failure: Failed adding connection for fabric=None: Error: Failed to get name server info:Error connecting via ssh: Specify a password or private_key
2015-02-23 14:15:18.262 TRACE oslo_messaging.rpc.dispatcher
2015-02-23 14:15:18.268 ERROR oslo_messaging._drivers.common [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] Returning exception Bad or unexpected response from the storage volume backend API: Unable to fetch connection information from backend: Fibre Channel connection control failure: Failed adding connection for fabric=None: Error: Failed to get name server info:Error connecting via ssh: Specify a password or private_key to caller
2015-02-23 14:15:18.268 ERROR oslo_messaging._drivers.common [req-4a4188e3-56e4-48e6-bcc4-6aa3be149cff ac709726edcd46dab40f003b7292ba6b cd30040404a442ff925ecacd308f04ec] ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply\n executor_callback))\n', ' File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch\n executor_callback)\n', ' File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch\n result = func(ctxt, **new_args)\n', ' File "/usr/local/lib/python2.7/dist-packages/osprofiler/profiler.py", line 105, in wrapper\n return f(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/manager.py", line 938, in initialize_connection\n raise exception.VolumeBackendAPIException(data=err_msg)\n', 'VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Unable to fetch connection information from backend: Fibre Channel connection control failure: Failed adding connection for fabric=None: Error: Failed to get name server info:Error connecting via ssh: Specify a password or private_key\n']

Walt Boring (walter-boring) on 2015-02-23

Changed in cinder:
status:	New → Confirmed
importance:	Undecided → High
milestone:	none → kilo-3

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-02-24: Fix proposed to cinder (master)

Fix proposed to branch: master
Review: https://review.openstack.org/158776

Changed in cinder:
assignee:	nobody → Walt Boring (walter-boring)
status:	Confirmed → In Progress

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-02-24: Fix merged to cinder (master)

Reviewed: https://review.openstack.org/158776
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=ef63d75db7181a79933b207fbb1ba8b0e7a1c0a7
Submitter: Jenkins
Branch: master

commit ef63d75db7181a79933b207fbb1ba8b0e7a1c0a7
Author: Walter A. Boring IV <email address hidden>
Date: Tue Feb 24 08:23:03 2015 -0800

FCZM fix reading of cinder config entries

    The zone manager and the lookup service had some cruft code that
    was incorrectly reading the cinder.conf sections it needed.
    When cinder.conf was configured to use the Cisco driver, the zone
    manager would never see it, because it was reading from the wrong
    section of cinder.conf.

Change-Id: I4a48bc39e55d4b7e9a149a3ec3aa3947980360ea
Closes-Bug: 1424852

Changed in cinder:
status:	In Progress → Fix Committed

Thierry Carrez (ttx) on 2015-03-20

Changed in cinder:
status:	Fix Committed → Fix Released

Thierry Carrez (ttx) on 2015-04-30

Changed in cinder:
milestone:	kilo-3 → 2015.1.0

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.