NetApp NFS driver won't resolve hostnames

Bug #1267667 reported by Andrew Kerr
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Cinder
Fix Released
Undecided
Bob Callaway

Bug Description

If you use host names in your NFS shares configuration file for the NetApp NFS driver in the format of:

hostname:/share

Cinder scheduler will report the following error when attempting to create a volume (cinder create 1):

2014-01-09 19:44:12.064 WARNING cinder.scheduler.host_manager [req-277fdfab-5404-4f17-890a-c15d30399c5e 0319d133143048acb7f438ff6b265c2d 4432249f42ba42e3974943bc305e8083] volume service is down or disabled. (host: openstack1)
2014-01-09 19:44:12.064 WARNING cinder.scheduler.host_manager [req-277fdfab-5404-4f17-890a-c15d30399c5e 0319d133143048acb7f438ff6b265c2d 4432249f42ba42e3974943bc305e8083] volume service is down or disabled. (host: openstack1@cmodeDirectNFS)
2014-01-09 19:44:12.065 ERROR cinder.volume.flows.create_volume [req-277fdfab-5404-4f17-890a-c15d30399c5e 0319d133143048acb7f438ff6b265c2d 4432249f42ba42e3974943bc305e8083] Failed to schedule_create_volume: No
valid host was found.
2014-01-09 19:44:12.066 DEBUG cinder.volume.flows.create_volume [req-277fdfab-5404-4f17-890a-c15d30399c5e 0319d133143048acb7f438ff6b265c2d 4432249f42ba42e3974943bc305e8083] Updating volume: c1eeb7cb-b292-420d-a9c4-96b09bfdd69b with {'status': 'error'} due to: No valid host was found. from (pid=16336) _error_out_volume /opt/stack/cinder/cinder/volume/flows/create_volume/__init__.py:130

If an ip address is used instead:

1.2.3.4:/share

The volume create works correctly

Tags: netapp nfs
Changed in cinder:
assignee: nobody → Bob Callaway (bob-callaway)
Revision history for this message
Andrew Kerr (andrew-kerr) wrote :
Download full text (3.4 KiB)

New information. My original issue was bad DNS settings, once that was fixed the true issue arose when attempting to create a snapshot with hostnames in the nfs shares file. The following is thrown in the c-vol log:

2014-01-10 11:02:58.063 DEBUG cinder.volume.manager [req-3a3a9d0b-4b39-4315-aef7-1864acdf0e08 bbfe41bc184f4378948211506fe3f780 83f2105d92f64cbe96853ca6ffd2a0d8]
snapshot f6a145e1-32fc-4980-896c-c70b4b4d1968: creating from (pid=5060) create_snapshot /opt/stack/cinder/cinder/volume/manager.py:444
2014-01-10 11:02:58.150 ERROR cinder.openstack.common.rpc.amqp [req-3a3a9d0b-4b39-4315-aef7-1864acdf0e08 bbfe41bc184f4378948211506fe3f780 83f2105d92f64cbe96853ca6ffd2a0d8]
Exception during message handling
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last):
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp File "/opt/stack/cinder/cinder/openstack/common/rpc/amqp.py", line 441, in _process_data
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp **args)
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp File "/opt/stack/cinder/cinder/openstack/common/rpc/dispatcher.py", line 148, in dispatch
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs)
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp File "/opt/stack/cinder/cinder/utils.py", line 818, in wrapper
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp return func(self, *args, **kwargs)
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp File "/opt/stack/cinder/cinder/volume/manager.py", line 459, in create_snapshot
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp {'status': 'error'})
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp self.gen.next()
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp File "/opt/stack/cinder/cinder/volume/manager.py", line 450, in create_snapshot
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp model_update = self.driver.create_snapshot(snapshot_ref)
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp File "/opt/stack/cinder/cinder/volume/drivers/netapp/nfs.py", line 112, in create_snapshot
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp snapshot['volume_id'])
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp File "/opt/stack/cinder/cinder/volume/drivers/netapp/nfs.py", line 782, in _clone_volume
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp (vserver, exp_volume) = self._get_vserver_and_exp_vol(volume_id, share)
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp File "/opt/stack/cinder/cinder/volume/drivers/netapp/nfs.py", line 790, in _get_vserver_and_exp_vol
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp ifs = self._get_if_info_by_ip(host_ip)
2014-01-10 11:02:58.150 TRACE cinder.openstack.common.rpc.amqp File "/opt/stack/cinder/cinder/volume/drivers/netapp/nfs.py", ...

Read more...

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (master)

Fix proposed to branch: master
Review: https://review.openstack.org/65999

Changed in cinder:
status: New → In Progress
Changed in cinder:
assignee: Bob Callaway (bob-callaway) → John Griffith (john-griffith)
Changed in cinder:
assignee: John Griffith (john-griffith) → Bob Callaway (bob-callaway)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (master)

Reviewed: https://review.openstack.org/65999
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=ed05bbe1e786e3eedfd94e7f6724ecb38f32f1e6
Submitter: Jenkins
Branch: master

commit ed05bbe1e786e3eedfd94e7f6724ecb38f32f1e6
Author: Bob Callaway <email address hidden>
Date: Fri Jan 10 11:15:07 2014 -0500

    Ensure hostnames are converted to IP for comparison.

    Also switch to using getaddrinfo for IPv6 compliance
    vs gethostbyname.

    Change-Id: I1a194eae514a65bff56488571c05457bfa660c02
    Closes-Bug: 1267667

Changed in cinder:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in cinder:
milestone: none → icehouse-2
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in cinder:
milestone: icehouse-2 → 2014.1
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.