VMware: Failed to launch instance if vCenter is configured to listen to any port other than 443

Bug #1387074 reported by Johnson koil raj
30
This bug affects 4 people
Affects Status Importance Assigned to Milestone
Cinder
Fix Released
Medium
Vipin Balachandran
OpenStack Compute (nova)
Fix Released
Medium
Johnson koil raj

Bug Description

When a vCenter is configured to listen to any port other the default 443. During instance launch the driver fails to make connection to vCenter when performing the glance image copy to the datastore.

2014-10-29 20:03:25.535 ERROR oslo.vmware.api [-] Task: (returnval){
   value = "session[565de56e-2576-69ae-ae5f-50daafe6b90f]525ec5a1-a9f7-6c80-3c22-d78fb31ac069"
   _type = "Task"
 } failed with error: File [datastore1 (1)] 10.1.195.24_base/46e35b38-64f2-4cca-aa53-31407cf9a28e was not found.
2014-10-29 20:03:25.535 ERROR oslo.vmware.common.loopingcall [-] in fixed duration looping call
2014-10-29 20:03:25.535 TRACE oslo.vmware.common.loopingcall Traceback (most recent call last):
2014-10-29 20:03:25.535 TRACE oslo.vmware.common.loopingcall File "/usr/local/lib/python2.7/dist-packages/oslo/vmware/common/loopingcall.py", line 76, in _inner
2014-10-29 20:03:25.535 TRACE oslo.vmware.common.loopingcall self.f(*self.args, **self.kw)
2014-10-29 20:03:25.535 TRACE oslo.vmware.common.loopingcall File "/usr/local/lib/python2.7/dist-packages/oslo/vmware/api.py", line 419, in _poll_task
2014-10-29 20:03:25.535 TRACE oslo.vmware.common.loopingcall raise task_ex
2014-10-29 20:03:25.535 TRACE oslo.vmware.common.loopingcall FileNotFoundException: File [datastore1 (1)] 10.1.195.24_base/46e35b38-64f2-4cca-aa53-31407cf9a28e was not f
2014-10-29 20:03:25.535 TRACE oslo.vmware.common.loopingcall

2014-10-29 19:21:16.448 ERROR nova.compute.manager [-] [instance: c2c69864-331a-4405-b589-4589d01cfd60] Instance failed to spawn
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] Traceback (most recent call last):
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/opt/stack/nova/nova/compute/manager.py", line 2244, in _build_resources
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] yield resources
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/opt/stack/nova/nova/compute/manager.py", line 2114, in _build_and_run_instance
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] block_device_info=block_device_info)
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/opt/stack/nova/nova/virt/vmwareapi/driver.py", line 488, in spawn
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] admin_password, network_info, block_device_info)
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 484, in spawn
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] self._fetch_image_if_missing(context, vi)
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 421, in _fetch_image_if_missing
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] image_fetch(context, vi, tmp_image_ds_loc)
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/opt/stack/nova/nova/virt/vmwareapi/vmops.py", line 293, in _fetch_image_as_file
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] cookies=cookies)
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/opt/stack/nova/nova/virt/vmwareapi/images.py", line 240, in fetch_image
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] host, dc_name, ds_name, cookies, file_path, file_size)
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/opt/stack/nova/nova/virt/vmwareapi/read_write_util.py", line 131, in __init__
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] conn.endheaders()
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/usr/lib/python2.7/httplib.py", line 969, in endheaders
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] self._send_output(message_body)
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/usr/lib/python2.7/httplib.py", line 829, in _send_output
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] self.send(msg)
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/usr/lib/python2.7/httplib.py", line 791, in send
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] self.connect()
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/usr/lib/python2.7/httplib.py", line 1172, in connect
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] self.timeout, self.source_address)
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] File "/usr/local/lib/python2.7/dist-packages/eventlet/green/socket.py", line 60, in create_connection
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] raise error(msg)
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60] error: [Errno 111] ECONNREFUSED
2014-10-29 19:21:16.448 TRACE nova.compute.manager [instance: c2c69864-331a-4405-b589-4589d01cfd60]
2014-10-29 19:21:16.449 AUDIT nova.compute.manager [req-622143c1-d783-48bc-80b6-829d5f07121d admin admin] [instance: c2c69864-331a-4405-b589-4589d01cfd60] Terminating instance

Changed in nova:
importance: Undecided → Medium
Changed in cinder:
importance: Undecided → Medium
assignee: nobody → Johnson koil raj (jjohnsonkoilraj)
Tracy Jones (tjones-i)
tags: added: vmware
Changed in nova:
status: New → In Progress
Changed in cinder:
status: New → Confirmed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (master)

Fix proposed to branch: master
Review: https://review.openstack.org/140732

Changed in cinder:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on cinder (master)

Change abandoned by Johnson koil raj (<email address hidden>) on branch: master
Review: https://review.openstack.org/140732
Reason: Submitting a new patch because of use of oslo.vmware lib for cinder vmdk driver

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (master)

Fix proposed to branch: master
Review: https://review.openstack.org/146384

Changed in cinder:
assignee: Johnson koil raj (jjohnsonkoilraj) → Vipin Balachandran (vbala)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (master)

Reviewed: https://review.openstack.org/131777
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=2009eab057d9cb1f1036dbbaed9ab6ff89aa6799
Submitter: Jenkins
Branch: master

commit 2009eab057d9cb1f1036dbbaed9ab6ff89aa6799
Author: Johnson koil raj <email address hidden>
Date: Wed Oct 29 19:30:54 2014 +0530

    VMware: driver not handling port other than 443

    During the image download/upload from a vCenter datastore the
    driver is failing to connect to vCenter if it configured to
    listen to any port other than default 443.

    Closes-Bug: #1387074

    Change-Id: Iebfd90bda2b9a3eb20ca146e4cc9ae8e4cf464f3

Changed in nova:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in nova:
milestone: none → kilo-2
status: Fix Committed → Fix Released
Changed in cinder:
assignee: Vipin Balachandran (vbala) → Johnson koil raj (jjohnsonkoilraj)
Thierry Carrez (ttx)
Changed in nova:
milestone: kilo-2 → 2015.1.0
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on cinder (master)

Change abandoned by Mike Perez (<email address hidden>) on branch: master
Review: https://review.openstack.org/146384
Reason: Over a month with no update.

Changed in cinder:
status: In Progress → Confirmed
Changed in cinder:
assignee: Johnson koil raj (jjohnsonkoilraj) → Vipin Balachandran (vbala)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (master)

Fix proposed to branch: master
Review: https://review.openstack.org/267450

Changed in cinder:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (master)

Reviewed: https://review.openstack.org/267450
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=55b442ce192e93a26d12064645aa95fd3661babb
Submitter: Jenkins
Branch: master

commit 55b442ce192e93a26d12064645aa95fd3661babb
Author: Vipin Balachandran <email address hidden>
Date: Thu Jan 14 00:05:28 2016 -0800

    VMware: Support for non-default port

    Currently the VMDK driver fails to connect to vCenter server
    if vCenter is configured to listen to any port other than the
    default port 443. This patch fixes it by adding support for a
    new config option 'vmware_host_port' which specifies the port
    number to connect to vCenter server.

    DocImpact
      Added config option 'vmware_host_port' which specifies the
      port number to connect to vCenter server.

    Change-Id: I71846cdc09bc1ff2a7e35d45aa7c639c468f1418
    Co-Authored-By: Johnson koil raj <email address hidden>
    Closes-Bug: #1387074

Changed in cinder:
status: In Progress → Fix Released
Revision history for this message
Zhen Zhen Jiang (zzjiang) wrote :

@<email address hidden>, could you please cherry pick the fix into kilo branch? Thank you.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/305601

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (stable/mitaka)

Reviewed: https://review.openstack.org/305601
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=83ef56a4187115422bbdb47dc218c243cef13054
Submitter: Jenkins
Branch: stable/mitaka

commit 83ef56a4187115422bbdb47dc218c243cef13054
Author: Vipin Balachandran <email address hidden>
Date: Thu Jan 14 00:05:28 2016 -0800

    VMware: Support for non-default port

    Currently the VMDK driver fails to connect to vCenter server
    if vCenter is configured to listen to any port other than the
    default port 443. This patch fixes it by adding support for a
    new config option 'vmware_host_port' which specifies the port
    number to connect to vCenter server.

    DocImpact
      Added config option 'vmware_host_port' which specifies the
      port number to connect to vCenter server.

    Change-Id: I71846cdc09bc1ff2a7e35d45aa7c639c468f1418
    Co-Authored-By: Johnson koil raj <email address hidden>
    Closes-Bug: #1387074
    (cherry picked from commit 55b442ce192e93a26d12064645aa95fd3661babb)

tags: added: in-stable-mitaka
Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/cinder 9.0.0.0b1

This issue was fixed in the openstack/cinder 9.0.0.0b1 development milestone.

Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/cinder 8.1.0

This issue was fixed in the openstack/cinder 8.1.0 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.