metadata service throws 500 - NoSuchOptError

Bug #1063851 reported by Mate Lakat
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
High
Vish Ishaya
Folsom
High
Chuck Short
nova (Ubuntu)
Undecided
Unassigned
Quantal
Undecided
Unassigned

Bug Description

On a devstack installation, after launching a cirros VM, it fails to get metadata. See the console log:

############ debug end ##############
cloud-setup: failed to read iid from metadata. tried 30
WARN: /etc/rc3.d/S45-cloud-setup failed
Starting dropbear sshd: generating rsa key... generating dsa key... OK
===== cloud-final: system completely up in 44.86 seconds ====
wget: server returned error: HTTP/1.1 500 Internal Server Error
wget: server returned error: HTTP/1.1 500 Internal Server Error
wget: server returned error: HTTP/1.1 500 Internal Server Error
  instance-id:
  public-ipv4:
  local-ipv4 :
wget: server returned error: HTTP/1.1 500 Internal Server Error
cloud-userdata: failed to read instance id
WARN: /etc/rc3.d/S99-cloud-userdata failed

In the nova-api log, you see:

[req-8130fb17-1ac1-4004-be6a-c2d7ae41425c None None] Failed to get metadata for ip: 10.0.0.2
Traceback (most recent call last):
  File "/opt/stack/nova/nova/api/metadata/handler.py", line 75, in __call__
    meta_data = self.get_metadata(remote_address)
  File "/opt/stack/nova/nova/api/metadata/handler.py", line 57, in get_metadata
    data = base.get_metadata_by_address(address)
  File "/opt/stack/nova/nova/api/metadata/base.py", line 383, in get_metadata_by_address
    return InstanceMetadata(instance, address)
  File "/opt/stack/nova/nova/api/metadata/base.py", line 102, in __init__
    self.mappings = _format_instance_mapping(ctxt, instance)
  File "/opt/stack/nova/nova/api/metadata/base.py", line 388, in _format_instance_mapping
    return block_device.instance_block_mapping(instance, bdms)
  File "/opt/stack/nova/nova/block_device.py", line 97, in instance_block_mapping
    if FLAGS.compute_driver.endswith('xenapi.XenAPIDriver'):
  File "/opt/stack/nova/nova/openstack/common/cfg.py", line 1039, in __getattr__
    return self._get(name)
  File "/opt/stack/nova/nova/openstack/common/cfg.py", line 1361, in _get
    value = self._substitute(self._do_get(name, group))
  File "/opt/stack/nova/nova/openstack/common/cfg.py", line 1377, in _do_get
    info = self._get_opt_info(name, group)
  File "/opt/stack/nova/nova/openstack/common/cfg.py", line 1470, in _get_opt_info
    raise NoSuchOptError(opt_name, group)
NoSuchOptError: no such option: compute_driver

Changed in nova:
assignee: nobody → John Garbutt (johngarbutt)
Revision history for this message
John Garbutt (johngarbutt) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (master)

Fix proposed to branch: master
Review: https://review.openstack.org/14170

Changed in nova:
status: New → In Progress
Revision history for this message
John Garbutt (johngarbutt) wrote :
Revision history for this message
Vish Ishaya (vishvananda) wrote :

It looks more like it was this change to me:

https://review.openstack.org/#/c/14068/

tags: added: folsom-backport-potential
Revision history for this message
Robert Collins (lifeless) wrote :

@Vish, John - I confirm that backing out https://review.openstack.org/#/c/14068/ fixes the issue for me. Should we revert that patch as broken?

Revision history for this message
Vish Ishaya (vishvananda) wrote :

no I would prefer if we just fix it.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/14991

Changed in nova:
assignee: John Garbutt (johngarbutt) → Vish Ishaya (vishvananda)
Changed in nova:
importance: Undecided → High
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (master)

Reviewed: https://review.openstack.org/14991
Committed: http://github.com/openstack/nova/commit/9102f807e09508419d4c1cd356b22c7f3ca50b18
Submitter: Jenkins
Branch: master

commit 9102f807e09508419d4c1cd356b22c7f3ca50b18
Author: John Garbutt <email address hidden>
Date: Mon Oct 8 16:46:39 2012 +0100

    Ensures compute_driver flag can be used by bdm

    Fixes bug 1063851 by moving compute_driver flag from
    compute/manager.py to the global flags.py

    Change-Id: I06891fd65550b63ffe83da18b6af41cf46938667

Changed in nova:
status: In Progress → Fix Committed
Chuck Short (zulcss)
tags: removed: folsom-backport-potential
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (stable/folsom)

Fix proposed to branch: stable/folsom
Review: https://review.openstack.org/16432

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (stable/folsom)

Reviewed: https://review.openstack.org/16432
Committed: http://github.com/openstack/nova/commit/d3fd05b1f8889d9f39b8eb5be3f7e7798d648206
Submitter: Jenkins
Branch: stable/folsom

commit d3fd05b1f8889d9f39b8eb5be3f7e7798d648206
Author: John Garbutt <email address hidden>
Date: Mon Oct 8 16:46:39 2012 +0100

    Ensures compute_driver flag can be used by bdm

    Fixes bug 1063851 by moving compute_driver flag from
    compute/manager.py to the global flags.py

    Change-Id: I337795f6956050b398c39a8476e3c1e2b689c470
    Signed-off-by: Chuck Short <email address hidden>

Thierry Carrez (ttx)
Changed in nova:
milestone: none → grizzly-1
status: Fix Committed → Fix Released
Changed in nova (Ubuntu):
status: New → Fix Released
Changed in nova (Ubuntu Quantal):
status: New → Confirmed
Revision history for this message
Clint Byrum (clint-fewbar) wrote : Please test proposed package

Hello Mate, or anyone else affected,

Accepted nova into quantal-proposed. The package will build now and be available at http://launchpad.net/ubuntu/+source/nova/2012.2.1+stable-20121212-a99a802e-0ubuntu1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Changed in nova (Ubuntu Quantal):
status: Confirmed → Fix Committed
tags: added: verification-needed
Revision history for this message
Launchpad Janitor (janitor) wrote :
Download full text (8.3 KiB)

This bug was fixed in the package nova - 2012.2.1+stable-20121212-a99a802e-0ubuntu1

---------------
nova (2012.2.1+stable-20121212-a99a802e-0ubuntu1) quantal-proposed; urgency=low

  * Ubuntu updates:
    - debian/control: Ensure novaclient is upgraded with nova,
      require python-keystoneclient >= 1:2.9.0. (LP: #1073289)
    - d/p/avoid_setuptools_git_dependency.patch: Refresh.
  * Dropped patches, applied upstream:
    - debian/patches/CVE-2012-5625.patch: [a99a802]
  * Resynchronize with stable/folsom (b55014ca) (LP: #1085255):
    - [a99a802] create_lvm_image allocates dirty blocks (LP: #1070539)
    - [670b388] RPC exchange name defaults to 'openstack' (LP: #1083944)
    - [3ede373] disassociate_floating_ip with multi_host=True fails
      (LP: #1074437)
    - [22d7c3b] libvirt imagecache should handle shared image storage
      (LP: #1075018)
    - [e787786] Detached and deleted RBD volumes remain associated with insance
      (LP: #1083818)
    - [9265eb0] live_migration missing migrate_data parameter in Hyper-V driver
      (LP: #1066513)
    - [3d99848] use_single_default_gateway does not function correctly
      (LP: #1075859)
    - [65a2d0a] resize does not migrate DHCP host information (LP: #1065440)
    - [102c76b] Nova backup image fails (LP: #1065053)
    - [48a3521] Fix config-file overrides for nova-dhcpbridge
    - [69663ee] Cloudpipe in Folsom: no such option: cnt_vpn_clients
      (LP: #1069573)
    - [6e47cc8] DisassociateAddress can cause Internal Server Error
      (LP: #1080406)
    - [22c3d7b] API calls to dis-associate an auto-assigned floating IP should
      return proper warning (LP: #1061499)
    - [bd11d15] libvirt: if exception raised during volume_detach, volume state
      is inconsistent (LP: #1057756)
    - [dcb59c3] admin can't describe all images in ec2 api (LP: #1070138)
    - [78de622] Incorrect Exception raised during Create server when metadata
      over 255 characters (LP: #1004007)
    - [c313de4] Fixed IP isn't released before updating DHCP host file
      (LP: #1078718)
    - [f4ab42d] Enabling Return Reservation ID with XML create server request
      returns no body (LP: #1061124)
    - [3db2a38] 'BackupCreate' should accept rotation parameter greater than or
      equal to zero (LP: #1071168)
    - [f7e5dde] libvirt reboot sometimes fails to reattach volumes
      (LP: #1073720)
    - [ff776d4] libvirt: detaching volume may fail while terminating other
      instances on the same host concurrently (LP: #1060836)
    - [85a8bc2] Used instance uuid rather than id in remove-fixed-ip
    - [42a85c0] Fix error on invalid delete_on_termination value
    - [6a17579] xenapi migrations fail w/ swap (LP: #1064083)
    - [97649b8] attach-time field for volumes is not updated for detach volume
      (LP: #1056122)
    - [8f6a718] libvirt: rebuild is not using kernel and ramdisk associated with
      the new image (LP: #1060925)
    - [fbe835f] live-migration and volume host assignement (LP: #1066887)
    - [c2a9150] typo prevents volume_tmp_dir flag from working (LP: #1071536)
    - [93efa21] Instances deleted during spawn leak network allocations
      (LP: #1068716)
    - [ebabd02] After restartin...

Read more...

Changed in nova (Ubuntu Quantal):
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in nova:
milestone: grizzly-1 → 2013.1
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers