metadata service throws 500 - NoSuchOptError

Bug #1063851 reported by Mate Lakat
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
High
Vish Ishaya
Folsom
Fix Released
High
Chuck Short
nova (Ubuntu)
Fix Released
Undecided
Unassigned
Quantal
Fix Released
Undecided
Unassigned

Bug Description

On a devstack installation, after launching a cirros VM, it fails to get metadata. See the console log:

############ debug end ##############
cloud-setup: failed to read iid from metadata. tried 30
WARN: /etc/rc3.d/S45-cloud-setup failed
Starting dropbear sshd: generating rsa key... generating dsa key... OK
===== cloud-final: system completely up in 44.86 seconds ====
wget: server returned error: HTTP/1.1 500 Internal Server Error
wget: server returned error: HTTP/1.1 500 Internal Server Error
wget: server returned error: HTTP/1.1 500 Internal Server Error
  instance-id:
  public-ipv4:
  local-ipv4 :
wget: server returned error: HTTP/1.1 500 Internal Server Error
cloud-userdata: failed to read instance id
WARN: /etc/rc3.d/S99-cloud-userdata failed

In the nova-api log, you see:

[req-8130fb17-1ac1-4004-be6a-c2d7ae41425c None None] Failed to get metadata for ip: 10.0.0.2
Traceback (most recent call last):
  File "/opt/stack/nova/nova/api/metadata/handler.py", line 75, in __call__
    meta_data = self.get_metadata(remote_address)
  File "/opt/stack/nova/nova/api/metadata/handler.py", line 57, in get_metadata
    data = base.get_metadata_by_address(address)
  File "/opt/stack/nova/nova/api/metadata/base.py", line 383, in get_metadata_by_address
    return InstanceMetadata(instance, address)
  File "/opt/stack/nova/nova/api/metadata/base.py", line 102, in __init__
    self.mappings = _format_instance_mapping(ctxt, instance)
  File "/opt/stack/nova/nova/api/metadata/base.py", line 388, in _format_instance_mapping
    return block_device.instance_block_mapping(instance, bdms)
  File "/opt/stack/nova/nova/block_device.py", line 97, in instance_block_mapping
    if FLAGS.compute_driver.endswith('xenapi.XenAPIDriver'):
  File "/opt/stack/nova/nova/openstack/common/cfg.py", line 1039, in __getattr__
    return self._get(name)
  File "/opt/stack/nova/nova/openstack/common/cfg.py", line 1361, in _get
    value = self._substitute(self._do_get(name, group))
  File "/opt/stack/nova/nova/openstack/common/cfg.py", line 1377, in _do_get
    info = self._get_opt_info(name, group)
  File "/opt/stack/nova/nova/openstack/common/cfg.py", line 1470, in _get_opt_info
    raise NoSuchOptError(opt_name, group)
NoSuchOptError: no such option: compute_driver

Changed in nova:
assignee: nobody → John Garbutt (johngarbutt)
Revision history for this message
John Garbutt (johngarbutt) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (master)

Fix proposed to branch: master
Review: https://review.openstack.org/14170

Changed in nova:
status: New → In Progress
Revision history for this message
John Garbutt (johngarbutt) wrote :
Revision history for this message
Vish Ishaya (vishvananda) wrote :

It looks more like it was this change to me:

https://review.openstack.org/#/c/14068/

tags: added: folsom-backport-potential
Revision history for this message
Robert Collins (lifeless) wrote :

@Vish, John - I confirm that backing out https://review.openstack.org/#/c/14068/ fixes the issue for me. Should we revert that patch as broken?

Revision history for this message
Vish Ishaya (vishvananda) wrote :

no I would prefer if we just fix it.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/14991

Changed in nova:
assignee: John Garbutt (johngarbutt) → Vish Ishaya (vishvananda)
Changed in nova:
importance: Undecided → High
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (master)

Reviewed: https://review.openstack.org/14991
Committed: http://github.com/openstack/nova/commit/9102f807e09508419d4c1cd356b22c7f3ca50b18
Submitter: Jenkins
Branch: master

commit 9102f807e09508419d4c1cd356b22c7f3ca50b18
Author: John Garbutt <email address hidden>
Date: Mon Oct 8 16:46:39 2012 +0100

    Ensures compute_driver flag can be used by bdm

    Fixes bug 1063851 by moving compute_driver flag from
    compute/manager.py to the global flags.py

    Change-Id: I06891fd65550b63ffe83da18b6af41cf46938667

Changed in nova:
status: In Progress → Fix Committed
Chuck Short (zulcss)
tags: removed: folsom-backport-potential
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (stable/folsom)

Fix proposed to branch: stable/folsom
Review: https://review.openstack.org/16432

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (stable/folsom)

Reviewed: https://review.openstack.org/16432
Committed: http://github.com/openstack/nova/commit/d3fd05b1f8889d9f39b8eb5be3f7e7798d648206
Submitter: Jenkins
Branch: stable/folsom

commit d3fd05b1f8889d9f39b8eb5be3f7e7798d648206
Author: John Garbutt <email address hidden>
Date: Mon Oct 8 16:46:39 2012 +0100

    Ensures compute_driver flag can be used by bdm

    Fixes bug 1063851 by moving compute_driver flag from
    compute/manager.py to the global flags.py

    Change-Id: I337795f6956050b398c39a8476e3c1e2b689c470
    Signed-off-by: Chuck Short <email address hidden>

Thierry Carrez (ttx)
Changed in nova:
milestone: none → grizzly-1
status: Fix Committed → Fix Released
Changed in nova (Ubuntu):
status: New → Fix Released
Changed in nova (Ubuntu Quantal):
status: New → Confirmed
Revision history for this message
Clint Byrum (clint-fewbar) wrote : Please test proposed package

Hello Mate, or anyone else affected,

Accepted nova into quantal-proposed. The package will build now and be available at http://launchpad.net/ubuntu/+source/nova/2012.2.1+stable-20121212-a99a802e-0ubuntu1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Changed in nova (Ubuntu Quantal):
status: Confirmed → Fix Committed
tags: added: verification-needed
Revision history for this message
Launchpad Janitor (janitor) wrote :
Download full text (8.3 KiB)

This bug was fixed in the package nova - 2012.2.1+stable-20121212-a99a802e-0ubuntu1

---------------
nova (2012.2.1+stable-20121212-a99a802e-0ubuntu1) quantal-proposed; urgency=low

  * Ubuntu updates:
    - debian/control: Ensure novaclient is upgraded with nova,
      require python-keystoneclient >= 1:2.9.0. (LP: #1073289)
    - d/p/avoid_setuptools_git_dependency.patch: Refresh.
  * Dropped patches, applied upstream:
    - debian/patches/CVE-2012-5625.patch: [a99a802]
  * Resynchronize with stable/folsom (b55014ca) (LP: #1085255):
    - [a99a802] create_lvm_image allocates dirty blocks (LP: #1070539)
    - [670b388] RPC exchange name defaults to 'openstack' (LP: #1083944)
    - [3ede373] disassociate_floating_ip with multi_host=True fails
      (LP: #1074437)
    - [22d7c3b] libvirt imagecache should handle shared image storage
      (LP: #1075018)
    - [e787786] Detached and deleted RBD volumes remain associated with insance
      (LP: #1083818)
    - [9265eb0] live_migration missing migrate_data parameter in Hyper-V driver
      (LP: #1066513)
    - [3d99848] use_single_default_gateway does not function correctly
      (LP: #1075859)
    - [65a2d0a] resize does not migrate DHCP host information (LP: #1065440)
    - [102c76b] Nova backup image fails (LP: #1065053)
    - [48a3521] Fix config-file overrides for nova-dhcpbridge
    - [69663ee] Cloudpipe in Folsom: no such option: cnt_vpn_clients
      (LP: #1069573)
    - [6e47cc8] DisassociateAddress can cause Internal Server Error
      (LP: #1080406)
    - [22c3d7b] API calls to dis-associate an auto-assigned floating IP should
      return proper warning (LP: #1061499)
    - [bd11d15] libvirt: if exception raised during volume_detach, volume state
      is inconsistent (LP: #1057756)
    - [dcb59c3] admin can't describe all images in ec2 api (LP: #1070138)
    - [78de622] Incorrect Exception raised during Create server when metadata
      over 255 characters (LP: #1004007)
    - [c313de4] Fixed IP isn't released before updating DHCP host file
      (LP: #1078718)
    - [f4ab42d] Enabling Return Reservation ID with XML create server request
      returns no body (LP: #1061124)
    - [3db2a38] 'BackupCreate' should accept rotation parameter greater than or
      equal to zero (LP: #1071168)
    - [f7e5dde] libvirt reboot sometimes fails to reattach volumes
      (LP: #1073720)
    - [ff776d4] libvirt: detaching volume may fail while terminating other
      instances on the same host concurrently (LP: #1060836)
    - [85a8bc2] Used instance uuid rather than id in remove-fixed-ip
    - [42a85c0] Fix error on invalid delete_on_termination value
    - [6a17579] xenapi migrations fail w/ swap (LP: #1064083)
    - [97649b8] attach-time field for volumes is not updated for detach volume
      (LP: #1056122)
    - [8f6a718] libvirt: rebuild is not using kernel and ramdisk associated with
      the new image (LP: #1060925)
    - [fbe835f] live-migration and volume host assignement (LP: #1066887)
    - [c2a9150] typo prevents volume_tmp_dir flag from working (LP: #1071536)
    - [93efa21] Instances deleted during spawn leak network allocations
      (LP: #1068716)
    - [ebabd02] After restartin...

Read more...

Changed in nova (Ubuntu Quantal):
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in nova:
milestone: grizzly-1 → 2013.1
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.