[b1] pod created vm fails commissioning after getting 404 from metadata api
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
MAAS |
Fix Released
|
Critical
|
Blake Rouse | ||
2.3 |
Won't Fix
|
High
|
Blake Rouse | ||
cloud-init |
Invalid
|
Undecided
|
Unassigned |
Bug Description
A vm created via the pods API in maas failed to commission immediately after it was created.
It PXE booted, got initrd and the kernel, dhcp'd again, and then wasn't heard from anymore:
http://
There are no rsyslog logs for it. The hostname of the vm is landscapeamqp-
If I connect to the node with virt-viewer, it is sitting at an Ubuntu prompt, but I can't login because there are no passwords set. There are no console logs available on disk (bug 1742971).
This is with maas 2.3.0 (6434-gd354690-
To check for this bug you can look for 404 errors like this:
http://
This was using the default daily maas images.
Related branches
- Blake Rouse (community): Disapprove
- MAAS Lander: Needs Fixing
-
Diff: 2113 lines (+309/-297)70 files modifiedsrc/apiclient/maas_client.py (+8/-1)
src/apiclient/tests/test_maas_client.py (+7/-0)
src/maascli/actions/tests/test_boot_resources_create.py (+1/-1)
src/maascli/actions/tests/test_sshkeys_import.py (+1/-1)
src/maasserver/api/doc_handler.py (+1/-1)
src/maasserver/api/tests/test_api.py (+6/-6)
src/maasserver/api/tests/test_bcache.py (+2/-2)
src/maasserver/api/tests/test_bcache_cacheset.py (+2/-2)
src/maasserver/api/tests/test_boot_resources.py (+3/-3)
src/maasserver/api/tests/test_boot_source_selections.py (+2/-2)
src/maasserver/api/tests/test_boot_sources.py (+2/-2)
src/maasserver/api/tests/test_devices.py (+2/-2)
src/maasserver/api/tests/test_dhcpsnippets.py (+3/-3)
src/maasserver/api/tests/test_discoveries.py (+2/-2)
src/maasserver/api/tests/test_dnsresourcerecords.py (+2/-2)
src/maasserver/api/tests/test_dnsresources.py (+2/-2)
src/maasserver/api/tests/test_doc.py (+2/-2)
src/maasserver/api/tests/test_domains.py (+2/-2)
src/maasserver/api/tests/test_events.py (+1/-1)
src/maasserver/api/tests/test_fabrics.py (+2/-2)
src/maasserver/api/tests/test_fannetworks.py (+2/-2)
src/maasserver/api/tests/test_filestorage.py (+2/-2)
src/maasserver/api/tests/test_interfaces.py (+2/-2)
src/maasserver/api/tests/test_ipaddresses.py (+1/-1)
src/maasserver/api/tests/test_ipranges.py (+2/-2)
src/maasserver/api/tests/test_licensekey.py (+2/-2)
src/maasserver/api/tests/test_machine.py (+1/-1)
src/maasserver/api/tests/test_machines.py (+1/-1)
src/maasserver/api/tests/test_network.py (+2/-1)
src/maasserver/api/tests/test_networks.py (+2/-1)
src/maasserver/api/tests/test_node.py (+1/-1)
src/maasserver/api/tests/test_nodes.py (+1/-1)
src/maasserver/api/tests/test_notification.py (+2/-2)
src/maasserver/api/tests/test_packagerepositories.py (+4/-3)
src/maasserver/api/tests/test_pods.py (+2/-2)
src/maasserver/api/tests/test_rackcontroller.py (+3/-2)
src/maasserver/api/tests/test_raid.py (+2/-2)
src/maasserver/api/tests/test_regioncontroller.py (+2/-2)
src/maasserver/api/tests/test_scriptresults.py (+5/-5)
src/maasserver/api/tests/test_scripts.py (+4/-4)
src/maasserver/api/tests/test_spaces.py (+2/-2)
src/maasserver/api/tests/test_ssl_key.py (+2/-2)
src/maasserver/api/tests/test_staticroutes.py (+2/-2)
src/maasserver/api/tests/test_subnets.py (+2/-2)
src/maasserver/api/tests/test_tag.py (+2/-2)
src/maasserver/api/tests/test_users.py (+2/-2)
src/maasserver/api/tests/test_version.py (+1/-1)
src/maasserver/api/tests/test_vlans.py (+3/-2)
src/maasserver/api/tests/test_volume_groups.py (+2/-2)
src/maasserver/api/tests/test_zone.py (+2/-1)
src/maasserver/api/tests/test_zones.py (+1/-1)
src/maasserver/bootresources.py (+1/-7)
src/maasserver/djangosettings/monkey.py (+6/-6)
src/maasserver/djangosettings/settings.py (+9/-5)
src/maasserver/djangosettings/urls.py (+1/-1)
src/maasserver/middleware.py (+52/-60)
src/maasserver/testing/factory.py (+2/-2)
src/maasserver/testing/testclient.py (+26/-1)
src/maasserver/tests/test_bootresources.py (+8/-7)
src/maasserver/tests/test_commands.py (+1/-1)
src/maasserver/tests/test_middleware.py (+35/-17)
src/maasserver/tests/test_preseed.py (+5/-4)
src/maasserver/utils/__init__.py (+10/-27)
src/maasserver/utils/tests/test_utils.py (+10/-36)
src/maasserver/views/tests/test_account.py (+12/-12)
src/maasserver/views/tests/test_general.py (+3/-3)
src/maasserver/views/tests/test_settings.py (+3/-3)
src/metadataserver/middleware.py (+1/-1)
src/provisioningserver/tags.py (+2/-2)
src/provisioningserver/tests/test_tags.py (+5/-5)
- Andres Rodriguez (community): Approve
-
Diff: 38 lines (+15/-1)2 files modifiedsrc/apiclient/maas_client.py (+8/-1)
src/apiclient/tests/test_maas_client.py (+7/-0)
- MAAS Lander: Needs Fixing
- Andres Rodriguez (community): Approve
- Alberto Donato (community): Approve
-
Diff: 1887 lines (+232/-239)66 files modifiedsrc/maascli/actions/tests/test_boot_resources_create.py (+1/-1)
src/maascli/actions/tests/test_sshkeys_import.py (+1/-1)
src/maasserver/api/doc_handler.py (+1/-1)
src/maasserver/api/tests/test_api.py (+6/-6)
src/maasserver/api/tests/test_bcache.py (+2/-2)
src/maasserver/api/tests/test_bcache_cacheset.py (+2/-2)
src/maasserver/api/tests/test_boot_resources.py (+3/-3)
src/maasserver/api/tests/test_boot_source_selections.py (+2/-2)
src/maasserver/api/tests/test_boot_sources.py (+2/-2)
src/maasserver/api/tests/test_devices.py (+2/-2)
src/maasserver/api/tests/test_dhcpsnippets.py (+3/-3)
src/maasserver/api/tests/test_discoveries.py (+2/-2)
src/maasserver/api/tests/test_dnsresourcerecords.py (+2/-2)
src/maasserver/api/tests/test_dnsresources.py (+2/-2)
src/maasserver/api/tests/test_doc.py (+2/-2)
src/maasserver/api/tests/test_domains.py (+2/-2)
src/maasserver/api/tests/test_events.py (+1/-1)
src/maasserver/api/tests/test_fabrics.py (+2/-2)
src/maasserver/api/tests/test_fannetworks.py (+2/-2)
src/maasserver/api/tests/test_filestorage.py (+2/-2)
src/maasserver/api/tests/test_interfaces.py (+2/-2)
src/maasserver/api/tests/test_ipaddresses.py (+1/-1)
src/maasserver/api/tests/test_ipranges.py (+2/-2)
src/maasserver/api/tests/test_licensekey.py (+2/-2)
src/maasserver/api/tests/test_machine.py (+1/-1)
src/maasserver/api/tests/test_machines.py (+1/-1)
src/maasserver/api/tests/test_network.py (+2/-1)
src/maasserver/api/tests/test_networks.py (+2/-1)
src/maasserver/api/tests/test_node.py (+1/-1)
src/maasserver/api/tests/test_nodes.py (+1/-1)
src/maasserver/api/tests/test_notification.py (+2/-2)
src/maasserver/api/tests/test_packagerepositories.py (+4/-3)
src/maasserver/api/tests/test_pods.py (+2/-2)
src/maasserver/api/tests/test_rackcontroller.py (+3/-2)
src/maasserver/api/tests/test_raid.py (+2/-2)
src/maasserver/api/tests/test_regioncontroller.py (+2/-2)
src/maasserver/api/tests/test_scriptresults.py (+5/-5)
src/maasserver/api/tests/test_scripts.py (+4/-4)
src/maasserver/api/tests/test_spaces.py (+2/-2)
src/maasserver/api/tests/test_ssl_key.py (+2/-2)
src/maasserver/api/tests/test_staticroutes.py (+2/-2)
src/maasserver/api/tests/test_subnets.py (+2/-2)
src/maasserver/api/tests/test_tag.py (+2/-2)
src/maasserver/api/tests/test_users.py (+2/-2)
src/maasserver/api/tests/test_version.py (+1/-1)
src/maasserver/api/tests/test_vlans.py (+3/-2)
src/maasserver/api/tests/test_volume_groups.py (+2/-2)
src/maasserver/api/tests/test_zone.py (+2/-1)
src/maasserver/api/tests/test_zones.py (+1/-1)
src/maasserver/bootresources.py (+1/-2)
src/maasserver/djangosettings/monkey.py (+6/-6)
src/maasserver/djangosettings/settings.py (+7/-3)
src/maasserver/middleware.py (+8/-10)
src/maasserver/testing/factory.py (+2/-2)
src/maasserver/testing/testclient.py (+26/-1)
src/maasserver/tests/test_bootresources.py (+8/-7)
src/maasserver/tests/test_commands.py (+1/-1)
src/maasserver/tests/test_middleware.py (+20/-18)
src/maasserver/tests/test_preseed.py (+5/-4)
src/maasserver/utils/__init__.py (+10/-27)
src/maasserver/utils/tests/test_utils.py (+10/-36)
src/maasserver/views/tests/test_account.py (+14/-14)
src/maasserver/views/tests/test_general.py (+2/-2)
src/maasserver/views/tests/test_settings.py (+3/-3)
src/provisioningserver/tags.py (+2/-2)
src/provisioningserver/tests/test_tags.py (+5/-5)
Changed in maas: | |
milestone: | none → 2.4.0beta1 |
summary: |
- pod created vm fails commissioning after apparently booting to linux + [b1] pod created vm fails commissioning after apparently booting to + linux |
summary: |
- [b1] pod created vm fails commissioning after apparently booting to - linux + [b1] pod created vm fails commissioning after getting 404 from metadata + api |
description: | updated |
Changed in maas: | |
milestone: | 2.4.0beta1 → 2.4.0beta2 |
Changed in maas: | |
assignee: | Andres Rodriguez (andreserl) → Blake Rouse (blake-rouse) |
status: | New → Triaged |
importance: | Undecided → High |
Changed in cloud-init: | |
status: | New → Invalid |
Changed in maas: | |
assignee: | Blake Rouse (blake-rouse) → Mike Pontillo (mpontillo) |
Changed in maas: | |
milestone: | 2.4.0beta2 → 2.3.x |
milestone: | 2.3.x → 2.4.0beta2 |
Changed in maas: | |
milestone: | 2.4.0beta2 → 2.4.0rc1 |
Changed in maas: | |
assignee: | Mike Pontillo (mpontillo) → Blake Rouse (blake-rouse) |
Changed in maas: | |
importance: | High → Critical |
Changed in maas: | |
status: | New → In Progress |
Changed in maas: | |
status: | In Progress → Fix Committed |
Changed in maas: | |
milestone: | 2.4.0rc1 → 2.4.0beta3 |
Changed in maas: | |
status: | Fix Committed → Fix Released |
tags: | added: track |
@Jason,
As per our IRC chat, while there are no console logs stored on the host, this doesn't prevent you from obtaining the logs by attempting to recommission:
1. Attempt to get the kernel params being sent, you will see those on the VM's KVM. (Try re-commissioning to obtain these).
2. Enable console log as kernel params in the specific VM, and attempt to re-commission.