[2.0a1/2.0pre-a2] Fail to commission when Fabric on Machine Interface and Rack Interface dont match

[Andres Rodriguez]

==> /var/log/maas/regiond.log <==
2016-03-12 00:16:59 [maasserver] ERROR: ################################ Exception: 'NoneType' object has no attribute 'url' ################################
2016-03-12 00:16:59 [maasserver] ERROR: Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/lib/python3/dist-packages/maasserver/utils/views.py", line 180, in view_atomic_with_post_commit_savepoint
    return view_atomic(*args, **kwargs)
  File "/usr/lib/python3.5/contextlib.py", line 30, in inner
    return func(*args, **kwds)
  File "/usr/lib/python3/dist-packages/maasserver/api/pxeconfig.py", line 202, in pxeconfig
    preseed_url = compose_preseed_url(node)
  File "/usr/lib/python3/dist-packages/maasserver/preseed.py", line 704, in compose_preseed_url
    base_url = node.get_boot_primary_rack_controller().url
AttributeError: 'NoneType' object has no attribute 'url'

2016-03-12 00:16:59 [-] 127.0.0.1 - - [11/Mar/2016:16:16:58 +0000] "GET /MAAS/api/2.0/pxeconfig/?local=192.168.10.27&bios_boot_method=pxe&mac=74-d4-35-89-bd-2b&ra
ckcontroller_id=4y3h7n&remote=192.168.10.59 HTTP/1.0" 500 40 "-" "provisioningserver.pserv_services.tftp.TFTPBackend"

[Andres Rodriguez (andreserl)]

from another bug:

2016-03-11 14:57:52 [maasserver] ERROR: ################################ Exception: 'NoneType' object has no attribute 'url' ################################
2016-03-11 14:57:52 [maasserver] ERROR: Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/lib/python3/dist-packages/maasserver/utils/views.py", line 180, in view_atomic_with_post_commit_savepoint
    return view_atomic(*args, **kwargs)
  File "/usr/lib/python3.5/contextlib.py", line 30, in inner
    return func(*args, **kwds)
  File "/usr/lib/python3/dist-packages/maasserver/api/pxeconfig.py", line 202, in pxeconfig
    preseed_url = compose_preseed_url(node)
  File "/usr/lib/python3/dist-packages/maasserver/preseed.py", line 704, in compose_preseed_url
    base_url = node.get_boot_primary_rack_controller().url
AttributeError: 'NoneType' object has no attribute 'url'

[Andres Rodriguez (andreserl)]

https://bugs.launchpad.net/maas/+bug/1555570

[Andres Rodriguez (andreserl)]

In my lab:

{
    "address_ttl": null,
    "hostname": "advective-simonne",
    "boot_interface": {
        "mac_address": "74:d4:35:89:bd:2b"
    },
    "virtualblockdevice_set": [],
    "status_message": null,
    "architecture": "amd64/generic",
    "status": 0,
    "status_action": null,
    "power_state": "unknown",
    "power_type": "ipmi",
    "blockdevice_set": [],
    "storage": 0.0,
    "physicalblockdevice_set": [],
    "cpu_count": 0,
    "system_id": "4y3haq",
    "osystem": "",
    "macaddress_set": [
        {
            "mac_address": "74:d4:35:89:bd:2b"
        },
        {
            "mac_address": "74:d4:35:89:bd:2c"
        }
    ],
    "min_hwe_kernel": "",
    "owner": null,
    "interface_set": [
        {
            "discovered": null,
            "id": 136,
            "name": "eth0",
            "mac_address": "74:d4:35:89:bd:2b",
            "parents": [],
            "enabled": true,
            "type": "physical",
            "links": [],
            "vlan": {
                "vid": 0,
                "resource_uri": "/MAAS/api/2.0/vlans/1/",
                "secondary_rack": null,
                "id": 1,
                "fabric": "fabric-0",
                "mtu": 1500,
                "name": "untagged",
                "primary_rack": null,
                "dhcp_on": false
            },
            "resource_uri": "/MAAS/api/2.0/nodes/4y3haq/interfaces/136/",
            "params": "",
            "tags": [],
            "children": [],
            "effective_mtu": 1500
        },
        {
            "discovered": null,
            "id": 137,
            "name": "eth1",
            "mac_address": "74:d4:35:89:bd:2c",
            "parents": [],
            "enabled": true,
            "type": "physical",
            "links": [],
            "vlan": {
                "vid": 0,
                "resource_uri": "/MAAS/api/2.0/vlans/1/",
                "secondary_rack": null,
                "id": 1,
                "fabric": "fabric-0",
                "mtu": 1500,
                "name": "untagged",
                "primary_rack": null,
                "dhcp_on": false
            },
            "resource_uri": "/MAAS/api/2.0/nodes/4y3haq/interfaces/137/",
            "params": "",
            "tags": [],
            "children": [],
            "effective_mtu": 1500
        }
    ],
    "boot_disk": null,
    "ip_addresses": [],
    "memory": 0,
    "fqdn": "advective-simonne.maas",
    "tag_names": [],
    "disable_ipv4": false,
    "node_type_name": "Machine",
    "zone": {
        "description": "",
        "resource_uri": "/MAAS/api/2.0/zones/default/",
        "name": "default"
    },
    "domain": {
        "resource_record_count": 18,
        "resource_uri": "/MAAS/api/2.0/domains/0/",
        "id": 0,
        "name": "maas",
        "authoritative": true,
        "ttl": null
    },
    "distro_series": "",
    "node_type": 0,
    "resource_uri": "/MAAS/api/2.0/machines/4y3haq/",
    "hwe_kernel": "",
    "netboot": true,
    "swap_size": null,
    "status_name": "New"
}

[Andres Rodriguez (andreserl)]

Ok, I dunno if this is related, but can't commission. It seems it boots into the enlistment process instead of commissioning. I'm using manual power type, and I see the error in:

2016-03-12 00:16:59+0800 [-] Stopping protocol <tftp.bootstrap.RemoteOriginReadSession object at 0x7f077cc1ee10>
2016-03-12 00:16:59+0800 [TFTP (UDP)] Datagram received from ('192.168.10.59', 49159): <RRQDatagram(filename=b'pxelinux.cfg/2bbd8935-d474-8001-e311-f0a10054a09d',
 mode=b'octet', options=OrderedDict([(b'tsize', b'0'), (b'blksize', b'1408')]))>
2016-03-12 00:16:59+0800 [TFTP (UDP)] Datagram received from ('192.168.10.59', 49160): <RRQDatagram(filename=b'pxelinux.cfg/01-74-d4-35-89-bd-2b', mode=b'octet',
options=OrderedDict([(b'tsize', b'0'), (b'blksize', b'1408')]))>

==> /var/log/maas/regiond.log <==
2016-03-12 00:16:59 [maasserver] ERROR: ################################ Exception: 'NoneType' object has no attribute 'url' ################################
2016-03-12 00:16:59 [maasserver] ERROR: Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/lib/python3/dist-packages/maasserver/utils/views.py", line 180, in view_atomic_with_post_commit_savepoint
    return view_atomic(*args, **kwargs)
  File "/usr/lib/python3.5/contextlib.py", line 30, in inner
    return func(*args, **kwds)
  File "/usr/lib/python3/dist-packages/maasserver/api/pxeconfig.py", line 202, in pxeconfig
    preseed_url = compose_preseed_url(node)
  File "/usr/lib/python3/dist-packages/maasserver/preseed.py", line 704, in compose_preseed_url
    base_url = node.get_boot_primary_rack_controller().url
AttributeError: 'NoneType' object has no attribute 'url'

2016-03-12 00:16:59 [-] 127.0.0.1 - - [11/Mar/2016:16:16:58 +0000] "GET /MAAS/api/2.0/pxeconfig/?local=192.168.10.27&bios_boot_method=pxe&mac=74-d4-35-89-bd-2b&ra
ckcontroller_id=4y3h7n&remote=192.168.10.59 HTTP/1.0" 500 40 "-" "provisioningserver.pserv_services.tftp.TFTPBackend"

[Andres Rodriguez (andreserl)]

Ok, so I think this relates to: https://bugs.launchpad.net/maas/+bug/1555570 as well.

So I re-install to re-test and I had this configuration

1. a maas server with eth0, eth1, eth2, where eth0 is the network MAAS is managing. This, by default was in fabric-2.
2. maas node with eth0, eth1, both NIC's were auto placed on fabric-0

On commissioning, I'd see the failure: AttributeError: 'NoneType' object has no attribute 'url' so, what I did is to ensure that eth0, the interface where I was managing DHCP was connected to fabric-0 instead of fabric-0. After I did that, the machine commissioned successfully.

[Andres Rodriguez (andreserl)]

Work around:

The Rack Controller interface that's on the same subnet as the subnet where DHCP has been enabled, needs to always be in Fabric-0. This can be done in the Rack Controller detail page, under the Interfaces section.

[Michael Foord (mfoord)]

This workaround works for me. Thanks.

[Michael Foord (mfoord)]

Except now enlisting doesn't work (no pxe boot).

[Andres Rodriguez (andreserl)]

Michael,

Are you only importing Xenial?

On Monday, March 14, 2016, Michael Foord <email address hidden> wrote:

> Except now enlisting doesn't work (no pxe boot).
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1554566
>
> Title:
> [2.0a1/2.0pre-a2] Fail to commission when Fabric on Machine Interface
> and Rack Interface dont match
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/maas/+bug/1554566/+subscriptions
>

--
Andres Rodriguez (RoAkSoAx)
Ubuntu Server Developer
MSc. Telecom & Networking
Systems Engineer

[John George (jog)]

CDOQA tests also ran into what appears to be this same issue, while commissioning a Node into 2.0a2.
I was also able to work around it by setting the Nodes network interface, that's used to PXE boot, to match the fabric for that managed subnet (fabric-3 in this case).

2016-03-15 00:18:24 [maasserver] ERROR: ################################ Exception: 'NoneType' object has no attribute 'url' ################################
2016-03-15 00:18:24 [maasserver] ERROR: Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/lib/python3/dist-packages/maasserver/utils/views.py", line 180, in view_atomic_with_post_commit_savepoint
    return view_atomic(*args, **kwargs)
  File "/usr/lib/python3.5/contextlib.py", line 30, in inner
    return func(*args, **kwds)
  File "/usr/lib/python3/dist-packages/maasserver/api/support.py", line 54, in __call__
    response = upcall(request, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/django/views/decorators/vary.py", line 21, in inner_func
    response = func(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/piston3/resource.py", line 190, in __call__
    result = self.error_handler(e, request, meth, em_format)
  File "/usr/lib/python3/dist-packages/piston3/resource.py", line 188, in __call__
    result = meth(request, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/maasserver/api/support.py", line 210, in dispatch
    return function(self, request, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/metadataserver/api.py", line 768, in get_preseed
    return HttpResponse(get_preseed(node), content_type="text/plain")
  File "/usr/lib/python3/dist-packages/maasserver/preseed.py", line 393, in get_preseed
    release=Config.objects.get_config('commissioning_distro_series'))
  File "/usr/lib/python3/dist-packages/maasserver/preseed.py", line 680, in render_preseed
    node, osystem, release, rack_controller=rack_controller))
  File "/usr/lib/python3/dist-packages/maasserver/preseed.py", line 628, in get_node_preseed_context
    base_url=rack_controller.url)
AttributeError: 'NoneType' object has no attribute 'url'

[Michael Foord (mfoord)]

Andres: I have 14.0.4 and 15.10 images.