I have added the following to all three associations:

      "DependsOn" : "router",
      "DependsOn" : "router_interface_private",
      "DependsOn" : "router_gateway_external",

I have added the second and third because I noticed that it created the
router, but it did not connect it
to both networks before creating an association and it failed again.


With the above three lines added it seems to be working most of the time,
but not always.

Event list working:

saso@devstack-new-virt:~/diploma$ heat event-list DNS5
+-----------------------------+-----+------------------------+-----------------+----------------------+
| logical_resource_id         | id  | resource_status_reason |
resource_status | event_time           |
+-----------------------------+-----+------------------------+-----------------+----------------------+
| MinimalSecurityGroup        | 369 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:10Z |
| MinimalSecurityGroup        | 370 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:12Z |
| floating_ip_DNSserver       | 371 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:13Z |
| floating_ip_Client1         | 373 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:14Z |
| floating_ip_DNSserver       | 372 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:14Z |
| floating_ip_Client1         | 374 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:15Z |
| network                     | 375 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:15Z |
| Client2Port                 | 379 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:16Z |
| network                     | 376 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:16Z |
| subnet                      | 377 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:16Z |
| subnet                      | 378 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:16Z |
| Client2Port                 | 380 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:18Z |
| Client2                     | 381 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:19Z |
| Client1Port                 | 383 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:37Z |
| Client2                     | 382 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:37Z |
| Client1Port                 | 384 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:38Z |
| router                      | 385 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:38Z |
| router                      | 386 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:39Z |
| router_gateway_external     | 387 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:39Z |
| DNSServerPort               | 391 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:40Z |
| router_gateway_external     | 388 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:40Z |
| router_interface_private    | 389 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:40Z |
| router_interface_private    | 390 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:40Z |
| DNSServerPort               | 392 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:42Z |
| floating_ip_assoc_DNSserver | 393 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:42Z |
| floating_ip_Client2         | 395 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:44Z |
| floating_ip_Client2         | 396 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:44Z |
| floating_ip_assoc_DNSserver | 394 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:44Z |
| floating_ip_assoc_Client1   | 399 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:45Z |
| floating_ip_assoc_Client2   | 397 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:45Z |
| floating_ip_assoc_Client2   | 398 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:45Z |
| DNSServerSecurityGroup      | 401 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:46Z |
| floating_ip_assoc_Client1   | 400 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:46Z |
| DNSServer                   | 403 | state changed          | IN_PROGRESS
    | 2013-05-06T03:22:51Z |
| DNSServerSecurityGroup      | 402 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:22:51Z |
| Client1                     | 405 | state changed          | IN_PROGRESS
    | 2013-05-06T03:23:10Z |
| DNSServer                   | 404 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:23:10Z |
| Client1                     | 406 | state changed          |
CREATE_COMPLETE | 2013-05-06T03:23:33Z |
+-----------------------------+-----+------------------------+-----------------+----------------------+
saso@devstack-new-virt:~/diploma$

Not working:

saso@devstack-new-virt:~/diploma$ heat event-list DNS5
+-----------------------------+-----+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+----------------------+
| logical_resource_id         | id  | resource_status_reason


                                               | resource_status |
event_time           |
+-----------------------------+-----+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+----------------------+
| floating_ip_Client2         | 529 | state changed


                                              | IN_PROGRESS     |
2013-05-06T03:40:00Z |
| floating_ip_Client2         | 530 | state changed


                                              | CREATE_COMPLETE |
2013-05-06T03:40:01Z |
| floating_ip_DNSserver       | 531 | state changed


                                              | IN_PROGRESS     |
2013-05-06T03:40:02Z |
| floating_ip_DNSserver       | 532 | state changed


                                              | CREATE_COMPLETE |
2013-05-06T03:40:03Z |
| router                      | 533 | state changed


                                              | IN_PROGRESS     |
2013-05-06T03:40:03Z |
| router                      | 534 | state changed


                                              | CREATE_COMPLETE |
2013-05-06T03:40:03Z |
| router_gateway_external     | 535 | state changed


                                              | IN_PROGRESS     |
2013-05-06T03:40:03Z |
| DNSServerSecurityGroup      | 537 | state changed


                                              | IN_PROGRESS     |
2013-05-06T03:40:04Z |
| router_gateway_external     | 536 | state changed


                                              | CREATE_COMPLETE |
2013-05-06T03:40:04Z |
| DNSServerSecurityGroup      | 538 | state changed


                                              | CREATE_COMPLETE |
2013-05-06T03:40:07Z |
| MinimalSecurityGroup        | 539 | state changed


                                              | IN_PROGRESS     |
2013-05-06T03:40:07Z |
| MinimalSecurityGroup        | 540 | state changed


                                              | CREATE_COMPLETE |
2013-05-06T03:40:11Z |
| network                     | 541 | state changed


                                              | IN_PROGRESS     |
2013-05-06T03:40:12Z |
| network                     | 542 | state changed


                                              | CREATE_COMPLETE |
2013-05-06T03:40:12Z |
| subnet                      | 543 | state changed


                                              | IN_PROGRESS     |
2013-05-06T03:40:12Z |
| subnet                      | 544 | state changed


                                              | CREATE_COMPLETE |
2013-05-06T03:40:13Z |
| Client2Port                 | 545 | state changed


                                              | IN_PROGRESS     |
2013-05-06T03:40:14Z |
| Client2Port                 | 546 | state changed


                                              | CREATE_COMPLETE |
2013-05-06T03:40:15Z |
| DNSServerPort               | 547 | state changed


                                              | IN_PROGRESS     |
2013-05-06T03:40:15Z |
| DNSServerPort               | 548 | state changed


                                              | CREATE_COMPLETE |
2013-05-06T03:40:16Z |
| floating_ip_assoc_Client2   | 551 | Stack creation aborted


                                               | CREATE_FAILED   |
2013-05-06T03:40:16Z |
| floating_ip_assoc_DNSserver | 549 | state changed


                                              | IN_PROGRESS     |
2013-05-06T03:40:16Z |
| floating_ip_assoc_DNSserver | 550 | QuantumClientException: External
network 97459abb-4dc6-428a-8639-ebe1b4bd7cbb is not reachable from subnet
38c496c7-bdcd-46ec-a686-df2ac22d005e.  Therefore, cannot associate Port
cdb5db2b-f4c4-4e68-9746-98eaa7ed18fa with a Floating IP. | CREATE_FAILED
| 2013-05-06T03:40:16Z |
| Client1                     | 555 | Stack creation aborted


                                               | CREATE_FAILED   |
2013-05-06T03:40:17Z |
| Client1Port                 | 554 | Stack creation aborted


                                               | CREATE_FAILED   |
2013-05-06T03:40:17Z |
| Client2                     | 553 | Stack creation aborted


                                               | CREATE_FAILED   |
2013-05-06T03:40:17Z |
| DNSServer                   | 556 | Stack creation aborted


                                               | CREATE_FAILED   |
2013-05-06T03:40:17Z |
| floating_ip_Client1         | 557 | Stack creation aborted


                                               | CREATE_FAILED   |
2013-05-06T03:40:17Z |
| floating_ip_assoc_Client1   | 558 | Stack creation aborted


                                               | CREATE_FAILED   |
2013-05-06T03:40:17Z |
| router_interface_private    | 552 | Stack creation aborted


                                               | CREATE_FAILED   |
2013-05-06T03:40:17Z |
+-----------------------------+-----+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+----------------------+
saso@devstack-new-virt:~/diploma$

Here in the not working case it seems it tried to create floating point
associations before it created router interface on the local network, even
though it has a line to depend on the
router_interface_private.

Stack delete also seems to fail sometimes, as in the case below:
saso@devstack-new-virt:~/diploma$ heat event-list DNS7
+-----------------------------+-----+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------+----------------------+
| logical_resource_id         | id  | resource_status_reason


             | resource_status    | event_time           |
+-----------------------------+-----+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------+----------------------+
| floating_ip_Client1         | 746 | state changed


            | IN_PROGRESS        | 2013-05-06T03:59:41Z |
| floating_ip_Client1         | 747 | state changed


            | CREATE_COMPLETE    | 2013-05-06T03:59:42Z |
| DNSServerSecurityGroup      | 748 | state changed


            | IN_PROGRESS        | 2013-05-06T03:59:43Z |
| DNSServerSecurityGroup      | 749 | state changed


            | CREATE_COMPLETE    | 2013-05-06T03:59:46Z |
| MinimalSecurityGroup        | 750 | state changed


            | IN_PROGRESS        | 2013-05-06T03:59:46Z |
| MinimalSecurityGroup        | 751 | state changed


            | CREATE_COMPLETE    | 2013-05-06T03:59:48Z |
| floating_ip_Client2         | 752 | state changed


            | IN_PROGRESS        | 2013-05-06T03:59:48Z |
| floating_ip_Client2         | 753 | state changed


            | CREATE_COMPLETE    | 2013-05-06T03:59:49Z |
| floating_ip_DNSserver       | 754 | state changed


            | IN_PROGRESS        | 2013-05-06T03:59:49Z |
| floating_ip_DNSserver       | 755 | state changed


            | CREATE_COMPLETE    | 2013-05-06T03:59:51Z |
| router                      | 756 | state changed


            | IN_PROGRESS        | 2013-05-06T03:59:52Z |
| router                      | 757 | state changed


            | CREATE_COMPLETE    | 2013-05-06T03:59:52Z |
| network                     | 758 | state changed


            | IN_PROGRESS        | 2013-05-06T03:59:53Z |
| network                     | 759 | state changed


            | CREATE_COMPLETE    | 2013-05-06T03:59:53Z |
| subnet                      | 760 | state changed


            | IN_PROGRESS        | 2013-05-06T03:59:53Z |
| Client2Port                 | 762 | state changed


            | IN_PROGRESS        | 2013-05-06T03:59:54Z |
| Client2Port                 | 763 | state changed


            | CREATE_COMPLETE    | 2013-05-06T03:59:54Z |
| subnet                      | 761 | state changed


            | CREATE_COMPLETE    | 2013-05-06T03:59:54Z |
| DNSServerPort               | 764 | state changed


            | IN_PROGRESS        | 2013-05-06T03:59:55Z |
| DNSServer                   | 766 | state changed


            | IN_PROGRESS        | 2013-05-06T03:59:56Z |
| DNSServerPort               | 765 | state changed


            | CREATE_COMPLETE    | 2013-05-06T03:59:56Z |
| Client1Port                 | 768 | state changed


            | IN_PROGRESS        | 2013-05-06T04:00:16Z |
| DNSServer                   | 767 | state changed


            | CREATE_COMPLETE    | 2013-05-06T04:00:16Z |
| Client1                     | 770 | state changed


            | IN_PROGRESS        | 2013-05-06T04:00:17Z |
| Client1Port                 | 769 | state changed


            | CREATE_COMPLETE    | 2013-05-06T04:00:17Z |
| Client1                     | 771 | state changed


            | CREATE_COMPLETE    | 2013-05-06T04:00:36Z |
| Client2                     | 772 | state changed


            | IN_PROGRESS        | 2013-05-06T04:00:36Z |
| Client2                     | 773 | state changed


            | CREATE_COMPLETE    | 2013-05-06T04:01:00Z |
| router_interface_private    | 774 | state changed


            | IN_PROGRESS        | 2013-05-06T04:01:00Z |
| router_gateway_external     | 776 | state changed


            | IN_PROGRESS        | 2013-05-06T04:01:01Z |
| router_gateway_external     | 777 | state changed


            | CREATE_COMPLETE    | 2013-05-06T04:01:01Z |
| router_interface_private    | 775 | state changed


            | CREATE_COMPLETE    | 2013-05-06T04:01:01Z |
| floating_ip_assoc_Client1   | 778 | state changed


            | IN_PROGRESS        | 2013-05-06T04:01:02Z |
| floating_ip_assoc_Client1   | 779 | state changed


            | CREATE_COMPLETE    | 2013-05-06T04:01:02Z |
| floating_ip_assoc_DNSserver | 780 | state changed


            | IN_PROGRESS        | 2013-05-06T04:01:02Z |
| floating_ip_assoc_Client2   | 782 | state changed


            | IN_PROGRESS        | 2013-05-06T04:01:03Z |
| floating_ip_assoc_DNSserver | 781 | state changed


            | CREATE_COMPLETE    | 2013-05-06T04:01:03Z |
| floating_ip_assoc_Client2   | 783 | state changed


            | CREATE_COMPLETE    | 2013-05-06T04:01:07Z |
| router_interface_private    | 784 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:04:53Z |
| floating_ip_assoc_Client1   | 786 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:04:54Z |
| floating_ip_assoc_Client1   | 787 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:04:54Z |
| router_interface_private    | 785 | QuantumClientException: Router
interface for subnet b0415e83-6813-4ba0-99bf-b01266e8856b on router
ae37dc90-3be1-4ced-b417-c5c635420feb cannot be deleted, as it is required
by one or more floating IPs. | DELETE_FAILED      | 2013-05-06T04:04:54Z |
| DNSServer                   | 788 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:04:55Z |
| DNSServer                   | 789 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:01Z |
| DNSServerSecurityGroup      | 790 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:02Z |
| DNSServerSecurityGroup      | 791 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:06Z |
| Client2                     | 792 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:07Z |
| Client2                     | 793 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:13Z |
| floating_ip_assoc_DNSserver | 794 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:13Z |
| DNSServerPort               | 796 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:14Z |
| DNSServerPort               | 797 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:14Z |
| floating_ip_assoc_DNSserver | 795 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:14Z |
| floating_ip_DNSserver       | 798 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:15Z |
| Client2Port                 | 802 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:16Z |
| floating_ip_DNSserver       | 799 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:16Z |
| floating_ip_assoc_Client2   | 800 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:16Z |
| floating_ip_assoc_Client2   | 801 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:16Z |
| Client2Port                 | 803 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:17Z |
| floating_ip_Client2         | 806 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:17Z |
| router_gateway_external     | 804 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:17Z |
| router_gateway_external     | 805 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:17Z |
| floating_ip_Client1         | 810 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:18Z |
| floating_ip_Client2         | 807 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:18Z |
| router                      | 808 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:18Z |
| router                      | 809 | QuantumClientException: Router
ae37dc90-3be1-4ced-b417-c5c635420feb still has active ports

                   | DELETE_FAILED      | 2013-05-06T04:05:18Z |
| floating_ip_Client1         | 811 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:20Z |
| Client1                     | 812 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:21Z |
| Client1                     | 813 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:28Z |
| MinimalSecurityGroup        | 814 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:28Z |
| Client1Port                 | 816 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:30Z |
| Client1Port                 | 817 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:30Z |
| MinimalSecurityGroup        | 815 | state changed


            | DELETE_COMPLETE    | 2013-05-06T04:05:30Z |
| subnet                      | 818 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:31Z |
| subnet                      | 819 | QuantumClientException: Unable to
complete operation on subnet b0415e83-6813-4ba0-99bf-b01266e8856b. One or
more ports have an IP allocation from this subnet.
                   | DELETE_FAILED      | 2013-05-06T04:05:31Z |
| network                     | 820 | state changed


            | DELETE_IN_PROGRESS | 2013-05-06T04:05:32Z |
| network                     | 821 | QuantumClientException: Unable to
complete operation on network 9bd22cb5-1fb0-4111-af7d-f75b98e4c14d. There
are one or more ports still in use on the network.
                   | DELETE_FAILED      | 2013-05-06T04:05:32Z |
+-----------------------------+-----+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------+----------------------+
saso@devstack-new-virt:~/diploma$

It seems stack deletion tries to delete router_interface_private before
releasing floating ips.



On Mon, May 6, 2013 at 4:39 AM, Steve Baker <email address hidden> wrote:

> OK, I think I understand.
>
> The order the resources are placed in the template has no determination
> on the order the resources are created.
>
> Heat builds a dependency chain based on the dependencies it can see in
> the template (including Refs to other resources)
>
> If there is an implicit dependency between resource not stated in the
> template you can always add an explicit DependsOn to ensure a resource
> is created first.
>
> Something like this might help:
>     "floating_ip_assoc_DNSserver": {
>       "Type": "OS::Quantum::FloatingIPAssociation",
>       "DependsOn" : "router",
>       "Properties": {
>         "floatingip_id": { "Ref" : "floating_ip_DNSserver" },
>         "port_id": { "Ref" : "DNSServerPort" }
>       }
>     },
>
> If this works we could investigate the association->router dependency
> being fixed in Heat
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1176661
>
> Title:
>   Stack creation fail when using Quantum floating IPs
>
> Status in Orchestration API (Heat):
>   New
>
> Bug description:
>   I have created a template which uses Quantum resources and creates a
>   configuration with three instances on a private network, connected to
>   external network. It also assigns floating IPs to the three instances.
>   The problem is, that assigning floating IPs fails, because the router
>   is not yet created and connected before assigning floating IPs.
>
>   If I remove entries for floating IPs, the whole stack is successfully
> created.
>   The error reported by stack-show:
>   ...
>   | stack_status         | CREATE_FAILED
>
> |
>   | stack_status_reason  | Resource FloatingIPAssociation
>
>  |
>   |                      | "floating_ip_assoc_DNSserver" failed with:
>
>  |
>   |                      | QuantumClientException: External network
> 524ac1ab-f8d3
>        |
>   |                      | -47cd-b0df-cfdc7072b9cf is not reachable from
> subnet
>    |
>   |                      | 71145fd6-d5ce-4d10-8e91-46792a8b6e3a.
>  Therefore,
>           |
>   |                      | cannot associate Port 7c
>   ...
>
>   If I try to associate floating IPs from the dashboard and there is no
>   router connecting local and external nets, I get the same error.
>
>   Template:
>   {
>     "AWSTemplateFormatVersion" : "2013-05-04",
>
>     "Description" : "AWS CloudFormation template for use with OpenStack.
>   It uses Quantum for networking configuration. It sets up three Ubuntu
>   12.04 instances, each on its own subnet/network. One instance is set
>   up with bind9 for configuration of DNS server. When stack is created,
>   DNS is not configured, just installed on the instance. The other two
>   instances are used for testing DNS configuration. The three subnets
>   are connected with a router, that is also connected to the external
>   network. Floating IPs are also provided to the spawned instances for
>   external communication.",
>
>     "Parameters" : {
>       "KeyName" : {
>         "Description" : "Name of an existing EC2 KeyPair to enable SSH
> access to the instances",
>         "Type" : "String"
>       },
>
>       "ExtNetUuid" : {
>         "Description" : "UUID of the external network to be used for
> external access",
>         "Type" : "String"
>       },
>
>       "InstanceType" : {
>         "Description" : "DNSServer EC2 instance type",
>         "Type" : "String",
>         "Default" : "m1.micro",
>         "AllowedValues" : [ "t1.micro", "m1.small", "m1.large",
> "m1.xlarge", "m2.xlarge", "m2.2xlarge", "m2.4xlarge", "c1.medium",
> "c1.xlarge", "cc1.4xlarge", "m1.micro" ],
>         "ConstraintDescription" : "must be a valid EC2 instance type."
>       },
>       "LinuxDistribution": {
>         "Default": "U12",
>         "Description" : "Distribution of choice",
>         "Type": "String",
>         "AllowedValues" : "U12"
>       }
>     },
>
>     "Mappings" : {
>       "AWSInstanceType2Arch" : {
>         "t1.micro"    : { "Arch" : "32" },
>         "m1.small"    : { "Arch" : "32" },
>         "m1.large"    : { "Arch" : "64" },
>         "m1.xlarge"   : { "Arch" : "64" },
>         "m2.xlarge"   : { "Arch" : "64" },
>         "m2.2xlarge"  : { "Arch" : "64" },
>         "m2.4xlarge"  : { "Arch" : "64" },
>         "c1.medium"   : { "Arch" : "32" },
>         "c1.xlarge"   : { "Arch" : "64" },
>         "cc1.4xlarge" : { "Arch" : "64" },
>         "m1.micro"    : { "Arch" : "64" }
>       },
>       "DistroArch2AMI": {
>         "U12"      : { "32" : "U12-i386-cfntools", "64" :
> "U12-x86_64-cfntools" }
>       }
>     },
>
>     "Resources" : {
>
>       "network": {
>         "Type": "OS::Quantum::Net",
>         "Properties": {
>           "name": "local_network"
>         }
>       },
>
>       "subnet": {
>         "Type": "OS::Quantum::Subnet",
>         "Properties": {
>           "network_id": { "Ref" : "network" },
>           "ip_version": 4,
>           "cidr": "10.0.10.0/24",
>           "allocation_pools": [{"start": "10.0.10.20", "end":
> "10.0.10.50"}]
>         }
>       },
>
>       "DNSServerPort": {
>         "Type": "OS::Quantum::Port",
>         "Properties": {
>           "network_id": { "Ref" : "network" },
>           "fixed_ips": [{
>             "subnet_id": { "Ref" : "subnet" },
>             "ip_address": "10.0.10.30"
>           }]
>         }
>       },
>
>       "Client1Port": {
>         "Type": "OS::Quantum::Port",
>         "Properties": {
>           "network_id": { "Ref" : "network" },
>           "fixed_ips": [{
>             "subnet_id": { "Ref" : "subnet" },
>             "ip_address": "10.0.10.31"
>           }]
>         }
>       },
>
>       "Client2Port": {
>         "Type": "OS::Quantum::Port",
>         "Properties": {
>           "network_id": { "Ref" : "network" },
>           "fixed_ips": [{
>             "subnet_id": { "Ref" : "subnet" },
>             "ip_address": "10.0.10.32"
>           }]
>         }
>       },
>
>       "router": {
>         "Type": "OS::Quantum::Router"
>       },
>
>       "router_interface_private": {
>         "Type": "OS::Quantum::RouterInterface",
>         "Properties": {
>           "router_id": { "Ref" : "router" },
>           "subnet_id": { "Ref" : "subnet" }
>         }
>       },
>
>       "router_gateway_external": {
>         "Type": "OS::Quantum::RouterGateway",
>         "Properties": {
>           "router_id": { "Ref" : "router" },
>           "network_id": { "Ref" : "ExtNetUuid" }
>         }
>       },
>
>       "DNSServerSecurityGroup" : {
>         "Type" : "AWS::EC2::SecurityGroup",
>         "Properties" : {
>           "GroupDescription" : "Enable ping, SSH and DNS (port 53) access",
>           "SecurityGroupIngress" : [
>             {"IpProtocol" : "icmp", "FromPort" : "-1", "ToPort" : "-1",
> "CidrIp" : "0.0.0.0/0"},
>             {"IpProtocol" : "tcp", "FromPort" : "22", "ToPort" : "22",
> "CidrIp" : "0.0.0.0/0"},
>             {"IpProtocol" : "tcp", "FromPort" : "53", "ToPort" : "53",
> "CidrIp" : "0.0.0.0/0"},
>             {"IpProtocol" : "udp", "FromPort" : "53", "ToPort" : "53",
> "CidrIp" : "0.0.0.0/0"}
>           ]
>         }
>       },
>
>       "MinimalSecurityGroup" : {
>         "Type" : "AWS::EC2::SecurityGroup",
>         "Properties" : {
>           "GroupDescription" : "Enable only ping and SSH access",
>           "SecurityGroupIngress" : [
>             {"IpProtocol" : "icmp", "FromPort" : "-1", "ToPort" : "-1",
> "CidrIp" : "0.0.0.0/0"},
>             {"IpProtocol" : "tcp", "FromPort" : "22", "ToPort" : "22",
> "CidrIp" : "0.0.0.0/0"}
>           ]
>         }
>       },
>
>       "DNSServer": {
>         "Type": "AWS::EC2::Instance",
>         "Metadata" : {
>           "AWS::CloudFormation::Init" : {
>             "config" : {
>               "services" : {
>                 "sysvinit" : {
>                   "bind9"    : { "enabled" : "true", "ensureRunning" :
> "true" }
>                 }
>               },
>               "packages" : {
>                 "apt" : {
>                   "bind9"    : [],
>                   "dnsutils" : []
>                 }
>               }
>             }
>           }
>         },
>         "Properties": {
>           "ImageId" : { "Fn::FindInMap" : [ "DistroArch2AMI", { "Ref" :
> "LinuxDistribution" },
>                             { "Fn::FindInMap" : [ "AWSInstanceType2Arch",
> { "Ref" : "InstanceType" }, "Arch" ] } ] },
>           "InstanceType"   : { "Ref" : "InstanceType" },
>           "KeyName"        : { "Ref" : "KeyName" },
>           "SecurityGroups" : [ { "Ref" : "DNSServerSecurityGroup" } ],
>           "NetworkInterfaces" : [ { "Ref" : "DNSServerPort" } ],
>           "UserData"       : { "Fn::Base64" : { "Fn::Join" : ["", [
>             "#!/bin/bash -v\n",
>             "touch /tmp/cfninitwashere",
>             "/opt/aws/bin/cfn-init\n"
>           ]]}}
>         }
>       },
>
>       "Client1": {
>         "Type": "AWS::EC2::Instance",
>         "Metadata" : {
>           "AWS::CloudFormation::Init" : {
>             "config" : {
>               "packages" : {
>                 "apt" : {
>                   "dnsutils" : []
>                 }
>               }
>             }
>           }
>         },
>         "Properties": {
>           "ImageId" : { "Fn::FindInMap" : [ "DistroArch2AMI", { "Ref" :
> "LinuxDistribution" },
>                             { "Fn::FindInMap" : [ "AWSInstanceType2Arch",
> { "Ref" : "InstanceType" }, "Arch" ] } ] },
>           "InstanceType"   : { "Ref" : "InstanceType" },
>           "KeyName"        : { "Ref" : "KeyName" },
>           "SecurityGroups" : [ { "Ref" : "MinimalSecurityGroup" } ],
>           "NetworkInterfaces" : [ { "Ref" : "Client1Port" } ],
>           "UserData"       : { "Fn::Base64" : { "Fn::Join" : ["", [
>             "#!/bin/bash -v\n",
>             "/opt/aws/bin/cfn-init\n"
>           ]]}}
>         }
>       },
>
>       "Client2": {
>         "Type": "AWS::EC2::Instance",
>         "Metadata" : {
>           "AWS::CloudFormation::Init" : {
>             "config" : {
>               "packages" : {
>                 "apt" : {
>                   "dnsutils" : []
>                 }
>               }
>             }
>           }
>         },
>         "Properties": {
>           "ImageId" : { "Fn::FindInMap" : [ "DistroArch2AMI", { "Ref" :
> "LinuxDistribution" },
>                             { "Fn::FindInMap" : [ "AWSInstanceType2Arch",
> { "Ref" : "InstanceType" }, "Arch" ] } ] },
>           "InstanceType"   : { "Ref" : "InstanceType" },
>           "KeyName"        : { "Ref" : "KeyName" },
>           "SecurityGroups" : [ { "Ref" : "MinimalSecurityGroup" } ],
>           "NetworkInterfaces" : [ { "Ref" : "Client2Port" } ],
>           "UserData"       : { "Fn::Base64" : { "Fn::Join" : ["", [
>             "#!/bin/bash -v\n",
>             "/opt/aws/bin/cfn-init\n"
>           ]]}}
>         }
>       },
>
>       "floating_ip_DNSserver": {
>         "Type": "OS::Quantum::FloatingIP",
>         "Properties": {
>           "floating_network_id": { "Ref" : "ExtNetUuid" }
>         }
>       },
>
>       "floating_ip_Client1": {
>         "Type": "OS::Quantum::FloatingIP",
>         "Properties": {
>           "floating_network_id": { "Ref" : "ExtNetUuid" }
>         }
>       },
>
>       "floating_ip_Client2": {
>         "Type": "OS::Quantum::FloatingIP",
>         "Properties": {
>           "floating_network_id": { "Ref" : "ExtNetUuid" }
>         }
>       },
>
>       "floating_ip_assoc_DNSserver": {
>         "Type": "OS::Quantum::FloatingIPAssociation",
>         "Properties": {
>           "floatingip_id": { "Ref" : "floating_ip_DNSserver" },
>           "port_id": { "Ref" : "DNSServerPort" }
>         }
>       },
>
>       "floating_ip_assoc_Client1": {
>         "Type": "OS::Quantum::FloatingIPAssociation",
>         "Properties": {
>           "floatingip_id": { "Ref" : "floating_ip_Client1" },
>           "port_id": { "Ref" : "Client1Port" }
>         }
>       },
>
>       "floating_ip_assoc_Client2": {
>         "Type": "OS::Quantum::FloatingIPAssociation",
>         "Properties": {
>           "floatingip_id": { "Ref" : "floating_ip_Client2" },
>           "port_id": { "Ref" : "Client2Port" }
>         }
>       }
>     },
>
>     "Outputs" : {
>     }
>   }
>
>   Does the order of resources in the template matter, meaning would
>   changing the order have impact on resource creation?
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/heat/+bug/1176661/+subscriptions
>