running update-clouds breaks bootstrapping on aws

[Richard Harding]

With RC3, I can bootstrap to AWS just fine. However, after I run update-clouds it breaks.

$ juju bootstrap hadoop aws
ERROR Get https://us-east-1.aws.amazon.com/v1.2/?Action=DescribeAccountAttributes&Timestamp=2016-10-07T14%3A16%3A16Z&Version=2014-10-01: dial tcp: lookup us-east-1.aws.amazon.com on 127.0.1.1:53: no such host

The AWS regions are noted as changed:

    changed cloud region:
        - aws-china/cn-north-1
        - aws-gov/us-gov-west-1
        - aws/ap-northeast-1
        - aws/ap-northeast-2
        - aws/ap-southeast-1
        - aws/ap-southeast-2
        - aws/eu-central-1
        - aws/eu-west-1
        - aws/sa-east-1
        - aws/us-east-1
        - aws/us-west-1
        - aws/us-west-2

The urls are incorrect in $HOME/.local/share/juju/public-clouds.yaml

[Richard Harding (rharding)]

Removing the bad file for now will unblock using AWS while we correct the file and publish an updated version with the correct urls.

$HOME/.local/share/juju/public-clouds.yaml

[Martin Packman (gz)]

So, the public clouds stuff is all managed through cpc's jerff machine, which is trusted with the signing keys, and drived my our code and jenkins jobs:

lp:update-juju-streams
http://juju-ci.vapour.ws/job/cloud-update-scc

(Remember to log in to see all the non-public jenkins jobs)

The master copy is apparently the one in cloud-city, "very closely based on fallback-public-clouds.yaml from juju itself", so we want to update those two files then re-run the job to fix the copy in streams.canonical.com.

[Aaron Bentley (abentley)]

fallback-public-clouds.yaml was already updated:
https://github.com/juju/juju/commit/2fc121e4058eb6bdd1afe79108f7a139e477d912

That's why deleting the local copy of public-clouds solves the problem.

I only received Andrew's request to update public-clouds today. I am doing that.

I was wrong when I told Martin the authoritative copy is in cloud-city. It's actually: lp:~canonical-juju-qa/+junk/clouds-unsigned

[Aaron Bentley (abentley)]

I have updated http://streams.canonical.com/juju/public-clouds.syaml using the data from fallback-public-cloud.yaml

[Alexis Bruemmer (alexis-bruemmer)]

verified that rc1 successful updates and runs "list-clouds" with the latest proposed public-clouds.syaml; here are the results from the test run:

 juju update-clouds
Fetching latest public cloud list...
Updated your list of public clouds with 1 cloud region added as well as 3 cloud attributes and 12 cloud regions changed:

    added cloud region:
        - aws/ap-south-1
    changed cloud attribute:
        - azure
        - azure-china
        - rackspace
    changed cloud region:
        - aws-china/cn-north-1
        - aws-gov/us-gov-west-1
        - aws/ap-northeast-1
        - aws/ap-northeast-2
        - aws/ap-southeast-1
        - aws/ap-southeast-2
        - aws/eu-central-1
        - aws/eu-west-1
        - aws/sa-east-1
        - aws/us-east-1
        - aws/us-west-1
        - aws/us-west-2

juju list-clouds
CLOUD TYPE REGIONS
aws ec2 us-east-1, us-west-1, us-west-2, eu-west-1, eu-central-1, ap-south-1, ap-southeast-1 ...
aws-china ec2 cn-north-1
aws-gov ec2 us-gov-west-1
azure azure centralus, eastus, eastus2, northcentralus, southcentralus, westus, northeurope ...
azure-china azure chinaeast, chinanorth
cloudsigma cloudsigma hnl, mia, sjc, wdc, zrh
google gce us-east1, us-central1, europe-west1, asia-east1
joyent joyent eu-ams-1, us-sw-1, us-east-1, us-east-2, us-east-3, us-west-1
rackspace rackspace dfw, ord, iad, lon, syd, hkg
localhost lxd localhost
hmaas maas