Rackspace no longer works with Juju

Bug #1578906 reported by Curtis Hovey
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
juju-ci-tools
Fix Released
High
Martin Packman
juju-core
Invalid
Critical
Eric Snow

Bug Description

Rackspace cloud has changed. No version of juju can bootstrap. Juju or Rackspace needs to change to allow users to bootstrap.
As seen in
    http://reports.vapour.ws/releases/issue/56eaba9f749a56698ae41fa2

The devel jujus cannot bootstrap. Juju CI's cloud health checks that use a stable (ish) juju shows that even a reliable juju cannot bootstrap. The last successful bootstrap was at 05-May-2016 08:46:25 UTC.

the error is consistently like this
    index file has no data for cloud {DFW https://identity.api.rackspacecloud.com/v2.0} not found

Curtis Hovey (sinzui)
Changed in juju-core:
status: New → Triaged
importance: Undecided → Critical
milestone: none → 2.0-beta7
tags: added: blocker ci rackspace-provider regression
description: updated
description: updated
Changed in juju-release-tools:
status: New → Triaged
importance: Undecided → Critical
Revision history for this message
Anastasia (anastasia-macmood) wrote :

The most recent change in the area was to do with region name cases.

@Curtis - could we bootstrap rackspace with these changes? If yes, have rackspace images changed lately?

Revision history for this message
Curtis Hovey (sinzui) wrote :

@Anastasia Since NO version of juju can bootstrap going all the way back 1.26-alpha1 and the cloud health checks use an older Juju. I am sure Juju has not changed anything. Streams may have changed, or the cloud has changed.

Revision history for this message
Curtis Hovey (sinzui) wrote :

Sourcing the rackspace OpenStack creds, I can run 'nova' to boot an image using the same account and keys used by cloud health checks and revision tests.

Changed in juju-core:
assignee: nobody → Eric Snow (ericsnowcurrently)
status: Triaged → In Progress
Martin Packman (gz)
no longer affects: juju-ci-tools
no longer affects: juju-release-tools
Changed in juju-ci-tools:
assignee: nobody → Martin Packman (gz)
importance: Undecided → High
status: New → In Progress
Revision history for this message
Eric Snow (ericsnowcurrently) wrote :

Per Martin, this is not an issue in core.

Changed in juju-core:
status: In Progress → Invalid
Revision history for this message
Cheryl Jennings (cherylj) wrote :

I was able to bootstrap yesterday in DFW with the following config:

image-metadata-url: http://0315ec36e423bb7dba4b-3eabf88619cf7b7e6fc262bcf48df10b.r19.cf1.rackcdn.com/images
image-stream: "released"

Revision history for this message
Curtis Hovey (sinzui) wrote :

This issue is resolved, but I am concerned this issue can happen again.

1. Canonical, and specifically CPC does not provide official Ubuntu images to rackspace. You wont find rackspace in image streams at cloud-images.ubuntu.com.

2. Martin generated streams to test the the rackspace provder works. These streams have become the defacto official streams. see
   https://jujucharms.com/docs/master/help-rackspace

3. Both CPC and Juju QA share the account to test in rackspace. The rackspace streams are just files in swift under the shared account.

4. There was a cleanup of resources in that account a just prior to the outage. Someone not realising the swift container serves images streams deleted it.

The images streams were republished. It took just a few minutes.

Until CPC provides official images and streams, we need to safeguard the streams in the shared account.

1. The cloud health check was successful in identifying the issue. Now that we understand it, it is easy to take immediate action to republish streams to the swift container.

2. We cannot lock the container. So the CPC and juju QA team need to know NEVER delete juju-ci-image-streams container or its objects.

Curtis Hovey (sinzui)
Changed in juju-ci-tools:
status: In Progress → Fix Released
Curtis Hovey (sinzui)
Changed in juju-core:
milestone: 2.0-beta7 → none
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.