Bootstrapping azure causes memory to fill

Bug #1250007 reported by Dan Chapman 
18
This bug affects 2 people
Affects Status Importance Assigned to Milestone
juju-core
Fix Released
High
Andrew Wilkins
juju-core (Ubuntu)
Fix Released
High
Unassigned

Bug Description

When running 'juju bootstrap -e azure' my memory is completely filling up (16GB +8GB swap) within about 1-2 minutes, leaving me with an unusable system. I have also tried using the package in the ppa which I experienced the same issue.

Distributor ID: Ubuntu
Description: Ubuntu 13.10
Release: 13.10
Codename: saucy

juju-core:
  Installed: 1.16.0-0ubuntu1
  Candidate: 1.16.0-0ubuntu1
  Version table:
 *** 1.16.0-0ubuntu1 0
        500 http://gb.archive.ubuntu.com/ubuntu/ saucy/universe amd64 Packages
        500 http://archive.ubuntu.com/ubuntu/ saucy/universe amd64 Packages
        100 /var/lib/dpkg/status

Is there any specific logs you need with this bug report?? If so i will get those to you asap.

ProblemType: Bug
DistroRelease: Ubuntu 13.10
Package: juju 1.16.0-0ubuntu1
ProcVersionSignature: Ubuntu 3.11.0-13.20-generic 3.11.6
Uname: Linux 3.11.0-13-generic x86_64
ApportVersion: 2.12.5-0ubuntu2.1
Architecture: amd64
Date: Mon Nov 11 09:28:09 2013
Dependencies:
 gcc-4.8-base 4.8.1-10ubuntu8
 juju-core 1.16.0-0ubuntu1
 libc6 2.17-93ubuntu4
 libgcc1 1:4.8.1-10ubuntu8
 multiarch-support 2.17-93ubuntu4
InstallationDate: Installed on 2013-10-28 (13 days ago)
InstallationMedia: Ubuntu 13.04 "Raring Ringtail" - Release amd64 (20130424)
MarkForUpload: True
PackageArchitecture: all
SourcePackage: juju-core
UpgradeStatus: Upgraded to saucy on 2013-11-10 (0 days ago)

FIX:
The problem is caused by using the *.cer. Azure wants the *.pem file. The azure documentation from MS is vague. Users of the SDKs also make this mistake.

The juju azure-provider could check if the file is a pem and raise an error early.

Revision history for this message
Dan Chapman  (dpniel) wrote :
Revision history for this message
Curtis Hovey (sinzui) wrote :

We have never seen this in automated or manual testing, both of which use machines with 2-4Gs of memory. Does this happen with 1.16.5?

Changed in juju-core:
status: New → Incomplete
Revision history for this message
Dave Cheney (dave-cheney) wrote : Re: [Bug 1250007] Re: Bootstrapping azure causes memory to fill

I'm very certain this will be a bug in printing an error message who's
string (Error()) routine calls itself, recursively.

So it only happens during an error, and make things infinitely worse

@jamespage, if you can reproduce the issue, can you hit the process with a
SIGQUIT and post whatever output you can, the stack trace will point to the
offending code.

On Fri, Dec 13, 2013 at 5:27 AM, Curtis Hovey <email address hidden> wrote:

> We have never seen this in automated or manual testing, both of which
> use machines with 2-4Gs of memory. Does this happen with 1.16.5?
>
> ** Changed in: juju-core
> Status: New => Incomplete
>
> --
> You received this bug notification because you are subscribed to juju-
> core.
> Matching subscriptions: MOAR JUJU SPAM!
> https://bugs.launchpad.net/bugs/1250007
>
> Title:
> Bootstrapping azure causes memory to fill
>
> Status in juju-core:
> Incomplete
> Status in “juju-core” package in Ubuntu:
> New
>
> Bug description:
> When running 'juju bootstrap -e azure' my memory is completely filling
> up (16GB +8GB swap) within about 1-2 minutes, leaving me with an
> unusable system. I have also tried using the package in the ppa which
> I experienced the same issue.
>
> Distributor ID: Ubuntu
> Description: Ubuntu 13.10
> Release: 13.10
> Codename: saucy
>
> juju-core:
> Installed: 1.16.0-0ubuntu1
> Candidate: 1.16.0-0ubuntu1
> Version table:
> *** 1.16.0-0ubuntu1 0
> 500 http://gb.archive.ubuntu.com/ubuntu/ saucy/universe amd64
> Packages
> 500 http://archive.ubuntu.com/ubuntu/ saucy/universe amd64
> Packages
> 100 /var/lib/dpkg/status
>
> Is there any specific logs you need with this bug report?? If so i
> will get those to you asap.
>
> ProblemType: Bug
> DistroRelease: Ubuntu 13.10
> Package: juju 1.16.0-0ubuntu1
> ProcVersionSignature: Ubuntu 3.11.0-13.20-generic 3.11.6
> Uname: Linux 3.11.0-13-generic x86_64
> ApportVersion: 2.12.5-0ubuntu2.1
> Architecture: amd64
> Date: Mon Nov 11 09:28:09 2013
> Dependencies:
> gcc-4.8-base 4.8.1-10ubuntu8
> juju-core 1.16.0-0ubuntu1
> libc6 2.17-93ubuntu4
> libgcc1 1:4.8.1-10ubuntu8
> multiarch-support 2.17-93ubuntu4
> InstallationDate: Installed on 2013-10-28 (13 days ago)
> InstallationMedia: Ubuntu 13.04 "Raring Ringtail" - Release amd64
> (20130424)
> MarkForUpload: True
> PackageArchitecture: all
> SourcePackage: juju-core
> UpgradeStatus: Upgraded to saucy on 2013-11-10 (0 days ago)
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/juju-core/+bug/1250007/+subscriptions
>

Revision history for this message
Francesco Banconi (frankban) wrote :

Had the same issue and a debugging session demonstrated that the problem occurs while marshalling the environInfo management-certificate setting. It ended up I was using the wrong path to the certificate (management-certificate-path pointed to the cer file rather than the pem file).
I'd suggest to clarify that in the documentation, which seems at least ambiguous: https://juju.ubuntu.com/docs/config-azure.html
IMHO we should also improve unexpected values serialization in juju.

Curtis Hovey (sinzui)
Changed in juju-core:
status: Incomplete → Triaged
importance: Undecided → High
milestone: none → 1.17.1
Martin Packman (gz)
Changed in juju-core:
milestone: 1.17.1 → 1.18.0
James Page (james-page)
Changed in juju-core (Ubuntu):
importance: Undecided → High
Changed in juju-core:
milestone: 1.20.0 → next-stable
Curtis Hovey (sinzui)
tags: added: azure-provider
Revision history for this message
Launchpad Janitor (janitor) wrote :

Status changed to 'Confirmed' because the bug affects multiple users.

Changed in juju-core (Ubuntu):
status: New → Confirmed
Curtis Hovey (sinzui)
description: updated
Andrew Wilkins (axwalk)
Changed in juju-core:
status: Triaged → In Progress
assignee: nobody → Andrew Wilkins (axwalk)
Andrew Wilkins (axwalk)
Changed in juju-core:
status: In Progress → Fix Committed
milestone: next-stable → 1.19.4
Curtis Hovey (sinzui)
Changed in juju-core:
status: Fix Committed → Fix Released
Curtis Hovey (sinzui)
Changed in juju-core (Ubuntu):
status: Confirmed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.