| 2010-04-16 23:31:11 |
C de-Avillez |
bug |
|
|
added bug |
| 2010-04-16 23:31:11 |
C de-Avillez |
attachment added |
|
Dependencies.txt http://launchpadlibrarian.net/44492702/Dependencies.txt |
|
| 2010-04-16 23:31:11 |
C de-Avillez |
attachment added |
|
EucalyptusCloudDebugLog.gz http://launchpadlibrarian.net/44492703/EucalyptusCloudDebugLog.gz |
|
| 2010-04-16 23:31:11 |
C de-Avillez |
attachment added |
|
EucalyptusCloudOutputLog.gz http://launchpadlibrarian.net/44492704/EucalyptusCloudOutputLog.gz |
|
| 2010-04-16 23:31:11 |
C de-Avillez |
attachment added |
|
EucalyptusInstalledVersions.txt http://launchpadlibrarian.net/44492705/EucalyptusInstalledVersions.txt |
|
| 2010-04-16 23:31:11 |
C de-Avillez |
attachment added |
|
eucalyptus.conf.txt http://launchpadlibrarian.net/44492706/eucalyptus.conf.txt |
|
| 2010-04-16 23:31:11 |
C de-Avillez |
attachment added |
|
eucalyptus.local.conf.txt http://launchpadlibrarian.net/44492707/eucalyptus.local.conf.txt |
|
| 2010-04-20 17:01:48 |
Dustin Kirkland |
eucalyptus (Ubuntu): status |
New |
In Progress |
|
| 2010-04-20 17:01:56 |
Dustin Kirkland |
eucalyptus (Ubuntu): importance |
Undecided |
High |
|
| 2010-04-20 17:02:11 |
Dustin Kirkland |
eucalyptus (Ubuntu): milestone |
|
ubuntu-10.04 |
|
| 2010-04-20 17:02:41 |
Dustin Kirkland |
eucalyptus (Ubuntu): assignee |
|
Dustin Kirkland (kirkland) |
|
| 2010-04-20 17:03:49 |
Dustin Kirkland |
nominated for series |
|
Ubuntu Lucid |
|
| 2010-04-20 17:03:49 |
Dustin Kirkland |
bug task added |
|
eucalyptus (Ubuntu Lucid) |
|
| 2010-04-20 19:16:09 |
C de-Avillez |
attachment added |
|
CLC logs http://launchpadlibrarian.net/44916919/clc-logs.tar.gz |
|
| 2010-04-20 19:28:44 |
Dustin Kirkland |
bug task added |
|
eucalyptus |
|
| 2010-04-21 03:01:47 |
Dustin Kirkland |
eucalyptus (Ubuntu Lucid): milestone |
ubuntu-10.04 |
lucid-updates |
|
| 2010-04-23 01:20:46 |
Launchpad Janitor |
branch linked |
|
lp:~ubuntu-core-dev/eucalyptus/ubuntu |
|
| 2010-04-24 19:10:47 |
Neil Soman |
eucalyptus: importance |
Undecided |
High |
|
| 2010-04-24 19:10:54 |
Neil Soman |
eucalyptus: status |
New |
Fix Committed |
|
| 2010-04-28 13:54:26 |
Dustin Kirkland |
description |
stress-testing, 400 instances to be started in total. After a while the walrus starts reporting out-of-memory, and all new instances fail.
Ubuntu-server 2010-04-16, UEC 2010-04-16.
ProblemType: Bug
DistroRelease: Ubuntu 10.04
Package: eucalyptus-walrus 1.6.2-0ubuntu30
ProcVersionSignature: Ubuntu 2.6.32-21.31-server 2.6.32.11+drm33.2
Uname: Linux 2.6.32-21-server x86_64
Architecture: amd64
Date: Fri Apr 16 19:18:49 2010
ProcEnviron:
LANG=en_US.UTF-8
SHELL=/bin/bash
SourcePackage: eucalyptus |
stress-testing, 400 instances to be started in total. After a while the walrus starts reporting out-of-memory, and all new instances fail.
Ubuntu-server 2010-04-16, UEC 2010-04-16.
ProblemType: Bug
DistroRelease: Ubuntu 10.04
Package: eucalyptus-walrus 1.6.2-0ubuntu30
ProcVersionSignature: Ubuntu 2.6.32-21.31-server 2.6.32.11+drm33.2
Uname: Linux 2.6.32-21-server x86_64
Architecture: amd64
Date: Fri Apr 16 19:18:49 2010
ProcEnviron:
LANG=en_US.UTF-8
SHELL=/bin/bash
SourcePackage: eucalyptus
========
IMPACT:
* This bug affects UEC installs, with the CLC and Walrus on separate machines. After running a few hundred (or thousands) of instances, the Walrus will eventually run out of memory.
ADDRESSED:
* The bug is addressed in two ways. First, a configuration parameter has been added to /etc/eucalyptus/eucalyptus.conf, JVM_MEM, defaulting to 512M. Admins can tailor this value to the needs of their cloud (more memory mean more instances in a shorter period of time, before the garbage collector has to run). Secondly, we have cherry picked several commits from the upstream stable source branch that address various memory leaks in the Walrus Java code. Both of these are necessary to fully address the problem.
PATCH:
* The patch isn't very minimal. Sorry. But it's what's required to solve the problem. And it's already in the upstream stable branch.
REPRODUCE:
* Reproducing this bug is not easy. We most frequently see this happen when the CLC and Walrus are not co-located on the same machine. And then we run several thousand instances. Eventually, Walrus falls over with OOM.
REGRESSION POTENTIAL:
* There's certainly regression potential in the Walrus itself, as that's the code that's changed. However, we have put this code through a very heavy barrage of scalability testing (which also exercises many of the base features). We believe that we have proactively tested this code thoroughly.
======== |
|
| 2010-04-28 13:56:07 |
Dustin Kirkland |
summary |
walrus reports java.lang.OutOfMemoryError: Java heap space |
[scalability] walrus reports java.lang.OutOfMemoryError: Java heap space |
|
| 2010-04-28 14:01:53 |
Dustin Kirkland |
summary |
[scalability] walrus reports java.lang.OutOfMemoryError: Java heap space |
[SRU] [scalability] walrus reports java.lang.OutOfMemoryError: Java heap space |
|
| 2010-04-29 06:30:37 |
Martin Pitt |
eucalyptus (Ubuntu Lucid): status |
In Progress |
Fix Committed |
|
| 2010-04-29 06:30:51 |
Martin Pitt |
tags |
amd64 apport-bug lucid |
amd64 apport-bug lucid verification-needed |
|
| 2010-04-29 07:36:13 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/lucid-proposed/eucalyptus |
|
| 2010-04-30 13:25:41 |
Martin Pitt |
tags |
amd64 apport-bug lucid verification-needed |
amd64 apport-bug lucid verification-done |
|
| 2010-05-03 07:53:10 |
Martin Pitt |
eucalyptus (Ubuntu): status |
Fix Committed |
Fix Released |
|
| 2010-05-03 07:57:31 |
Launchpad Janitor |
eucalyptus (Ubuntu Lucid): status |
Fix Committed |
Fix Released |
|
| 2010-05-03 07:59:49 |
Martin Pitt |
eucalyptus (Ubuntu Lucid): status |
Fix Released |
Fix Committed |
|
| 2010-06-15 07:32:09 |
Launchpad Janitor |
eucalyptus (Ubuntu Lucid): status |
Fix Committed |
Fix Released |
|
| 2011-10-28 19:14:24 |
graziano obertelli |
eucalyptus: status |
Fix Committed |
Fix Released |
|
