| 2012-04-05 19:55:26 |
Gary Poster |
bug |
|
|
added bug |
| 2012-04-11 20:28:10 |
Gary Poster |
launchpad: status |
Triaged |
Invalid |
|
| 2012-04-11 20:28:44 |
Gary Poster |
bug task added |
|
lxc (Ubuntu) |
|
| 2012-04-11 20:29:27 |
Gary Poster |
summary |
celery tests fail on parallel testing instances |
Semaphores cannot be created in lxc container |
|
| 2012-04-11 20:31:16 |
Gary Poster |
description |
The same three tests failed consistently over several runs:
======================================================================
FAIL: lp.code.model.tests.test_branch.TestBranchJobViaCelery.test_destroySelf_via_celery
----------------------------------------------------------------------
Traceback (most recent call last):
_StringException: librarian-log: {{{
2012-04-05 19:56:24+0530 [-] Log opened.
2012-04-05 19:56:24+0530 [-] twistd 11.1.0 (/usr/bin/python2.6 2.6.5) starting up.
2012-04-05 19:56:24+0530 [-] reactor class: twisted.internet.pollreactor.PollReactor.
2012-04-05 19:56:24+0530 [-] FileUploadFactory starting on 58125
2012-04-05 19:56:24+0530 [-] Starting factory <lp.services.librarianserver.libraryprotocol.FileUploadFactory instance at 0xa2e90ec>
2012-04-05 19:56:24+0530 [-] Site starting on 51003
2012-04-05 19:56:24+0530 [-] Starting factory <twisted.web.server.Site instance at 0xa2e94ac>
2012-04-05 19:56:24+0530 [-] FileUploadFactory starting on 51219
2012-04-05 19:56:24+0530 [-] Starting factory <lp.services.librarianserver.libraryprotocol.FileUploadFactory instance at 0xa2e978c>
2012-04-05 19:56:24+0530 [-] Site starting on 35098
2012-04-05 19:56:24+0530 [-] Starting factory <twisted.web.server.Site instance at 0xa2e96ac>
2012-04-05 19:56:24+0530 [-] Not using upstream librarian
2012-04-05 19:56:24+0530 [-] daemon ready!
}}}
Traceback (most recent call last):
File "/var/lib/buildbot/slaves/slave/lucid-devel/build/lib/lp/code/model/tests/test_branch.py", line 364, in test_destroySelf_via_celery
self.assertThat(branch_path, Not(PathExists()))
MismatchError: '/var/tmp/bazaar.launchpad.dev/mirrors/00/00/00/4d' matches MatchesPredicate(<function exists at 0xf73b5df4>, '%s does not exist.')
======================================================================
ERROR: lp.code.model.tests.test_branch.TestBranchUpgrade.test_requestUpgradeUsesCelery
----------------------------------------------------------------------
Traceback (most recent call last):
_StringException: librarian-log: {{{
2012-04-05 19:55:15+0530 [-] Log opened.
2012-04-05 19:55:15+0530 [-] twistd 11.1.0 (/usr/bin/python2.6 2.6.5) starting up.
2012-04-05 19:55:15+0530 [-] reactor class: twisted.internet.pollreactor.PollReactor.
2012-04-05 19:55:15+0530 [-] FileUploadFactory starting on 39820
2012-04-05 19:55:15+0530 [-] Starting factory <lp.services.librarianserver.libraryprotocol.FileUploadFactory instance at 0xa6d10ec>
2012-04-05 19:55:15+0530 [-] Site starting on 53904
2012-04-05 19:55:15+0530 [-] Starting factory <twisted.web.server.Site instance at 0xa6d14ac>
2012-04-05 19:55:15+0530 [-] FileUploadFactory starting on 51169
2012-04-05 19:55:15+0530 [-] Starting factory <lp.services.librarianserver.libraryprotocol.FileUploadFactory instance at 0xa6d178c>
2012-04-05 19:55:15+0530 [-] Site starting on 52093
2012-04-05 19:55:15+0530 [-] Starting factory <twisted.web.server.Site instance at 0xa6d16ac>
2012-04-05 19:55:15+0530 [-] Not using upstream librarian
2012-04-05 19:55:15+0530 [-] daemon ready!
}}}
Traceback (most recent call last):
File "/var/lib/buildbot/slaves/slave/lucid-devel/build/lib/lp/code/model/tests/test_branch.py", line 833, in test_requestUpgradeUsesCelery
responses[-1].wait(30)
File "/var/lib/buildbot/dependencies/eggs/celery-2.5.1-py2.6.egg/celery/result.py", line 95, in get
interval=interval)
File "/var/lib/buildbot/dependencies/eggs/celery-2.5.1-py2.6.egg/celery/backends/amqp.py", line 137, in wait_for
raise TimeoutError("The operation timed out.")
TimeoutError: The operation timed out.
======================================================================
FAIL: lp.code.model.tests.test_branch.TestBranchJobViaCelery.test_branchChanged_via_celery
----------------------------------------------------------------------
Traceback (most recent call last):
_StringException: librarian-log: {{{
2012-04-05 19:55:15+0530 [-] Log opened.
2012-04-05 19:55:15+0530 [-] twistd 11.1.0 (/usr/bin/python2.6 2.6.5) starting up.
2012-04-05 19:55:15+0530 [-] reactor class: twisted.internet.pollreactor.PollReactor.
2012-04-05 19:55:15+0530 [-] FileUploadFactory starting on 39820
2012-04-05 19:55:15+0530 [-] Starting factory <lp.services.librarianserver.libraryprotocol.FileUploadFactory instance at 0xa6d10ec>
2012-04-05 19:55:15+0530 [-] Site starting on 53904
2012-04-05 19:55:15+0530 [-] Starting factory <twisted.web.server.Site instance at 0xa6d14ac>
2012-04-05 19:55:15+0530 [-] FileUploadFactory starting on 51169
2012-04-05 19:55:15+0530 [-] Starting factory <lp.services.librarianserver.libraryprotocol.FileUploadFactory instance at 0xa6d178c>
2012-04-05 19:55:15+0530 [-] Site starting on 52093
2012-04-05 19:55:15+0530 [-] Starting factory <twisted.web.server.Site instance at 0xa6d16ac>
2012-04-05 19:55:15+0530 [-] Not using upstream librarian
2012-04-05 19:55:15+0530 [-] daemon ready!
}}}
Traceback (most recent call last):
File "/var/lib/buildbot/slaves/slave/lucid-devel/build/lib/lp/code/model/tests/test_branch.py", line 333, in test_branchChanged_via_celery
'Updating branch scanner status: 1 revs', proc.stderr.read())
MismatchError: 'Updating branch scanner status: 1 revs' not in '/var/lib/buildbot/dependencies/eggs/ampoule-0.2.0-py2.6.egg/ampoule/main.py:4: DeprecationWarning: the sets module is deprecated\n import sets\n[2012-04-05 19:56:01,602: WARNING/MainProcess] -------------- celery@lptests-temp-7AmBFVK v2.5.1\n---- **** -----\n--- * *** * -- [Configuration]\n-- * - **** --- . broker: amqp://guest@localhost:60868//\n- ** ---------- . loader: celery.loaders.default.Loader\n- ** ---------- . logfile: [stderr]@INFO\n- ** ---------- . concurrency: 1\n- ** ---------- . events: OFF\n- *** --- * --- . beat: OFF\n-- ******* ----\n--- ***** ----- [Queues]\n -------------- . standard: exchange:standard (direct) binding:standard\n \n\n[Tasks]\n . lp.services.job.celeryjob.CeleryRunJob\n[2012-04-05 19:56:01,742: ERROR/MainProcess] Unrecoverable error: OSError(13, \'Permission denied\')\nTraceback (most recent call last):\n File "/var/lib/buildbot/dependencies/eggs/celery-2.5.1-py2.6.egg/celery/worker/__init__.py", line 230, in start\n component.start()\n File "/var/lib/buildbot/dependencies/eggs/celery-2.5.1-py2.6.egg/celery/concurrency/base.py", line 83, in start\n self.on_start()\n File "/var/lib/buildbot/dependencies/eggs/celery-2.5.1-py2.6.egg/celery/concurrency/processes/__init__.py", line 67, in on_start\n **self.options)\n File "/var/lib/buildbot/dependencies/eggs/celery-2.5.1-py2.6.egg/celery/concurrency/processes/pool.py", line 537, in __init__\n self._setup_queues()\n File "/var/lib/buildbot/dependencies/eggs/celery-2.5.1-py2.6.egg/celery/concurrency/processes/pool.py", line 720, in _setup_queues\n self._inqueue = SimpleQueue()\n File "/usr/lib/python2.6/multiprocessing/queues.py", line 328, in __init__\n self._rlock = Lock()\n File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 117, in __init__\n SemLock.__init__(self, SEMAPHORE, 1, 1)\n File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 49, in __init__\n sl = self._semlock = _multiprocessing.SemLock(kind, value, maxvalue)\nOSError: [Errno 13] Permission denied\n[2012-04-05 19:56:01,744: INFO/MainProcess] process shutting down\n' |
>>> from multiprocessing import synchronize
>>> synchronize.Lock()
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 117, in __init__
SemLock.__init__(self, SEMAPHORE, 1, 1)
File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 49, in __init__
sl = self._semlock = _multiprocessing.SemLock(kind, value, maxvalue)
OSError: [Errno 38] Function not implemented
Thanks to hallyn, there's a workaround and a fix: adding this line to the container's fstab will fix the problem:
none dev/shm tmpfs defaults 0 0
He is updating the ubuntu template with this change.
Original bug report description was Launchpad related (celery tests fail on parallel testing instances) |
|
| 2012-04-12 11:18:09 |
James Page |
lxc (Ubuntu): importance |
Undecided |
High |
|
| 2012-04-12 11:18:31 |
James Page |
lxc (Ubuntu): assignee |
|
Serge Hallyn (serge-hallyn) |
|
| 2012-04-12 11:18:35 |
James Page |
lxc (Ubuntu): milestone |
|
ubuntu-12.04 |
|
| 2012-04-12 11:18:57 |
James Page |
bug |
|
|
added subscriber Ubuntu Server Release Tracking |
| 2012-04-12 11:19:00 |
James Page |
lxc (Ubuntu): status |
New |
Confirmed |
|
| 2012-04-12 15:54:13 |
Serge Hallyn |
bug task added |
|
sysvinit (Ubuntu) |
|
| 2012-04-12 15:54:25 |
Serge Hallyn |
sysvinit (Ubuntu): status |
New |
Confirmed |
|
| 2012-04-12 16:50:44 |
Launchpad Janitor |
lxc (Ubuntu): status |
Confirmed |
Fix Released |
|
| 2012-04-12 17:13:20 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/lxc |
|
| 2012-04-17 16:23:34 |
Ursula Junque |
sysvinit (Ubuntu): importance |
Undecided |
High |
|
| 2012-05-18 21:30:41 |
Serge Hallyn |
attachment added |
|
sysvinit-shm.debdiff https://bugs.launchpad.net/launchpad/+bug/974584/+attachment/3152926/+files/sysvinit-shm.debdiff |
|
| 2012-05-18 22:47:58 |
Steve Langasek |
nominated for series |
|
Ubuntu Precise |
|
| 2012-05-18 22:47:58 |
Steve Langasek |
bug task added |
|
sysvinit (Ubuntu Precise) |
|
| 2012-05-18 22:47:58 |
Steve Langasek |
bug task added |
|
lxc (Ubuntu Precise) |
|
| 2012-05-18 22:47:58 |
Steve Langasek |
nominated for series |
|
Ubuntu Quantal |
|
| 2012-05-18 22:47:58 |
Steve Langasek |
bug task added |
|
sysvinit (Ubuntu Quantal) |
|
| 2012-05-18 22:47:58 |
Steve Langasek |
bug task added |
|
lxc (Ubuntu Quantal) |
|
| 2012-05-18 22:48:42 |
Steve Langasek |
lxc (Ubuntu Precise): status |
New |
Fix Released |
|
| 2012-05-18 22:48:49 |
Steve Langasek |
sysvinit (Ubuntu Quantal): status |
Confirmed |
Triaged |
|
| 2012-05-18 22:48:53 |
Steve Langasek |
sysvinit (Ubuntu Precise): status |
New |
Triaged |
|
| 2012-05-18 22:48:56 |
Steve Langasek |
sysvinit (Ubuntu Precise): importance |
Undecided |
High |
|
| 2012-05-18 22:49:14 |
Steve Langasek |
sysvinit (Ubuntu Precise): milestone |
|
ubuntu-12.04.1 |
|
| 2012-05-19 00:16:17 |
Ubuntu Foundations Team Bug Bot |
tags |
paralleltest |
paralleltest patch |
|
| 2012-05-21 18:40:38 |
Serge Hallyn |
attachment added |
|
sysvinit-shm2.debdiff https://bugs.launchpad.net/launchpad/+bug/974584/+attachment/3156342/+files/sysvinit-shm2.debdiff |
|
| 2012-05-24 17:54:23 |
Serge Hallyn |
bug watch added |
|
http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=674178 |
|
| 2012-05-24 17:54:23 |
Serge Hallyn |
bug task added |
|
sysvinit (Debian) |
|
| 2012-05-24 18:54:08 |
Bug Watch Updater |
sysvinit (Debian): status |
Unknown |
New |
|
| 2012-05-30 18:09:40 |
Serge Hallyn |
attachment added |
|
sysvinit-shm3.debdiff https://bugs.launchpad.net/launchpad/+bug/974584/+attachment/3169450/+files/sysvinit-shm3.debdiff |
|
| 2012-06-19 16:09:53 |
James Page |
lxc (Ubuntu Quantal): milestone |
ubuntu-12.04 |
quantal-alpha-2 |
|
| 2012-06-22 04:22:56 |
Kate Stewart |
tags |
paralleltest patch |
paralleltest patch rls-q-incoming |
|
| 2012-06-26 20:24:15 |
Steve Langasek |
tags |
paralleltest patch rls-q-incoming |
paralleltest patch |
|
| 2012-06-26 20:24:39 |
Steve Langasek |
bug |
|
|
added subscriber Steve Langasek |
| 2012-06-28 04:09:45 |
Bug Watch Updater |
sysvinit (Debian): status |
New |
Fix Released |
|
| 2012-06-28 04:41:53 |
Launchpad Janitor |
branch linked |
|
lp:debian/sysvinit |
|
| 2012-07-12 21:45:15 |
Stéphane Graber |
sysvinit (Ubuntu Precise): assignee |
|
Canonical Foundations Team (canonical-foundations) |
|
| 2012-07-12 21:45:26 |
Stéphane Graber |
sysvinit (Ubuntu Quantal): assignee |
|
Canonical Foundations Team (canonical-foundations) |
|
| 2012-07-18 15:39:20 |
Stéphane Graber |
sysvinit (Ubuntu Quantal): assignee |
Canonical Foundations Team (canonical-foundations) |
Stéphane Graber (stgraber) |
|
| 2012-07-18 15:39:24 |
Stéphane Graber |
sysvinit (Ubuntu Precise): assignee |
Canonical Foundations Team (canonical-foundations) |
Stéphane Graber (stgraber) |
|
| 2012-07-20 22:15:32 |
Launchpad Janitor |
sysvinit (Ubuntu Quantal): status |
Triaged |
Fix Released |
|
| 2012-07-20 22:20:41 |
Stéphane Graber |
description |
>>> from multiprocessing import synchronize
>>> synchronize.Lock()
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 117, in __init__
SemLock.__init__(self, SEMAPHORE, 1, 1)
File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 49, in __init__
sl = self._semlock = _multiprocessing.SemLock(kind, value, maxvalue)
OSError: [Errno 38] Function not implemented
Thanks to hallyn, there's a workaround and a fix: adding this line to the container's fstab will fix the problem:
none dev/shm tmpfs defaults 0 0
He is updating the ubuntu template with this change.
Original bug report description was Launchpad related (celery tests fail on parallel testing instances) |
[rational]
Current initscripts doesn't deal properly with chroots, bind-mounting /run/shm to /dev/shm instead of making the later a symlink to the former.
LXC has been carrying a workaround for that, sadly the workaround stopped working late in the 12.04 cycle, meaning that an extra chunk of code had to be added to properly fix any broken container before applying the upgrade as any initscripts update would otherwise fail.
[test case]
Two things to test:
1) lxc-create -t ubuntu -n p1
2) Check that /dev/shm is a chroot to /run/shm in the container
1) Get an existing container
2) Update to -proposed
3) Check that /dev/shm is now a symlink to /run/shm
[regression potential]
There's a known risk for applications using shm during the upgrade as the entries will be moved to another file system. As long as all the processes accessing the file keep running, it should be fine, but it won't if another one is spawned as it will try reading it from the new location. A warning is displayed recommending a reboot.
The rest of the code was already tested with all known scenario and should be sufficiently guarded to only apply to the affected systems.
>>> from multiprocessing import synchronize
>>> synchronize.Lock()
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 117, in __init__
SemLock.__init__(self, SEMAPHORE, 1, 1)
File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 49, in __init__
sl = self._semlock = _multiprocessing.SemLock(kind, value, maxvalue)
OSError: [Errno 38] Function not implemented
Thanks to hallyn, there's a workaround and a fix: adding this line to the container's fstab will fix the problem:
none dev/shm tmpfs defaults 0 0
He is updating the ubuntu template with this change.
Original bug report description was Launchpad related (celery tests fail on parallel testing instances) |
|
| 2012-07-20 22:20:47 |
Stéphane Graber |
sysvinit (Ubuntu Precise): status |
Triaged |
In Progress |
|
| 2012-07-26 17:00:00 |
Stéphane Graber |
lxc (Ubuntu Precise): importance |
Undecided |
High |
|
| 2012-07-26 17:00:04 |
Stéphane Graber |
lxc (Ubuntu Precise): status |
Fix Released |
Triaged |
|
| 2012-07-26 17:00:08 |
Stéphane Graber |
lxc (Ubuntu Precise): assignee |
|
Stéphane Graber (stgraber) |
|
| 2012-07-26 17:00:13 |
Stéphane Graber |
lxc (Ubuntu Quantal): assignee |
Serge Hallyn (serge-hallyn) |
Stéphane Graber (stgraber) |
|
| 2012-07-26 17:00:15 |
Stéphane Graber |
lxc (Ubuntu Quantal): status |
Fix Released |
Triaged |
|
| 2012-07-26 17:00:20 |
Stéphane Graber |
lxc (Ubuntu Quantal): milestone |
quantal-alpha-2 |
|
|
| 2012-07-26 17:00:23 |
Stéphane Graber |
lxc (Ubuntu Precise): milestone |
|
ubuntu-12.04.1 |
|
| 2012-07-26 17:52:34 |
Stéphane Graber |
description |
[rational]
Current initscripts doesn't deal properly with chroots, bind-mounting /run/shm to /dev/shm instead of making the later a symlink to the former.
LXC has been carrying a workaround for that, sadly the workaround stopped working late in the 12.04 cycle, meaning that an extra chunk of code had to be added to properly fix any broken container before applying the upgrade as any initscripts update would otherwise fail.
[test case]
Two things to test:
1) lxc-create -t ubuntu -n p1
2) Check that /dev/shm is a chroot to /run/shm in the container
1) Get an existing container
2) Update to -proposed
3) Check that /dev/shm is now a symlink to /run/shm
[regression potential]
There's a known risk for applications using shm during the upgrade as the entries will be moved to another file system. As long as all the processes accessing the file keep running, it should be fine, but it won't if another one is spawned as it will try reading it from the new location. A warning is displayed recommending a reboot.
The rest of the code was already tested with all known scenario and should be sufficiently guarded to only apply to the affected systems.
>>> from multiprocessing import synchronize
>>> synchronize.Lock()
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 117, in __init__
SemLock.__init__(self, SEMAPHORE, 1, 1)
File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 49, in __init__
sl = self._semlock = _multiprocessing.SemLock(kind, value, maxvalue)
OSError: [Errno 38] Function not implemented
Thanks to hallyn, there's a workaround and a fix: adding this line to the container's fstab will fix the problem:
none dev/shm tmpfs defaults 0 0
He is updating the ubuntu template with this change.
Original bug report description was Launchpad related (celery tests fail on parallel testing instances) |
[rational]
Current initscripts doesn't deal properly with chroots, bind-mounting /run/shm to /dev/shm instead of making the later a symlink to the former.
LXC has been carrying a workaround for that, sadly the workaround stopped working late in the 12.04 cycle, meaning that an extra chunk of code had to be added to properly fix any broken container before applying the upgrade as any initscripts update would otherwise fail.
[test case]
Two things to test:
1) lxc-create -t ubuntu -n p1
2) Check that /dev/shm is a symlink to /run/shm in the container
1) Get an existing container
2) Update to -proposed
3) Check that /dev/shm is now a symlink to /run/shm
[regression potential]
There's a known risk for applications using shm during the upgrade as the entries will be moved to another file system. As long as all the processes accessing the file keep running, it should be fine, but it won't if another one is spawned as it will try reading it from the new location. A warning is displayed recommending a reboot.
The rest of the code was already tested with all known scenario and should be sufficiently guarded to only apply to the affected systems.
>>> from multiprocessing import synchronize
>>> synchronize.Lock()
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 117, in __init__
SemLock.__init__(self, SEMAPHORE, 1, 1)
File "/usr/lib/python2.6/multiprocessing/synchronize.py", line 49, in __init__
sl = self._semlock = _multiprocessing.SemLock(kind, value, maxvalue)
OSError: [Errno 38] Function not implemented
Thanks to hallyn, there's a workaround and a fix: adding this line to the container's fstab will fix the problem:
none dev/shm tmpfs defaults 0 0
He is updating the ubuntu template with this change.
Original bug report description was Launchpad related (celery tests fail on parallel testing instances) |
|
| 2012-07-26 18:22:09 |
Brian Murray |
sysvinit (Ubuntu Precise): status |
In Progress |
Fix Committed |
|
| 2012-07-26 18:22:14 |
Brian Murray |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2012-07-26 18:22:17 |
Brian Murray |
bug |
|
|
added subscriber SRU Verification |
| 2012-07-26 18:22:20 |
Brian Murray |
tags |
paralleltest patch |
paralleltest patch verification-needed |
|
| 2012-07-26 18:22:48 |
Brian Murray |
lxc (Ubuntu Precise): status |
Triaged |
Fix Committed |
|
| 2012-07-26 18:44:10 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/precise-proposed/lxc |
|
| 2012-07-26 18:55:39 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/precise-proposed/sysvinit |
|
| 2012-07-26 23:35:13 |
Launchpad Janitor |
lxc (Ubuntu Quantal): status |
Triaged |
Fix Released |
|
| 2012-07-27 14:54:05 |
Stéphane Graber |
tags |
paralleltest patch verification-needed |
paralleltest patch verification-done |
|
| 2012-08-02 21:29:15 |
Brian Murray |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
| 2012-08-02 21:32:10 |
Launchpad Janitor |
lxc (Ubuntu Precise): status |
Fix Committed |
Fix Released |
|
| 2012-08-02 21:32:19 |
Launchpad Janitor |
sysvinit (Ubuntu Precise): status |
Fix Committed |
Fix Released |
|
