| 2016-10-19 17:42:49 |
bugproxy |
bug |
|
|
added bug |
| 2016-10-19 17:42:51 |
bugproxy |
tags |
|
architecture-ppc64le bugnameltc-147708 severity-medium targetmilestone-inin1610 |
|
| 2016-10-19 17:42:53 |
bugproxy |
ubuntu: assignee |
|
Taco Screen team (taco-screen-team) |
|
| 2016-10-19 17:43:02 |
bugproxy |
affects |
ubuntu |
rabbitmq-server (Ubuntu) |
|
| 2016-11-01 17:04:16 |
Nish Aravamudan |
tags |
architecture-ppc64le bugnameltc-147708 severity-medium targetmilestone-inin1610 |
architecture-ppc64le bitesize bugnameltc-147708 server-next severity-medium targetmilestone-inin1610 |
|
| 2016-11-01 17:04:26 |
Nish Aravamudan |
rabbitmq-server (Ubuntu): status |
New |
Triaged |
|
| 2016-11-01 17:04:31 |
Nish Aravamudan |
rabbitmq-server (Ubuntu): importance |
Undecided |
Medium |
|
| 2016-11-01 17:04:40 |
Nish Aravamudan |
bug |
|
|
added subscriber Ubuntu Server Team |
| 2016-11-01 17:06:50 |
Nish Aravamudan |
nominated for series |
|
Ubuntu Yakkety |
|
| 2016-11-01 17:06:50 |
Nish Aravamudan |
bug task added |
|
rabbitmq-server (Ubuntu Yakkety) |
|
| 2016-11-01 17:06:50 |
Nish Aravamudan |
nominated for series |
|
Ubuntu Xenial |
|
| 2016-11-01 17:06:50 |
Nish Aravamudan |
bug task added |
|
rabbitmq-server (Ubuntu Xenial) |
|
| 2017-02-06 17:33:02 |
Manoj Iyer |
rabbitmq-server (Ubuntu): assignee |
Taco Screen team (taco-screen-team) |
Canonical Server Team (canonical-server) |
|
| 2017-02-13 16:55:56 |
Launchpad Janitor |
rabbitmq-server (Ubuntu Xenial): status |
New |
Confirmed |
|
| 2017-02-13 16:55:56 |
Launchpad Janitor |
rabbitmq-server (Ubuntu Yakkety): status |
New |
Confirmed |
|
| 2017-03-20 18:51:36 |
Jon Grimm |
rabbitmq-server (Ubuntu): assignee |
Canonical Server Team (canonical-server) |
Jon Grimm (jgrimm) |
|
| 2017-03-20 18:51:42 |
Jon Grimm |
bug |
|
|
added subscriber Jon Grimm |
| 2017-03-20 22:00:05 |
Jon Grimm |
rabbitmq-server (Ubuntu): status |
Triaged |
Fix Released |
|
| 2017-03-21 01:01:05 |
Jon Grimm |
attachment added |
|
xenial debdiff https://bugs.launchpad.net/ubuntu/+source/rabbitmq-server/+bug/1634989/+attachment/4841278/+files/rabbitmq-server_3.5.7-1ubuntu16.04.1.debdiff |
|
| 2017-03-21 01:01:56 |
Jon Grimm |
attachment added |
|
yakkety debdiff https://bugs.launchpad.net/ubuntu/+source/rabbitmq-server/+bug/1634989/+attachment/4841279/+files/rabbitmq-server_3.5.7-1ubuntu16.10.1.debdiff |
|
| 2017-03-21 01:02:23 |
Jon Grimm |
rabbitmq-server (Ubuntu Xenial): status |
Confirmed |
In Progress |
|
| 2017-03-21 01:02:27 |
Jon Grimm |
rabbitmq-server (Ubuntu Yakkety): status |
Confirmed |
In Progress |
|
| 2017-03-22 22:28:41 |
Jon Grimm |
description |
---Problem Description---
Starting rabbitmq-server triggers segfault.
The segfault happens when the host is not reachable, for instance, which breaks the installation of rabbitmq-server package.
It is comprehensible that an error must occur, but segfault should not be a default behaviour.
This has been tested on 16.04 and 16.10, archs ppc64el and x86_64
---uname output---
Linux vm1 4.8.0-22-generic #24-Ubuntu SMP Sat Oct 8 09:14:41 UTC 2016 ppc64le ppc64le ppc64le GNU/Linux
---Steps to Reproduce---
#Better reproducible on a machine with 1 cpu
root@yakkety:~# echo "192.168.1.1 blah" >> /etc/hosts
root@yakkety:~# hostname blah
root@yakkety:~# apt-get install rabbitmq-server
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following NEW packages will be installed:
rabbitmq-server
0 upgraded, 1 newly installed, 0 to remove and 2 not upgraded.
Need to get 0 B/4,251 kB of archives.
After this operation, 5,243 kB of additional disk space will be used.
Selecting previously unselected package rabbitmq-server.
(Reading database ... 63962 files and directories currently installed.)
Preparing to unpack .../rabbitmq-server_3.5.7-1_all.deb ...
Unpacking rabbitmq-server (3.5.7-1) ...
Processing triggers for ureadahead (0.100.0-19) ...
Setting up rabbitmq-server (3.5.7-1) ...
Created symlink /etc/systemd/system/multi-user.target.wants/rabbitmq-server.service ? /lib/systemd/system/rabbitmq-server.service.
Job for rabbitmq-server.service failed because the control process exited with error code.
See "systemctl status rabbitmq-server.service" and "journalctl -xe" for details.
invoke-rc.d: initscript rabbitmq-server, action "start" failed.
? rabbitmq-server.service - RabbitMQ Messaging Server
Loaded: loaded (/lib/systemd/system/rabbitmq-server.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Wed 2016-10-19 11:13:46 EDT; 7ms ago
Process: 2818 ExecStartPost=/usr/lib/rabbitmq/bin/rabbitmq-server-wait (code=exited, status=139)
Process: 2817 ExecStart=/usr/sbin/rabbitmq-server (code=exited, status=1/FAILURE)
Main PID: 2817 (code=exited, status=1/FAILURE)
Oct 19 11:13:13 blah systemd[1]: Starting RabbitMQ Messaging Server...
Oct 19 11:13:13 blah rabbitmq[2818]: Waiting for rabbit@blah ...
Oct 19 11:13:13 blah rabbitmq[2818]: pid is 2826 ...
Oct 19 11:13:43 blah systemd[1]: rabbitmq-server.service: Main process exited, code=exited, status=1/FAILURE
Oct 19 11:13:46 blah rabbitmq[2818]: Segmentation fault
Oct 19 11:13:46 blah systemd[1]: rabbitmq-server.service: Control process exited, code=exited status=139
Oct 19 11:13:46 blah systemd[1]: Failed to start RabbitMQ Messaging Server.
Oct 19 11:13:46 blah systemd[1]: rabbitmq-server.service: Unit entered failed state.
Oct 19 11:13:46 blah systemd[1]: rabbitmq-server.service: Failed with result 'exit-code'.
dpkg: error processing package rabbitmq-server (--configure):
subprocess installed post-installation script returned error exit status 1
Processing triggers for systemd (231-9git1) ...
Processing triggers for man-db (2.7.5-1) ...
Processing triggers for ureadahead (0.100.0-19) ...
Errors were encountered while processing:
rabbitmq-server
E: Sub-process /usr/bin/dpkg returned an error code (1)
root@yakkety:~# dmesg -T
[Wed Oct 19 11:11:55 2016] async_10[2334]: unhandled signal 11 at 0000000000000000 nip 00000000206867bc lr 0000000020635648 code 30001
[Wed Oct 19 11:13:02 2016] random: crng init done
[Wed Oct 19 11:13:02 2016] systemd[1]: apt-daily.timer: Adding 3h 37min 32.381328s random time.
[Wed Oct 19 11:13:02 2016] systemd[1]: apt-daily.timer: Adding 11h 5min 8.314218s random time.
[Wed Oct 19 11:13:02 2016] systemd[1]: apt-daily.timer: Adding 11h 7min 37.045127s random time.
[Wed Oct 19 11:13:03 2016] systemd[1]: apt-daily.timer: Adding 8h 43min 50.771575s random time.
[Wed Oct 19 11:13:03 2016] systemd[1]: apt-daily.timer: Adding 2h 31min 33.179443s random time.
[Wed Oct 19 11:13:04 2016] systemd[1]: apt-daily.timer: Adding 4h 22min 42.585438s random time.
[Wed Oct 19 11:13:04 2016] systemd[1]: apt-daily.timer: Adding 36min 58.644429s random time.
[Wed Oct 19 11:13:04 2016] systemd[1]: apt-daily.timer: Adding 9h 16min 4.769857s random time.
[Wed Oct 19 11:13:12 2016] systemd[1]: apt-daily.timer: Adding 7h 48min 614.372ms random time.
[Wed Oct 19 11:13:12 2016] systemd[1]: apt-daily.timer: Adding 3h 13min 41.779132s random time.
[Wed Oct 19 11:13:12 2016] systemd[1]: apt-daily.timer: Adding 9h 39min 46.023823s random time.
[Wed Oct 19 11:13:45 2016] async_10[2912]: unhandled signal 11 at 0000000000000000 nip 000000004f0d67bc lr 000000004f085648 code 30001
[Wed Oct 19 11:13:45 2016] systemd[1]: apt-daily.timer: Adding 9h 5min 5.067674s random time.
Userspace tool common name: rabbitmq-server
The userspace tool has the following bit modes: 64
Userspace package: rabbitmq-server
I have just tested the patch in https://github.com/rabbitmq/rabbitmq-common/pull/54, which is present on v3.6.1 and prevents the segfault. The patch works and can be easily backported.
Thanks |
[Impact]
* rabbitmq-server can segfault along codepath which happens to "open a port with the same fd multiple times". Doing so is undefined (and unsafe in erlang, though segfaulting is unintentinal).
* This only happens on specific versions of erlang, but the rabbitmq-server code is agreeably incorrect per erlang and has been fixed upstream.
* This only affects xenial & yakkety.
* The codepath belongs to an internal helper for writing to stderr, this prevents useful diagnostic information from being provided to a user.
[Test Case]
* Make sure your hostname resolves to something unreachable, I've selected 192.168.2.2, install rabbitmq-server, witness segfault.
* # hostname blah
* # echo "192.168.2.22 blah" >> /etc/hosts
* # ping blah
PING blah (192.168.122.2) 56(84) bytes of data.
From x1 (192.168.122.90) icmp_seq=1 Destination Host Unreachable
* # apt install rabbitmq-server
...
Mar 22 22:12:41 blah systemd[1]: Starting RabbitMQ Messaging Server...
Mar 22 22:12:42 blah rabbitmq[17995]: Waiting for rabbit@blah ...
Mar 22 22:12:42 blah rabbitmq[17995]: pid is 18025 ...
Mar 22 22:12:45 blah systemd[1]: rabbitmq-server.service: Main process exited, code=exited, status=1/FAILURE
Mar 22 22:12:46 blah rabbitmq[17995]: Segmentation fault (core dumped)
...
* Expected behavior would be not to segfault, and consequently print out a diagnostic message to stderr:
* # dpkg -i rabbitmq-server_3.5.7-1ubuntu16.04.1_all.deb
...
Mar 22 22:15:16 blah systemd[1]: Starting RabbitMQ Messaging Server...
Mar 22 22:15:16 blah rabbitmq[18365]: Waiting for rabbit@blah ...
Mar 22 22:15:16 blah rabbitmq[18365]: pid is 18386 ...
Mar 22 22:15:19 blah systemd[1]: rabbitmq-server.service: Main process exited, code=exited, status=1/FAILURE
Mar 22 22:15:20 blah rabbitmq[18365]: Error: process_not_running
...
* Note: This just happens to be one error path that happens to hit the format_stderr() helper function.
[Regression Potential]
* Limited to diagnostic messages path, so its really only seen when something is configured incorrectly. That being said, any execution through this path today will segfault and without any diagnostic information to figure out what, so seems infinitely better.
* This fix from upstream has been in place over a year without any issue, and was originally code that was working around buggy/flaking erlang library that has (according to upstream reports) been fixed since erlang 17, thus uneeded.
[Other Info]
* While the rabbitmq-server in trusty has this offending code, the version of erlang does not segfault. Additionally, the fix provided by upstream is not necessarily sufficient on erlang < 17 that is in trusty, so I have not fixed it there.
* Zesty if already fixed.
---Problem Description---
Starting rabbitmq-server triggers segfault.
The segfault happens when the host is not reachable, for instance, which breaks the installation of rabbitmq-server package.
It is comprehensible that an error must occur, but segfault should not be a default behaviour.
This has been tested on 16.04 and 16.10, archs ppc64el and x86_64
---uname output---
Linux vm1 4.8.0-22-generic #24-Ubuntu SMP Sat Oct 8 09:14:41 UTC 2016 ppc64le ppc64le ppc64le GNU/Linux
---Steps to Reproduce---
#Better reproducible on a machine with 1 cpu
root@yakkety:~# echo "192.168.1.1 blah" >> /etc/hosts
root@yakkety:~# hostname blah
root@yakkety:~# apt-get install rabbitmq-server
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following NEW packages will be installed:
rabbitmq-server
0 upgraded, 1 newly installed, 0 to remove and 2 not upgraded.
Need to get 0 B/4,251 kB of archives.
After this operation, 5,243 kB of additional disk space will be used.
Selecting previously unselected package rabbitmq-server.
(Reading database ... 63962 files and directories currently installed.)
Preparing to unpack .../rabbitmq-server_3.5.7-1_all.deb ...
Unpacking rabbitmq-server (3.5.7-1) ...
Processing triggers for ureadahead (0.100.0-19) ...
Setting up rabbitmq-server (3.5.7-1) ...
Created symlink /etc/systemd/system/multi-user.target.wants/rabbitmq-server.service ? /lib/systemd/system/rabbitmq-server.service.
Job for rabbitmq-server.service failed because the control process exited with error code.
See "systemctl status rabbitmq-server.service" and "journalctl -xe" for details.
invoke-rc.d: initscript rabbitmq-server, action "start" failed.
? rabbitmq-server.service - RabbitMQ Messaging Server
Loaded: loaded (/lib/systemd/system/rabbitmq-server.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Wed 2016-10-19 11:13:46 EDT; 7ms ago
Process: 2818 ExecStartPost=/usr/lib/rabbitmq/bin/rabbitmq-server-wait (code=exited, status=139)
Process: 2817 ExecStart=/usr/sbin/rabbitmq-server (code=exited, status=1/FAILURE)
Main PID: 2817 (code=exited, status=1/FAILURE)
Oct 19 11:13:13 blah systemd[1]: Starting RabbitMQ Messaging Server...
Oct 19 11:13:13 blah rabbitmq[2818]: Waiting for rabbit@blah ...
Oct 19 11:13:13 blah rabbitmq[2818]: pid is 2826 ...
Oct 19 11:13:43 blah systemd[1]: rabbitmq-server.service: Main process exited, code=exited, status=1/FAILURE
Oct 19 11:13:46 blah rabbitmq[2818]: Segmentation fault
Oct 19 11:13:46 blah systemd[1]: rabbitmq-server.service: Control process exited, code=exited status=139
Oct 19 11:13:46 blah systemd[1]: Failed to start RabbitMQ Messaging Server.
Oct 19 11:13:46 blah systemd[1]: rabbitmq-server.service: Unit entered failed state.
Oct 19 11:13:46 blah systemd[1]: rabbitmq-server.service: Failed with result 'exit-code'.
dpkg: error processing package rabbitmq-server (--configure):
subprocess installed post-installation script returned error exit status 1
Processing triggers for systemd (231-9git1) ...
Processing triggers for man-db (2.7.5-1) ...
Processing triggers for ureadahead (0.100.0-19) ...
Errors were encountered while processing:
rabbitmq-server
E: Sub-process /usr/bin/dpkg returned an error code (1)
root@yakkety:~# dmesg -T
[Wed Oct 19 11:11:55 2016] async_10[2334]: unhandled signal 11 at 0000000000000000 nip 00000000206867bc lr 0000000020635648 code 30001
[Wed Oct 19 11:13:02 2016] random: crng init done
[Wed Oct 19 11:13:02 2016] systemd[1]: apt-daily.timer: Adding 3h 37min 32.381328s random time.
[Wed Oct 19 11:13:02 2016] systemd[1]: apt-daily.timer: Adding 11h 5min 8.314218s random time.
[Wed Oct 19 11:13:02 2016] systemd[1]: apt-daily.timer: Adding 11h 7min 37.045127s random time.
[Wed Oct 19 11:13:03 2016] systemd[1]: apt-daily.timer: Adding 8h 43min 50.771575s random time.
[Wed Oct 19 11:13:03 2016] systemd[1]: apt-daily.timer: Adding 2h 31min 33.179443s random time.
[Wed Oct 19 11:13:04 2016] systemd[1]: apt-daily.timer: Adding 4h 22min 42.585438s random time.
[Wed Oct 19 11:13:04 2016] systemd[1]: apt-daily.timer: Adding 36min 58.644429s random time.
[Wed Oct 19 11:13:04 2016] systemd[1]: apt-daily.timer: Adding 9h 16min 4.769857s random time.
[Wed Oct 19 11:13:12 2016] systemd[1]: apt-daily.timer: Adding 7h 48min 614.372ms random time.
[Wed Oct 19 11:13:12 2016] systemd[1]: apt-daily.timer: Adding 3h 13min 41.779132s random time.
[Wed Oct 19 11:13:12 2016] systemd[1]: apt-daily.timer: Adding 9h 39min 46.023823s random time.
[Wed Oct 19 11:13:45 2016] async_10[2912]: unhandled signal 11 at 0000000000000000 nip 000000004f0d67bc lr 000000004f085648 code 30001
[Wed Oct 19 11:13:45 2016] systemd[1]: apt-daily.timer: Adding 9h 5min 5.067674s random time.
Userspace tool common name: rabbitmq-server
The userspace tool has the following bit modes: 64
Userspace package: rabbitmq-server
I have just tested the patch in https://github.com/rabbitmq/rabbitmq-common/pull/54, which is present on v3.6.1 and prevents the segfault. The patch works and can be easily backported.
Thanks |
|
| 2017-03-23 15:27:55 |
Jon Grimm |
bug |
|
|
added subscriber Ubuntu Sponsors Team |
| 2017-03-23 22:17:01 |
Mathew Hodson |
rabbitmq-server (Ubuntu Xenial): importance |
Undecided |
Medium |
|
| 2017-03-23 22:17:04 |
Mathew Hodson |
rabbitmq-server (Ubuntu Yakkety): importance |
Undecided |
Medium |
|
| 2017-03-27 18:31:45 |
Jon Grimm |
attachment removed |
xenial debdiff https://bugs.launchpad.net/ubuntu/+source/rabbitmq-server/+bug/1634989/+attachment/4841278/+files/rabbitmq-server_3.5.7-1ubuntu16.04.1.debdiff |
|
|
| 2017-03-27 18:32:10 |
Jon Grimm |
attachment removed |
yakkety debdiff https://bugs.launchpad.net/ubuntu/+source/rabbitmq-server/+bug/1634989/+attachment/4841279/+files/rabbitmq-server_3.5.7-1ubuntu16.10.1.debdiff |
|
|
| 2017-03-27 18:33:27 |
Jon Grimm |
attachment added |
|
xenial debdiff https://bugs.launchpad.net/ubuntu/+source/rabbitmq-server/+bug/1634989/+attachment/4847916/+files/rabbitmq-server_3.5.7-1ubuntu0.16.04.1.debdiff |
|
| 2017-03-27 18:34:15 |
Jon Grimm |
attachment added |
|
yakkety debdiff https://bugs.launchpad.net/ubuntu/+source/rabbitmq-server/+bug/1634989/+attachment/4847917/+files/rabbitmq-server_3.5.7-1ubuntu0.16.10.1.debdiff |
|
| 2017-03-27 18:38:27 |
bugproxy |
attachment added |
|
xenial debdiff https://bugs.launchpad.net/bugs/1634989/+attachment/4847918/+files/rabbitmq-server_3.5.7-1ubuntu16.04.1.debdiff |
|
| 2017-03-27 18:38:29 |
bugproxy |
attachment added |
|
yakkety debdiff https://bugs.launchpad.net/bugs/1634989/+attachment/4847919/+files/rabbitmq-server_3.5.7-1ubuntu16.10.1.debdiff |
|
| 2017-03-28 22:47:39 |
Jon Grimm |
attachment removed |
xenial debdiff https://bugs.launchpad.net/ubuntu/+source/rabbitmq-server/+bug/1634989/+attachment/4847916/+files/rabbitmq-server_3.5.7-1ubuntu0.16.04.1.debdiff |
|
|
| 2017-03-28 22:47:49 |
Jon Grimm |
attachment removed |
yakkety debdiff https://bugs.launchpad.net/ubuntu/+source/rabbitmq-server/+bug/1634989/+attachment/4847917/+files/rabbitmq-server_3.5.7-1ubuntu0.16.10.1.debdiff |
|
|
| 2017-03-28 22:48:49 |
Jon Grimm |
attachment added |
|
xenial debdiff https://bugs.launchpad.net/ubuntu/+source/rabbitmq-server/+bug/1634989/+attachment/4849319/+files/rabbitmq-server_3.5.7-1ubuntu0.16.04.1.debdiff |
|
| 2017-03-28 22:49:29 |
Jon Grimm |
attachment added |
|
yakkety debdiff https://bugs.launchpad.net/ubuntu/+source/rabbitmq-server/+bug/1634989/+attachment/4849320/+files/rabbitmq-server_3.5.7-1ubuntu0.16.10.1.debdiff |
|
| 2017-03-28 22:59:08 |
bugproxy |
attachment added |
|
xenial debdiff https://bugs.launchpad.net/bugs/1634989/+attachment/4849321/+files/rabbitmq-server_3.5.7-1ubuntu0.16.04.1.debdiff |
|
| 2017-03-28 22:59:10 |
bugproxy |
attachment added |
|
yakkety debdiff https://bugs.launchpad.net/bugs/1634989/+attachment/4849322/+files/rabbitmq-server_3.5.7-1ubuntu0.16.10.1.debdiff |
|
| 2017-03-30 23:34:47 |
Brian Murray |
rabbitmq-server (Ubuntu Yakkety): status |
In Progress |
Fix Committed |
|
| 2017-03-30 23:34:50 |
Brian Murray |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2017-03-30 23:34:55 |
Brian Murray |
bug |
|
|
added subscriber SRU Verification |
| 2017-03-30 23:35:00 |
Brian Murray |
tags |
architecture-ppc64le bitesize bugnameltc-147708 server-next severity-medium targetmilestone-inin1610 |
architecture-ppc64le bitesize bugnameltc-147708 server-next severity-medium targetmilestone-inin1610 verification-needed |
|
| 2017-03-30 23:35:55 |
Brian Murray |
rabbitmq-server (Ubuntu Xenial): status |
In Progress |
Fix Committed |
|
| 2017-03-30 23:36:30 |
Brian Murray |
removed subscriber Ubuntu Sponsors Team |
|
|
|
| 2017-04-04 15:49:41 |
Jon Grimm |
tags |
architecture-ppc64le bitesize bugnameltc-147708 server-next severity-medium targetmilestone-inin1610 verification-needed |
architecture-ppc64le bitesize bugnameltc-147708 server-next severity-medium targetmilestone-inin1610 verification-done-yakkety verification-needed-xenial |
|
| 2017-04-04 15:58:38 |
Jon Grimm |
tags |
architecture-ppc64le bitesize bugnameltc-147708 server-next severity-medium targetmilestone-inin1610 verification-done-yakkety verification-needed-xenial |
architecture-ppc64le bitesize bugnameltc-147708 server-next severity-medium targetmilestone-inin1610 verification-done-xenial verification-done-yakkety |
|
| 2017-04-12 11:51:14 |
Launchpad Janitor |
rabbitmq-server (Ubuntu Xenial): status |
Fix Committed |
Fix Released |
|
| 2017-04-12 11:51:18 |
Robie Basak |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
| 2017-04-12 11:51:25 |
Launchpad Janitor |
rabbitmq-server (Ubuntu Yakkety): status |
Fix Committed |
Fix Released |
|
