| 2018-04-04 07:59:47 |
Olivier Bourdon |
bug |
|
|
added bug |
| 2018-04-04 08:00:38 |
Olivier Bourdon |
attachment added |
|
complete journalctl -xe output https://bugs.launchpad.net/ubuntu/+source/squid3/+bug/1761096/+attachment/5101009/+files/dnsmasq_journal.log.gz |
|
| 2018-04-04 08:01:16 |
Olivier Bourdon |
description |
Setup to reproduce:
Ubuntu Xenial amd64 net install iso from http://archive.ubuntu.com/ubuntu/dists/xenial/main/installer-amd64/current/images/netboot/mini.iso
Install system with mostly defaults + LVM + OpenSSH server
Note that this bug applies to both DHCP and static IP+DNS network configurations
Once server rebooted and is available, log in and install dnsmasq + squid:
apt-get update && apt-get install squid dnsmasq
output of this can be found at https://pastebin.com/9Atuipju
journalctl -xe output at https://pastebin.com/uLhfM4jN
Furthermore at this point I can run alternating errors
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:18:07 CEST 2018
Wed Apr 4 09:18:07 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq stop ; date
Wed Apr 4 09:18:39 CEST 2018
Wed Apr 4 09:18:39 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:19:10 CEST 2018
Job for dnsmasq.service failed because a timeout was exceeded. See "systemctl status dnsmasq.service" and "journalctl -xe" for details.
Wed Apr 4 09:20:40 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:42:57 CEST 2018
Wed Apr 4 09:42:57 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq stop ; date
Wed Apr 4 09:43:14 CEST 2018
Wed Apr 4 09:43:14 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:43:26 CEST 2018
Job for dnsmasq.service failed because a timeout was exceeded. See "systemctl status dnsmasq.service" and "journalctl -xe" for details.
Wed Apr 4 09:44:56 CEST 2018
and so on... Each and every 1 out of 2 stop/start cycle fails in 1m30s timeout
Complete journalctl -xe output can be found at http://www.olivierbourdon.com/BUGS/dnsmasq_journal.log.gz |
Setup to reproduce:
Ubuntu Xenial amd64 net install iso from http://archive.ubuntu.com/ubuntu/dists/xenial/main/installer-amd64/current/images/netboot/mini.iso
Install system with mostly defaults + LVM + OpenSSH server
Note that this bug applies to both DHCP and static IP+DNS network configurations
Once server rebooted and is available, log in and install dnsmasq + squid:
apt-get update && apt-get install squid dnsmasq
output of this can be found at https://pastebin.com/9Atuipju
journalctl -xe output at https://pastebin.com/uLhfM4jN
Furthermore at this point I can run alternating errors
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:18:07 CEST 2018
Wed Apr 4 09:18:07 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq stop ; date
Wed Apr 4 09:18:39 CEST 2018
Wed Apr 4 09:18:39 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:19:10 CEST 2018
Job for dnsmasq.service failed because a timeout was exceeded. See "systemctl status dnsmasq.service" and "journalctl -xe" for details.
Wed Apr 4 09:20:40 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:42:57 CEST 2018
Wed Apr 4 09:42:57 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq stop ; date
Wed Apr 4 09:43:14 CEST 2018
Wed Apr 4 09:43:14 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:43:26 CEST 2018
Job for dnsmasq.service failed because a timeout was exceeded. See "systemctl status dnsmasq.service" and "journalctl -xe" for details.
Wed Apr 4 09:44:56 CEST 2018
and so on... Each and every 1 out of 2 stop/start cycle fails in 1m30s timeout
Complete journalctl -xe output attached |
|
| 2018-04-04 08:01:54 |
Olivier Bourdon |
affects |
squid3 (Ubuntu) |
dnsmasq (Ubuntu) |
|
| 2018-06-20 14:24:49 |
Christian Ehrhardt |
bug |
|
|
added subscriber Ubuntu Server |
| 2018-06-20 14:24:52 |
Christian Ehrhardt |
nominated for series |
|
Ubuntu Xenial |
|
| 2018-06-20 14:24:52 |
Christian Ehrhardt |
bug task added |
|
dnsmasq (Ubuntu Xenial) |
|
| 2018-06-20 14:24:58 |
Christian Ehrhardt |
dnsmasq (Ubuntu Xenial): status |
New |
Confirmed |
|
| 2018-06-20 14:25:01 |
Christian Ehrhardt |
dnsmasq (Ubuntu): status |
New |
Fix Released |
|
| 2018-06-20 14:25:04 |
Christian Ehrhardt |
dnsmasq (Ubuntu Xenial): importance |
Undecided |
High |
|
| 2018-06-20 14:25:10 |
Christian Ehrhardt |
tags |
dnsmasq squid ubuntu xenial |
dnsmasq server-next squid ubuntu xenial |
|
| 2018-06-20 14:29:04 |
Christian Ehrhardt |
bug task added |
|
squid (Ubuntu) |
|
| 2018-06-20 14:29:10 |
Christian Ehrhardt |
squid (Ubuntu Xenial): status |
New |
Confirmed |
|
| 2018-06-20 14:29:13 |
Christian Ehrhardt |
squid (Ubuntu Xenial): importance |
Undecided |
High |
|
| 2018-06-20 14:29:15 |
Christian Ehrhardt |
squid (Ubuntu): status |
New |
Fix Released |
|
| 2020-09-01 20:39:20 |
Sergio Durigan Junior |
bug watch added |
|
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=777113 |
|
| 2020-09-01 20:39:29 |
Sergio Durigan Junior |
bug |
|
|
added subscriber Sergio Durigan Junior |
| 2020-09-02 07:33:17 |
Christian Ehrhardt |
bug watch added |
|
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=774153 |
|
| 2020-09-02 07:33:17 |
Christian Ehrhardt |
bug watch added |
|
https://bugs.freedesktop.org/show_bug.cgi?id=92430 |
|
| 2020-09-02 07:33:17 |
Christian Ehrhardt |
bug watch added |
|
https://bugzilla.redhat.com/show_bug.cgi?id=1367981 |
|
| 2020-09-03 01:11:29 |
Sergio Durigan Junior |
bug watch added |
|
https://github.com/systemd/systemd/issues/10464 |
|
| 2020-09-04 20:49:39 |
Sergio Durigan Junior |
description |
Setup to reproduce:
Ubuntu Xenial amd64 net install iso from http://archive.ubuntu.com/ubuntu/dists/xenial/main/installer-amd64/current/images/netboot/mini.iso
Install system with mostly defaults + LVM + OpenSSH server
Note that this bug applies to both DHCP and static IP+DNS network configurations
Once server rebooted and is available, log in and install dnsmasq + squid:
apt-get update && apt-get install squid dnsmasq
output of this can be found at https://pastebin.com/9Atuipju
journalctl -xe output at https://pastebin.com/uLhfM4jN
Furthermore at this point I can run alternating errors
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:18:07 CEST 2018
Wed Apr 4 09:18:07 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq stop ; date
Wed Apr 4 09:18:39 CEST 2018
Wed Apr 4 09:18:39 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:19:10 CEST 2018
Job for dnsmasq.service failed because a timeout was exceeded. See "systemctl status dnsmasq.service" and "journalctl -xe" for details.
Wed Apr 4 09:20:40 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:42:57 CEST 2018
Wed Apr 4 09:42:57 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq stop ; date
Wed Apr 4 09:43:14 CEST 2018
Wed Apr 4 09:43:14 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:43:26 CEST 2018
Job for dnsmasq.service failed because a timeout was exceeded. See "systemctl status dnsmasq.service" and "journalctl -xe" for details.
Wed Apr 4 09:44:56 CEST 2018
and so on... Each and every 1 out of 2 stop/start cycle fails in 1m30s timeout
Complete journalctl -xe output attached |
[Impact]
When using dnsmasq along with squid on Ubuntu Xenial, the user will experience a deadlock while performing on every second execution of the "systemctl start dnsmasq.service" command. The deadlock will be caused by an attempt to invoke, by nss-lookup.target, a "systemctl reload squid.service", which will itself try to start the nss-lookup.target, which will be waiting on squid, therefore eventually leading to a timeout.
The underlying cause of this deadlock is related to how systemd used to handle dependencies between multiple jobs being started in the same transaction.
[Test Case]
One can reproduce the issue on a Xenial container:
$ lxc launch ubuntu-daily:xenial squid-bug1761096
$ lxc shell squid-bug1761096
# apt update
# apt install squid dnsmasq -y
It is quite possible that during "apt install" the bug will manifest, and dnsmasq will fail to start due to a timeout. The user might see a message like:
Job for dnsmasq.service failed because a timeout was exceeded. See "systemctl status dnsmasq.service" and "journalctl -xe" for details.
If the bug doesn't manifest itself during installation, the following commands in sequence should trigger it:
# systemctl restart dnsmasq.service
# systemctl restart dnsmasq.service
[Regression Potential]
This change only touches the mechanism by which squid has its configuration reloaded in case of a DNS resolver change. Because "systemctl reload --no-block" returns practically immediately, if squid's configuration file is invalid the user won't see any notifications. However, this behaviour is already present currently, because "systemctl reload squid" invokes "/etc/init.d/squid reload"; the user has to check "journalctl -u squid.service" if she wants to verify whether there were any failures during the reload.
Other than that, and because systemctl will offload the service to the SysV script as usual (in the case of squid), I don't foresee any potential regressions.
[Original Description]
Setup to reproduce:
Ubuntu Xenial amd64 net install iso from http://archive.ubuntu.com/ubuntu/dists/xenial/main/installer-amd64/current/images/netboot/mini.iso
Install system with mostly defaults + LVM + OpenSSH server
Note that this bug applies to both DHCP and static IP+DNS network configurations
Once server rebooted and is available, log in and install dnsmasq + squid:
apt-get update && apt-get install squid dnsmasq
output of this can be found at https://pastebin.com/9Atuipju
journalctl -xe output at https://pastebin.com/uLhfM4jN
Furthermore at this point I can run alternating errors
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:18:07 CEST 2018
Wed Apr 4 09:18:07 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq stop ; date
Wed Apr 4 09:18:39 CEST 2018
Wed Apr 4 09:18:39 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:19:10 CEST 2018
Job for dnsmasq.service failed because a timeout was exceeded. See "systemctl status dnsmasq.service" and "journalctl -xe" for details.
Wed Apr 4 09:20:40 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:42:57 CEST 2018
Wed Apr 4 09:42:57 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq stop ; date
Wed Apr 4 09:43:14 CEST 2018
Wed Apr 4 09:43:14 CEST 2018
root@ubuntu-min:~# date ; service dnsmasq start ; date
Wed Apr 4 09:43:26 CEST 2018
Job for dnsmasq.service failed because a timeout was exceeded. See "systemctl status dnsmasq.service" and "journalctl -xe" for details.
Wed Apr 4 09:44:56 CEST 2018
and so on... Each and every 1 out of 2 stop/start cycle fails in 1m30s timeout
Complete journalctl -xe output attached |
|
| 2020-09-04 20:51:01 |
Launchpad Janitor |
merge proposal linked |
|
https://code.launchpad.net/~sergiodj/ubuntu/+source/squid3/+git/squid3/+merge/390333 |
|
| 2020-09-04 20:52:52 |
Sergio Durigan Junior |
squid (Ubuntu Xenial): assignee |
|
Sergio Durigan Junior (sergiodj) |
|
| 2020-09-04 20:53:31 |
Sergio Durigan Junior |
dnsmasq (Ubuntu Xenial): status |
Confirmed |
Invalid |
|
| 2020-09-09 16:51:05 |
Robie Basak |
bug task added |
|
squid3 (Ubuntu) |
|
| 2020-09-09 16:51:07 |
Dan Streetman |
bug |
|
|
added subscriber Dan Streetman |
| 2020-09-09 16:51:16 |
Robie Basak |
nominated for series |
|
Ubuntu Bionic |
|
| 2020-09-09 16:51:16 |
Robie Basak |
bug task added |
|
squid (Ubuntu Bionic) |
|
| 2020-09-09 16:51:16 |
Robie Basak |
bug task added |
|
dnsmasq (Ubuntu Bionic) |
|
| 2020-09-09 16:51:16 |
Robie Basak |
bug task added |
|
squid3 (Ubuntu Bionic) |
|
| 2020-09-09 16:51:24 |
Robie Basak |
squid3 (Ubuntu): status |
New |
Invalid |
|
| 2020-09-09 16:51:27 |
Robie Basak |
squid3 (Ubuntu Bionic): status |
New |
Incomplete |
|
| 2020-09-09 16:51:31 |
Robie Basak |
squid3 (Ubuntu Xenial): status |
New |
In Progress |
|
| 2020-09-09 16:51:42 |
Robie Basak |
squid3 (Ubuntu Xenial): assignee |
|
Sergio Durigan Junior (sergiodj) |
|
| 2020-09-09 16:51:54 |
Robie Basak |
squid (Ubuntu Xenial): assignee |
Sergio Durigan Junior (sergiodj) |
|
|
| 2020-09-09 16:51:57 |
Robie Basak |
squid (Ubuntu Xenial): importance |
High |
Undecided |
|
| 2020-09-09 16:52:01 |
Robie Basak |
squid (Ubuntu Xenial): status |
Confirmed |
Invalid |
|
| 2020-09-09 16:52:05 |
Robie Basak |
squid (Ubuntu Bionic): status |
New |
Invalid |
|
| 2020-09-09 16:52:09 |
Robie Basak |
squid3 (Ubuntu Xenial): importance |
Undecided |
High |
|
| 2020-09-09 16:52:15 |
Robie Basak |
dnsmasq (Ubuntu Bionic): status |
New |
Invalid |
|
| 2020-09-09 16:57:32 |
Robie Basak |
squid3 (Ubuntu Xenial): status |
In Progress |
Fix Committed |
|
| 2020-09-09 16:57:34 |
Robie Basak |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2020-09-09 16:57:37 |
Robie Basak |
bug |
|
|
added subscriber SRU Verification |
| 2020-09-09 16:57:41 |
Robie Basak |
tags |
dnsmasq server-next squid ubuntu xenial |
dnsmasq server-next squid ubuntu verification-needed verification-needed-xenial xenial |
|
| 2020-09-16 15:53:02 |
Sergio Durigan Junior |
tags |
dnsmasq server-next squid ubuntu verification-needed verification-needed-xenial xenial |
dnsmasq server-next squid ubuntu verification-done-xenial verification-needed xenial |
|
| 2020-09-22 15:08:57 |
Launchpad Janitor |
squid3 (Ubuntu Xenial): status |
Fix Committed |
Fix Released |
|
| 2020-09-22 15:09:01 |
Brian Murray |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
| 2021-06-16 08:39:23 |
Christian Ehrhardt |
tags |
dnsmasq server-next squid ubuntu verification-done-xenial verification-needed xenial |
dnsmasq squid ubuntu verification-done-xenial verification-needed xenial |
|
