Fuel for OpenStack

  1. Bug #1401870
  2. Activity log

Activity log for bug #1401870

Date Who What changed Old value New value Message
2014-12-12 12:33:41 Oleg S. Gelbukh bug added bug
2014-12-12 12:33:59 Oleg S. Gelbukh description This parameter is used by nova-network to determine if a bridge and gateway ip address of a network must be deleted from Compute node when the network is deleted in API. By default, it is set to 'False' which means that bridge, ip address and dnsmasq process listening on that address are left behind even after the network is deleted. This leads to problems when another network with the same parameters (i.e. cidr and vlan id) created on that host: nova-network fails to start dnsmasq for that network. ```2014-12-12 10:49:58.062 8450 ERROR oslo.messaging.rpc.dispatcher [req-ba613287-419b-4ec3-8e06-b0eb30b93362 ] Exception during message handling: Unexpected error while running command. Command: sudo nova-rootwrap /etc/nova/rootwrap.conf env CONFIG_FILE=["/usr/share/nova/nova-dist.conf", "/etc/nova/nova.conf", "/etc/nova/nova.conf"] NETWORK_ID=84 dnsmasq --strict-order --bind-interfaces --conf-fi le= --pid-file=/var/lib/nova/networks/nova-br203.pid --listen-address=10.42.1.3 --except-interface=lo --dhcp-range=set:pumphouse--network-664099187,10.42.1.3,static,255.255.255.0,120s --dhcp-lease-max=256 --dhcp-h ostsfile=/var/lib/nova/networks/nova-br203.conf --dhcp-script=/usr/bin/nova-dhcpbridge --leasefile-ro --domain=novalocal --no-hosts --addn-hosts=/var/lib/nova/networks/nova-br203.hosts Exit code: 2 Stdout: u'' Stderr: u'\ndnsmasq: failed to create listening socket for 10.42.1.3: Address already in use\n' 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last): 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher incoming.message)) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher result = getattr(endpoint, method)(ctxt, **new_args) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/floating_ips.py", line 119, in allocate_for_instance 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher **kwargs) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 515, in allocate_for_instance 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher requested_networks=requested_networks) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 216, in _allocate_fixed_ips 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher vpn=vpn, address=address) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 1778, in allocate_fixed_ip 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher self._setup_network_on_host(context, network) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 249, in inner 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher return f(*args, **kwargs) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 1892, in _setup_network_on_host 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher self.driver.update_dhcp(elevated, dev, network) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/linux_net.py", line 1004, in update_dhcp 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher restart_dhcp(context, dev, network_ref) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 249, in inner 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher return f(*args, **kwargs) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/linux_net.py", line 1118, in restart_dhcp 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher _execute(*cmd, run_as_root=True) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/linux_net.py", line 1211, in _execute 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher return utils.execute(*cmd, **kwargs) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/utils.py", line 165, in execute 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher return processutils.execute(*cmd, **kwargs) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/openstack/common/processutils.py", line 195, in execute 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher cmd=sanitized_cmd) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher ProcessExecutionError: Unexpected error while running command. 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher Command: sudo nova-rootwrap /etc/nova/rootwrap.conf env CONFIG_FILE=["/usr/share/nova/nova-dist.conf", "/etc/nova/nova.conf", "/etc/nova/nova.conf"] NETWORK_ID=84 dnsmasq --strict-order --bind-interfaces --conf-file= --pid-file=/var/lib/nova/networks/nova-br203.pid --listen-address=10.42.1.3 --except-interface=lo --dhcp-range=set:pumphouse--network-664099187, 10.42.1.3,static,255.255.255.0,120s --dhcp-lease-max=256 --dhcp-hostsfile=/var/lib/nova/networks/nova-br203.conf --dhcp-script=/usr/bin/nova-dhcpbridge --leasefile-ro --domain=novalocal --no-hosts --addn-hosts=/va r/lib/nova/networks/nova-br203.hosts 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher Exit code: 2 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher Stdout: u'' 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher Stderr: u'\ndnsmasq: failed to create listening socket for 10.42.1.3: Address already in use\n' 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher ``` This parameter is used by nova-network to determine if a bridge and gateway ip address of a network must be deleted from Compute node when the network is deleted in API. By default, it is set to 'False' which means that bridge, ip address and dnsmasq process listening on that address are left behind even after the network is deleted. This leads to problems when another network with the same parameters (i.e. cidr and vlan id) created on that host: nova-network fails to start dnsmasq for that network. 2014-12-12 10:49:58.062 8450 ERROR oslo.messaging.rpc.dispatcher [req-ba613287-419b-4ec3-8e06-b0eb30b93362 ] Exception during message handling: Unexpected error while running command. Command: sudo nova-rootwrap /etc/nova/rootwrap.conf env CONFIG_FILE=["/usr/share/nova/nova-dist.conf", "/etc/nova/nova.conf", "/etc/nova/nova.conf"] NETWORK_ID=84 dnsmasq --strict-order --bind-interfaces --conf-fi le= --pid-file=/var/lib/nova/networks/nova-br203.pid --listen-address=10.42.1.3 --except-interface=lo --dhcp-range=set:pumphouse--network-664099187,10.42.1.3,static,255.255.255.0,120s --dhcp-lease-max=256 --dhcp-h ostsfile=/var/lib/nova/networks/nova-br203.conf --dhcp-script=/usr/bin/nova-dhcpbridge --leasefile-ro --domain=novalocal --no-hosts --addn-hosts=/var/lib/nova/networks/nova-br203.hosts Exit code: 2 Stdout: u'' Stderr: u'\ndnsmasq: failed to create listening socket for 10.42.1.3: Address already in use\n' 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last): 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher incoming.message)) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher result = getattr(endpoint, method)(ctxt, **new_args) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/floating_ips.py", line 119, in allocate_for_instance 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher **kwargs) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 515, in allocate_for_instance 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher requested_networks=requested_networks) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 216, in _allocate_fixed_ips 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher vpn=vpn, address=address) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 1778, in allocate_fixed_ip 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher self._setup_network_on_host(context, network) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 249, in inner 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher return f(*args, **kwargs) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 1892, in _setup_network_on_host 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher self.driver.update_dhcp(elevated, dev, network) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/linux_net.py", line 1004, in update_dhcp 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher restart_dhcp(context, dev, network_ref) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 249, in inner 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher return f(*args, **kwargs) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/linux_net.py", line 1118, in restart_dhcp 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher _execute(*cmd, run_as_root=True) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/network/linux_net.py", line 1211, in _execute 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher return utils.execute(*cmd, **kwargs) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/utils.py", line 165, in execute 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher return processutils.execute(*cmd, **kwargs) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/openstack/common/processutils.py", line 195, in execute 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher cmd=sanitized_cmd) 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher ProcessExecutionError: Unexpected error while running command. 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher Command: sudo nova-rootwrap /etc/nova/rootwrap.conf env CONFIG_FILE=["/usr/share/nova/nova-dist.conf", "/etc/nova/nova.conf", "/etc/nova/nova.conf"]  NETWORK_ID=84 dnsmasq --strict-order --bind-interfaces --conf-file= --pid-file=/var/lib/nova/networks/nova-br203.pid --listen-address=10.42.1.3 --except-interface=lo --dhcp-range=set:pumphouse--network-664099187, 10.42.1.3,static,255.255.255.0,120s --dhcp-lease-max=256 --dhcp-hostsfile=/var/lib/nova/networks/nova-br203.conf --dhcp-script=/usr/bin/nova-dhcpbridge --leasefile-ro --domain=novalocal --no-hosts --addn-hosts=/va r/lib/nova/networks/nova-br203.hosts 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher Exit code: 2 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher Stdout: u'' 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher Stderr: u'\ndnsmasq: failed to create listening socket for 10.42.1.3: Address already in use\n' 2014-12-12 10:49:58.062 8450 TRACE oslo.messaging.rpc.dispatcher
2014-12-12 13:03:57 Stanislav Makar fuel: importance Undecided Medium
2014-12-12 13:04:09 Stanislav Makar fuel: assignee Fuel Library Team (fuel-library)
2014-12-12 13:04:42 Stanislav Makar fuel: status New Triaged
2014-12-12 13:05:24 Stanislav Makar tags low-hanging-fruit
2014-12-12 13:19:20 Vladimir Kuklin fuel: milestone 6.1
2014-12-16 10:47:32 Bartłomiej Piotrowski fuel: assignee Fuel Library Team (fuel-library) Bartlomiej Piotrowski (bpiotrowski)
2015-01-29 11:58:20 OpenStack Infra fuel: status Triaged In Progress
2015-02-05 13:06:19 Bogdan Dobrelya nominated for series fuel/6.1.x
2015-02-05 13:06:19 Bogdan Dobrelya bug task added fuel/6.1.x
2015-02-05 13:06:29 Bogdan Dobrelya nominated for series fuel/5.1.x
2015-02-05 13:06:29 Bogdan Dobrelya bug task added fuel/5.1.x
2015-02-05 13:06:29 Bogdan Dobrelya nominated for series fuel/6.0.x
2015-02-05 13:06:29 Bogdan Dobrelya bug task added fuel/6.0.x
2015-02-05 13:06:37 Bogdan Dobrelya fuel/6.0.x: assignee Bartlomiej Piotrowski (bpiotrowski)
2015-02-05 13:06:43 Bogdan Dobrelya fuel/5.1.x: assignee Bartlomiej Piotrowski (bpiotrowski)
2015-02-05 13:06:47 Bogdan Dobrelya fuel/6.0.x: milestone 6.0.1
2015-02-05 13:06:53 Bogdan Dobrelya fuel/5.1.x: milestone 5.1.2
2015-02-05 13:06:57 Bogdan Dobrelya fuel/6.0.x: importance Undecided Medium
2015-02-05 13:07:00 Bogdan Dobrelya fuel/5.1.x: importance Undecided Medium
2015-02-05 13:07:05 Bogdan Dobrelya fuel/6.0.x: status New Triaged
2015-02-05 13:07:09 Bogdan Dobrelya fuel/5.1.x: status New Triaged
2015-02-06 09:02:17 Bartłomiej Piotrowski fuel/5.1.x: status Triaged In Progress
2015-02-06 09:37:12 Bartłomiej Piotrowski fuel/6.0.x: status Triaged In Progress
2015-02-16 10:20:28 OpenStack Infra fuel: status In Progress Fix Committed
2015-02-17 17:59:25 Vladimir Kuklin fuel/6.0.x: status In Progress Fix Committed
2015-03-10 13:12:33 Bartłomiej Piotrowski fuel/5.1.x: status In Progress Fix Committed
2015-05-27 12:45:13 Bartłomiej Piotrowski fuel/6.1.x: status Fix Committed Fix Released