centos from source sudo failing

Bug #1503412 reported by Steven Dake
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla
Fix Released
Critical
Steven Dake

Bug Description

ip netns doesn't work with neutron-rootwrap's configuration. The configuration within the container does look correct however.

fa:16:3e:00:59:b0,host-10-0-0-8.openstacklocal.,10.0.0.8
fa:16:3e:03:3a:d1,host-10-0-0-21.openstacklocal.,10.0.0.21
fa:16:3e:03:58:03,host-10-0-0-14.openstacklocal.,10.0.0.14
fa:16:3e:0b:d4:dd,host-10-0-0-15.openstacklocal.,10.0.0.15
fa:16:3e:16:a2:2a,host-10-0-0-11.openstacklocal.,10.0.0.11
fa:16:3e:1c:24:3e,host-10-0-0-26.openstacklocal.,10.0.0.26
fa:16:3e:2c:e8:c9,host-10-0-0-9.openstacklocal.,10.0.0.9
fa:16:3e:30:6f:f4,host-10-0-0-22.openstacklocal.,10.0.0.22
fa:16:3e:32:01:7b,host-10-0-0-6.openstacklocal.,10.0.0.6
fa:16:3e:35:1c:b6,host-10-0-0-20.openstacklocal.,10.0.0.20
fa:16:3e:36:3a:bd,host-10-0-0-13.openstacklocal.,10.0.0.13
fa:16:3e:3c:ae:c7,host-10-0-0-19.openstacklocal.,10.0.0.19
fa:16:3e:45:2d:09,host-10-0-0-18.openstacklocal.,10.0.0.18
fa:16:3e:4b:14:e1,host-10-0-0-24.openstacklocal.,10.0.0.24
fa:16:3e:51:13:9f,host-10-0-0-4.openstacklocal.,10.0.0.4
fa:16:3e:5c:a9:2a,host-10-0-0-3.openstacklocal.,10.0.0.3
fa:16:3e:64:9a:29,host-10-0-0-10.openstacklocal.,10.0.0.10
fa:16:3e:95:20:89,host-10-0-0-23.openstacklocal.,10.0.0.23
fa:16:3e:95:d1:0c,host-10-0-0-2.openstacklocal.,10.0.0.2
fa:16:3e:ae:ec:48,host-10-0-0-7.openstacklocal.,10.0.0.7
fa:16:3e:bd:ed:21,host-10-0-0-12.openstacklocal.,10.0.0.12
fa:16:3e:c6:cf:07,host-10-0-0-1.openstacklocal.,10.0.0.1
fa:16:3e:da:cf:91,host-10-0-0-16.openstacklocal.,10.0.0.16
fa:16:3e:de:25:3f,host-10-0-0-25.openstacklocal.,10.0.0.25
fa:16:3e:ed:fd:c9,host-10-0-0-17.openstacklocal.,10.0.0.17
fa:16:3e:ff:88:58,host-10-0-0-5.openstacklocal.,10.0.0.5
 _output_hosts_file /usr/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:671
2015-10-06 19:44:32.105 8 DEBUG neutron.agent.linux.utils [-] Unable to access /var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/pid get_value_from_file /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:239
2015-10-06 19:44:32.106 8 DEBUG neutron.agent.linux.utils [-] Running command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-d55fef68-a0f2-40e3-936d-b84335f3557b', 'dnsmasq', '--no-hosts', '--no-resolv', '--strict-order', '--except-interface=lo', '--pid-file=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/pid', '--dhcp-hostsfile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/host', '--addn-hosts=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/addn_hosts', '--dhcp-optsfile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/opts', '--dhcp-leasefile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/leases', '--dhcp-match=set:ipxe,175', '--bind-interfaces', '--interface=tapbe067e56-be', '--dhcp-range=set:tag0,10.0.0.0,static,86400s', '--dhcp-lease-max=256', '--conf-file=/etc/neutron/dnsmasq.conf', '--domain=openstacklocal'] create_process /usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py:84
2015-10-06 19:44:32.216 8 ERROR neutron.agent.linux.utils [-]
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-d55fef68-a0f2-40e3-936d-b84335f3557b', 'dnsmasq', '--no-hosts', '--no-resolv', '--strict-order', '--except-interface=lo', '--pid-file=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/pid', '--dhcp-hostsfile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/host', '--addn-hosts=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/addn_hosts', '--dhcp-optsfile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/opts', '--dhcp-leasefile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/leases', '--dhcp-match=set:ipxe,175', '--bind-interfaces', '--interface=tapbe067e56-be', '--dhcp-range=set:tag0,10.0.0.0,static,86400s', '--dhcp-lease-max=256', '--conf-file=/etc/neutron/dnsmasq.conf', '--domain=openstacklocal']
Exit code: 99
Stdin:
Stdout:
Stderr: /bin/neutron-rootwrap: Unauthorized command: ip netns exec qdhcp-d55fef68-a0f2-40e3-936d-b84335f3557b dnsmasq --no-hosts --no-resolv --strict-order --except-interface=lo --pid-file=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/pid --dhcp-hostsfile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/host --addn-hosts=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/addn_hosts --dhcp-optsfile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/opts --dhcp-leasefile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/leases --dhcp-match=set:ipxe,175 --bind-interfaces --interface=tapbe067e56-be --dhcp-range=set:tag0,10.0.0.0,static,86400s --dhcp-lease-max=256 --conf-file=/etc/neutron/dnsmasq.conf --domain=openstacklocal (no filter matched)

2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent [-] Unable to enable dhcp for d55fef68-a0f2-40e3-936d-b84335f3557b.
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent Traceback (most recent call last):
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/neutron/agent/dhcp/agent.py", line 115, in call_driver
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent getattr(driver, action)(**action_kwargs)
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py", line 205, in enable
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent self.spawn_process()
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py", line 413, in spawn_process
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent self._spawn_or_reload_process(reload_with_HUP=False)
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py", line 427, in _spawn_or_reload_process
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent pm.enable(reload_cfg=reload_with_HUP)
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/external_process.py", line 92, in enable
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent run_as_root=self.run_as_root)
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ip_lib.py", line 833, in execute
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent extra_ok_codes=extra_ok_codes, **kwargs)
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 158, in execute
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent raise RuntimeError(m)
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent RuntimeError:
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-d55fef68-a0f2-40e3-936d-b84335f3557b', 'dnsmasq', '--no-hosts', '--no-resolv', '--strict-order', '--except-interface=lo', '--pid-file=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/pid', '--dhcp-hostsfile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/host', '--addn-hosts=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/addn_hosts', '--dhcp-optsfile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/opts', '--dhcp-leasefile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/leases', '--dhcp-match=set:ipxe,175', '--bind-interfaces', '--interface=tapbe067e56-be', '--dhcp-range=set:tag0,10.0.0.0,static,86400s', '--dhcp-lease-max=256', '--conf-file=/etc/neutron/dnsmasq.conf', '--domain=openstacklocal']
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent Exit code: 99
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent Stdin:
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent Stdout:
2015-10-06 19:44:32.216 8 ERROR neutron.agent.dhcp.agent Stderr: /bin/neutron-rootwrap: Unauthorized command: ip netns exec qdhcp-d55fef68-a0f2-40e3-936d-b84335f3557b dnsmasq --no-hosts --no-resolv --strict-order --except-interface=lo --pid-file=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/pid --dhcp-hostsfile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/host --addn-hosts=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/addn_hosts --dhcp-optsfile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/opts --dhcp-leasefile=/var/lib/neutron/dhcp/d55fef68-a0f2-40e3-936d-b84335f3557b/leases --dhcp-match=set:ipxe,175 --bind-interfaces --interface=tapbe067e56-be --dhcp-range=set:tag0,10.0.0.0,static,86400s --dhcp-lease-max=256 --conf-file=/etc/neutron/dnsmasq.conf --domain=openstacklocal (no filter matched)

Steven Dake (sdake)
Changed in kolla:
status: New → Triaged
importance: Undecided → Critical
milestone: none → liberty-rc2
assignee: nobody → Steven Dake (sdake)
description: updated
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (master)

Fix proposed to branch: master
Review: https://review.openstack.org/231754

Changed in kolla:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (master)

Reviewed: https://review.openstack.org/231754
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=2dead815647b448bbcdc86bb2268f48d9a8d2515
Submitter: Jenkins
Branch: master

commit 2dead815647b448bbcdc86bb2268f48d9a8d2515
Author: Steven Dake <email address hidden>
Date: Tue Oct 6 15:58:12 2015 -0700

    Install agent dependencies from source for CentOS

    Several packages are not installed from RPM packages which are
    required in order for CentOS from source to operate correctly.

    This looked like sudo was failing to execute, but it was because
    the dnsmasq binary was not found.

    backport: liberty

    Change-Id: If23cfbacd55d9089ffec442399ee0151adea923f
    Closes-Bug: #1503412

Changed in kolla:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (stable/liberty)

Fix proposed to branch: stable/liberty
Review: https://review.openstack.org/233159

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (stable/liberty)

Reviewed: https://review.openstack.org/233159
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=58ef3fd22b3394be09e76f9fd1eb12a1e7588e42
Submitter: Jenkins
Branch: stable/liberty

commit 58ef3fd22b3394be09e76f9fd1eb12a1e7588e42
Author: Steven Dake <email address hidden>
Date: Tue Oct 6 15:58:12 2015 -0700

    Install agent dependencies from source for CentOS

    Several packages are not installed from RPM packages which are
    required in order for CentOS from source to operate correctly.

    This looked like sudo was failing to execute, but it was because
    the dnsmasq binary was not found.

    backport: liberty

    Change-Id: If23cfbacd55d9089ffec442399ee0151adea923f
    Closes-Bug: #1503412
    (cherry picked from commit bc0f8b422ad8a49d59ab2a504a108554cc75cbc0)

tags: added: in-stable-liberty
Sam Yaple (s8m)
Changed in kolla:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.