docker-puppet fails to run neutron ovs agent container with db.sock not available error

Bug #1766759 reported by Saravanan KR
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
High
Saravanan KR

Bug Description

Deploy a DPDK cluster, docker-puppet fails with below error on step1

            "Error: Failed to apply catalog: Execution of '/usr/bin/ovs-vsctl list Open_vSwitch .' returned 1: ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)",

-----------------------------------------------------------------------
            "2018-04-24 11:44:42,832 ERROR: 11511 -- Notice: hiera(): Cannot load backend module_data: cannot load such file -- hiera/backend/module_data_backend",
            "Notice: hiera(): Cannot load backend module_data: cannot load such file -- hiera/backend/module_data_backend",
            "Notice: Compiled catalog for computeovsdpdk-1.localdomain in environment production in 1.93 seconds",
            "Notice: /Stage[main]/Tripleo::Profile::Base::Neutron::Ovs/File[/var/lib/vhost_sockets]/ensure: created",
            "Notice: /Stage[main]/Vswitch::Dpdk/File_line[/etc/sysconfig/openvswitch]/ensure: created",
            "Changes:",
            " Total: 2",
            "Events:",
            " Success: 2",
            "Resources:",
            " Changed: 2",
            " Out of sync: 2",
            " Skipped: 5",
            " Total: 9",
            "Time:",
            " Resources: 0.00",
            " File line: 0.00",
            " File: 0.00",
            " Last run: 1524570282",
            " Config retrieval: 2.14",
            " Total: 2.14",
            "Version:",
            " Config: 1524570280",
            " Puppet: 4.8.2",
            "",
            "2018-04-24 11:44:42,832 ERROR: 11511 -- + mkdir -p /etc/puppet",
            "+ cp -a /tmp/puppet-etc/auth.conf /tmp/puppet-etc/hiera.yaml /tmp/puppet-etc/hieradata /tmp/puppet-etc/modules /tmp/puppet-etc/puppet.conf /tmp/puppet-etc/ssl /etc/puppet",
            "+ rm -Rf /etc/puppet/ssl",
            "+ echo '{\"step\": 6}'",
            "+ TAGS=",
            "+ '[' -n file,file_line,concat,augeas,cron,neutron_plugin_ml2,neutron_config,neutron_agent_ovs,neutron_plugin_ml2 ']'",
            "+ TAGS='--tags file,file_line,concat,augeas,cron,neutron_plugin_ml2,neutron_config,neutron_agent_ovs,neutron_plugin_ml2'",
            "+ origin_of_time=/var/lib/config-data/neutron.origin_of_time",
            "+ touch /var/lib/config-data/neutron.origin_of_time",
            "+ sync",
            "+ set +e",
            "+ FACTER_hostname=computeovsdpdk-1",
            "+ FACTER_uuid=docker",
            "+ /usr/bin/puppet apply --summarize --detailed-exitcodes --color=false --logdest syslog --logdest console --modulepath=/etc/puppet/modules:/usr/share/openstack-puppet/modules --tags file,file_line,concat,augeas,cron,neutron_plugin_ml2,neutron_config,neutron_agent_ovs,neutron_plugin_ml2 /etc/config.pp",
            "ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)",
            "Failed to get D-Bus connection: Operation not permitted",
            "Warning: Undefined variable 'deploy_config_name'; ",
            " (file & line not available)",
            "Warning: ModuleLoader: module 'neutron' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules",
            "Warning: ModuleLoader: module 'openstacklib' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules",
            "Warning: Scope(Class[Neutron]): neutron::rabbit_host, neutron::rabbit_hosts, neutron::rabbit_password, neutron::rabbit_port, neutron::rabbit_user, neutron::rabbit_virtual_host and neutron::rpc_backend are deprecated. Please use neutron::default_transport_url instead.",
            "Warning: This method is deprecated, please use match expressions with Stdlib::Compat::Array instead. They are described at https://docs.puppet.com/puppet/latest/reference/lang_data_type.html#match-expressions. at [\"/etc/puppet/modules/neutron/manifests/init.pp\", 530]:[\"/etc/puppet/modules/tripleo/manifests/profile/base/neutron/plugins/ml2.pp\", 45]",
            " (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:28:in `deprecation')",
            "Warning: This method is deprecated, please use the stdlib validate_legacy function,",
            " with Stdlib::Compat::Hash. There is further documentation for validate_legacy function in the README. at [\"/etc/puppet/modules/neutron/manifests/config.pp\", 132]:[\"/etc/puppet/modules/tripleo/manifests/profile/base/neutron.pp\", 131]",
            " with Stdlib::Compat::Array. There is further documentation for validate_legacy function in the README. at [\"/etc/puppet/modules/neutron/manifests/agents/ml2/ovs.pp\", 219]:[\"/etc/puppet/modules/tripleo/manifests/profile/base/neutron/ovs.pp\", 59]",
            "Warning: ModuleLoader: module 'oslo' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules",
            "Error: Failed to apply catalog: Execution of '/usr/bin/ovs-vsctl list Open_vSwitch .' returned 1: ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)",
            "+ rc=1",
            "+ set -e",
            "+ '[' 1 -ne 2 -a 1 -ne 0 ']'",
            "+ exit 1",
---------------------------------------------------------------

Saravanan KR (skramaja)
Changed in tripleo:
importance: Undecided → High
assignee: nobody → Saravanan KR (skramaja)
milestone: none → rocky-2
status: New → Triaged
Changed in tripleo:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (master)

Reviewed: https://review.openstack.org/563978
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=ec3e34709231b3dd0b166db9c011c5ef4d66cd80
Submitter: Zuul
Branch: master

commit ec3e34709231b3dd0b166db9c011c5ef4d66cd80
Author: Saravanan KR <email address hidden>
Date: Tue Apr 24 19:47:47 2018 +0530

    Add volumes list of docker-puppet container when merging config volumes

    When config volumes of same types are merged, the volumes to be mounted
    for the continer is not merged. In order to run neutron container with
    ovs agent, '/run/openvswitch' directory mount is required to execute
    ovs-vsctl commands. This patch merges the volumes list of the same
    config volumes instead of taking only the first one.

    Closes-Bug: #1766759
    Change-Id: I70972ad2fc339c9316befd74dda8555982f23316

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/queens)

Fix proposed to branch: stable/queens
Review: https://review.openstack.org/564384

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/queens)

Reviewed: https://review.openstack.org/564384
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=db6f0d3b60264fac13100eca951e6d11cac5205f
Submitter: Zuul
Branch: stable/queens

commit db6f0d3b60264fac13100eca951e6d11cac5205f
Author: Saravanan KR <email address hidden>
Date: Tue Apr 24 19:47:47 2018 +0530

    Add volumes list of docker-puppet container when merging config volumes

    When config volumes of same types are merged, the volumes to be mounted
    for the continer is not merged. In order to run neutron container with
    ovs agent, '/run/openvswitch' directory mount is required to execute
    ovs-vsctl commands. This patch merges the volumes list of the same
    config volumes instead of taking only the first one.

    Closes-Bug: #1766759
    Change-Id: I70972ad2fc339c9316befd74dda8555982f23316
    (cherry picked from commit ec3e34709231b3dd0b166db9c011c5ef4d66cd80)

tags: added: in-stable-queens
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 8.0.3

This issue was fixed in the openstack/tripleo-heat-templates 8.0.3 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 9.0.0.0b3

This issue was fixed in the openstack/tripleo-heat-templates 9.0.0.0b3 development milestone.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.