neutron_ovs_agent constantly restarts on rhel8

Bug #1818834 reported by Michele Baldessari on 2019-03-06
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
High
Michele Baldessari

Bug Description

On rhel8 the ovs_neutron_agent container endlessly restarts with:

2019-03-05 15:41:57.096 534226 DEBUG oslo_concurrency.lockutils [req-a004e117-dba8-42bf-81fe-abf7a9f2faab - - - - -] Lock "conntrack" released by "neutron.agent.linux.ip_conntrack.get_conntrack" :: held 0.257s inner /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:339
2019-03-05 15:41:57.096 534226 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-a004e117-dba8-42bf-81fe-abf7a9f2faab - - - - -] Exit code: 1; Stdin: ; Stdout: Table `raw' does not exist
; Stderr: Agent terminated!: neutron_lib.exceptions.ProcessExecutionError: Exit code: 1; Stdin: ; Stdout: Table `raw' does not exist
2019-03-05 15:41:57.098 534226 INFO oslo_rootwrap.client [-] Stopping rootwrap daemon process with pid=534237

This is due to an iptables bug listing tables that were not initialized:
https://bugzilla.redhat.com/show_bug.cgi?id=1673609

Changed in tripleo:
assignee: nobody → Michele Baldessari (michele)
Changed in tripleo:
status: Triaged → In Progress

Reviewed: https://review.openstack.org/641316
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=b1d82e6acbc79d9db1a54d53cd178080b72d0845
Submitter: Zuul
Branch: master

commit b1d82e6acbc79d9db1a54d53cd178080b72d0845
Author: Michele Baldessari <email address hidden>
Date: Wed Mar 6 11:53:39 2019 +0100

    Workaround rhel8,0 iptables bug causing neutron_ovs_agent to restart continuously

    On rhel8 the ovs_neutron_agent container endlessly restarts with:

    2019-03-05 15:41:57.096 534226 DEBUG oslo_concurrency.lockutils [req-a004e117-dba8-42bf-81fe-abf7a9f2faab - - - - -] Lock "conntrack" released by "neutron.agent.linux.ip_conntrack.get_conntrack" :: held 0.257s inner /usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py:339
    2019-03-05 15:41:57.096 534226 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-a004e117-dba8-42bf-81fe-abf7a9f2faab - - - - -] Exit code: 1; Stdin: ; Stdout: Table `raw' does not exist
    ; Stderr: Agent terminated!: neutron_lib.exceptions.ProcessExecutionError: Exit code: 1; Stdin: ; Stdout: Table `raw' does not exist
    2019-03-05 15:41:57.098 534226 INFO oslo_rootwrap.client [-] Stopping rootwrap daemon process with pid=534237

    This is due to an iptables bug listing tables that were not initialized:
    https://bugzilla.redhat.com/show_bug.cgi?id=1673609

    Let us just load the raw module by listing it so that the issue does not
    appear. Slawomir and I tested this on an environment and could confirm
    that the agent does not restart any longer:
    [root@undercloud-0 ~]# podman logs neutron_ovs_agent 2>&1|grep -i error
    [root@undercloud-0 ~]#

    We are leaving these commands running on any OS version as they are
    harmless in any case.

    Closes-Bug: #1818834

    Co-Authored-By: Slawomir Kaplonski <email address hidden>

    Change-Id: Ifddcec009ae93ad0e51abfe1425eb81c1817db55

Changed in tripleo:
status: In Progress → Fix Released

This issue was fixed in the openstack/tripleo-heat-templates 10.4.0 release.

Michele Baldessari (michele) wrote :

So the fix for this was actually okay for deployment, but we will still have the issue during a reboot of undercloud/overcloud

Changed in tripleo:
status: Fix Released → Triaged
Changed in tripleo:
milestone: stein-3 → train-1
tags: added: stein-backport-potential
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.