test_floatingip_list_with_pagination failure

Bug #1656262 reported by YAMAMOTO Takashi
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
networking-midonet
Fix Released
Critical
YAMAMOTO Takashi
neutron
Fix Released
Undecided
YAMAMOTO Takashi

Bug Description

midonet.neutron.tests.unit.test_midonet_plugin_ml2.TestMidonetL3NatExtraRoute.test_floatingip_list_with_pagination_reverse
--------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/tests/base.py", line 114, in func
        return f(self, *args, **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/tests/base.py", line 114, in func
        return f(self, *args, **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/tests/base.py", line 114, in func
        return f(self, *args, **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/tests/unit/extensions/test_l3.py", line 2730, in test_floatingip_list_with_pagination_reverse
        ('floating_ip_address', 'asc'), 2, 2)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/tests/unit/db/test_db_base_plugin_v2.py", line 746, in _test_list_with_pagination_reverse
        self.assertThat(len(res[resources]),
    KeyError: 'floatingips'

Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
     WARNING [neutron.agent.securitygroups_rpc] Driver configuration doesn't match with enable_security_group
     WARNING [neutron.plugins.ml2.managers] Host filtering is disabled because at least one mechanism doesn't support it.
     WARNING [neutron.agent.securitygroups_rpc] Driver configuration doesn't match with enable_security_group
     WARNING [neutron.scheduler.dhcp_agent_scheduler] No more DHCP agents
     WARNING [neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api] Unable to schedule network 85a36d0b-3950-4c3b-aa00-8fbdab2b48a4: no agents available; will retry on subsequent port and subnet creation events.
     WARNING [neutron.scheduler.dhcp_agent_scheduler] No more DHCP agents
     WARNING [neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api] Unable to schedule network ce168e7d-70e7-412a-8333-711c3f13890b: no agents available; will retry on subsequent port and subnet creation events.
     WARNING [neutron.scheduler.dhcp_agent_scheduler] No more DHCP agents
     WARNING [neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api] Unable to schedule network c15a7692-272e-4140-bd9a-2faa8287deeb: no agents available; will retry on subsequent port and subnet creation events.
     WARNING [neutron.scheduler.dhcp_agent_scheduler] No more DHCP agents
     WARNING [neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api] Unable to schedule network 85a36d0b-3950-4c3b-aa00-8fbdab2b48a4: no agents available; will retry on subsequent port and subnet creation events.
     WARNING [neutron.scheduler.dhcp_agent_scheduler] No more DHCP agents
     WARNING [neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api] Unable to schedule network ce168e7d-70e7-412a-8333-711c3f13890b: no agents available; will retry on subsequent port and subnet creation events.
     WARNING [neutron.scheduler.dhcp_agent_scheduler] No more DHCP agents
     WARNING [neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api] Unable to schedule network c15a7692-272e-4140-bd9a-2faa8287deeb: no agents available; will retry on subsequent port and subnet creation events.
       ERROR [neutron.api.v2.resource] index failed: No details.
    Traceback (most recent call last):
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/api/v2/resource.py", line 79, in resource
        result = method(request=request, **args)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/db/api.py", line 92, in wrapped
        setattr(e, '_RETRY_EXCEEDED', True)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
        self.force_reraise()
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
        six.reraise(self.type_, self.value, self.tb)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/db/api.py", line 88, in wrapped
        return f(*args, **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_db/api.py", line 151, in wrapper
        ectxt.value = e.inner_exc
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
        self.force_reraise()
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
        six.reraise(self.type_, self.value, self.tb)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_db/api.py", line 139, in wrapper
        return f(*args, **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/db/api.py", line 128, in wrapped
        traceback.format_exc())
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
        self.force_reraise()
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
        six.reraise(self.type_, self.value, self.tb)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/db/api.py", line 123, in wrapped
        return f(*dup_args, **dup_kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/api/v2/base.py", line 369, in index
        return self._items(request, True, parent_id)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/api/v2/base.py", line 308, in _items
        obj_list = obj_getter(request.context, **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/db/api.py", line 163, in wrapped
        return method(*args, **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/db/api.py", line 92, in wrapped
        setattr(e, '_RETRY_EXCEEDED', True)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
        self.force_reraise()
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
        six.reraise(self.type_, self.value, self.tb)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/db/api.py", line 88, in wrapped
        return f(*args, **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_db/api.py", line 151, in wrapper
        ectxt.value = e.inner_exc
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
        self.force_reraise()
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
        six.reraise(self.type_, self.value, self.tb)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_db/api.py", line 139, in wrapper
        return f(*args, **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/db/api.py", line 128, in wrapped
        traceback.format_exc())
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
        self.force_reraise()
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
        six.reraise(self.type_, self.value, self.tb)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/db/api.py", line 123, in wrapped
        return f(*dup_args, **dup_kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/db/l3_db.py", line 1413, in get_floatingips
        page_reverse=page_reverse)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/db/common_db_mixin.py", line 253, in _get_collection
        page_reverse=page_reverse)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/src/neutron/neutron/db/common_db_mixin.py", line 243, in _get_collection_query
        sort_dirs=sort_dirs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_db/sqlalchemy/utils.py", line 235, in paginate_query
        crit_attrs.append((model_attr > marker_values[i]))
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/sqlalchemy/sql/operators.py", line 318, in __gt__
        return self.operate(gt, other)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/sqlalchemy/orm/attributes.py", line 175, in operate
        return op(self.comparator, *other, **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/sqlalchemy/sql/operators.py", line 318, in __gt__
        return self.operate(gt, other)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/sqlalchemy/orm/properties.py", line 269, in operate
        return op(self.__clause_element__(), *other, **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/sqlalchemy/sql/operators.py", line 318, in __gt__
        return self.operate(gt, other)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/sqlalchemy/sql/elements.py", line 742, in operate
        return op(self.comparator, *other, **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/sqlalchemy/sql/operators.py", line 318, in __gt__
        return self.operate(gt, other)
      File "<string>", line 1, in <lambda>
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/sqlalchemy/sql/type_api.py", line 60, in operate
        return o[0](self.expr, op, *(other + o[1:]), **kwargs)
      File "/Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/sqlalchemy/sql/default_comparator.py", line 53, in _boolean_compare
        "Only '=', '!=', 'is_()', 'isnot()' operators can "
    ArgumentError: Only '=', '!=', 'is_()', 'isnot()' operators can be used with None/True/False

Captured stderr:
~~~~~~~~~~~~~~~~
    /Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py:259: OsloDBDeprecationWarning: EngineFacade is deprecated; please use oslo_db.sqlalchemy.enginefacade
      self._legacy_facade = LegacyEngineFacade(None, _factory=self)
    /Users/yamamoto/git/networking-midonet/.tox/py27/lib/python2.7/site-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated. Call .resolve and .require separately.
      return pkg_resources.EntryPoint.parse("x=" + s).load(False)

description: updated
tags: added: gate-failure
Changed in networking-midonet:
assignee: nobody → YAMAMOTO Takashi (yamamoto)
importance: Undecided → Critical
milestone: none → 4.0.0
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to neutron (master)

Fix proposed to branch: master
Review: https://review.openstack.org/419896

Changed in neutron:
assignee: nobody → YAMAMOTO Takashi (yamamoto)
status: New → In Progress
Changed in neutron:
assignee: YAMAMOTO Takashi (yamamoto) → Gary Kotton (garyk)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to neutron (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/420458

Changed in neutron:
assignee: Gary Kotton (garyk) → YAMAMOTO Takashi (yamamoto)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to neutron (master)

Reviewed: https://review.openstack.org/419896
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=e74b45d0eb923129902f1926aaddb51e6e2b8085
Submitter: Jenkins
Branch: master

commit e74b45d0eb923129902f1926aaddb51e6e2b8085
Author: YAMAMOTO Takashi <email address hidden>
Date: Fri Jan 13 11:50:06 2017 +0000

    Revert "Protect against non-determinstic sort"

    This reverts commit 175bfe048283ae930b60b1cea87874d1fa1d10d6.

    The change causes the following error if you're
    unlucky enough to have such a marker column.

       ArgumentError: Only '=', '!=', 'is_()', 'isnot()' operators can be used with None/True/False

    I saw test_floatingip_list_with_pagination failing,
    where fixed_port_id of the marker was None.

    Closes-Bug: #1656262
    Change-Id: I6c32949d789f25d877d329ef0ae9d8650cb81acf

Changed in neutron:
status: In Progress → Fix Released
tags: added: neutron-proactive-backport-potential
tags: removed: neutron-proactive-backport-potential
Changed in networking-midonet:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/neutron 10.0.0.0b3

This issue was fixed in the openstack/neutron 10.0.0.0b3 development milestone.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to neutron (master)

Reviewed: https://review.openstack.org/420458
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=e9572eabc0fd56bb0d9853553b100476a53403f8
Submitter: Jenkins
Branch: master

commit e9572eabc0fd56bb0d9853553b100476a53403f8
Author: YAMAMOTO Takashi <email address hidden>
Date: Mon Jan 16 07:40:02 2017 +0900

    test_l3: Enable native pagination and sort

    Add the following vars in test plugins to improve the coverage.
        __native_pagination_support
        __native_sort_support

    non-native cases are still covered by others. (eg. test_extraroute)

    Related-Bug: #1656262
    Change-Id: Icea91df303d06190995a06f532ea595ec2c9919f

tags: added: neutron-proactive-backport-potential
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to neutron (stable/newton)

Related fix proposed to branch: stable/newton
Review: https://review.openstack.org/449586

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to neutron (stable/newton)

Reviewed: https://review.openstack.org/449586
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=5b321afbc3e2b73b0dd6b83c27c26e8626080595
Submitter: Jenkins
Branch: stable/newton

commit 5b321afbc3e2b73b0dd6b83c27c26e8626080595
Author: YAMAMOTO Takashi <email address hidden>
Date: Mon Jan 16 07:40:02 2017 +0900

    test_l3: Enable native pagination and sort

    Add the following vars in test plugins to improve the coverage.
        __native_pagination_support
        __native_sort_support

    non-native cases are still covered by others. (eg. test_extraroute)

    Related-Bug: #1656262
    Change-Id: Icea91df303d06190995a06f532ea595ec2c9919f
    (cherry picked from commit e9572eabc0fd56bb0d9853553b100476a53403f8)

tags: added: in-stable-newton
tags: removed: neutron-proactive-backport-potential
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.