test_list_pagination_with_href_links fails intermittently

[Armando Migliaccio]

http://logs.openstack.org/08/347708/2/gate/gate-neutron-dsvm-api/d70465a/testr_results.html.gz

Traceback (most recent call last):
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/test_ports.py", line 80, in test_list_pagination_with_href_links
    self._test_list_pagination_with_href_links()
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/base.py", line 485, in inner
    return f(self, *args, **kwargs)
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/base.py", line 476, in inner
    return f(self, *args, **kwargs)
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/base.py", line 663, in _test_list_pagination_with_href_links
    self._test_list_pagination_iteratively(self._list_all_with_hrefs)
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/base.py", line 592, in _test_list_pagination_iteratively
    len(expected_resources), sort_args
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/base.py", line 643, in _list_all_with_hrefs
    self.assertNotIn('next', prev_links)
  File "/usr/local/lib/python2.7/dist-packages/testtools/testcase.py", line 455, in assertNotIn
    self.assertThat(haystack, matcher, message)
  File "/usr/local/lib/python2.7/dist-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: {u'previous': u'http://127.0.0.1:9696/v2.0/ports?limit=1&sort_dir=asc&sort_key=name&marker=a963fff7-eaf1-4455-9597-e82528720797&page_reverse=True', u'next': u'http://127.0.0.1:9696/v2.0/ports?limit=1&sort_dir=asc&sort_key=name&marker=a963fff7-eaf1-4455-9597-e82528720797'} matches Contains('next')

or

Traceback (most recent call last):
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/test_networks.py", line 124, in test_list_pagination_with_href_links
    self._test_list_pagination_with_href_links()
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/base.py", line 486, in inner
    return f(self, *args, **kwargs)
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/base.py", line 477, in inner
    return f(self, *args, **kwargs)
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/base.py", line 664, in _test_list_pagination_with_href_links
    self._test_list_pagination_iteratively(self._list_all_with_hrefs)
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/base.py", line 593, in _test_list_pagination_iteratively
    len(expected_resources), sort_args
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/base.py", line 657, in _list_all_with_hrefs
    self.assertSameOrder(resources, reversed(resources2))
  File "/opt/stack/new/neutron/neutron/tests/tempest/api/base.py", line 516, in assertSameOrder
    self.assertEqual(expected[self.field], res[self.field])
  File "/usr/local/lib/python2.7/dist-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/local/lib/python2.7/dist-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: u'123test' != u'abc1'

[Armando Migliaccio (armando-migliaccio)]

@Ihar: mind having a look?

[Victor Morales (electrocucaracha)]

It seems like next doesn't have page_reverse query field

[Ihar Hrachyshka (ihar-hrachyshka)]

I believe this is the duplicate of bug 1607903: the output suggests that router interfaces are included in the baseline list of ports we use to compare to paginated results.

[Armando Migliaccio (armando-migliaccio)]

Thanks!

[Armando Migliaccio (armando-migliaccio)]

I got a more recent failure, that postdates the fix for bug 1607903

http://logs.openstack.org/18/337518/1/gate/gate-neutron-dsvm-api/7dc1856/

[Ihar Hrachyshka (ihar-hrachyshka)]

Armando, that other failure you identified is for another test, and is indeed a duplicate of what you marked the bug a duplicate for. But THIS bug is different, we should not make it a dup of 1614964.

[Armando Migliaccio (armando-migliaccio)]

Ihar, thanks for looking into this. The only reason why this is DUP is because I'd rather have one bug to look at when dealing with the family of failures of the test_list_pagination_with_href_links test than N. If you want to dedup, it's fine so long as we have a prompt fix :)