LBaaS: test_healthmonitor_basic scenario fails

[Elena Ezhova]

test_healthmonitor_basic fails in Jenkins as well as when it is run locally using tox -e scenario

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):
      File "neutron_lbaas/tests/tempest/lib/test.py", line 310, in tearDownClass
        six.reraise(etype, value, trace)
      File "neutron_lbaas/tests/tempest/lib/test.py", line 293, in tearDownClass
        teardown()
      File "neutron_lbaas/tests/tempest/lib/test.py", line 502, in clear_isolated_creds
        cls._creds_provider.clear_isolated_creds()
      File "neutron_lbaas/tests/tempest/lib/common/isolated_creds.py", line 415, in clear_isolated_creds
        self._clear_isolated_net_resources()
      File "neutron_lbaas/tests/tempest/lib/common/isolated_creds.py", line 406, in _clear_isolated_net_resources
        creds.subnet['name'])
      File "neutron_lbaas/tests/tempest/lib/common/isolated_creds.py", line 357, in _clear_isolated_subnet
        net_client.delete_subnet(subnet_id)
      File "neutron_lbaas/tests/tempest/lib/services/network/json/network_client.py", line 113, in _delete
        resp, body = self.delete(uri)
      File "/opt/stack/neutron-lbaas/.tox/scenario/local/lib/python2.7/site-packages/tempest_lib/common/rest_client.py", line 287, in delete
        return self.request('DELETE', url, extra_headers, headers, body)
      File "/opt/stack/neutron-lbaas/.tox/scenario/local/lib/python2.7/site-packages/tempest_lib/common/rest_client.py", line 643, in request
        resp, resp_body)
      File "/opt/stack/neutron-lbaas/.tox/scenario/local/lib/python2.7/site-packages/tempest_lib/common/rest_client.py", line 705, in _error_checker
        raise exceptions.Conflict(resp_body)
    tempest_lib.exceptions.Conflict: An object with that identifier already exists
    Details: {u'message': u'Unable to complete operation on subnet 8a98d02b-13c5-4d68-8908-18cc2ba868a3. One or more ports have an IP allocation from this subnet.', u'detail': u'', u'type': u'SubnetInUse'}

[Madhusudhan Kandadai (madhusudhan-kandadai)]

Did you test this patch: https://review.openstack.org/#/c/207196/ for the above failure?

From my experience, I would suggest to run the scenario test suite on a fresh environment(maybe restacking the devstack) else it may throw a lot of exception. FYI, I ran this in my environment(after restacking devstack) before I push that patch:

scenario develop-inst-nodeps: /opt/stack/neutron-lbaas
scenario installed: adium-theme-ubuntu==0.3.4,aioeventlet==0.4,alembic==0.7.7,amqp==1.4.6,anyjson==0.3.3,appdirs==1.4.0,apt-xapian-index==0.45,automaton==0.4.0,Babel==1.3,beautifulsoup4==4.4.0,boto==2.38.0,cachetools==1.0.3,cffi==1.1.2,chardet==2.0.1,-e git://git.openstack.org/openstack/cinder.git@4f197feb0d6d4d8c44329087eb373ecdbf282bac#egg=cinder-master,cliff==1.13.0,cliff-tablib==1.1,cmd2==0.6.8,command-not-found==0.3,contextlib2==0.4.0,coverage==3.7.1,cryptography==0.9.3,ddt==1.0.0,debtagshw==0.1,debtcollector==0.5.0,decorator==4.0.0,defer==1.0.6,dirspec==13.10,discover==0.4.0,Django==1.7.8,django-appconf==1.0.1,django-babel==0.4.0,django-compressor==1.5,django-openstack-auth==1.3.1,django-pyscss==2.0.2,docutils==0.12,dogpile.cache==0.5.6,dogpile.core==0.4.1,duplicity==0.6.23,ecdsa==0.13,enum34==1.0.4,eventlet==0.17.4,extras==0.0.3,fasteners==0.12.0,fixtures==1.3.1,flake8==2.2.4,funcsigs==0.4,functools32==3.2.3.post2,futures==3.0.3,futurist==0.1.2,git-review==1.23,-e git://git.openstack.org/openstack/glance.git@d4cf5a015b49b8163a71726781aee54da9c252ec#egg=glance-master,glance-store==0.6.0,greenlet==0.4.7,hacking==0.10.2,-e git+https://github.com/openstack/horizon@9a7326a6b4db8b4afc5c780ba35b09baf3c45921#egg=horizon-master,httplib2==0.9.1,idna==2.0,ipaddress==1.0.14,ipython==1.2.1,iso8601==0.1.10,Jinja2==2.7.3,jsonpatch==1.11,jsonpointer==1.9,jsonschema==2.5.1,-e git://git.openstack.org/openstack/keystone.git@6a6fcc22bef6f81dd202928e9c3f342c3338ad73#egg=keystone-master,keystonemiddleware==2.0.0,kombu==3.0.26,libvirt-python==1.2.16,linecache2==1.0.0,lockfile==0.8,logutils==0.3.3,lxml==3.3.3,M2Crypto==0.21.1,Mako==1.0.1,MarkupSafe==0.23,mccabe==0.2.1,mock==1.3.0,monotonic==0.2,mox3==0.8.0,msgpack-python==0.4.6,mysql-connector-python==1.1.6,MySQL-python==1.2.3,netaddr==0.7.15,netifaces==0.10.4,networkx==1.9.1,-e git://git.openstack.org/openstack/neutron.git@e96172e7a210d7f3fdecbe2e962a1890c08df20d#egg=neutron-master,-e git+https://review.openstack.org/openstack/neutron-lbaas@30842f7776b22b62dc5e737a444c3632b5335ff2#egg=neutron_lbaas-master,nose==1.3.7,-e git://git.openstack.org/openstack/nova.git@3ee98a619f64a7bbbbc4f58b4f5d44b759958f18#egg=nova-master,numpy==1.8.2,oauthlib==0.6.1,oneconf==0.3.7,ordereddict==1.1,os-brick==0.3.2,os-client-config==1.4.0,os-testr==0.2.0,oslo.concurrency==2.3.0,oslo.config==2.0.0,oslo.context==0.4.0,oslo.db==2.1.0,oslo.i18n==2.1.0,oslo.log==1.6.0,oslo.messaging==2.0.0,oslo.middleware==2.4.0,oslo.policy==0.6.0,oslo.reports==0.3.0,oslo.rootwrap==2.0.0,oslo.serialization==1.7.0,oslo.service==0.4.0,oslo.utils==2.0.0,oslo.versionedobjects==0.4.0,oslo.vmware==1.17.0,oslosphinx==3.0.0,oslotest==1.9.0,osprofiler==0.3.0,PAM==0.4.2,paramiko==1.15.2,passlib==1.6.2,Paste==2.0.2,PasteDeploy==1.5.2,pathlib==1.0.1,pbr==1.3.0,pecan==0.9.0,pep8...

[Elena Ezhova (eezhova)]

This bug hasn't been fixed yet, the change that fixes it [1] is still on review.

[1] https://review.openstack.org/#/c/207196/6

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/207196
Committed: https://git.openstack.org/cgit/openstack/neutron-lbaas/commit/?id=5f64a41907c2bf80815b9cf6cf32f993a2b01824
Submitter: Jenkins
Branch: master

commit 5f64a41907c2bf80815b9cf6cf32f993a2b01824
Author: madhusudhan-kandadai <email address hidden>
Date: Wed Jul 29 12:41:03 2015 -0700

    Fix for code redundancy and healthmonitor scenario tests

    Fixing the following files and code redundancy related to bug
    (a)base.py: Included ipv6 subnet creation for future ipv6 tests
    (b)create lb and heathmonitor with default ipv4 address
    (c)fix code redundancy for checking healthmonitor traffic requests

    Change-Id: Ieca24cc38d213a3ad4ea77c30a2a857b1f8843c8
    Closes-Bug: #1479346

[Armando Migliaccio (armando-migliaccio)]

This is not released yet. Leave it to Jenkins, that will know when this is 'released' properly.

[Madhusudhan Kandadai (madhusudhan-kandadai)]

Armando, just for my understanding, this patch: https://review.openstack.org/#/c/207196/ is merged in Jenkins, so do I still need to wait from Jenkins to take care of it?