tempest cases test_associate_floatingip_port_ext_net_unreachable and test_create_floatingip_with_port_ext_net_unreachable fails

[Vedamurthy Joshi]

R2.20 Build 64

Tempest cases test_associate_floatingip_port_ext_net_unreachable and test_create_floatingip_with_port_ext_net_unreachable fails

Not sure why this assert is expected to be hit. Logging the bug anyway to track these failures

pythonlogging:'': {{{
2015-07-20 16:09:27,084 6082 INFO [tempest_lib.common.rest_client] Request (FloatingIPNegativeTestJSON:test_create_floatingip_with_port_ext_net_unreachable): 201 POST http://10.204.217.143:9696/v2.0/floatingips 0.216s
2015-07-20 16:09:27,085 6082 DEBUG [tempest_lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"floatingip": {"floating_network_id": "b1ea4692-b91b-4329-96a1-a894589f9e15", "fixed_ip_address": "10.100.0.3", "port_id": "eee83926-2321-49e2-a2ba-5664f24e000e"}}
    Response - Headers: {'status': '201', 'content-length': '371', 'connection': 'close', 'date': 'Mon, 20 Jul 2015 10:18:15 GMT', 'content-type': 'application/json; charset=UTF-8', 'x-openstack-request-id': 'req-3b1f967a-1e77-4f3e-bfc1-80903a16b0d7'}
        Body: {"floatingip": {"router_id": "f5d47cf0-4be6-4774-818f-6763658c69ab", "status": "ACTIVE", "tenant_id": "fb04e1c1c13e49b893cae7fa5ccd1682", "floating_network_id": "b1ea4692-b91b-4329-96a1-a894589f9e15", "fixed_ip_address": "10.100.0.3", "floating_ip_address": "10.204.219.3", "port_id": "eee83926-2321-49e2-a2ba-5664f24e000e", "id": "891ff5e8-07f5-4bc1-893a-0e9fbfa069bd"}}
}}}

Traceback (most recent call last):
  File "/home/ubuntu/jenkins/workspace/VeduTempest/tempest/tempest/api/network/test_floating_ips_negative.py", line 61, in test_create_floatingip_with_port_ext_net_unreachable
    ['ip_address'])
  File "/home/ubuntu/jenkins/workspace/VeduTempest/tempest/.venv/local/lib/python2.7/site-packages/testtools/testcase.py", line 422, in assertRaises
    self.assertThat(our_callable, matcher)
  File "/home/ubuntu/jenkins/workspace/VeduTempest/tempest/.venv/local/lib/python2.7/site-packages/testtools/testcase.py", line 435, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: <bound method NetworkClient.create_floatingip of <tempest.services.network.json.network_client.NetworkClient object at 0x5001450>> returned {u'floatingip': {u'router_id': u'f5d47cf0-4be6-4774-818f-6763658c69ab', u'status': u'ACTIVE', u'tenant_id': u'fb04e1c1c13e49b893cae7fa5ccd1682', u'floating_network_id': u'b1ea4692-b91b-4329-96a1-a894589f9e15', u'fixed_ip_address': u'10.100.0.3', u'floating_ip_address': u'10.204.219.3', u'port_id': u'eee83926-2321-49e2-a2ba-5664f24e000e', u'id': u'891ff5e8-07f5-4bc1-893a-0e9fbfa069bd'}}

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/23597
Submitter: <email address hidden> (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/23597
Committed: http://github.org/Juniper/contrail-controller/commit/b0669f1507299fcaacdead1dd62ad660773cabc5
Submitter: Zuul
Branch: master

commit b0669f1507299fcaacdead1dd62ad660773cabc5
Author: Sahil Sabharwal <email address hidden>
Date: Thu Aug 25 15:11:03 2016 -0700

Added Strict Compliance check

1. When Strict Compliance is set to true, check if the port has external gateway to the network
when associating it with a floatingip.
2. Added a test for verifying strict compliance behaviour at the time of fip creation.

Change-Id: I65ad6210db458d21beedbaa7d700c8aa967cf24c
Closes-Bug: 1476935

[Andrey Pavlov (apavlov-e)]

See same behaviour in R4.0 + OSPD10. build CB-25 rhel7+newton

Traceback (most recent call last):
  File "tempest/api/network/test_floating_ips_negative.py", line 84, in test_associate_floatingip_port_ext_net_unreachable
    fixed_ip_address=self.port['fixed_ips'][0]['ip_address'])
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 422, in assertRaises
    self.assertThat(our_callable, matcher)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 435, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: &lt;bound method FloatingIPsClient.update_floatingip of &lt;tempest.lib.services.network.floating_ips_client.FloatingIPsClient object at 0x4d8df90&gt;&gt; returned {u'floatingip': {u'router_id': u'6f9bc187-7bcd-4d4f-a101-9f14bcabad87', u'status': u'ACTIVE', u'description': u'', u'tenant_id': u'0724228ffb11432c883f98f5118eae08', u'created_at': u'2017-08-22T20:20:28.051428', u'updated_at': u'2017-08-22T20:20:28.051428', u'floating_network_id': u'801e61ac-cf3a-4f0e-a918-96b893e4e936', u'fixed_ip_address': u'10.100.0.3', u'floating_ip_address': u'10.5.0.10', u'port_id': u'1dde8f91-f054-4bbb-af42-eb4d46aede95', u'id': u'6cdba80e-17f7-4282-9579-74ad51d45abd'}}

[Sahil Sabharwal (ssabharwal)]

You should have 'strict_compliance' set to True in neutron.conf for this test case to pass.
Can you make sure it's set it that way and re-run the test again?

[Andrey Pavlov (apavlov-e)]

Hi Sahil,
I've set strict_compliance to contrail-api.conf inside container and restarted contrail-api.
Test works fine.

[tikitavi (rtikitavi)]

R4.1+OSPD10

The same situation.

Traceback (most recent call last):
  File "tempest/api/network/test_floating_ips_negative.py", line 59, in test_create_floatingip_with_port_ext_net_unreachable
    ['ip_address'])
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 422, in assertRaises
    self.assertThat(our_callable, matcher)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 435, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: <bound method FloatingIPsClient.create_floatingip of <tempest.lib.services.network.floating_ips_client.FloatingIPsClient object at 0x7f36d064d390>> returned {u'floatingip': {u'router_id': u'40c3ab0c-4c70-404a-ac0f-986ea45c7419', u'status': u'ACTIVE', u'description': u'', u'tenant_id': u'04bae483b313449e972aa8f1c2c3034a', u'created_at': u'2018-05-18T10:45:51.479617', u'updated_at': u'2018-05-18T10:45:51.479617', u'floating_network_id': u'6589c0f1-977c-4fc6-bc82-ec450a8ea284', u'fixed_ip_address': u'10.100.0.3', u'floating_ip_address': u'10.5.0.33', u'port_id': u'c3645c83-e73f-4bf1-9bdc-09afd07bf33a', u'id': u'e95e9891-76fc-4ff4-9aee-be298b384c2a'}}

Tried to set strict_compliance = True, but didn't succeed

[tikitavi (rtikitavi)]

Sorry, my fault, tested it again, test works fine.