fullstack.test_apps.TestArpResponder is always failed

[Li Ma]

dragonflow.tests.fullstack.test_apps.TestArpResponder is failed in the CI, but it is really working in my local environment.

ft2.1: dragonflow.tests.fullstack.test_apps.TestArpResponder.test_simple_response_StringException: Empty attachments:
  pythonlogging:''
  stderr
  stdout

Traceback (most recent call last):
  File "dragonflow/tests/fullstack/test_apps.py", line 164, in test_simple_response
    self.policy.wait(30)
  File "dragonflow/tests/common/app_testing_objects.py", line 456, in wait
    thread.wait(timeout)
  File "dragonflow/tests/common/app_testing_objects.py", line 863, in wait
    self.daemon.wait(timeout)
  File "dragonflow/common/utils.py", line 87, in wait
    self.thread.wait()
  File "/opt/stack/new/dragonflow/.tox/fullstack/local/lib/python2.7/site-packages/eventlet/greenthread.py", line 175, in wait
    return self._exit_event.wait()
  File "/opt/stack/new/dragonflow/.tox/fullstack/local/lib/python2.7/site-packages/eventlet/event.py", line 121, in wait
    return hubs.get_hub().switch()
  File "/opt/stack/new/dragonflow/.tox/fullstack/local/lib/python2.7/site-packages/eventlet/hubs/hub.py", line 294, in switch
    return self.greenlet.switch()
eventlet.timeout.Timeout: 30 seconds

[Li Ma (nick-ma-z)]

The fullstack test seems not running because there are no corresponding logs generated.

[Li Ma (nick-ma-z)]

After I skipped the ARP Response Test, the next test case still failed without any corresponding logs.

2016-07-24 03:40:24.271 | Test id Runtime (s)
2016-07-24 03:40:24.273 | -------------------------------------------------------------------------- -----------
2016-07-24 03:40:24.274 | dragonflow.tests.fullstack.test_apps.TestDHCPApp.test_dhcp_app 64.159
2016-07-24 03:40:24.276 | dragonflow.tests.fullstack.test_apps.TestApps.test_infrastructure 7.714
2016-07-24 03:40:24.277 | dragonflow.tests.fullstack.test_apps.TestArpResponder.test_simple_response 0.000

[Li Ma (nick-ma-z)]

I run all the test cases in test_apps in local environment. The timeout issue was randomly appeared.
Slowest Tests
Test id Runtime (s)
-------------------------------------------------------------------------- -----------
dragonflow.tests.fullstack.test_apps.TestL3App.test_icmp_ping_pong 76.976
dragonflow.tests.fullstack.test_apps.TestDHCPApp.test_dhcp_app 44.690
dragonflow.tests.fullstack.test_apps.TestDHCPApp.test_dhcp_app_dos_block 40.565
dragonflow.tests.fullstack.test_apps.TestArpResponder.test_simple_response 39.365
dragonflow.tests.fullstack.test_apps.TestApps.test_infrastructure 17.450

It seems that the running time of each case was increased and then reached the eventlet timeout.

[OpenStack Infra (hudson-openstack)]

Change abandoned by Li Ma (<email address hidden>) on branch: master
Review: https://review.openstack.org/343464

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/352072
Committed: https://git.openstack.org/cgit/openstack/dragonflow/commit/?id=64cedb13ea4f81d473fb64ea9f11237bb5a60162
Submitter: Jenkins
Branch: master

commit 64cedb13ea4f81d473fb64ea9f11237bb5a60162
Author: Omer Anson <email address hidden>
Date: Sun Aug 7 11:52:04 2016 +0300

    Add setting to set OVS manager

    Set default manager to listen at 0.0.0.0:6640. This should solve the
    fullstack issues.

    Closes-Bug: 1599458
    Change-Id: I03d5d22cbb47dc0c2c262f8c498cc84a225fbdd5