Autopilot test flakyness in test_outgoing_answer_local_hangup and test_outgoing_answer_remote_hangup

[Łukasz Zemczak]

On smoketesting, we are getting frequent failures of the test_outgoing_answer_local_hangup test in dialer_app test suite. It doesn't happen locally when running the tests - only on smoketesting. Re-runs can lead to things working again.

Traceback test_outgoing_answer_local_hangup:

Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/dialer_app/tests/test_calls.py", line 98, in test_outgoing_answer_local_hangup
    self.main_view.live_call_page.click_hangup_button()
  File "/usr/lib/python2.7/dist-packages/dialer_app/tests/__init__.py", line 104, in main_view
    return self.app.select_single(emulators.MainView)
  File "/usr/lib/python2.7/dist-packages/autopilot/introspection/dbus.py", line 320, in select_single
    instances = self.select_many(type_name, **kwargs)
  File "/usr/lib/python2.7/dist-packages/autopilot/introspection/dbus.py", line 458, in select_many
    state_dicts = self.get_state_by_path(query_path)
  File "/usr/lib/python2.7/dist-packages/autopilot/introspection/dbus.py", line 542, in get_state_by_path
    data = self._backend.introspection_iface.GetState(piece)
  File "/usr/lib/python2.7/dist-packages/dbus/proxies.py", line 70, in __call__
    return self._proxy_method(*args, **keywords)
  File "/usr/lib/python2.7/dist-packages/dbus/proxies.py", line 145, in __call__
    **keywords)
  File "/usr/lib/python2.7/dist-packages/dbus/connection.py", line 651, in call_blocking
    message, timeout)
DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the
message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken.

Traceback test_outgoing_answer_remote_hangup:

Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/dialer_app/tests/test_calls.py", line 107, in test_outgoing_answer_remote_hangup
    self.main_view.live_call_page.title, Eventually(Equals(number)))
  File "/usr/lib/python2.7/dist-packages/testtools/testcase.py", line 404, in assertThat
    mismatch_error = self._matchHelper(matchee, matcher, message, verbose)
  File "/usr/lib/python2.7/dist-packages/testtools/testcase.py", line 454, in _matchHelper
    mismatch = matcher.match(matchee)
  File "/usr/lib/python2.7/dist-packages/autopilot/matchers/__init__.py", line 113, in match
    wait_fun(self.matcher, self.timeout)
  File "/usr/lib/python2.7/dist-packages/autopilot/introspection/types.py", line 158, in wait_for
    _, new_state = self.parent.get_new_state()
  File "/usr/lib/python2.7/dist-packages/autopilot/introspection/dbus.py", line 564, in get_new_state
    raise StateNotFoundError(self.__class__.__name__, id=self.id)
StateNotFoundError: Object not found with name 'LiveCall' and properties {'id': 32}.

Smoketesting results with the failures:
 * http://ci.ubuntu.com/smokeng/trusty/touch/mako/299:20140416:20140411.3/7764/dialer_app/1038117/
 * http://ci.ubuntu.com/smokeng/trusty/touch/mako/299:20140416:20140411.3/7764/dialer_app/1038122/

[Łukasz Zemczak (sil2100)]

I would suspect that during test_outgoing_answer_local_hangup dialer-app is crashing right before end of the test, and that would be the reason suddenly MainView is not findable.