Autopilot test failures in trunk.

[Thomi Richards]

I have three failing tests in autopilot trunk

full failure output:

======================================================================
FAIL: autopilot.tests.functional.test_introspection_features.IntrospectionFeatureTests.test_print_tree_depth_limit
----------------------------------------------------------------------
Empty attachments:
  /var/log/syslog
  process-stdout

process-return-code: {{{-15}}}
process-stderr: {{{
Gtk-Message: Failed to load module "autopilot"
Testability driver loaded. Wire protocol version is "1.4".
}}}

test-log: {{{
10:58:07.354 INFO globals:57 - ************************************************************
10:58:07.354 INFO globals:58 - Starting test autopilot.tests.functional.test_introspection_features.IntrospectionFeatureTests.test_print_tree_depth_limit
10:58:07.354 WARNING testcase:115 - No tracing available - install the python-autopilot-trace package!
10:58:07.367 INFO _launcher:152 - Launching process: ['/usr/bin/window-mocker', '-testability', '/tmp/tmpTXoG6h.json']
10:58:08.664 DEBUG dbus:431 - Selecting objects of type QMainWindow with attributes: {}
10:58:10.241 INFO _launcher:340 - waiting for process to exit.
10:58:10.241 INFO _launcher:266 - Killing process 22603
}}}

Traceback (most recent call last):
  File "autopilot/tests/functional/test_introspection_features.py", line 177, in test_print_tree_depth_limit
    self.assertThat(out, Contains("== /Root/QMainWindow =="))
  File "/usr/lib/python2.7/dist-packages/testtools/testcase.py", line 406, in assertThat
    raise mismatch_error
MismatchError: '== /Root/QMainWindow ==' not in u"== /window-mocker/QMainWindow ==\nChildren: [dbus.String(u'QMainWindowLayout'), dbus.String(u'QRubberBand'), dbus.String(u'QMenuBar'), dbus.String(u'MouseTestWidget')]\n_autopilot_id: 2\nacceptDrops: False\naccessibleDescription: u''\naccessibleName: u''\nanimated: True\nautoFillBackground: False\nbaseSize: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\nchildrenRect: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(100, variant_level=1)], signature=None)\ncontextMenuPolicy: 1\ndockNestingEnabled: False\ndockOptions: 5\ndocumentMode: False\nenabled: True\nfocus: False\nfocusPolicy: 0\nframeGeometry: Rectangle([dbus.Int32(42, variant_level=1), dbus.Int32(67, variant_level=1), dbus.Int32(216, variant_level=1), dbus.Int32(143, variant_level=1)], signature=None)\nframeSize: Size([dbus.Int32(216, variant_level=1), dbus.Int32(143, variant_level=1)], signature=None)\nfullScreen: False\ngeometry: Rectangle([dbus.Int32(50, variant_level=1), dbus.Int32(102, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(100, variant_level=1)], signature=None)\nglobalRect: Rectangle([dbus.Int32(50, variant_level=1), dbus.Int32(102, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(100, variant_level=1)], signature=None)\nheight: 100\niconSize: Size([dbus.Int32(24, variant_level=1), dbus.Int32(24, variant_level=1)], signature=None)\nid: 2\ninputMethodHints: 0\nisActiveWindow: True\nlayoutDirection: 0\nmaximized: False\nmaximumHeight: 16777215\nmaximumSize: Size([dbus.Int32(16777215, variant_level=1), dbus.Int32(16777215, variant_level=1)], signature=None)\nmaximumWidth: 16777215\nminimized: False\nminimumHeight: 58\nminimumSize: Size([dbus.Int32(27, variant_level=1), dbus.Int32(58, variant_level=1)], signature=None)\nminimumSizeHint: Size([dbus.Int32(27, variant_level=1), dbus.Int32(58, variant_level=1)], signature=None)\nminimumWidth: 27\nmodal: False\nmouseTracking: False\nnormalGeometry: Rectangle([dbus.Int32(50, variant_level=1), dbus.Int32(102, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(100, variant_level=1)], signature=None)\nobjectName: u''\npos: Point([dbus.Int32(42, variant_level=1), dbus.Int32(67, variant_level=1)], signature=None)\nrect: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(100, variant_level=1)], signature=None)\nsize: Size([dbus.Int32(200, variant_level=1), dbus.Int32(100, variant_level=1)], signature=None)\nsizeHint: Size([dbus.Int32(27, variant_level=1), dbus.Int32(58, variant_level=1)], signature=None)\nsizeIncrement: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\nstatusTip: u''\nstyleSheet: u''\ntabShape: 0\ntoolButtonStyle: 0\ntoolTip: u''\nunifiedTitleAndToolBarOnMac: False\nupdatesEnabled: True\nvisible: True\nwhatsThis: u''\nwidth: 200\nwindowFilePath: u''\nwindowIconText: u''\nwindowModality: 0\nwindowModified: False\nwindowOpacity: 1.0\nwindowTitle: u'Default Window Title'\nx: 42\ny: 67\n\n == /window-mocker/QMainWindow/QRubberBand ==\n _autopilot_id: 4\n acceptDrops: False\n accessibleDescription: u''\n accessibleName: u''\n autoFillBackground: False\n baseSize: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n childrenRect: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n contextMenuPolicy: 1\n enabled: True\n focus: False\n focusPolicy: 0\n frameGeometry: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n frameSize: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n fullScreen: False\n geometry: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n globalRect: Rectangle([dbus.Int32(50, variant_level=1), dbus.Int32(102, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n height: 0\n id: 4\n inputMethodHints: 0\n isActiveWindow: True\n layoutDirection: 0\n maximized: False\n maximumHeight: 16777215\n maximumSize: Size([dbus.Int32(16777215, variant_level=1), dbus.Int32(16777215, variant_level=1)], signature=None)\n maximumWidth: 16777215\n minimized: False\n minimumHeight: 0\n minimumSize: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n minimumSizeHint: Size([dbus.Int32(-1, variant_level=1), dbus.Int32(-1, variant_level=1)], signature=None)\n minimumWidth: 0\n modal: False\n mouseTracking: False\n normalGeometry: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n objectName: u'qt_rubberband'\n pos: Point([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n rect: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n size: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n sizeHint: Size([dbus.Int32(-1, variant_level=1), dbus.Int32(-1, variant_level=1)], signature=None)\n sizeIncrement: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n statusTip: u''\n styleSheet: u''\n toolTip: u''\n updatesEnabled: True\n visible: False\n whatsThis: u''\n width: 0\n windowFilePath: u''\n windowIconText: u''\n windowModality: 0\n windowModified: False\n windowOpacity: 1.0\n windowTitle: u''\n x: 0\n y: 0\n\n == /window-mocker/QMainWindow/QMainWindowLayout ==\n _autopilot_id: 5\n id: 5\n margin: 11\n objectName: u'_layout'\n sizeConstraint: 0\n spacing: 6\n\n == /window-mocker/QMainWindow/MouseTestWidget ==\n Children: [dbus.String(u'QLabel'), dbus.String(u'QLabel'), dbus.String(u'QVBoxLayout'), dbus.String(u'QPropertyAnimation')]\n _autopilot_id: 6\n acceptDrops: False\n accessibleDescription: u''\n accessibleName: u''\n autoFillBackground: False\n baseSize: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n childrenRect: Rectangle([dbus.Int32(9, variant_level=1), dbus.Int32(9, variant_level=1), dbus.Int32(182, variant_level=1), dbus.Int32(82, variant_level=1)], signature=None)\n contextMenuPolicy: 1\n enabled: True\n focus: False\n focusPolicy: 0\n frameGeometry: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(100, variant_level=1)], signature=None)\n frameSize: Size([dbus.Int32(200, variant_level=1), dbus.Int32(100, variant_level=1)], signature=None)\n fullScreen: False\n geometry: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(100, variant_level=1)], signature=None)\n globalRect: Rectangle([dbus.Int32(50, variant_level=1), dbus.Int32(102, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(100, variant_level=1)], signature=None)\n height: 100\n id: 6\n inputMethodHints: 0\n isActiveWindow: True\n layoutDirection: 0\n maximized: False\n maximumHeight: 16777215\n maximumSize: Size([dbus.Int32(16777215, variant_level=1), dbus.Int32(16777215, variant_level=1)], signature=None)\n maximumWidth: 16777215\n minimized: False\n minimumHeight: 0\n minimumSize: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n minimumSizeHint: Size([dbus.Int32(27, variant_level=1), dbus.Int32(58, variant_level=1)], signature=None)\n minimumWidth: 0\n modal: False\n mouseTracking: True\n normalGeometry: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n objectName: u''\n pos: Point([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n rect: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(100, variant_level=1)], signature=None)\n size: Size([dbus.Int32(200, variant_level=1), dbus.Int32(100, variant_level=1)], signature=None)\n sizeHint: Size([dbus.Int32(27, variant_level=1), dbus.Int32(58, variant_level=1)], signature=None)\n sizeIncrement: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n statusTip: u''\n styleSheet: u''\n toolTip: u''\n updatesEnabled: True\n visible: True\n whatsThis: u''\n width: 200\n windowFilePath: u''\n windowIconText: u''\n windowModality: 0\n windowModified: False\n windowOpacity: 1.0\n windowTitle: u''\n x: 0\n y: 0\n\n == /window-mocker/QMainWindow/QMenuBar ==\n Children: [dbus.String(u'QDBusServiceWatcher'), dbus.String(u'QToolButton')]\n _autopilot_id: 7\n acceptDrops: False\n accessibleDescription: u''\n accessibleName: u''\n autoFillBackground: False\n baseSize: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n childrenRect: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n contextMenuPolicy: 1\n defaultUp: False\n enabled: True\n focus: False\n focusPolicy: 0\n frameGeometry: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n frameSize: Size([dbus.Int32(200, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n fullScreen: False\n geometry: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n globalRect: Rectangle([dbus.Int32(50, variant_level=1), dbus.Int32(102, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n height: 0\n id: 7\n inputMethodHints: 0\n isActiveWindow: True\n layoutDirection: 0\n maximized: False\n maximumHeight: 16777215\n maximumSize: Size([dbus.Int32(16777215, variant_level=1), dbus.Int32(16777215, variant_level=1)], signature=None)\n maximumWidth: 16777215\n minimized: False\n minimumHeight: 0\n minimumSize: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n minimumSizeHint: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n minimumWidth: 0\n modal: False\n mouseTracking: True\n nativeMenuBar: True\n normalGeometry: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n objectName: u''\n pos: Point([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n rect: Rectangle([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1), dbus.Int32(200, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n size: Size([dbus.Int32(200, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n sizeHint: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n sizeIncrement: Size([dbus.Int32(0, variant_level=1), dbus.Int32(0, variant_level=1)], signature=None)\n statusTip: u''\n styleSheet: u''\n toolTip: u''\n updatesEnabled: True\n visible: True\n whatsThis: u''\n width: 200\n windowFilePath: u''\n windowIconText: u''\n windowModality: 0\n windowModified: False\n windowOpacity: 1.0\n windowTitle: u''\n x: 0\n y: 0\n"
======================================================================
FAIL: autopilot.tests.functional.test_introspection_features.IntrospectionFeatureTests.test_print_tree_full
----------------------------------------------------------------------
Empty attachments:
  /var/log/syslog
  process-stdout

process-return-code: {{{-15}}}
process-stderr: {{{
Gtk-Message: Failed to load module "autopilot"
Testability driver loaded. Wire protocol version is "1.4".
QMetaProperty::read: Unable to handle unregistered datatype 'WatchMode' for property 'QDBusServiceWatcher::watchMode'
QMetaProperty::read: Unable to handle unregistered datatype 'WatchMode' for property 'QDBusServiceWatcher::watchMode'
QMetaProperty::read: Unable to handle unregistered datatype 'WatchMode' for property 'QDBusServiceWatcher::watchMode'
QMetaProperty::read: Unable to handle unregistered datatype 'WatchMode' for property 'QDBusServiceWatcher::watchMode'
QMetaProperty::read: Unable to handle unregistered datatype 'WatchMode' for property 'QDBusServiceWatcher::watchMode'
QMetaProperty::read: Unable to handle unregistered datatype 'WatchMode' for property 'QDBusServiceWatcher::watchMode'
}}}

test-log: {{{
10:58:24.066 INFO globals:57 - ************************************************************
10:58:24.066 INFO globals:58 - Starting test autopilot.tests.functional.test_introspection_features.IntrospectionFeatureTests.test_print_tree_full
10:58:24.067 WARNING testcase:115 - No tracing available - install the python-autopilot-trace package!
10:58:24.082 INFO _launcher:152 - Launching process: ['/usr/bin/window-mocker', '-testability', '/tmp/tmpTQuqOV.json']
10:58:25.377 DEBUG dbus:431 - Selecting objects of type QMainWindow with attributes: {}
10:58:28.621 INFO _launcher:340 - waiting for process to exit.
10:58:28.621 INFO _launcher:266 - Killing process 22666
}}}

Traceback (most recent call last):
  File "autopilot/tests/functional/test_introspection_features.py", line 138, in test_print_tree_full
    Equals(True))
  File "/usr/lib/python2.7/dist-packages/testtools/testcase.py", line 406, in assertThat
    raise mismatch_error
MismatchError: True != False
======================================================================
FAIL: autopilot.tests.functional.test_introspection_features.IntrospectionFeatureTests.test_window_geometry
----------------------------------------------------------------------
Empty attachments:
  /var/log/syslog
  process-stdout

process-return-code: {{{-15}}}
process-stderr: {{{
Gtk-Message: Failed to load module "autopilot"
Testability driver loaded. Wire protocol version is "1.4".
}}}

test-log: {{{
11:01:24.167 INFO globals:57 - ************************************************************
11:01:24.167 INFO globals:58 - Starting test autopilot.tests.functional.test_introspection_features.IntrospectionFeatureTests.test_window_geometry
11:01:24.167 WARNING testcase:115 - No tracing available - install the python-autopilot-trace package!
11:01:24.181 INFO _launcher:152 - Launching process: ['/usr/bin/window-mocker', '-testability', '/tmp/tmpvce4Or.json']
11:01:25.475 INFO _launcher:340 - waiting for process to exit.
11:01:25.475 INFO _launcher:266 - Killing process 23340
}}}

Traceback (most recent call last):
  File "autopilot/tests/functional/test_introspection_features.py", line 202, in test_window_geometry
    self.assertThat(geom[3], LessThan(sheight + 1))
  File "/usr/lib/python2.7/dist-packages/testtools/testcase.py", line 406, in assertThat
    raise mismatch_error
MismatchError: 1081 is not > 1896

Ran 721 tests in 398.826s
FAILED (failures=3)

[Launchpad Janitor (janitor)]

This bug was fixed in the package autopilot - 1.4+14.04.20140212-0ubuntu1

---------------
autopilot (1.4+14.04.20140212-0ubuntu1) trusty; urgency=low

  [ CI bot ]
  * Resync trunk

  [ Christopher Lee ]
  * Deprecating the use of AutopilotTestCase.pick_app_launcher
  * Fix a regression in the "autopilot launch" command which meant that
    application arguments were taken as the application to launch. (LP:
    #1275913)

  [ Thomi Richards ]
  * Remove ibus.py from autopilot, as it should live in lp:unity. (LP:
    #1210661)
  * Add unit tests to the autopilot.run module.
  * Refactor parts of the 'autopilot.run' module, adding unit tests and
    simplifying the code along the way.
  * Fix docs WRT Eventually matcher's interaction with Raises() matcher.
    (LP: #1244490)
  * Get display resolution using fbset, falling back to hard coded
    values based on image codename on phablet devices.
  * Fix functional tests that started failing when window-mocker
    changed. (LP: #1278187)
  * Add unit tests for missing coverage on code that picks device
    backends at runtime.
  * Fix a bug where autopilot didn't do the right thing with non-unicode
    valid bytestrings. (LP: #1278272)
 -- Ubuntu daily release <email address hidden> Wed, 12 Feb 2014 01:14:02 +0000