All webbrowser-app tests failing with new autopilot

[Łukasz Zemczak]

When using the latest autopilot from the daily-build PPA (1.3.1+13.10.20130926-0ubuntu1), all webbrowser-app tests are failing on Ubuntu Touch (mako). The errors have such a form:

======================================================================
ERROR: webbrowser_app.tests.test_tabs.TestTabs.test_close_tab(with touch)
----------------------------------------------------------------------
_StringException: Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/webbrowser_app/tests/__init__.py", line 235, in setUp
    super(StartOpenRemotePageTestCaseBase, self).setUp()
  File "/usr/lib/python2.7/dist-packages/webbrowser_app/tests/__init__.py", line 210, in setUp
    self.server = http_server.HTTPServerInAThread(HTTP_SERVER_PORT)
  File "/usr/lib/python2.7/dist-packages/webbrowser_app/tests/http_server.py", line 79, in __init__
    self.server = BaseHTTPServer.HTTPServer(("", port), HTTPRequestHandler)
  File "/usr/lib/python2.7/SocketServer.py", line 419, in __init__
    self.server_bind()
  File "/usr/lib/python2.7/BaseHTTPServer.py", line 108, in server_bind
    SocketServer.TCPServer.server_bind(self)
  File "/usr/lib/python2.7/SocketServer.py", line 430, in server_bind
    self.socket.bind(self.server_address)
  File "/usr/lib/python2.7/socket.py", line 224, in meth
    return getattr(self._sock,name)(*args)
error: [Errno 98] Address already in use

[Didier Roche-Tolomelli (didrocks)]

Please before reproposing for landing autopilot, try testing all apps AP tests so that we can reschedule it on the landing plan.

[Olivier Tilloy (osomon)]

The webbrowser-app autopilot tests fire up a test HTTP server in a thread, and this error means that it fails to claim the port on which it wants to listen to incoming requests, which usually means that a previous test hasn’t been cleaned up correctly (and another old test process is still running, blocking this port).

Note that the browser test case does the required cleanup and shuts down the test server in its tearDown() method, so I don’t think the issue is there.

This issue pops up from time to time, I don’t know whether autopilot could be made more robust to ensure that there’s never a leftover test process running.

[Corey Goldberg (coreygoldberg)]

> Note that the browser test case does the required cleanup
> and shuts down the test server in its tearDown() method,
> so I don't think the issue is there.

it might not always get called.

in the autopilot tests of webbrowser-app, both 'BrowserTestCaseBase' and 'BrowserTestCaseBaseWithHTTPServer' use tearDown() funtions. It would be more robust to add these as cleanups rather than teardowns.

tearDown is only called if the setUp() succeeds, whereas a cleanup is called unconditionally. (cleanups were new in Python 2.7's unittest, and also exist in testtools.TestCase)

see http://docs.python.org/3/library/unittest.html#unittest.TestCase.addCleanup

so if a setUp() fails somewhere after the server is started, the tearDown will not be called, leaving a hanging server process around.

for example, in 'BrowserTestCaseBaseWithHTTPServer' class, you could rename tearDown() to cleanup() (or whatever), and inside the setUp, add:

`self.addCleanup(cleanup)`

this would make it more robust and possibly alleviate this issue.

p.s. if this wasn't explained clearly, I can MP a fix to webbrowser-app changing from tearDowns to addCleanups.
the TestCase class I'm referring to reside in /tests/autopilot/webbrowser_app/tests/__init__.py of webbrowser-app.

-cgoldberg

[Corey Goldberg (coreygoldberg)]

I MP'ed a branch of webbrowser-app changing the tearDowns to Cleanups.

https://code.launchpad.net/~coreygoldberg/webbrowser-app/cleanup-http-server/+merge/187874

[Corey Goldberg (coreygoldberg)]

another thought is to make the http server in http_server.py look for a free port before trying to bind, ensuring it never conflicts with another zombie instance or running service.

[PS Jenkins bot (ps-jenkins)]

Fix committed into lp:webbrowser-app at revision None, scheduled for release in webbrowser-app, milestone ubuntu-13.04-month-5

[Launchpad Janitor (janitor)]

This bug was fixed in the package webbrowser-app - 0.22+13.10.20131004.1-0ubuntu1

---------------
webbrowser-app (0.22+13.10.20131004.1-0ubuntu1) saucy; urgency=low

  [ Alexandre Abreu ]
  * Harden the set of accepted url patterns. (LP: #1226690)
  * When the browser is requested to create a new tab (from a new window
    request), open the new tab externally when in webapp mode. (LP:
    #1221824)

  [ Robert Bruce Park ]
  * Enable hardening, and fix some lintian warnings.

  [ Olivier Tilloy ]
  * Use a different port for the test server when a zombie process
    doesn’t release the default one, and use cleanup functions instead
    of tearDown() for improved robustness. (LP: #1231492)
  * Live bookmarking functionality in the activity view. Known
    shortcoming: in the activity view, one should be allowed to bookmark
    a domain that contains only one page. This is currently not the
    case, it will be addressed separately.
  * Expose a single contextual menu for both images and hyperlinks. (LP:
    #1233282)

  [ Ubuntu daily release ]
  * Automatic snapshot from revision 367
 -- Ubuntu daily release <email address hidden> Fri, 04 Oct 2013 07:22:38 +0000