functional tests fail on EC2 juju 1.22 beta 3

[David Britton]

dpb@helo:trunk[0]$ python test_jujuclient.py
FFE...F..EEE
======================================================================
ERROR: test_charm (__main__.CharmTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 264, in test_charm
    self.charms.list()
  File "/home/dpb/src/canonical/juju/python-jujuclient/trunk/jujuclient.py", line 1482, in list
    "Params": {"Names": names}})
  File "/home/dpb/src/canonical/juju/python-jujuclient/trunk/jujuclient.py", line 1362, in rpc
    return self.env._rpc(op)
  File "/home/dpb/src/canonical/juju/python-jujuclient/trunk/jujuclient.py", line 279, in _rpc
    raise EnvError(result)
EnvError: <Env Error - Details:
 { u'Error': u'unknown version (1) of interface "Charms"',
    u'ErrorCode': u'not implemented',
    u'RequestId': 1,
    u'Response': { }}
 >

======================================================================
ERROR: test_ha (__main__.HATest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 281, in test_ha
    self.ha.ensure_availability(3)
  File "/home/dpb/src/canonical/juju/python-jujuclient/trunk/jujuclient.py", line 1766, in ensure_availability
    'EnvironTag': "environment-%s" % self._env_uuid,
AttributeError: 'HA' object has no attribute '_env_uuid'

======================================================================
ERROR: test_key_manager (__main__.KeyManagerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 88, in test_key_manager
    self.verify_keys(['juju-client-key', 'juju-system-key'])
  File "test_jujuclient.py", line 73, in verify_keys
    keys = self.key.keys(user)['Results'][0]['Result']
AttributeError: 'KeyManagerTest' object has no attribute 'key'

======================================================================
ERROR: test_user_manager (__main__.UserManagerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 142, in test_user_manager
    'created-by': 'admin@local'})
  File "test_jujuclient.py", line 126, in assert_user
    result = self.um.info(user['username'])
AttributeError: 'UserManager' object has no attribute 'info'

======================================================================
FAIL: test_actions (__main__.ActionTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 251, in test_actions
    self.assertEqual(result, [])
AssertionError: {u'results': [{u'error': {u'Message': u'id not found', u'Code': u'not found'}}]} != []

======================================================================
FAIL: test_backups (__main__.BackupTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 110, in test_backups
    self.assertEqual(len(self.bm.list()['List']), 2)
AssertionError: 1 != 2

======================================================================
FAIL: test_add_get_charm (__main__.ClientTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 329, in test_add_get_charm
    self.assertEqual(charm, {})
AssertionError: {u'URL': u'cs:~hazmat/trusty/etcd-6', u'Meta': {u'Peers': {u'cluster': {u'Name': [truncated]... != {}
Diff is 2058 characters long. Set self.maxDiff to None to see it.

----------------------------------------------------------------------
Ran 12 tests in 76.051s

FAILED (failures=3, errors=4)

Many look like easy ones to knock out, would need to compare to other juju versions though while testing.

[Kapil Thangavelu (hazmat)]

fwiw it looks like some of those are about testing with 1.23, some of those are just bugs, and some of those are api regressions in core.

[Tim Van Steenburgh (tvansteenburgh)]

Here's the test output using ec2 and 1.23.2:

> python test_jujuclient.py
FF........F.FEE....E
======================================================================
ERROR: test_ha (__main__.HATest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 304, in test_ha
    self.ha.ensure_availability(3)
  File "/home/tvansteenburgh/src/python-jujuclient/jujuclient.py", line 1806, in ensure_availability
    'EnvironTag': "environment-%s" % self._env_uuid,
AttributeError: 'HA' object has no attribute '_env_uuid'

======================================================================
ERROR: test_key_manager (__main__.KeyManagerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 111, in test_key_manager
    self.verify_keys(['juju-client-key', 'juju-system-key'])
  File "test_jujuclient.py", line 96, in verify_keys
    keys = self.key.keys(user)['Results'][0]['Result']
AttributeError: 'KeyManagerTest' object has no attribute 'key'

======================================================================
ERROR: test_user_manager (__main__.UserManagerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 165, in test_user_manager
    'created-by': 'admin@local'})
  File "test_jujuclient.py", line 149, in assert_user
    result = self.um.info(user['username'])
AttributeError: 'UserManager' object has no attribute 'info'

======================================================================
FAIL: test_actions (__main__.ActionTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 274, in test_actions
    self.assertEqual(result, [])
AssertionError: {u'results': [{u'started': u'0001-01-01T00:00:00Z', u'completed': u'0001-01-01T00:00:00Z', u'enqueued': u'0001-01-01T00:00:00Z', u'error': {u'Message': u'id not found', u'Code': u'not found'}}]} != []

======================================================================
FAIL: test_backups (__main__.BackupTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 133, in test_backups
    self.assertEqual(len(self.bm.list()['List']), 2)
AssertionError: 1 != 2

======================================================================
FAIL: test_add_get_charm (__main__.ClientTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test_jujuclient.py", line 352, in test_add_get_charm
    self.assertEqual(charm, {})
AssertionError: {u'URL': u'cs:~hazmat/trusty/etcd-6', u'Meta': {u'Peers': {u'cluster': {u'Name': [truncated]... != {}
Diff is 2089 characters long. Set self.maxDiff to None to see it.

======================================================================
FAIL: test_juju_info (__main__.ClientTest)
----------------------------------------------------------------------
Traceback (most recent call last):...