test_create_loadbalancer() instance ssh authentication failure

[Corey Bryant]

This failure can be seen in the following review (see: "Patch set 5 Oct 29 5:33 PM" and "hirsute-wallaby-ha-ovn"):
https://review.opendev.org/c/openstack/charm-octavia/+/815543

Full job output is attached.

Traceback:

2021-10-29 20:41:31.346942 | bionic-medium | 2021-10-29 20:41:31 [INFO] ======================================================================
2021-10-29 20:41:31.347161 | bionic-medium | 2021-10-29 20:41:31 [INFO] ERROR: test_create_loadbalancer (zaza.openstack.charm_tests.octavia.tests.LBAASv2Test)
2021-10-29 20:41:31.347305 | bionic-medium | 2021-10-29 20:41:31 [INFO] Create load balancer.
2021-10-29 20:41:31.347419 | bionic-medium | 2021-10-29 20:41:31 [INFO] ----------------------------------------------------------------------
2021-10-29 20:41:31.347536 | bionic-medium | 2021-10-29 20:41:31 [INFO] Traceback (most recent call last):
2021-10-29 20:41:31.347653 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/zaza/openstack/charm_tests/test_utils.py", line 681, in launch_guest
2021-10-29 20:41:31.347775 | bionic-medium | 2021-10-29 20:41:31 [INFO] userdata=userdata)
2021-10-29 20:41:31.347930 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/zaza/openstack/configure/guest.py", line 170, in launch_instance
2021-10-29 20:41:31.348057 | bionic-medium | 2021-10-29 20:41:31 [INFO] privkey=openstack_utils.get_private_key(nova_utils.KEYPAIR_NAME))
2021-10-29 20:41:31.348197 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/zaza/openstack/utilities/openstack.py", line 2865, in ssh_test
2021-10-29 20:41:31.348314 | bionic-medium | 2021-10-29 20:41:31 [INFO] reraise=True):
2021-10-29 20:41:31.348427 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/tenacity/__init__.py", line 382, in __iter__
2021-10-29 20:41:31.348686 | bionic-medium | 2021-10-29 20:41:31 [INFO] do = self.iter(retry_state=retry_state)
2021-10-29 20:41:31.348868 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/tenacity/__init__.py", line 360, in iter
2021-10-29 20:41:31.348992 | bionic-medium | 2021-10-29 20:41:31 [INFO] raise retry_exc.reraise()
2021-10-29 20:41:31.349087 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/tenacity/__init__.py", line 193, in reraise
2021-10-29 20:41:31.349179 | bionic-medium | 2021-10-29 20:41:31 [INFO] raise self.last_attempt.result()
2021-10-29 20:41:31.349292 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/usr/lib/python3.6/concurrent/futures/_base.py", line 425, in result
2021-10-29 20:41:31.349475 | bionic-medium | 2021-10-29 20:41:31 [INFO] return self.__get_result()
2021-10-29 20:41:31.349633 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/usr/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result
2021-10-29 20:41:31.349748 | bionic-medium | 2021-10-29 20:41:31 [INFO] raise self._exception
2021-10-29 20:41:31.349846 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/zaza/openstack/utilities/openstack.py", line 2868, in ssh_test
2021-10-29 20:41:31.349986 | bionic-medium | 2021-10-29 20:41:31 [INFO] password=password, privkey=privkey, verify=verify)
2021-10-29 20:41:31.350087 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/zaza/openstack/utilities/openstack.py", line 2905, in ssh_command
2021-10-29 20:41:31.350179 | bionic-medium | 2021-10-29 20:41:31 [INFO] ssh.connect(ip, username=username, password=None, pkey=key)
2021-10-29 20:41:31.350270 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/paramiko/client.py", line 446, in connect
2021-10-29 20:41:31.350379 | bionic-medium | 2021-10-29 20:41:31 [INFO] passphrase,
2021-10-29 20:41:31.350512 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/paramiko/client.py", line 764, in _auth
2021-10-29 20:41:31.350609 | bionic-medium | 2021-10-29 20:41:31 [INFO] raise saved_exception
2021-10-29 20:41:31.350739 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/paramiko/client.py", line 740, in _auth
2021-10-29 20:41:31.350833 | bionic-medium | 2021-10-29 20:41:31 [INFO] self._transport.auth_publickey(username, key)
2021-10-29 20:41:31.350977 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/paramiko/transport.py", line 1580, in auth_publickey
2021-10-29 20:41:31.351193 | bionic-medium | 2021-10-29 20:41:31 [INFO] return self.auth_handler.wait_for_response(my_event)
2021-10-29 20:41:31.351362 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/paramiko/auth_handler.py", line 250, in wait_for_response
2021-10-29 20:41:31.351516 | bionic-medium | 2021-10-29 20:41:31 [INFO] raise e
2021-10-29 20:41:31.351677 | bionic-medium | 2021-10-29 20:41:31 [INFO] paramiko.ssh_exception.AuthenticationException: Authentication failed.
2021-10-29 20:41:31.351781 | bionic-medium | 2021-10-29 20:41:31 [INFO] The above exception was the direct cause of the following exception:
2021-10-29 20:41:31.351872 | bionic-medium | 2021-10-29 20:41:31 [INFO] Traceback (most recent call last):
2021-10-29 20:41:31.351963 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/zaza/openstack/charm_tests/octavia/tests.py", line 405, in test_create_loadbalancer
2021-10-29 20:41:31.352093 | bionic-medium | 2021-10-29 20:41:31 [INFO] userdata='#cloud-config\npackages:\n - apache2\n')
2021-10-29 20:41:31.352198 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/zaza/openstack/charm_tests/test_utils.py", line 699, in launch_guests
2021-10-29 20:41:31.352289 | bionic-medium | 2021-10-29 20:41:31 [INFO] userdata=userdata))
2021-10-29 20:41:31.352378 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/zaza/openstack/charm_tests/test_utils.py", line 663, in launch_guest
2021-10-29 20:41:31.352527 | bionic-medium | 2021-10-29 20:41:31 [INFO] multiplier=1, min=2, max=10)):
2021-10-29 20:41:31.352756 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/tenacity/__init__.py", line 382, in __iter__
2021-10-29 20:41:31.352937 | bionic-medium | 2021-10-29 20:41:31 [INFO] do = self.iter(retry_state=retry_state)
2021-10-29 20:41:31.353090 | bionic-medium | 2021-10-29 20:41:31 [INFO] File "/home/ubuntu/src/review.opendev.org/openstack/charm-octavia/build/builds/octavia/.tox/func-target/lib/python3.6/site-packages/tenacity/__init__.py", line 361, in iter
2021-10-29 20:41:31.353235 | bionic-medium | 2021-10-29 20:41:31 [INFO] raise retry_exc from fut.exception()
2021-10-29 20:41:31.353402 | bionic-medium | 2021-10-29 20:41:31 [INFO] tenacity.RetryError: RetryError[<Future at 0x7f3a86f6a668 state=finished raised AuthenticationException>]
2021-10-29 20:41:31.353562 | bionic-medium | 2021-10-29 20:41:31 [INFO] ----------------------------------------------------------------------