shaker-image-builder failed with "Guest does not have a console available. " error

[Marie Delavergne]

Hi,

When using "shaker-image-builder" on a dockerized Shaker (from today's master), I got the error:

 interface. Use with caution in scripts.
2018-10-26 14:01:21.737 1 ERROR shaker.engine.image_builder [-] Error while building the image: Guest does not have a console available. (HTTP 404) (Request-ID: req-f750a78a-b4c0-484d-9a5c-89cfd7fb8811): novaclient.exceptions.NotFound: Guest does not have a console available. (HTTP 404) (Request-ID: req-f750a78a-b4c0-484d-9a5c-89cfd7fb8811)
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder [-] Guest does not have a console available. (HTTP 404) (Request-ID: req-f750a78a-b4c0-484d-9a5c-89cfd7fb8811): novaclient.exceptions.NotFound: Guest does not have a console available. (HTTP 404) (Request-ID: req-f750a78a-b4c0-484d-9a5c-89cfd7fb8811)
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder Traceback (most recent call last):
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder File "/usr/local/lib/python3.5/site-packages/shaker/engine/image_builder.py", line 94, in build_image_with_heat
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder nova.wait_server_shutdown(openstack_client.nova, server_id)
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder File "/usr/local/lib/python3.5/site-packages/shaker/openstack/clients/nova.py", line 156, in wait_server_shutdown
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder _poll_for_status(nova_client, server_id, ['shutoff'])
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder File "/usr/local/lib/python3.5/site-packages/shaker/openstack/clients/nova.py", line 135, in _poll_for_status
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder err_msg = check_server_console(nova_client, server_id)
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder File "/usr/local/lib/python3.5/site-packages/shaker/openstack/clients/nova.py", line 108, in check_server_console
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder console = nova_client.servers.get(server_id).get_console_output(len_limit)
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder File "/usr/local/lib/python3.5/site-packages/novaclient/v2/servers.py", line 99, in get_console_output
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder return self.manager.get_console_output(self, length)
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder File "/usr/local/lib/python3.5/site-packages/novaclient/v2/servers.py", line 1653, in get_console_output
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder {'length': length})
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder File "/usr/local/lib/python3.5/site-packages/novaclient/v2/servers.py", line 1937, in _action_return_resp_and_body
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder return self.api.client.post(url, body=body)
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder File "/usr/local/lib/python3.5/site-packages/keystoneauth1/adapter.py", line 357, in post
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder return self.request(url, 'POST', **kwargs)
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder File "/usr/local/lib/python3.5/site-packages/novaclient/client.py", line 83, in request
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder raise exceptions.from_response(resp, body, url, method)
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder novaclient.exceptions.NotFound: Guest does not have a console available. (HTTP 404) (Request-ID: req-f750a78a-b4c0-484d-9a5c-89cfd7fb8811)
2018-10-26 14:01:21.738 1 ERROR shaker.engine.image_builder

Thanks in advance

[Ilya Shakhat (shakhat)]

Server console is only used to get additional information about errors that may happen during the boot. It is not critical not to have a server console, so the fix is to ignore failures from Nova client

[Ilya Shakhat (shakhat)]

https://review.openstack.org/#/c/613808/

[Marie Delavergne (marie-donnie)]

Seems to work with this solution, I got the expected warning.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/613808
Committed: https://git.openstack.org/cgit/openstack/shaker/commit/?id=10b919127a605a6c9f9769d2047c48ed9dc95b17
Submitter: Zuul
Branch: master

commit 10b919127a605a6c9f9769d2047c48ed9dc95b17
Author: Ilya Shakhat <email address hidden>
Date: Mon Oct 29 00:49:05 2018 +0400

    Ignore errors from server console retrieval

    Server console is used to get errors that may occur
    during server boot. Those errors are used to give hints
    on critical failures inside VM.

    However it should not be critical not to get server console.

    Change-Id: Ibf13111a85b8967475dda710830acb212c7d6796
    Closes-Bug: #1800158