heat engine does not start in py3 job

[Rabi Mishra]

It seems heat-engine is failing in the py35 job for barbicanclient.

traceback:

http://logs.openstack.org/98/469798/5/check/gate-heat-dsvm-functional-convg-mysql-lbaasv2-py35-ubuntu-xenial/fdd6f75/logs/screen-h-eng.txt.gz

Jul 17 03:44:32.450689 ubuntu-xenial-osic-cloud1-s3500-9869293 systemd[1]: Started Devstack <email address hidden>.
Jul 17 03:44:35.371223 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: WARNING oslo_reports.guru_meditation_report [-] Guru meditation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Jul 17 03:44:36.184304 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: CRITICAL heat-engine [-] Unhandled error: AttributeError: 'ImportError' object has no attribute 'message'
Jul 17 03:44:36.184502 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine Traceback (most recent call last):
Jul 17 03:44:36.184591 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/usr/local/lib/python3.5/dist-packages/stevedore/extension.py", line 186, in _load_plugins
Jul 17 03:44:36.184673 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine verify_requirements,
Jul 17 03:44:36.184751 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/usr/local/lib/python3.5/dist-packages/stevedore/enabled.py", line 79, in _load_one_plugin
Jul 17 03:44:36.184834 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine verify_requirements,
Jul 17 03:44:36.184908 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/usr/local/lib/python3.5/dist-packages/stevedore/extension.py", line 214, in _load_one_plugin
Jul 17 03:44:36.184995 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine plugin = ep.resolve()
Jul 17 03:44:36.185078 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/usr/local/lib/python3.5/dist-packages/pkg_resources/__init__.py", line 2309, in resolve
Jul 17 03:44:36.185157 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine module = __import__(self.module_name, fromlist=['__name__'], level=0)
Jul 17 03:44:36.185234 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/opt/stack/new/heat/heat/engine/clients/os/barbican.py", line 14, in <module>
Jul 17 03:44:36.185308 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine from barbicanclient import containers
Jul 17 03:44:36.185385 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine ImportError: cannot import name 'containers'
Jul 17 03:44:36.185465 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine
Jul 17 03:44:36.185546 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine During handling of the above exception, another exception occurred:
Jul 17 03:44:36.185623 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine
Jul 17 03:44:36.185697 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine Traceback (most recent call last):
Jul 17 03:44:36.185770 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/usr/local/bin/heat-engine", line 10, in <module>
Jul 17 03:44:36.185847 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine sys.exit(main())
Jul 17 03:44:36.185951 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/opt/stack/new/heat/heat/cmd/engine.py", line 85, in main
Jul 17 03:44:36.186033 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine launcher = launch_engine()
Jul 17 03:44:36.186111 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/opt/stack/new/heat/heat/cmd/engine.py", line 70, in launch_engine
Jul 17 03:44:36.186191 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine srv = engine.EngineService(cfg.CONF.host, rpc_api.ENGINE_TOPIC)
Jul 17 03:44:36.186267 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/opt/stack/new/heat/heat/engine/service.py", line 316, in __init__
Jul 17 03:44:36.186341 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine resources.initialise()
Jul 17 03:44:36.186417 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/opt/stack/new/heat/heat/engine/resources/__init__.py", line 65, in initialise
Jul 17 03:44:36.186508 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine clients.initialise()
Jul 17 03:44:36.186592 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/opt/stack/new/heat/heat/engine/clients/__init__.py", line 130, in initialise
Jul 17 03:44:36.186670 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine on_load_failure_callback=pluginutils.log_fail_msg)
Jul 17 03:44:36.186751 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/usr/local/lib/python3.5/dist-packages/stevedore/enabled.py", line 72, in __init__
Jul 17 03:44:36.186828 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine verify_requirements=verify_requirements,
Jul 17 03:44:36.186904 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/usr/local/lib/python3.5/dist-packages/stevedore/extension.py", line 106, in __init__
Jul 17 03:44:36.186982 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine verify_requirements)
Jul 17 03:44:36.187058 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/usr/local/lib/python3.5/dist-packages/stevedore/extension.py", line 194, in _load_plugins
Jul 17 03:44:36.187137 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine self._on_load_failure_callback(self, ep, err)
Jul 17 03:44:36.187214 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine File "/opt/stack/new/heat/heat/common/pluginutils.py", line 24, in log_fail_msg
Jul 17 03:44:36.187293 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine 'message': exception.message,
Jul 17 03:44:36.187382 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine AttributeError: 'ImportError' object has no attribute 'message'
Jul 17 03:44:36.187460 ubuntu-xenial-osic-cloud1-s3500-9869293 heat-engine[12005]: 2017-07-17 03:44:36.175 12005 TRACE heat-engine
Jul 17 03:44:36.548683 ubuntu-xenial-osic-cloud1-s3500-9869293 systemd[1]: <email address hidden>: Main process exited, code=exited, status=1/FAILURE
Jul 17 03:44:36.548876 ubuntu-xenial-osic-cloud1-s3500-9869293 systemd[1]: <email address hidden>: Unit entered failed state.
Jul 17 03:44:36.548903 ubuntu-xenial-osic-cloud1-s3500-9869293 systemd[1]: <email address hidden>: Failed with result 'exit-code'.

[Rico Lin (rico-lin)]

https://review.openstack.org/#/c/484261/
https://review.openstack.org/#/c/484267/

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/484261
Committed: https://git.openstack.org/cgit/openstack/heat/commit/?id=3ae539bbf92ddb4686e9f98791eb073168be4c59
Submitter: Jenkins
Branch: master

commit 3ae539bbf92ddb4686e9f98791eb073168be4c59
Author: rabi <email address hidden>
Date: Mon Jul 17 12:03:27 2017 +0530

    Fix barbicanclient and glance upload issue

    It seems for py35 job barbicanclient is installed from source.

    Ib91e7049de007f4d4254abcd4c125b4dc7e03c55 has made some backward
    incompatible changes.

    This also changes to upload images using $IMAGE_URLS, so
    the images are stored locally and then uploaded.

    Change-Id: I9d3d9dabdfca0442bd17f93ce69ef9753049dc23
    Closes-Bug: #1704725

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/484267
Committed: https://git.openstack.org/cgit/openstack/heat/commit/?id=4ba0b5fe7f31d4353e9c091b03df7324d1c20e88
Submitter: Jenkins
Branch: master

commit 4ba0b5fe7f31d4353e9c091b03df7324d1c20e88
Author: ricolin <email address hidden>
Date: Mon Jul 17 15:14:50 2017 +0800

    Fix no message attribute in exception

    For py35, message attribute in exception seems removed.
    We should directly get the string message from exception object
    if message attribute not presented. And since get message attribute
    already been deprecated. We should remove sopport on
    exception.message after we fully jump to py35.
    Partial-Bug: #1704725

    Change-Id: I3970aa7c161aa82d179779f1a2f46405d5b0dddb

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/487640

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/heat 9.0.0.0b3 development milestone.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/487640
Committed: https://git.openstack.org/cgit/openstack/heat/commit/?id=dcd451045fb1b2b070b03df32134a22cb6222268
Submitter: Zuul
Branch: stable/ocata

commit dcd451045fb1b2b070b03df32134a22cb6222268
Author: ricolin <email address hidden>
Date: Mon Jul 17 15:14:50 2017 +0800

    Fix no message attribute in exception

    For py35, message attribute in exception seems removed.
    We should directly get the string message from exception object
    if message attribute not presented. And since get message attribute
    already been deprecated. We should remove sopport on
    exception.message after we fully jump to py35.
    Partial-Bug: #1704725

    Change-Id: I3970aa7c161aa82d179779f1a2f46405d5b0dddb
    (cherry picked from commit 4ba0b5fe7f31d4353e9c091b03df7324d1c20e88)