Hitting the same issue as of today (1st of July) with latest packages on centos-7.
Can add the following: right before the failure, located in mistral-executor log, we can see the following log trace bellow. It looks like either a path is wrong, or a file doesn't exist in the swift container. Also, this can be tracked back to the following code: https://github.com/openstack/tripleo-common/blob/master/tripleo_common/utils/config.py#L517
Packages: on the host: python2-tripleo-common-11.0.1-0.20190622091455.a20d66f.el7.noarch
In mistral container: puppet-mistral-15.1.0-0.20190610144005.030a4fe.el7.noarch python2-mistral-8.1.0-0.20190620140934.f75e719.el7.noarch openstack-mistral-executor-8.1.0-0.20190620140934.f75e719.el7.noarch python2-mistral-lib-1.1.0-0.20190306210850.bac92db.el7.noarch python2-mistralclient-3.9.0-0.20190517090825.de9d2de.el7.noarch openstack-mistral-common-8.1.0-0.20190620140934.f75e719.el7.noarch python2-tripleo-common-11.0.1-0.20190622091455.a20d66f.el7.noarch
Log of interest (from /var/log/containers/mistral/executor.log):
2019-07-01 14:21:17.995 8 INFO tripleo_common.actions.ansible [req-34985d26-9879-4842-8aff-01fe77df8081 988f449cc23b4114ae260bc8c022f5ac d1ff8565af7f4b0ca24df34237761a23 - default default] Running ansible-playbook command: ['ansible-playbook-2', '-vvvvv', '/tmp/ansible-mistral-action784EVw/playbook.yaml', '--become', '--become-user', 'root', '--inventory-file', '/tmp/ansible-mistral-action784EVw/inventory.yaml'] 2019-07-01 14:21:34.127 8 INFO swiftclient [req-34985d26-9879-4842-8aff-01fe77df8081 988f449cc23b4114ae260bc8c022f5ac d1ff8565af7f4b0ca24df34237761a23 - default default] REQ: curl -i https://192.168.24.2:13808/v1/AUTH_d1ff8565af7f4b0ca24df34237761a23/overcloud-config?format=json -X GET -H "Accept-Encoding: gzip" -H "X-Auth-Token: gAAAAABdGhJeSqV5..." 2019-07-01 14:21:34.129 8 INFO swiftclient [req-34985d26-9879-4842-8aff-01fe77df8081 988f449cc23b4114ae260bc8c022f5ac d1ff8565af7f4b0ca24df34237761a23 - default default] RESP STATUS: 404 Not Found 2019-07-01 14:21:34.129 8 INFO swiftclient [req-34985d26-9879-4842-8aff-01fe77df8081 988f449cc23b4114ae260bc8c022f5ac d1ff8565af7f4b0ca24df34237761a23 - default default] RESP HEADERS: {u'Date': u'Mon, 01 Jul 2019 14:21:34 GMT', u'Content-Length': u'70', u'Content-Type': u'text/html; charset=UTF-8', u'X-Openstack-Request-Id': u'tx5c4f2548a9f240e49071c-005d1a16ee', u'X-Trans-Id': u'tx5c4f2548a9f240e49071c-005d1a16ee'} 2019-07-01 14:21:34.129 8 INFO swiftclient [req-34985d26-9879-4842-8aff-01fe77df8081 988f449cc23b4114ae260bc8c022f5ac d1ff8565af7f4b0ca24df34237761a23 - default default] RESP BODY: <html><h1>Not Found</h1><p>The resource could not be found.</p></html> 2019-07-01 14:21:36.442 8 INFO tripleo_common.utils.config.Config [req-34985d26-9879-4842-8aff-01fe77df8081 988f449cc23b4114ae260bc8c022f5ac d1ff8565af7f4b0ca24df34237761a23 - default default] Generating configuration under the directory: /tmp/tripleo-JSp_J9-config 2019-07-01 14:21:39.656 8 INFO tripleo_common.utils.config.Config [req-34985d26-9879-4842-8aff-01fe77df8081 988f449cc23b4114ae260bc8c022f5ac d1ff8565af7f4b0ca24df34237761a23 - default default] Getting deployment data from Heat... 2019-07-01 14:22:04.277 8 WARNING mistral.executors.default_executor [req-34985d26-9879-4842-8aff-01fe77df8081 988f449cc23b4114ae260bc8c022f5ac d1ff8565af7f4b0ca24df34237761a23 - default default] The action raised an exception [action_ex_id=ba50b043-21f3-4fbe-8483-d88a5c525455, action_cls='<class 'mistral.actions.action_factory.GetOvercloudConfig'>', attributes='{}', params='{u'container_config': u'overcloud-config', u'container': u'overcloud'}'] expected a character buffer object: TypeError: expected a character buffer object 2019-07-01 14:22:04.277 8 ERROR mistral.executors.default_executor Traceback (most recent call last): 2019-07-01 14:22:04.277 8 ERROR mistral.executors.default_executor File "/usr/lib/python2.7/site-packages/mistral/executors/default_executor.py", line 114, in run_action 2019-07-01 14:22:04.277 8 ERROR mistral.executors.default_executor result = action.run(action_ctx) 2019-07-01 14:22:04.277 8 ERROR mistral.executors.default_executor File "/usr/lib/python2.7/site-packages/tripleo_common/actions/config.py", line 87, in run 2019-07-01 14:22:04.277 8 ERROR mistral.executors.default_executor commit_message=message) 2019-07-01 14:22:04.277 8 ERROR mistral.executors.default_executor File "/usr/lib/python2.7/site-packages/tripleo_common/utils/config.py", line 540, in download_config 2019-07-01 14:22:04.277 8 ERROR mistral.executors.default_executor "%s" % config_dir) 2019-07-01 14:22:04.277 8 ERROR mistral.executors.default_executor File "/usr/lib/python2.7/site-packages/tripleo_common/utils/config.py", line 517, in write_config 2019-07-01 14:22:04.277 8 ERROR mistral.executors.default_executor with open(network_config_path, 'w') as f: 2019-07-01 14:22:04.277 8 ERROR mistral.executors.default_executor TypeError: expected a character buffer object 2019-07-01 14:22:04.277 8 ERROR mistral.executors.default_executor
Hitting the same issue as of today (1st of July) with latest packages on centos-7.
Can add the following: /github. com/openstack/ tripleo- common/ blob/master/ tripleo_ common/ utils/config. py#L517
right before the failure, located in mistral-executor log, we can see the following log trace bellow.
It looks like either a path is wrong, or a file doesn't exist in the swift container.
Also, this can be tracked back to the following code:
https:/
Packages: tripleo- common- 11.0.1- 0.2019062209145 5.a20d66f. el7.noarch
on the host:
python2-
In mistral container: mistral- 15.1.0- 0.2019061014400 5.030a4fe. el7.noarch mistral- 8.1.0-0. 20190620140934. f75e719. el7.noarch mistral- executor- 8.1.0-0. 20190620140934. f75e719. el7.noarch mistral- lib-1.1. 0-0.20190306210 850.bac92db. el7.noarch mistralclient- 3.9.0-0. 20190517090825. de9d2de. el7.noarch mistral- common- 8.1.0-0. 20190620140934. f75e719. el7.noarch tripleo- common- 11.0.1- 0.2019062209145 5.a20d66f. el7.noarch
puppet-
python2-
openstack-
python2-
python2-
openstack-
python2-
Log of interest (from /var/log/ containers/ mistral/ executor. log):
2019-07-01 14:21:17.995 8 INFO tripleo_ common. actions. ansible [req-34985d26- 9879-4842- 8aff-01fe77df80 81 988f449cc23b411 4ae260bc8c022f5 ac d1ff8565af7f4b0 ca24df34237761a 23 - default default] Running ansible-playbook command: ['ansible- playbook- 2', '-vvvvv', '/tmp/ansible- mistral- action784EVw/ playbook. yaml', '--become', '--become-user', 'root', '--inventory-file', '/tmp/ansible- mistral- action784EVw/ inventory. yaml'] 9879-4842- 8aff-01fe77df80 81 988f449cc23b411 4ae260bc8c022f5 ac d1ff8565af7f4b0 ca24df34237761a 23 - default default] REQ: curl -i https:/ /192.168. 24.2:13808/ v1/AUTH_ d1ff8565af7f4b0 ca24df34237761a 23/overcloud- config? format= json -X GET -H "Accept-Encoding: gzip" -H "X-Auth-Token: gAAAAABdGhJeSqV 5..." 9879-4842- 8aff-01fe77df80 81 988f449cc23b411 4ae260bc8c022f5 ac d1ff8565af7f4b0 ca24df34237761a 23 - default default] RESP STATUS: 404 Not Found 9879-4842- 8aff-01fe77df80 81 988f449cc23b411 4ae260bc8c022f5 ac d1ff8565af7f4b0 ca24df34237761a 23 - default default] RESP HEADERS: {u'Date': u'Mon, 01 Jul 2019 14:21:34 GMT', u'Content-Length': u'70', u'Content-Type': u'text/html; charset=UTF-8', u'X-Openstack- Request- Id': u'tx5c4f2548a9f 240e49071c- 005d1a16ee' , u'X-Trans-Id': u'tx5c4f2548a9f 240e49071c- 005d1a16ee' } 9879-4842- 8aff-01fe77df80 81 988f449cc23b411 4ae260bc8c022f5 ac d1ff8565af7f4b0 ca24df34237761a 23 - default default] RESP BODY: <html><h1>Not Found</h1><p>The resource could not be found.</p></html> common. utils.config. Config [req-34985d26- 9879-4842- 8aff-01fe77df80 81 988f449cc23b411 4ae260bc8c022f5 ac d1ff8565af7f4b0 ca24df34237761a 23 - default default] Generating configuration under the directory: /tmp/tripleo- JSp_J9- config common. utils.config. Config [req-34985d26- 9879-4842- 8aff-01fe77df80 81 988f449cc23b411 4ae260bc8c022f5 ac d1ff8565af7f4b0 ca24df34237761a 23 - default default] Getting deployment data from Heat... executors. default_ executor [req-34985d26- 9879-4842- 8aff-01fe77df80 81 988f449cc23b411 4ae260bc8c022f5 ac d1ff8565af7f4b0 ca24df34237761a 23 - default default] The action raised an exception [action_ ex_id=ba50b043- 21f3-4fbe- 8483-d88a5c5254 55, action_cls='<class 'mistral. actions. action_ factory. GetOvercloudCon fig'>', attributes='{}', params= '{u'container_ config' : u'overcloud- config' , u'container': u'overcloud'}'] executors. default_ executor Traceback (most recent call last): executors. default_ executor File "/usr/lib/ python2. 7/site- packages/ mistral/ executors/ default_ executor. py", line 114, in run_action executors. default_ executor result = action. run(action_ ctx) executors. default_ executor File "/usr/lib/ python2. 7/site- packages/ tripleo_ common/ actions/ config. py", line 87, in run executors. default_ executor commit_ message= message) executors. default_ executor File "/usr/lib/ python2. 7/site- packages/ tripleo_ common/ utils/config. py", line 540, in download_config executors. default_ executor "%s" % config_dir) executors. default_ executor File "/usr/lib/ python2. 7/site- packages/ tripleo_ common/ utils/config. py", line 517, in write_config executors. default_ executor with open(network_ config_ path, 'w') as f: executors. default_ executor TypeError: expected a character buffer object executors. default_ executor
2019-07-01 14:21:34.127 8 INFO swiftclient [req-34985d26-
2019-07-01 14:21:34.129 8 INFO swiftclient [req-34985d26-
2019-07-01 14:21:34.129 8 INFO swiftclient [req-34985d26-
2019-07-01 14:21:34.129 8 INFO swiftclient [req-34985d26-
2019-07-01 14:21:36.442 8 INFO tripleo_
2019-07-01 14:21:39.656 8 INFO tripleo_
2019-07-01 14:22:04.277 8 WARNING mistral.
expected a character buffer object: TypeError: expected a character buffer object
2019-07-01 14:22:04.277 8 ERROR mistral.
2019-07-01 14:22:04.277 8 ERROR mistral.
2019-07-01 14:22:04.277 8 ERROR mistral.
2019-07-01 14:22:04.277 8 ERROR mistral.
2019-07-01 14:22:04.277 8 ERROR mistral.
2019-07-01 14:22:04.277 8 ERROR mistral.
2019-07-01 14:22:04.277 8 ERROR mistral.
2019-07-01 14:22:04.277 8 ERROR mistral.
2019-07-01 14:22:04.277 8 ERROR mistral.
2019-07-01 14:22:04.277 8 ERROR mistral.
2019-07-01 14:22:04.277 8 ERROR mistral.