sahara api and engine hanging

[bjolo]

ENV: kolla stable/newton; centos binary and source images. source: sahara stable-newton tarball

Deploy works, but sahara-api and sahara-engine seems hung in spinlock. Constantly consuming around 10% when idle.

docker logs sahara-engine
http://paste.openstack.org/show/587774/

strace -p <pid of sahara-engine>
http://paste.openstack.org/show/587776/

strace -p <pid of sahara-api>
http://paste.openstack.org/show/587778/

[bjolo (bjorn-lofdahl)]

seems like it could be related to heat
https://bugs.launchpad.net/sahara/+bug/1535274

]# docker logs heat_engine
INFO:__main__:Kolla config strategy set to: COPY_ALWAYS
INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json
INFO:__main__:Validating config file
INFO:__main__:Copying service configuration files
INFO:__main__:Removing existing destination: /etc/heat/heat.conf
INFO:__main__:Copying /var/lib/kolla/config_files/heat.conf to /etc/heat/heat.conf
INFO:__main__:Setting permissions for /etc/heat/heat.conf
INFO:__main__:Copying /var/lib/kolla/config_files/_deprecated.yaml to /etc/heat/environment.d/_deprecated.yaml
INFO:__main__:Setting permissions for /etc/heat/environment.d/_deprecated.yaml
INFO:__main__:Writing out command to execute
INFO:__main__:Setting permission for /var/log/kolla/heat
INFO:__main__:Setting permission for /var/log/kolla/heat/heat-api.log
INFO:__main__:Setting permission for /var/log/kolla/heat/heat-api-cfn.log
INFO:__main__:Setting permission for /var/log/kolla/heat/heat-engine.log
Running command: 'heat-engine'
/usr/lib64/python2.7/site-packages/sqlalchemy/sql/sqltypes.py:185: SAWarning: Unicode type received non-unicode bind param value 'data-processing-cluster'. (this warning may be suppressed after 10 occurrences)
  (util.ellipses_string(value),))
/usr/lib64/python2.7/site-packages/sqlalchemy/sql/sqltypes.py:185: SAWarning: Unicode type received non-unicode bind param value 'data-processing-cluster'. (this warning may be suppressed after 10 occurrences)
  (util.ellipses_string(value),))
/usr/lib64/python2.7/site-packages/sqlalchemy/sql/sqltypes.py:185: SAWarning: Unicode type received non-unicode bind param value 'data-processing-cluster'. (this warning may be suppressed after 10 occurrences)
  (util.ellipses_string(value),))
/usr/lib64/python2.7/site-packages/sqlalchemy/sql/sqltypes.py:185: SAWarning: Unicode type received non-unicode bind param value 'data-processing-cluster'. (this warning may be suppressed after 10 occurrences)
  (util.ellipses_string(value),))
/usr/lib64/python2.7/site-packages/sqlalchemy/sql/sqltypes.py:185: SAWarning: Unicode type received non-unicode bind param value 'data-processing-cluster'. (this warning may be suppressed after 10 occurrences)
  (util.ellipses_string(value),))

[Jeffrey Zhang (jeffrey4l)]

can not reproduce this now. mark this as incomplete.