test_db_encrypt_decrypt UnicodeDecodeError: 'utf8' codec can't decode

[Rabi Mishra]

I see this error locally and at the gate from time to time.

2015-06-23 13:23:15.730 | ======================================================================
2015-06-23 13:23:15.730 | FAIL: heat.tests.db.test_sqlalchemy_api.DBAPICryptParamsPropsTest.test_db_encrypt_decrypt
2015-06-23 13:23:15.730 | tags: worker-0
2015-06-23 13:23:15.731 | ----------------------------------------------------------------------
2015-06-23 13:23:15.731 | Empty attachments:
2015-06-23 13:23:15.731 | pythonlogging:'alembic'
2015-06-23 13:23:15.731 | pythonlogging:'barbicanclient'
2015-06-23 13:23:15.731 | pythonlogging:'cinderclient'
2015-06-23 13:23:15.731 | pythonlogging:'cliff'
2015-06-23 13:23:15.731 | pythonlogging:'heat-provision'
2015-06-23 13:23:15.731 | pythonlogging:'heat_integrationtests'
2015-06-23 13:23:15.731 | pythonlogging:'heatclient'
2015-06-23 13:23:15.731 | pythonlogging:'iso8601'
2015-06-23 13:23:15.731 | pythonlogging:'keystoneclient'
2015-06-23 13:23:15.731 | pythonlogging:'keystonemiddleware'
2015-06-23 13:23:15.732 | pythonlogging:'migrate'
2015-06-23 13:23:15.732 | pythonlogging:'neutronclient'
2015-06-23 13:23:15.732 | pythonlogging:'novaclient'
2015-06-23 13:23:15.732 | pythonlogging:'object'
2015-06-23 13:23:15.732 | pythonlogging:'oslo_concurrency'
2015-06-23 13:23:15.732 | pythonlogging:'oslo_config'
2015-06-23 13:23:15.732 | pythonlogging:'oslo_db'
2015-06-23 13:23:15.732 | pythonlogging:'oslo_log'
2015-06-23 13:23:15.732 | pythonlogging:'oslo_messaging'
2015-06-23 13:23:15.732 | pythonlogging:'oslo_middleware'
2015-06-23 13:23:15.732 | pythonlogging:'oslo_policy'
2015-06-23 13:23:37.683 | pTraceback (most recent call last):
2015-06-23 13:23:37.683 | File "/usr/lib/python2.7/logging/__init__.py", line 862, in emit
2015-06-23 13:26:36.907 | ythonlogging:'oslo_service'
2015-06-23 13:26:36.908 | pythonlogging:'oslo_utils'
2015-06-23 13:26:36.908 | pythonlogging:'oslo_versionedobjects'
2015-06-23 13:26:36.908 | pythonlogging:'requests'
2015-06-23 13:26:36.908 | pythonlogging:'routes'
2015-06-23 13:26:36.908 | pythonlogging:'saharaclient'
2015-06-23 13:26:36.908 | pythonlogging:'sqlalchemy'
2015-06-23 13:26:36.908 | pythonlogging:'stevedore'
2015-06-23 13:26:36.908 | pythonlogging:'swiftclient'
2015-06-23 13:26:36.908 | pythonlogging:'troveclient'
2015-06-23 13:26:36.909 |
2015-06-23 13:26:36.909 | pythonlogging:'': {{{
2015-06-23 13:26:36.909 | WARNING [heat.engine.environment] Changing GenericResourceType from <class 'heat.tests.generic_resource.GenericResource'> to <class 'heat.tests.generic_resource.GenericResource'>
2015-06-23 13:26:36.909 | WARNING [heat.engine.environment] Changing SignalResourceType from <class 'heat.tests.generic_resource.SignalResource'> to <class 'heat.tests.generic_resource.SignalResource'>
2015-06-23 13:26:36.909 | WARNING [heat.engine.environment] Changing ResourceWithPropsType from <class 'heat.tests.generic_resource.ResourceWithProps'> to <class 'heat.tests.generic_resource.ResourceWithProps'>
2015-06-23 13:26:36.909 | WARNING [heat.engine.environment] Changing StackUserResourceType from <class 'heat.tests.generic_resource.StackUserResource'> to <class 'heat.tests.generic_resource.StackUserResource'>
2015-06-23 13:26:36.909 | WARNING [heat.engine.environment] Changing ResourceWithResourceIDType from <class 'heat.tests.generic_resource.ResourceWithResourceID'> to <class 'heat.tests.generic_resource.ResourceWithResourceID'>
2015-06-23 13:26:36.909 | WARNING [heat.engine.environment] Changing ResourceWithAttributeType from <class 'heat.tests.generic_resource.ResourceWithAttributeType'> to <class 'heat.tests.generic_resource.ResourceWithAttributeType'>
2015-06-23 13:26:36.909 | WARNING [heat.engine.environment] Changing ResourceWithRequiredProps from <class 'heat.tests.generic_resource.ResourceWithRequiredProps'> to <class 'heat.tests.generic_resource.ResourceWithRequiredProps'>
2015-06-23 13:26:36.909 | WARNING [heat.engine.environment] Changing ResourceWithPropsAndAttrs from <class 'heat.tests.generic_resource.ResourceWithPropsAndAttrs'> to <class 'heat.tests.generic_resource.ResourceWithPropsAndAttrs'>
2015-06-23 13:26:36.910 | WARNING [heat.engine.environment] Changing ResWithComplexPropsAndAttrs from <class 'heat.tests.generic_resource.ResWithComplexPropsAndAttrs'> to <class 'heat.tests.generic_resource.ResWithComplexPropsAndAttrs'>
2015-06-23 13:26:36.910 | WARNING [heat.engine.environment] Changing ResourceWithCustomConstraint from <class 'heat.tests.generic_resource.ResourceWithCustomConstraint'> to <class 'heat.tests.generic_resource.ResourceWithCustomConstraint'>
2015-06-23 13:26:36.910 | WARNING [heat.engine.environment] Changing ResourceWithComplexAttributesType from <class 'heat.tests.generic_resource.ResourceWithComplexAttributes'> to <class 'heat.tests.generic_resource.ResourceWithComplexAttributes'>
2015-06-23 13:26:36.910 | }}}
2015-06-23 13:26:36.910 |
2015-06-23 13:26:36.910 | Traceback (most recent call last):
2015-06-23 13:26:36.910 | File "heat/tests/db/test_sqlalchemy_api.py", line 2736, in test_db_encrypt_decrypt
2015-06-23 13:26:36.910 | self.ctx, '774c15be099ea74123a9b9592ff12680')
2015-06-23 13:26:36.910 | File "heat/db/sqlalchemy/api.py", line 1172, in db_decrypt_parameters_and_properties
2015-06-23 13:26:36.910 | parameters[param_name] = encodeutils.safe_decode(decrypted_val)
2015-06-23 13:26:36.910 | File "/home/jenkins/workspace/gate-heat-python27/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/encodeutils.py", line 57, in safe_decode
2015-06-23 13:26:36.911 | return text.decode('utf-8', errors)
2015-06-23 13:26:36.911 | File "/home/jenkins/workspace/gate-heat-python27/.tox/py27/lib/python2.7/encodings/utf_8.py", line 16, in decode
2015-06-23 13:26:36.911 | return codecs.utf_8_decode(input, errors, True)
2015-06-23 13:26:36.911 | UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 0: invalid continuation byte
2015-06-23 13:26:36.911 | Ran 4557 tests in 179.515s
2015-06-23 13:26:36.911 | FAILED (id=0, failures=1, skips=5)
2015-06-23 13:26:36.911 | error: testr failed (1)
2015-06-23 13:26:37.986 | ERROR: InvocationError: '/home/jenkins/workspace/gate-heat-python27/.tox/py27/bin/python setup.py testr --slowest --testr-args=^(?!heat_integrationtests)'

[Steve Baker (steve-stevebaker)]

Could you set up an elastic-recheck search to track how often this is happening?

http://git.openstack.org/cgit/openstack-infra/elastic-recheck
http://status.openstack.org/elastic-recheck/

[Rabi Mishra (rabi)]

Patch for search query:

https://review.openstack.org/#/c/194930/

[Sirushti Murugesan (sirushtim)]

Seems to have resurfaced again - http://logs.openstack.org/85/195385/6/gate/gate-heat-python27/9eb06f4/console.html

http://paste.openstack.org/show/324312/

[Rabi Mishra (rabi)]

It seems we're seeing more of these lately.

http://status.openstack.org/elastic-recheck/#1467965